Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-06-16T19:51:46Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-06-16T19:51:46Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260616 19:51:46.542742 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasknFdngH/build/asan/bin/kudu
/tmp/dist-test-tasknFdngH/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.190:35857
--webserver_interface=127.0.105.190
--webserver_port=0
--builtin_ntp_servers=127.0.105.148:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260616 19:51:46.882790 430 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260616 19:51:46.883100 430 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260616 19:51:46.883165 430 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260616 19:51:46.891465 430 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260616 19:51:46.891578 430 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260616 19:51:46.891636 430 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260616 19:51:46.891682 430 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260616 19:51:46.902102 430 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.190:35857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.105.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 16 Jun 2026 19:43:22 UTC on bdcb31816ec0
build id 12426
ASAN enabled
I20260616 19:51:46.903717 430 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260616 19:51:46.905516 430 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260616 19:51:46.914503 436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:51:46.914472 435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:51:46.914733 438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:51:46.916313 430 server_base.cc:1061] running on GCE node
I20260616 19:51:46.917106 430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260616 19:51:46.918514 430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260616 19:51:46.919739 430 hybrid_clock.cc:648] HybridClock initialized: now 1781639506919671 us; error 82 us; skew 500 ppm
I20260616 19:51:46.920106 430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260616 19:51:46.922329 430 webserver.cc:533] Webserver started at http://127.0.105.190:39725/ using document root <none> and password file <none>
I20260616 19:51:46.923071 430 fs_manager.cc:362] Metadata directory not provided
I20260616 19:51:46.923202 430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260616 19:51:46.923542 430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260616 19:51:46.925922 430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/data/instance:
uuid: "85d6b13547f2413c86ee07194ca74704"
format_stamp: "Formatted at 2026-06-16 19:51:46 on dist-test-slave-s7fg"
I20260616 19:51:46.926700 430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/wal/instance:
uuid: "85d6b13547f2413c86ee07194ca74704"
format_stamp: "Formatted at 2026-06-16 19:51:46 on dist-test-slave-s7fg"
I20260616 19:51:46.931775 430 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260616 19:51:46.935499 444 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:46.936772 430 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260616 19:51:46.936941 430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/data,/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/wal
uuid: "85d6b13547f2413c86ee07194ca74704"
format_stamp: "Formatted at 2026-06-16 19:51:46 on dist-test-slave-s7fg"
I20260616 19:51:46.937160 430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260616 19:51:46.993788 430 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260616 19:51:46.994722 430 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260616 19:51:46.995033 430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260616 19:51:47.017150 430 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.190:35857
I20260616 19:51:47.017194 495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.190:35857 every 8 connection(s)
I20260616 19:51:47.018687 430 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/data/info.pb
I20260616 19:51:47.023175 496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:47.024727 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasknFdngH/build/asan/bin/kudu as pid 430
I20260616 19:51:47.025004 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-0/wal/instance
I20260616 19:51:47.027413 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasknFdngH/build/asan/bin/kudu
/tmp/dist-test-tasknFdngH/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.189:43055
--webserver_interface=127.0.105.189
--webserver_port=0
--builtin_ntp_servers=127.0.105.148:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260616 19:51:47.029480 496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } has no permanent_uuid. Determining permanent_uuid...
I20260616 19:51:47.046249 496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } has no permanent_uuid. Determining permanent_uuid...
W20260616 19:51:47.047501 445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.189:43055: connect: Connection refused (error 111)
W20260616 19:51:47.049176 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:43055: Network error: Client connection negotiation failed: client connection to 127.0.105.189:43055: connect: Connection refused (error 111)
I20260616 19:51:47.098570 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } attempt: 1
W20260616 19:51:47.101174 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:43055: Network error: Client connection negotiation failed: client connection to 127.0.105.189:43055: connect: Connection refused (error 111)
I20260616 19:51:47.169476 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } attempt: 2
W20260616 19:51:47.171469 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:43055: Network error: Client connection negotiation failed: client connection to 127.0.105.189:43055: connect: Connection refused (error 111)
I20260616 19:51:47.262758 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } attempt: 3
W20260616 19:51:47.265215 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:43055: Network error: Client connection negotiation failed: client connection to 127.0.105.189:43055: connect: Connection refused (error 111)
W20260616 19:51:47.359539 498 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260616 19:51:47.359838 498 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260616 19:51:47.359993 498 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260616 19:51:47.368793 498 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260616 19:51:47.368885 498 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260616 19:51:47.368969 498 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260616 19:51:47.369073 498 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260616 19:51:47.379087 498 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.189:43055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.189
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 16 Jun 2026 19:43:22 UTC on bdcb31816ec0
build id 12426
ASAN enabled
I20260616 19:51:47.380707 498 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260616 19:51:47.382513 498 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260616 19:51:47.390810 506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:51:47.390784 507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:51:47.391548 509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:51:47.392107 498 server_base.cc:1061] running on GCE node
I20260616 19:51:47.392887 498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260616 19:51:47.394352 498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260616 19:51:47.395556 498 hybrid_clock.cc:648] HybridClock initialized: now 1781639507395517 us; error 31 us; skew 500 ppm
I20260616 19:51:47.395888 498 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260616 19:51:47.398228 498 webserver.cc:533] Webserver started at http://127.0.105.189:42593/ using document root <none> and password file <none>
I20260616 19:51:47.398969 498 fs_manager.cc:362] Metadata directory not provided
I20260616 19:51:47.399092 498 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260616 19:51:47.399452 498 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260616 19:51:47.402243 498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data/instance:
uuid: "2b8fb7a8523741a2b7a5e75d8b415be0"
format_stamp: "Formatted at 2026-06-16 19:51:47 on dist-test-slave-s7fg"
I20260616 19:51:47.403062 498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/wal/instance:
uuid: "2b8fb7a8523741a2b7a5e75d8b415be0"
format_stamp: "Formatted at 2026-06-16 19:51:47 on dist-test-slave-s7fg"
I20260616 19:51:47.408427 498 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260616 19:51:47.408623 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } attempt: 4
W20260616 19:51:47.410560 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:43055: Network error: Client connection negotiation failed: client connection to 127.0.105.189:43055: connect: Connection refused (error 111)
I20260616 19:51:47.412597 515 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:47.413959 498 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260616 19:51:47.414165 498 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data,/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/wal
uuid: "2b8fb7a8523741a2b7a5e75d8b415be0"
format_stamp: "Formatted at 2026-06-16 19:51:47 on dist-test-slave-s7fg"
I20260616 19:51:47.414402 498 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260616 19:51:47.427745 498 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260616 19:51:47.428642 498 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260616 19:51:47.428923 498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260616 19:51:47.450129 498 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.189:43055
I20260616 19:51:47.450150 566 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.189:43055 every 8 connection(s)
I20260616 19:51:47.451610 498 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data/info.pb
I20260616 19:51:47.455096 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasknFdngH/build/asan/bin/kudu as pid 498
I20260616 19:51:47.455324 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/wal/instance
I20260616 19:51:47.455806 567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:47.456390 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasknFdngH/build/asan/bin/kudu
/tmp/dist-test-tasknFdngH/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:34219
--webserver_interface=127.0.105.188
--webserver_port=0
--builtin_ntp_servers=127.0.105.148:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260616 19:51:47.461505 567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } has no permanent_uuid. Determining permanent_uuid...
I20260616 19:51:47.474318 567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } has no permanent_uuid. Determining permanent_uuid...
I20260616 19:51:47.484208 567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } has no permanent_uuid. Determining permanent_uuid...
W20260616 19:51:47.485376 518 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
W20260616 19:51:47.486892 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:34219: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
I20260616 19:51:47.536201 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } attempt: 1
W20260616 19:51:47.538208 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:34219: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
I20260616 19:51:47.606475 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } attempt: 2
W20260616 19:51:47.609426 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:34219: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
I20260616 19:51:47.700704 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } attempt: 3
W20260616 19:51:47.702786 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:34219: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
I20260616 19:51:47.709823 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } attempt: 5
I20260616 19:51:47.716096 496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } has no permanent_uuid. Determining permanent_uuid...
W20260616 19:51:47.718019 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:34219: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
I20260616 19:51:47.769271 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } attempt: 1
W20260616 19:51:47.771297 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:34219: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
W20260616 19:51:47.791255 569 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260616 19:51:47.791541 569 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260616 19:51:47.791615 569 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260616 19:51:47.800304 569 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260616 19:51:47.800453 569 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260616 19:51:47.800571 569 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260616 19:51:47.800622 569 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260616 19:51:47.810703 569 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:34219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.188
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 16 Jun 2026 19:43:22 UTC on bdcb31816ec0
build id 12426
ASAN enabled
I20260616 19:51:47.812202 569 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260616 19:51:47.813903 569 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260616 19:51:47.821657 577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:51:47.821797 578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:51:47.822561 580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:51:47.823225 569 server_base.cc:1061] running on GCE node
I20260616 19:51:47.823920 569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260616 19:51:47.825515 569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260616 19:51:47.826804 569 hybrid_clock.cc:648] HybridClock initialized: now 1781639507826739 us; error 49 us; skew 500 ppm
I20260616 19:51:47.827168 569 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260616 19:51:47.829705 569 webserver.cc:533] Webserver started at http://127.0.105.188:35247/ using document root <none> and password file <none>
I20260616 19:51:47.830397 569 fs_manager.cc:362] Metadata directory not provided
I20260616 19:51:47.830528 569 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260616 19:51:47.830878 569 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260616 19:51:47.833340 569 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/instance:
uuid: "c404c91cd2194cf6838fddd212f2f4ae"
format_stamp: "Formatted at 2026-06-16 19:51:47 on dist-test-slave-s7fg"
I20260616 19:51:47.834110 569 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal/instance:
uuid: "c404c91cd2194cf6838fddd212f2f4ae"
format_stamp: "Formatted at 2026-06-16 19:51:47 on dist-test-slave-s7fg"
I20260616 19:51:47.839102 569 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260616 19:51:47.839542 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } attempt: 2
W20260616 19:51:47.841444 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:34219: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
I20260616 19:51:47.842886 586 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:47.844092 569 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260616 19:51:47.844259 569 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data,/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
uuid: "c404c91cd2194cf6838fddd212f2f4ae"
format_stamp: "Formatted at 2026-06-16 19:51:47 on dist-test-slave-s7fg"
I20260616 19:51:47.844465 569 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260616 19:51:47.846009 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } attempt: 4
W20260616 19:51:47.847681 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:34219: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
I20260616 19:51:47.862241 569 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260616 19:51:47.863027 569 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260616 19:51:47.863302 569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260616 19:51:47.883970 569 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.188:34219
I20260616 19:51:47.883994 637 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.188:34219 every 8 connection(s)
I20260616 19:51:47.885406 569 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/info.pb
I20260616 19:51:47.889539 638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:47.892766 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasknFdngH/build/asan/bin/kudu as pid 569
I20260616 19:51:47.892963 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal/instance
I20260616 19:51:47.895015 638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } has no permanent_uuid. Determining permanent_uuid...
I20260616 19:51:47.909929 638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } has no permanent_uuid. Determining permanent_uuid...
I20260616 19:51:47.917657 638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } has no permanent_uuid. Determining permanent_uuid...
I20260616 19:51:47.931589 638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: Bootstrap starting.
I20260616 19:51:47.934741 638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:47.935837 638 log.cc:826] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: Log is configured to *not* fsync() on all Append() calls
I20260616 19:51:47.938279 638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: No bootstrap required, opened a new log
I20260616 19:51:47.943714 638 raft_consensus.cc:359] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:47.943994 638 raft_consensus.cc:385] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:47.944123 638 raft_consensus.cc:740] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c404c91cd2194cf6838fddd212f2f4ae, State: Initialized, Role: FOLLOWER
I20260616 19:51:47.944715 638 consensus_queue.cc:260] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:47.945514 647 sys_catalog.cc:455] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:47.945731 647 sys_catalog.cc:458] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:51:47.946477 638 sys_catalog.cc:565] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: configured and running, proceeding with master startup.
I20260616 19:51:47.947641 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } attempt: 3
W20260616 19:51:47.959017 658 catalog_manager.cc:1593] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260616 19:51:47.959224 658 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260616 19:51:47.959942 496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Bootstrap starting.
I20260616 19:51:47.961951 647 raft_consensus.cc:493] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:47.962182 647 raft_consensus.cc:515] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:47.956244 569 master_runner.cc:187] Error getting master registration for 127.0.105.190:35857: OK, instance_id { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" instance_seqno: 1781639507010941 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260616 19:51:47.963138 569 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260616 19:51:47.963322 496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:47.963871 647 leader_election.cc:290] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85d6b13547f2413c86ee07194ca74704 (127.0.105.190:35857), 2b8fb7a8523741a2b7a5e75d8b415be0 (127.0.105.189:43055)
I20260616 19:51:47.964731 496 log.cc:826] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Log is configured to *not* fsync() on all Append() calls
I20260616 19:51:47.968240 496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: No bootstrap required, opened a new log
I20260616 19:51:47.975358 496 raft_consensus.cc:359] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:47.975661 496 raft_consensus.cc:385] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:47.975775 496 raft_consensus.cc:740] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85d6b13547f2413c86ee07194ca74704, State: Initialized, Role: FOLLOWER
I20260616 19:51:47.976394 496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:47.977617 661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:47.978113 661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:51:47.978814 496 sys_catalog.cc:565] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: configured and running, proceeding with master startup.
I20260616 19:51:47.978881 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c404c91cd2194cf6838fddd212f2f4ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d6b13547f2413c86ee07194ca74704" is_pre_election: true
I20260616 19:51:47.979323 471 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c404c91cd2194cf6838fddd212f2f4ae in term 0.
I20260616 19:51:47.979969 588 leader_election.cc:304] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85d6b13547f2413c86ee07194ca74704, c404c91cd2194cf6838fddd212f2f4ae; no voters:
I20260616 19:51:47.980798 647 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:47.980947 647 raft_consensus.cc:493] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:47.981051 647 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:47.984206 647 raft_consensus.cc:515] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:47.987735 647 leader_election.cc:290] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [CANDIDATE]: Term 1 election: Requested vote from peers 85d6b13547f2413c86ee07194ca74704 (127.0.105.190:35857), 2b8fb7a8523741a2b7a5e75d8b415be0 (127.0.105.189:43055)
I20260616 19:51:47.988101 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c404c91cd2194cf6838fddd212f2f4ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d6b13547f2413c86ee07194ca74704"
I20260616 19:51:47.988271 471 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:47.990746 471 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c404c91cd2194cf6838fddd212f2f4ae in term 1.
I20260616 19:51:47.991236 588 leader_election.cc:304] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85d6b13547f2413c86ee07194ca74704, c404c91cd2194cf6838fddd212f2f4ae; no voters:
I20260616 19:51:47.988865 430 master_runner.cc:187] Error getting master registration for 127.0.105.189:43055: OK, instance_id { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" instance_seqno: 1781639507444562 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260616 19:51:47.995012 430 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260616 19:51:47.995244 647 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:47.995980 647 raft_consensus.cc:697] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 1 LEADER]: Becoming Leader. State: Replica: c404c91cd2194cf6838fddd212f2f4ae, State: Running, Role: LEADER
I20260616 19:51:47.996589 647 consensus_queue.cc:237] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
W20260616 19:51:47.997697 450 tablet.cc:2406] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260616 19:51:48.002444 672 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260616 19:51:48.002636 672 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260616 19:51:48.002964 674 sys_catalog.cc:455] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader c404c91cd2194cf6838fddd212f2f4ae. Latest consensus state: current_term: 1 leader_uuid: "c404c91cd2194cf6838fddd212f2f4ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:48.003276 674 sys_catalog.cc:458] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: This master's current role is: LEADER
I20260616 19:51:48.009408 676 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260616 19:51:48.011562 676 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260616 19:51:48.026183 471 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Refusing update from remote peer c404c91cd2194cf6838fddd212f2f4ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:51:48.027235 674 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:51:48.055442 661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c404c91cd2194cf6838fddd212f2f4ae. Latest consensus state: current_term: 1 leader_uuid: "c404c91cd2194cf6838fddd212f2f4ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:48.055711 661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:51:48.068789 677 mvcc.cc:204] Tried to move back new op lower bound from 7297595424863977472 to 7297595424764624896. Current Snapshot: MvccSnapshot[applied={T|T < 7297595424863977472}]
I20260616 19:51:48.069159 647 sys_catalog.cc:455] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c404c91cd2194cf6838fddd212f2f4ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:48.069628 647 sys_catalog.cc:458] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: This master's current role is: LEADER
I20260616 19:51:48.071419 676 catalog_manager.cc:1382] Generated new cluster ID: d3d9ed8a8f984d7f816cb660c217abc3
I20260616 19:51:48.071524 676 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260616 19:51:48.089296 661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c404c91cd2194cf6838fddd212f2f4ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:48.089555 661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:51:48.113581 676 catalog_manager.cc:1405] Generated new certificate authority record
I20260616 19:51:48.115415 676 catalog_manager.cc:1539] Loading token signing keys...
I20260616 19:51:48.134104 676 catalog_manager.cc:6069] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: Generated new TSK 0
I20260616 19:51:48.135947 676 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260616 19:51:48.146806 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } attempt: 5
I20260616 19:51:48.156445 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasknFdngH/build/asan/bin/kudu
/tmp/dist-test-tasknFdngH/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.129:0
--local_ip_for_outbound_sockets=127.0.105.129
--webserver_interface=127.0.105.129
--webserver_port=0
--tserver_master_addrs=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--builtin_ntp_servers=127.0.105.148:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260616 19:51:48.162128 567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: Bootstrap starting.
I20260616 19:51:48.170794 567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:48.173590 567 log.cc:826] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: Log is configured to *not* fsync() on all Append() calls
I20260616 19:51:48.189733 567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: No bootstrap required, opened a new log
I20260616 19:51:48.205106 567 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:48.205953 567 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:48.206264 567 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8fb7a8523741a2b7a5e75d8b415be0, State: Initialized, Role: FOLLOWER
I20260616 19:51:48.207782 567 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:48.221124 684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:48.221510 684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:51:48.224491 542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c404c91cd2194cf6838fddd212f2f4ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" is_pre_election: true
I20260616 19:51:48.225401 542 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c404c91cd2194cf6838fddd212f2f4ae in term 0.
I20260616 19:51:48.226066 540 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:48.229373 540 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 1 FOLLOWER]: Refusing update from remote peer c404c91cd2194cf6838fddd212f2f4ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:51:48.229892 541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c404c91cd2194cf6838fddd212f2f4ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0"
I20260616 19:51:48.232934 541 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c404c91cd2194cf6838fddd212f2f4ae in term 1.
I20260616 19:51:48.233604 567 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: configured and running, proceeding with master startup.
I20260616 19:51:48.234100 674 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:51:48.291414 684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c404c91cd2194cf6838fddd212f2f4ae. Latest consensus state: current_term: 1 leader_uuid: "c404c91cd2194cf6838fddd212f2f4ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:48.291819 684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:51:48.291374 690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c404c91cd2194cf6838fddd212f2f4ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:48.292022 690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:51:48.310910 700 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260616 19:51:48.663775 682 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260616 19:51:48.664149 682 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260616 19:51:48.664296 682 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260616 19:51:48.673221 682 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260616 19:51:48.673446 682 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.129
I20260616 19:51:48.683876 682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.105.129
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.129
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 16 Jun 2026 19:43:22 UTC on bdcb31816ec0
build id 12426
ASAN enabled
I20260616 19:51:48.685575 682 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260616 19:51:48.687408 682 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260616 19:51:48.696915 705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:51:48.696946 706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:51:48.697026 708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:51:48.697985 682 server_base.cc:1061] running on GCE node
I20260616 19:51:48.698518 682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260616 19:51:48.699378 682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260616 19:51:48.700663 682 hybrid_clock.cc:648] HybridClock initialized: now 1781639508700626 us; error 108 us; skew 500 ppm
I20260616 19:51:48.700999 682 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260616 19:51:48.703368 682 webserver.cc:533] Webserver started at http://127.0.105.129:40721/ using document root <none> and password file <none>
I20260616 19:51:48.704257 682 fs_manager.cc:362] Metadata directory not provided
I20260616 19:51:48.704396 682 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260616 19:51:48.704779 682 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260616 19:51:48.707084 682 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/data/instance:
uuid: "7245e7dab0ec474a876537be514c8767"
format_stamp: "Formatted at 2026-06-16 19:51:48 on dist-test-slave-s7fg"
I20260616 19:51:48.707849 682 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/instance:
uuid: "7245e7dab0ec474a876537be514c8767"
format_stamp: "Formatted at 2026-06-16 19:51:48 on dist-test-slave-s7fg"
I20260616 19:51:48.713210 682 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260616 19:51:48.716359 714 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:48.717695 682 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260616 19:51:48.717870 682 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal
uuid: "7245e7dab0ec474a876537be514c8767"
format_stamp: "Formatted at 2026-06-16 19:51:48 on dist-test-slave-s7fg"
I20260616 19:51:48.718115 682 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260616 19:51:48.722946 674 sys_catalog.cc:455] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c404c91cd2194cf6838fddd212f2f4ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:48.723230 674 sys_catalog.cc:458] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: This master's current role is: LEADER
I20260616 19:51:48.753263 682 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260616 19:51:48.754225 682 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260616 19:51:48.754527 682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260616 19:51:48.755568 682 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260616 19:51:48.757284 682 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260616 19:51:48.757368 682 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:48.757517 682 ts_tablet_manager.cc:616] Registered 0 tablets
I20260616 19:51:48.757615 682 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:48.794729 682 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.129:46411
I20260616 19:51:48.794822 829 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.129:46411 every 8 connection(s)
I20260616 19:51:48.796268 682 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/data/info.pb
I20260616 19:51:48.799108 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasknFdngH/build/asan/bin/kudu as pid 682
I20260616 19:51:48.799324 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/instance
I20260616 19:51:48.805334 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasknFdngH/build/asan/bin/kudu
/tmp/dist-test-tasknFdngH/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.130:0
--local_ip_for_outbound_sockets=127.0.105.130
--webserver_interface=127.0.105.130
--webserver_port=0
--tserver_master_addrs=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--builtin_ntp_servers=127.0.105.148:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260616 19:51:48.856884 832 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:51:48.857084 831 heartbeater.cc:344] Connected to a master server at 127.0.105.190:35857
I20260616 19:51:48.857437 831 heartbeater.cc:461] Registering TS with master...
I20260616 19:51:48.858490 831 heartbeater.cc:507] Master 127.0.105.190:35857 requested a full tablet report, sending...
I20260616 19:51:48.858631 830 heartbeater.cc:344] Connected to a master server at 127.0.105.188:34219
I20260616 19:51:48.858741 830 heartbeater.cc:461] Registering TS with master...
I20260616 19:51:48.859109 830 heartbeater.cc:507] Master 127.0.105.188:34219 requested a full tablet report, sending...
I20260616 19:51:48.857430 832 heartbeater.cc:461] Registering TS with master...
I20260616 19:51:48.859905 832 heartbeater.cc:507] Master 127.0.105.189:43055 requested a full tablet report, sending...
I20260616 19:51:48.860754 603 ts_manager.cc:194] Registered new tserver with Master: 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:48.861510 532 ts_manager.cc:194] Registered new tserver with Master: 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:48.862461 603 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.129:36471
I20260616 19:51:48.862937 461 ts_manager.cc:194] Registered new tserver with Master: 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:49.005008 672 catalog_manager.cc:1294] Loaded cluster ID: d3d9ed8a8f984d7f816cb660c217abc3
I20260616 19:51:49.005126 672 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: loading cluster ID for follower catalog manager: success
I20260616 19:51:49.009160 672 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: acquiring CA information for follower catalog manager: success
I20260616 19:51:49.011704 672 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260616 19:51:49.076650 841 raft_consensus.cc:493] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c404c91cd2194cf6838fddd212f2f4ae)
I20260616 19:51:49.076894 841 raft_consensus.cc:515] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:49.078642 841 leader_election.cc:290] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b8fb7a8523741a2b7a5e75d8b415be0 (127.0.105.189:43055), c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219)
I20260616 19:51:49.079373 541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "85d6b13547f2413c86ee07194ca74704" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" is_pre_election: true
I20260616 19:51:49.079385 613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "85d6b13547f2413c86ee07194ca74704" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c404c91cd2194cf6838fddd212f2f4ae" is_pre_election: true
I20260616 19:51:49.080296 447 leader_election.cc:304] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85d6b13547f2413c86ee07194ca74704; no voters: 2b8fb7a8523741a2b7a5e75d8b415be0, c404c91cd2194cf6838fddd212f2f4ae
I20260616 19:51:49.080708 841 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260616 19:51:49.177904 838 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260616 19:51:49.178262 838 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260616 19:51:49.178399 838 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260616 19:51:49.187075 838 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260616 19:51:49.187309 838 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.130
I20260616 19:51:49.198048 838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.105.130
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.130
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 16 Jun 2026 19:43:22 UTC on bdcb31816ec0
build id 12426
ASAN enabled
I20260616 19:51:49.199679 838 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260616 19:51:49.201614 838 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260616 19:51:49.211556 846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:51:49.211654 847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:51:49.211676 849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:51:49.212814 838 server_base.cc:1061] running on GCE node
I20260616 19:51:49.213382 838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260616 19:51:49.214313 838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260616 19:51:49.215519 838 hybrid_clock.cc:648] HybridClock initialized: now 1781639509215478 us; error 34 us; skew 500 ppm
I20260616 19:51:49.215890 838 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260616 19:51:49.217895 838 webserver.cc:533] Webserver started at http://127.0.105.130:39893/ using document root <none> and password file <none>
I20260616 19:51:49.218639 838 fs_manager.cc:362] Metadata directory not provided
I20260616 19:51:49.218734 838 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260616 19:51:49.219022 838 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260616 19:51:49.221378 838 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/data/instance:
uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
format_stamp: "Formatted at 2026-06-16 19:51:49 on dist-test-slave-s7fg"
I20260616 19:51:49.222090 838 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/instance:
uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
format_stamp: "Formatted at 2026-06-16 19:51:49 on dist-test-slave-s7fg"
I20260616 19:51:49.224625 854 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c404c91cd2194cf6838fddd212f2f4ae)
I20260616 19:51:49.224836 854 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:49.226365 854 leader_election.cc:290] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85d6b13547f2413c86ee07194ca74704 (127.0.105.190:35857), c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219)
I20260616 19:51:49.226852 613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c404c91cd2194cf6838fddd212f2f4ae" is_pre_election: true
I20260616 19:51:49.227350 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85d6b13547f2413c86ee07194ca74704" is_pre_election: true
I20260616 19:51:49.228191 517 leader_election.cc:304] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b8fb7a8523741a2b7a5e75d8b415be0; no voters: 85d6b13547f2413c86ee07194ca74704, c404c91cd2194cf6838fddd212f2f4ae
I20260616 19:51:49.228590 854 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:51:49.229429 838 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260616 19:51:49.232805 856 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:49.234153 838 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260616 19:51:49.234333 838 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal
uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
format_stamp: "Formatted at 2026-06-16 19:51:49 on dist-test-slave-s7fg"
I20260616 19:51:49.234565 838 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260616 19:51:49.252342 838 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260616 19:51:49.253216 838 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260616 19:51:49.253443 838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260616 19:51:49.254338 838 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260616 19:51:49.255903 838 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260616 19:51:49.255986 838 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:49.256059 838 ts_tablet_manager.cc:616] Registered 0 tablets
I20260616 19:51:49.256549 838 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:49.292810 838 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.130:42787
I20260616 19:51:49.292912 968 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.130:42787 every 8 connection(s)
I20260616 19:51:49.294252 838 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/data/info.pb
I20260616 19:51:49.295356 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasknFdngH/build/asan/bin/kudu as pid 838
I20260616 19:51:49.295543 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/instance
I20260616 19:51:49.301229 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasknFdngH/build/asan/bin/kudu
/tmp/dist-test-tasknFdngH/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.131:0
--local_ip_for_outbound_sockets=127.0.105.131
--webserver_interface=127.0.105.131
--webserver_port=0
--tserver_master_addrs=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--builtin_ntp_servers=127.0.105.148:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260616 19:51:49.320834 971 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:51:49.321200 971 heartbeater.cc:461] Registering TS with master...
I20260616 19:51:49.322291 971 heartbeater.cc:507] Master 127.0.105.189:43055 requested a full tablet report, sending...
I20260616 19:51:49.325013 532 ts_manager.cc:194] Registered new tserver with Master: ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:49.325795 970 heartbeater.cc:344] Connected to a master server at 127.0.105.190:35857
I20260616 19:51:49.325923 970 heartbeater.cc:461] Registering TS with master...
I20260616 19:51:49.326802 970 heartbeater.cc:507] Master 127.0.105.190:35857 requested a full tablet report, sending...
I20260616 19:51:49.327859 461 ts_manager.cc:194] Registered new tserver with Master: ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:49.328550 969 heartbeater.cc:344] Connected to a master server at 127.0.105.188:34219
I20260616 19:51:49.328675 969 heartbeater.cc:461] Registering TS with master...
I20260616 19:51:49.329109 969 heartbeater.cc:507] Master 127.0.105.188:34219 requested a full tablet report, sending...
I20260616 19:51:49.329921 603 ts_manager.cc:194] Registered new tserver with Master: ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:49.330235 700 catalog_manager.cc:1294] Loaded cluster ID: d3d9ed8a8f984d7f816cb660c217abc3
I20260616 19:51:49.330335 700 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: loading cluster ID for follower catalog manager: success
I20260616 19:51:49.330905 603 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.130:38955
I20260616 19:51:49.334126 700 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: acquiring CA information for follower catalog manager: success
I20260616 19:51:49.337072 700 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260616 19:51:49.365064 830 heartbeater.cc:499] Master 127.0.105.188:34219 was elected leader, sending a full tablet report...
I20260616 19:51:49.618456 978 raft_consensus.cc:493] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c404c91cd2194cf6838fddd212f2f4ae)
I20260616 19:51:49.618685 978 raft_consensus.cc:515] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:49.619757 978 leader_election.cc:290] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b8fb7a8523741a2b7a5e75d8b415be0 (127.0.105.189:43055), c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219)
I20260616 19:51:49.620131 541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "85d6b13547f2413c86ee07194ca74704" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" is_pre_election: true
I20260616 19:51:49.620374 613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "85d6b13547f2413c86ee07194ca74704" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c404c91cd2194cf6838fddd212f2f4ae" is_pre_election: true
I20260616 19:51:49.620909 447 leader_election.cc:304] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85d6b13547f2413c86ee07194ca74704; no voters: 2b8fb7a8523741a2b7a5e75d8b415be0, c404c91cd2194cf6838fddd212f2f4ae
I20260616 19:51:49.621222 978 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260616 19:51:49.665253 976 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260616 19:51:49.665616 976 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260616 19:51:49.665755 976 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260616 19:51:49.675153 976 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260616 19:51:49.675386 976 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.131
I20260616 19:51:49.686483 976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.105.131
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.131
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 16 Jun 2026 19:43:22 UTC on bdcb31816ec0
build id 12426
ASAN enabled
I20260616 19:51:49.688087 976 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260616 19:51:49.689942 976 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260616 19:51:49.700016 984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:51:49.700951 983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:51:49.705765 986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:51:49.706506 976 server_base.cc:1061] running on GCE node
I20260616 19:51:49.707074 976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260616 19:51:49.708062 976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260616 19:51:49.709287 976 hybrid_clock.cc:648] HybridClock initialized: now 1781639509709229 us; error 53 us; skew 500 ppm
I20260616 19:51:49.709610 976 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260616 19:51:49.712126 976 webserver.cc:533] Webserver started at http://127.0.105.131:43953/ using document root <none> and password file <none>
I20260616 19:51:49.712980 976 fs_manager.cc:362] Metadata directory not provided
I20260616 19:51:49.713095 976 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260616 19:51:49.713456 976 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260616 19:51:49.715865 976 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/data/instance:
uuid: "61c874fef3684d10a272a9c7f280e0e2"
format_stamp: "Formatted at 2026-06-16 19:51:49 on dist-test-slave-s7fg"
I20260616 19:51:49.716692 976 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/instance:
uuid: "61c874fef3684d10a272a9c7f280e0e2"
format_stamp: "Formatted at 2026-06-16 19:51:49 on dist-test-slave-s7fg"
I20260616 19:51:49.722223 976 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260616 19:51:49.726079 992 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:49.727844 976 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260616 19:51:49.728030 976 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal
uuid: "61c874fef3684d10a272a9c7f280e0e2"
format_stamp: "Formatted at 2026-06-16 19:51:49 on dist-test-slave-s7fg"
I20260616 19:51:49.728231 976 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260616 19:51:49.752363 976 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260616 19:51:49.753280 976 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260616 19:51:49.753563 976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260616 19:51:49.754472 976 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260616 19:51:49.756124 976 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260616 19:51:49.756209 976 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:49.756361 976 ts_tablet_manager.cc:616] Registered 0 tablets
I20260616 19:51:49.756454 976 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:49.794561 976 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.131:37571
I20260616 19:51:49.794611 1104 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.131:37571 every 8 connection(s)
I20260616 19:51:49.796238 976 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/data/info.pb
I20260616 19:51:49.805913 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasknFdngH/build/asan/bin/kudu as pid 976
I20260616 19:51:49.806125 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/instance
I20260616 19:51:49.816511 1106 heartbeater.cc:344] Connected to a master server at 127.0.105.190:35857
I20260616 19:51:49.816534 1105 heartbeater.cc:344] Connected to a master server at 127.0.105.188:34219
I20260616 19:51:49.816941 1106 heartbeater.cc:461] Registering TS with master...
I20260616 19:51:49.816936 1105 heartbeater.cc:461] Registering TS with master...
I20260616 19:51:49.817101 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:51:49.817238 1107 heartbeater.cc:461] Registering TS with master...
I20260616 19:51:49.818332 1105 heartbeater.cc:507] Master 127.0.105.188:34219 requested a full tablet report, sending...
I20260616 19:51:49.818364 1107 heartbeater.cc:507] Master 127.0.105.189:43055 requested a full tablet report, sending...
I20260616 19:51:49.818388 1106 heartbeater.cc:507] Master 127.0.105.190:35857 requested a full tablet report, sending...
I20260616 19:51:49.819907 603 ts_manager.cc:194] Registered new tserver with Master: 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:49.820174 460 ts_manager.cc:194] Registered new tserver with Master: 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:49.820930 603 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.131:47121
I20260616 19:51:49.821704 532 ts_manager.cc:194] Registered new tserver with Master: 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:49.833380 969 heartbeater.cc:499] Master 127.0.105.188:34219 was elected leader, sending a full tablet report...
I20260616 19:51:49.833590 422 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260616 19:51:49.865847 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36996:
name: "default.Table_71e6d08e78b54e2782983675ce409f61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:49.865891 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36996:
name: "default.Table_3494f28ba0394c719e6bdda49aa971cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:49.867733 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3494f28ba0394c719e6bdda49aa971cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:49.868240 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36996:
name: "default.Table_1d74b72ffd704fb48b5f4d01165e17ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:49.868582 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36996:
name: "default.Table_d4ff953ddd3f4e9286958840ddeed8a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:49.869134 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d74b72ffd704fb48b5f4d01165e17ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:49.869220 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4ff953ddd3f4e9286958840ddeed8a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:49.873154 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36996:
name: "default.Table_23244abf4f804e5cb4b3ab312c84df41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:49.874212 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23244abf4f804e5cb4b3ab312c84df41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:49.873945 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36996:
name: "default.Table_88d0986c31ba428998a58bc33ad17f52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:49.875767 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88d0986c31ba428998a58bc33ad17f52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:49.877223 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36996:
name: "default.Table_f10ac61e4fa442ee98b5c4d07dae39b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:49.878394 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71e6d08e78b54e2782983675ce409f61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:49.878803 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f10ac61e4fa442ee98b5c4d07dae39b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:49.874429 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36996:
name: "default.Table_1397ca71b04b424280619af383d23552"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:49.881181 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1397ca71b04b424280619af383d23552 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:49.882763 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36996:
name: "default.Table_7c24e0b66b47494190f9b8f3443b21ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:49.887598 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c24e0b66b47494190f9b8f3443b21ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:49.885782 594 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36996:
name: "default.Table_3df1917338754d669287bb7dfb5f7e38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:49.890375 422 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-tasknFdngH/build/asan/bin/kudu pid 569
W20260616 19:51:49.890969 594 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3df1917338754d669287bb7dfb5f7e38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:49.921657 633 generic_service.cc:196] Checking for leaks (request via RPC)
W20260616 19:51:50.066004 588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.190:35857, user_credentials={real_user=slave}} blocked reactor thread for 128492us
I20260616 19:51:50.067682 422 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasknFdngH/build/asan/bin/kudu with pid 569
W20260616 19:51:50.088691 448 connection.cc:573] server connection from 127.0.0.1:41686 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260616 19:51:50.089653 1114 connection.cc:573] client connection to 127.0.105.188:34219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260616 19:51:50.090664 1114 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.105.188:34219)
W20260616 19:51:50.091032 1114 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.105.188:34219)
I20260616 19:51:50.323132 1105 heartbeater.cc:499] Master 127.0.105.188:34219 was elected leader, sending a full tablet report...
W20260616 19:51:50.324630 1105 heartbeater.cc:646] Failed to heartbeat to 127.0.105.188:34219 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
W20260616 19:51:50.336205 969 heartbeater.cc:646] Failed to heartbeat to 127.0.105.188:34219 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
W20260616 19:51:50.374307 830 heartbeater.cc:646] Failed to heartbeat to 127.0.105.188:34219 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
I20260616 19:51:50.416277 1166 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c404c91cd2194cf6838fddd212f2f4ae)
I20260616 19:51:50.416590 1166 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:50.417220 1166 leader_election.cc:290] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85d6b13547f2413c86ee07194ca74704 (127.0.105.190:35857), c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219)
I20260616 19:51:50.417713 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "85d6b13547f2413c86ee07194ca74704" is_pre_election: true
W20260616 19:51:50.419323 518 leader_election.cc:336] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219): Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
I20260616 19:51:50.419497 518 leader_election.cc:304] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b8fb7a8523741a2b7a5e75d8b415be0; no voters: 85d6b13547f2413c86ee07194ca74704, c404c91cd2194cf6838fddd212f2f4ae
I20260616 19:51:50.419742 1166 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:51:50.570101 1169 raft_consensus.cc:493] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c404c91cd2194cf6838fddd212f2f4ae)
I20260616 19:51:50.570297 1169 raft_consensus.cc:515] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:50.570996 1169 leader_election.cc:290] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b8fb7a8523741a2b7a5e75d8b415be0 (127.0.105.189:43055), c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219)
I20260616 19:51:50.571419 541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "85d6b13547f2413c86ee07194ca74704" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" is_pre_election: true
I20260616 19:51:50.571672 541 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85d6b13547f2413c86ee07194ca74704 in term 1.
I20260616 19:51:50.572245 445 leader_election.cc:304] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8fb7a8523741a2b7a5e75d8b415be0, 85d6b13547f2413c86ee07194ca74704; no voters:
I20260616 19:51:50.572557 1169 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260616 19:51:50.572711 1169 raft_consensus.cc:493] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c404c91cd2194cf6838fddd212f2f4ae)
I20260616 19:51:50.572855 1169 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 1 FOLLOWER]: Advancing to term 2
W20260616 19:51:50.573335 447 leader_election.cc:336] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219): Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
I20260616 19:51:50.575451 1169 raft_consensus.cc:515] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:50.576035 1169 leader_election.cc:290] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [CANDIDATE]: Term 2 election: Requested vote from peers 2b8fb7a8523741a2b7a5e75d8b415be0 (127.0.105.189:43055), c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219)
I20260616 19:51:50.576347 541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "85d6b13547f2413c86ee07194ca74704" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0"
I20260616 19:51:50.576573 541 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 1 FOLLOWER]: Advancing to term 2
W20260616 19:51:50.577309 447 leader_election.cc:336] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219): Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111)
I20260616 19:51:50.578701 541 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85d6b13547f2413c86ee07194ca74704 in term 2.
I20260616 19:51:50.579089 445 leader_election.cc:304] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b8fb7a8523741a2b7a5e75d8b415be0, 85d6b13547f2413c86ee07194ca74704; no voters: c404c91cd2194cf6838fddd212f2f4ae
I20260616 19:51:50.579376 1169 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 2 FOLLOWER]: Leader election won for term 2
I20260616 19:51:50.579756 1169 raft_consensus.cc:697] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [term 2 LEADER]: Becoming Leader. State: Replica: 85d6b13547f2413c86ee07194ca74704, State: Running, Role: LEADER
I20260616 19:51:50.580220 1169 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:50.581512 1172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85d6b13547f2413c86ee07194ca74704. Latest consensus state: current_term: 2 leader_uuid: "85d6b13547f2413c86ee07194ca74704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:50.581777 1172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: This master's current role is: LEADER
I20260616 19:51:50.582334 1173 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260616 19:51:50.584415 1173 catalog_manager.cc:679] Loaded metadata for table default.Table_3494f28ba0394c719e6bdda49aa971cd [id=249e27015542469da4f6d70df62e6008]
I20260616 19:51:50.585901 1173 tablet_loader.cc:96] loaded metadata for tablet ec8b1cb4a9d34a798ec287782f1219ee (table default.Table_3494f28ba0394c719e6bdda49aa971cd [id=249e27015542469da4f6d70df62e6008])
I20260616 19:51:50.586169 1173 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260616 19:51:50.587055 1173 catalog_manager.cc:1294] Loaded cluster ID: d3d9ed8a8f984d7f816cb660c217abc3
I20260616 19:51:50.587162 1173 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260616 19:51:50.588506 1173 catalog_manager.cc:1539] Loading token signing keys...
I20260616 19:51:50.589408 1173 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Loaded TSK: 0
I20260616 19:51:50.590235 1173 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260616 19:51:50.611946 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3494f28ba0394c719e6bdda49aa971cd" } new_table_name: "default.Table_7c5b4132a2e54d5996562b3cf61e0777" modify_external_catalogs: true
I20260616 19:51:50.612073 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3df1917338754d669287bb7dfb5f7e38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:50.612131 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7c24e0b66b47494190f9b8f3443b21ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:50.613166 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_88d0986c31ba428998a58bc33ad17f52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:50.613837 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1397ca71b04b424280619af383d23552"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:50.613694 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_71e6d08e78b54e2782983675ce409f61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:50.614892 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3df1917338754d669287bb7dfb5f7e38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:50.615309 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71e6d08e78b54e2782983675ce409f61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:50.615396 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1397ca71b04b424280619af383d23552 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:50.613864 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d4ff953ddd3f4e9286958840ddeed8a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:50.614670 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c24e0b66b47494190f9b8f3443b21ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:50.616806 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88d0986c31ba428998a58bc33ad17f52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:50.617162 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4ff953ddd3f4e9286958840ddeed8a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:50.614945 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1d74b72ffd704fb48b5f4d01165e17ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:50.614589 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_23244abf4f804e5cb4b3ab312c84df41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:50.618273 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f10ac61e4fa442ee98b5c4d07dae39b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:50.619942 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d74b72ffd704fb48b5f4d01165e17ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:50.619966 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23244abf4f804e5cb4b3ab312c84df41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:50.620483 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f10ac61e4fa442ee98b5c4d07dae39b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:50.623752 541 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Refusing update from remote peer 85d6b13547f2413c86ee07194ca74704: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260616 19:51:50.624554 1172 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260616 19:51:50.624815 447 consensus_peers.cc:597] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 -> Peer c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219): Couldn't send request to peer c404c91cd2194cf6838fddd212f2f4ae. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260616 19:51:50.628257 1166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85d6b13547f2413c86ee07194ca74704. Latest consensus state: current_term: 2 leader_uuid: "85d6b13547f2413c86ee07194ca74704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:50.628491 1166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:51:50.637614 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3bbd14b87c1d427f860652efbb92911e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:50.638175 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bbd14b87c1d427f860652efbb92911e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:50.639472 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7c24e0b66b47494190f9b8f3443b21ef" } new_table_name: "default.Table_7358903e7e734fe7bdf88a99a0cd40ef" modify_external_catalogs: true
W20260616 19:51:50.640403 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ec8b1cb4a9d34a798ec287782f1219ee has no consensus state
I20260616 19:51:50.640851 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3df1917338754d669287bb7dfb5f7e38" } new_table_name: "default.Table_1a3a46499a29471cbd3f312ef6f2c560" modify_external_catalogs: true
I20260616 19:51:50.642139 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_71e6d08e78b54e2782983675ce409f61" } new_table_name: "default.Table_6898df1fd20f49e29b1037b27d922358" modify_external_catalogs: true
I20260616 19:51:50.642150 1166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "85d6b13547f2413c86ee07194ca74704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:50.642330 1166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:51:50.645242 1172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "85d6b13547f2413c86ee07194ca74704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:50.645517 1172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: This master's current role is: LEADER
I20260616 19:51:50.653589 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_88d0986c31ba428998a58bc33ad17f52" } modify_external_catalogs: true
I20260616 19:51:50.653836 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_88d0986c31ba428998a58bc33ad17f52" } modify_external_catalogs: true
W20260616 19:51:50.655037 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08330a8219574829834e36523ec6408e has no consensus state
I20260616 19:51:50.655839 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7c5b4132a2e54d5996562b3cf61e0777" } new_table_name: "default.Table_2ab0cf99b6014917bcbbecd656555ecd" modify_external_catalogs: true
W20260616 19:51:50.656323 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61c66c72987941428a449601683fba68 has no consensus state
I20260616 19:51:50.656735 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d4ff953ddd3f4e9286958840ddeed8a1" } modify_external_catalogs: true
W20260616 19:51:50.656919 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52c1eff6222046bfa1b19720a558068d has no consensus state
I20260616 19:51:50.656944 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d4ff953ddd3f4e9286958840ddeed8a1" } modify_external_catalogs: true
I20260616 19:51:50.657047 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1397ca71b04b424280619af383d23552" } modify_external_catalogs: true
I20260616 19:51:50.657217 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1397ca71b04b424280619af383d23552" } modify_external_catalogs: true
I20260616 19:51:50.659004 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1a3a46499a29471cbd3f312ef6f2c560" } modify_external_catalogs: true
I20260616 19:51:50.659050 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3bbd14b87c1d427f860652efbb92911e" } modify_external_catalogs: true
I20260616 19:51:50.659168 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1a3a46499a29471cbd3f312ef6f2c560" } modify_external_catalogs: true
I20260616 19:51:50.659214 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3bbd14b87c1d427f860652efbb92911e" } modify_external_catalogs: true
I20260616 19:51:50.666445 452 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 8b2c416e7b4f46bbb77f4d7acd9ecb33
W20260616 19:51:50.666702 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet ec8b1cb4a9d34a798ec287782f1219ee (table default.Table_7c5b4132a2e54d5996562b3cf61e0777 [id=249e27015542469da4f6d70df62e6008], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ec8b1cb4a9d34a798ec287782f1219ee consensus state has no leader
I20260616 19:51:50.668203 458 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet f2ec1639686b47bdacd7d748c29d97a5
I20260616 19:51:50.668733 457 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 82b2301a75a44837a96b20eb1509f682
I20260616 19:51:50.688583 459 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 38fca377860b467f868c973107485006
W20260616 19:51:50.689002 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ec8b1cb4a9d34a798ec287782f1219ee consensus state has no leader
I20260616 19:51:50.695416 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 08330a8219574829834e36523ec6408e
I20260616 19:51:50.707261 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 08330a8219574829834e36523ec6408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:50.709301 903 tablet_service.cc:1511] Processing CreateTablet for tablet 52c1eff6222046bfa1b19720a558068d (DEFAULT_TABLE table=default.Table_7358903e7e734fe7bdf88a99a0cd40ef [id=b04cd7f15b3f43968eec7989c20caa41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.709455 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 08330a8219574829834e36523ec6408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:50.710821 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c1eff6222046bfa1b19720a558068d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.711228 901 tablet_service.cc:1511] Processing CreateTablet for tablet 61c66c72987941428a449601683fba68 (DEFAULT_TABLE table=default.Table_6898df1fd20f49e29b1037b27d922358 [id=e75a6e5e4f0047d9b398ce230b170131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.711656 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 61c66c72987941428a449601683fba68 (DEFAULT_TABLE table=default.Table_6898df1fd20f49e29b1037b27d922358 [id=e75a6e5e4f0047d9b398ce230b170131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.712946 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61c66c72987941428a449601683fba68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.713083 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 08330a8219574829834e36523ec6408e (DEFAULT_TABLE table=default.Table_1a3a46499a29471cbd3f312ef6f2c560 [id=f8770615f8d94929983c07bb73f3116f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.713454 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61c66c72987941428a449601683fba68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.713655 1038 tablet_service.cc:1511] Processing CreateTablet for tablet ec8b1cb4a9d34a798ec287782f1219ee (DEFAULT_TABLE table=default.Table_7c5b4132a2e54d5996562b3cf61e0777 [id=249e27015542469da4f6d70df62e6008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.714179 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8b1cb4a9d34a798ec287782f1219ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.715752 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 52c1eff6222046bfa1b19720a558068d (DEFAULT_TABLE table=default.Table_7358903e7e734fe7bdf88a99a0cd40ef [id=b04cd7f15b3f43968eec7989c20caa41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.716162 902 tablet_service.cc:1511] Processing CreateTablet for tablet ec8b1cb4a9d34a798ec287782f1219ee (DEFAULT_TABLE table=default.Table_7c5b4132a2e54d5996562b3cf61e0777 [id=249e27015542469da4f6d70df62e6008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.716701 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8b1cb4a9d34a798ec287782f1219ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.715981 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08330a8219574829834e36523ec6408e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.720631 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c1eff6222046bfa1b19720a558068d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.722973 904 tablet_service.cc:1511] Processing CreateTablet for tablet 08330a8219574829834e36523ec6408e (DEFAULT_TABLE table=default.Table_1a3a46499a29471cbd3f312ef6f2c560 [id=f8770615f8d94929983c07bb73f3116f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.723532 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08330a8219574829834e36523ec6408e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.728948 898 tablet_service.cc:1511] Processing CreateTablet for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 (DEFAULT_TABLE table=default.Table_23244abf4f804e5cb4b3ab312c84df41 [id=5fcb69f72f9a4146a022e60757c42e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.729538 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.732692 899 tablet_service.cc:1511] Processing CreateTablet for tablet 2124e4b923ba439893788bb7350cdae9 (DEFAULT_TABLE table=default.Table_1d74b72ffd704fb48b5f4d01165e17ba [id=48ebc382fbde40f8a05ccb60001efe00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.733255 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2124e4b923ba439893788bb7350cdae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.733775 765 tablet_service.cc:1511] Processing CreateTablet for tablet 08330a8219574829834e36523ec6408e (DEFAULT_TABLE table=default.Table_1a3a46499a29471cbd3f312ef6f2c560 [id=f8770615f8d94929983c07bb73f3116f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.735500 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08330a8219574829834e36523ec6408e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.737255 764 tablet_service.cc:1511] Processing CreateTablet for tablet 52c1eff6222046bfa1b19720a558068d (DEFAULT_TABLE table=default.Table_7358903e7e734fe7bdf88a99a0cd40ef [id=b04cd7f15b3f43968eec7989c20caa41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.737498 763 tablet_service.cc:1511] Processing CreateTablet for tablet ec8b1cb4a9d34a798ec287782f1219ee (DEFAULT_TABLE table=default.Table_7c5b4132a2e54d5996562b3cf61e0777 [id=249e27015542469da4f6d70df62e6008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.737829 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c1eff6222046bfa1b19720a558068d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.738193 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8b1cb4a9d34a798ec287782f1219ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.740921 762 tablet_service.cc:1511] Processing CreateTablet for tablet 61c66c72987941428a449601683fba68 (DEFAULT_TABLE table=default.Table_6898df1fd20f49e29b1037b27d922358 [id=e75a6e5e4f0047d9b398ce230b170131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.741354 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61c66c72987941428a449601683fba68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.746788 1192 tablet_bootstrap.cc:492] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:50.750671 1192 tablet_bootstrap.cc:654] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:50.752143 1192 log.cc:826] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: Log is configured to *not* fsync() on all Append() calls
I20260616 19:51:50.753187 904 tablet_service.cc:1511] Processing CreateTablet for tablet 96913044d566481e8a22d3dec765cdf2 (DEFAULT_TABLE table=default.Table_f10ac61e4fa442ee98b5c4d07dae39b3 [id=7b8e6e89495c4b509590e87f3e542079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.753569 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96913044d566481e8a22d3dec765cdf2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:50.753592 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 08330a8219574829834e36523ec6408e because the tablet was not found. No further retry: Not found: Tablet not found: 08330a8219574829834e36523ec6408e
I20260616 19:51:50.754735 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 08330a8219574829834e36523ec6408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:50.760268 760 tablet_service.cc:1511] Processing CreateTablet for tablet 2124e4b923ba439893788bb7350cdae9 (DEFAULT_TABLE table=default.Table_1d74b72ffd704fb48b5f4d01165e17ba [id=48ebc382fbde40f8a05ccb60001efe00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.769613 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 2124e4b923ba439893788bb7350cdae9 (DEFAULT_TABLE table=default.Table_1d74b72ffd704fb48b5f4d01165e17ba [id=48ebc382fbde40f8a05ccb60001efe00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.772332 461 master_service.cc:960] ReplaceTablet: received request to replace tablet 52c1eff6222046bfa1b19720a558068d from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:50.772984 1192 tablet_bootstrap.cc:492] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:50.773377 1192 ts_tablet_manager.cc:1403] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.003s
I20260616 19:51:50.773638 454 master_service.cc:960] ReplaceTablet: received request to replace tablet ec8b1cb4a9d34a798ec287782f1219ee from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:50.773411 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 96913044d566481e8a22d3dec765cdf2 (DEFAULT_TABLE table=default.Table_f10ac61e4fa442ee98b5c4d07dae39b3 [id=7b8e6e89495c4b509590e87f3e542079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.775127 1034 tablet_service.cc:1511] Processing CreateTablet for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 (DEFAULT_TABLE table=default.Table_23244abf4f804e5cb4b3ab312c84df41 [id=5fcb69f72f9a4146a022e60757c42e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.776587 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2124e4b923ba439893788bb7350cdae9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:50.779407 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 08330a8219574829834e36523ec6408e because the tablet was not found. No further retry: Not found: Tablet not found: 08330a8219574829834e36523ec6408e
I20260616 19:51:50.780769 459 master_service.cc:960] ReplaceTablet: received request to replace tablet 2124e4b923ba439893788bb7350cdae9 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:50.780709 1192 raft_consensus.cc:359] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:50.781157 1192 raft_consensus.cc:385] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:50.781250 1192 raft_consensus.cc:740] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:50.781705 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96913044d566481e8a22d3dec765cdf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.782070 1192 consensus_queue.cc:260] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:50.782724 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2124e4b923ba439893788bb7350cdae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.783010 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.784010 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 52c1eff6222046bfa1b19720a558068d
I20260616 19:51:50.785010 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 52c1eff6222046bfa1b19720a558068d with delete_type TABLET_DATA_DELETED (replaced by tablet 1369a97caf7246479b1a12ac38674eed) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:50.786790 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ec8b1cb4a9d34a798ec287782f1219ee
W20260616 19:51:50.787107 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 52c1eff6222046bfa1b19720a558068d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52c1eff6222046bfa1b19720a558068d already in progress: creating tablet
I20260616 19:51:50.787412 454 catalog_manager.cc:6784] ReplaceTablet: tablet ec8b1cb4a9d34a798ec287782f1219ee deleted and replaced by tablet 2df7d27b41b440c5b082e8783adfeced
I20260616 19:51:50.787691 901 tablet_service.cc:1558] Processing DeleteTablet for tablet ec8b1cb4a9d34a798ec287782f1219ee with delete_type TABLET_DATA_DELETED (replaced by tablet 2df7d27b41b440c5b082e8783adfeced) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:50.788976 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet ec8b1cb4a9d34a798ec287782f1219ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec8b1cb4a9d34a798ec287782f1219ee already in progress: creating tablet
I20260616 19:51:50.790647 461 catalog_manager.cc:6784] ReplaceTablet: tablet 52c1eff6222046bfa1b19720a558068d deleted and replaced by tablet 1369a97caf7246479b1a12ac38674eed
I20260616 19:51:50.791436 454 master_service.cc:960] ReplaceTablet: received request to replace tablet ec8b1cb4a9d34a798ec287782f1219ee from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:50.792169 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 52c1eff6222046bfa1b19720a558068d with delete_type TABLET_DATA_DELETED (replaced by tablet 1369a97caf7246479b1a12ac38674eed) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:50.792733 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2124e4b923ba439893788bb7350cdae9
I20260616 19:51:50.793279 459 catalog_manager.cc:6784] ReplaceTablet: tablet 2124e4b923ba439893788bb7350cdae9 deleted and replaced by tablet a8e2ac5db03f4278b341d01a58441100
I20260616 19:51:50.794054 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 2124e4b923ba439893788bb7350cdae9 with delete_type TABLET_DATA_DELETED (replaced by tablet a8e2ac5db03f4278b341d01a58441100) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:50.794706 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 2124e4b923ba439893788bb7350cdae9 with delete_type TABLET_DATA_DELETED (replaced by tablet a8e2ac5db03f4278b341d01a58441100) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:50.795089 1192 ts_tablet_manager.cc:1434] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.022s user 0.012s sys 0.003s
W20260616 19:51:50.795795 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 52c1eff6222046bfa1b19720a558068d because the tablet was not found. No further retry: Not found: Tablet not found: 52c1eff6222046bfa1b19720a558068d
W20260616 19:51:50.795946 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 2124e4b923ba439893788bb7350cdae9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2124e4b923ba439893788bb7350cdae9 already in progress: creating tablet
W20260616 19:51:50.796089 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2124e4b923ba439893788bb7350cdae9 because the tablet was not found. No further retry: Not found: Tablet not found: 2124e4b923ba439893788bb7350cdae9
I20260616 19:51:50.796361 461 master_service.cc:960] ReplaceTablet: received request to replace tablet 52c1eff6222046bfa1b19720a558068d from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:50.800799 1192 tablet_bootstrap.cc:492] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:50.802544 1192 tablet_bootstrap.cc:654] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:50.806238 972 tablet.cc:2406] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260616 19:51:50.810820 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 61c66c72987941428a449601683fba68 (table default.Table_6898df1fd20f49e29b1037b27d922358 [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 1 got 0
I20260616 19:51:50.812510 970 heartbeater.cc:499] Master 127.0.105.190:35857 was elected leader, sending a full tablet report...
I20260616 19:51:50.813622 1032 tablet_service.cc:1511] Processing CreateTablet for tablet a8e2ac5db03f4278b341d01a58441100 (DEFAULT_TABLE table=default.Table_1d74b72ffd704fb48b5f4d01165e17ba [id=48ebc382fbde40f8a05ccb60001efe00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.814347 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e2ac5db03f4278b341d01a58441100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.814623 1192 tablet_bootstrap.cc:492] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:50.814815 1192 ts_tablet_manager.cc:1403] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.004s
I20260616 19:51:50.815798 1192 raft_consensus.cc:359] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:50.816663 1192 raft_consensus.cc:385] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:50.816941 1192 raft_consensus.cc:740] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:50.817451 1192 consensus_queue.cc:260] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:50.820645 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet ec8b1cb4a9d34a798ec287782f1219ee with delete_type TABLET_DATA_DELETED (replaced by tablet 2df7d27b41b440c5b082e8783adfeced) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:50.821283 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 61c66c72987941428a449601683fba68 (table default.Table_6898df1fd20f49e29b1037b27d922358 [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 1 got 0
W20260616 19:51:50.821430 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ec8b1cb4a9d34a798ec287782f1219ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec8b1cb4a9d34a798ec287782f1219ee already in progress: creating tablet
I20260616 19:51:50.821370 1192 ts_tablet_manager.cc:1434] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260616 19:51:50.782697 759 tablet_service.cc:1511] Processing CreateTablet for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 (DEFAULT_TABLE table=default.Table_23244abf4f804e5cb4b3ab312c84df41 [id=5fcb69f72f9a4146a022e60757c42e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.824337 1192 tablet_bootstrap.cc:492] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:50.824327 901 tablet_service.cc:1511] Processing CreateTablet for tablet a8e2ac5db03f4278b341d01a58441100 (DEFAULT_TABLE table=default.Table_1d74b72ffd704fb48b5f4d01165e17ba [id=48ebc382fbde40f8a05ccb60001efe00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.824790 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 52c1eff6222046bfa1b19720a558068d with delete_type TABLET_DATA_DELETED (replaced by tablet 1369a97caf7246479b1a12ac38674eed) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:50.824882 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e2ac5db03f4278b341d01a58441100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.825402 904 tablet_service.cc:1558] Processing DeleteTablet for tablet ec8b1cb4a9d34a798ec287782f1219ee with delete_type TABLET_DATA_DELETED (replaced by tablet 2df7d27b41b440c5b082e8783adfeced) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:50.825611 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 08330a8219574829834e36523ec6408e because the tablet was not found. No further retry: Not found: Tablet not found: 08330a8219574829834e36523ec6408e
I20260616 19:51:50.828193 1192 tablet_bootstrap.cc:654] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:50.829025 1190 tablet_replica.cc:333] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:50.829690 1190 raft_consensus.cc:2243] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:50.830225 1190 raft_consensus.cc:2272] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:50.832309 1190 ts_tablet_manager.cc:1916] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:50.837246 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3b3dce47cfdc420eba859affc6ad8f5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:50.837880 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b3dce47cfdc420eba859affc6ad8f5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:50.837246 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 52c1eff6222046bfa1b19720a558068d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52c1eff6222046bfa1b19720a558068d already in progress: creating tablet
I20260616 19:51:50.840400 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6d6c3518a8c24d2a8e9b450d7058b3ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:50.841023 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d6c3518a8c24d2a8e9b450d7058b3ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:50.840938 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ae4095e00e384ff7b71ca9f98ef00fca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:50.841495 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae4095e00e384ff7b71ca9f98ef00fca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:50.842512 1190 ts_tablet_manager.cc:1929] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:50.842767 1190 log.cc:1199] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/ec8b1cb4a9d34a798ec287782f1219ee
I20260616 19:51:50.843079 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1d74b72ffd704fb48b5f4d01165e17ba" } new_table_name: "default.Table_4a48e35891a940babfcf8b6d6add8062" modify_external_catalogs: true
I20260616 19:51:50.843403 1190 ts_tablet_manager.cc:1950] T ec8b1cb4a9d34a798ec287782f1219ee P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:50.845499 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 52c1eff6222046bfa1b19720a558068d with delete_type TABLET_DATA_DELETED (replaced by tablet 1369a97caf7246479b1a12ac38674eed) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:50.846254 757 tablet_service.cc:1558] Processing DeleteTablet for tablet ec8b1cb4a9d34a798ec287782f1219ee with delete_type TABLET_DATA_DELETED (replaced by tablet 2df7d27b41b440c5b082e8783adfeced) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:50.851411 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c654445815a9494491a390790185534e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:50.851713 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d885b36210f04c1b9e68247e2ae26734"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:50.852002 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c654445815a9494491a390790185534e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:50.851914 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 1369a97caf7246479b1a12ac38674eed (DEFAULT_TABLE table=default.Table_7358903e7e734fe7bdf88a99a0cd40ef [id=b04cd7f15b3f43968eec7989c20caa41]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:50.852229 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d885b36210f04c1b9e68247e2ae26734 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:50.852442 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1369a97caf7246479b1a12ac38674eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.853515 761 tablet_service.cc:1511] Processing CreateTablet for tablet 96913044d566481e8a22d3dec765cdf2 (DEFAULT_TABLE table=default.Table_f10ac61e4fa442ee98b5c4d07dae39b3 [id=7b8e6e89495c4b509590e87f3e542079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.855618 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ec5cab88a5f44540b0d789bd2543b79a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:50.856097 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec5cab88a5f44540b0d789bd2543b79a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:50.858803 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 2124e4b923ba439893788bb7350cdae9 with delete_type TABLET_DATA_DELETED (replaced by tablet a8e2ac5db03f4278b341d01a58441100) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:50.859669 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_21a0653003a3493e952199c335c04c55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:50.860189 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21a0653003a3493e952199c335c04c55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:50.862607 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5c46e26441ec423090e08d2e315b9eb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:50.850957 757 tablet_service.cc:1511] Processing CreateTablet for tablet a8e2ac5db03f4278b341d01a58441100 (DEFAULT_TABLE table=default.Table_1d74b72ffd704fb48b5f4d01165e17ba [id=48ebc382fbde40f8a05ccb60001efe00]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:50.863165 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c46e26441ec423090e08d2e315b9eb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:50.863222 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 2df7d27b41b440c5b082e8783adfeced (DEFAULT_TABLE table=default.Table_2ab0cf99b6014917bcbbecd656555ecd [id=249e27015542469da4f6d70df62e6008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.863718 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df7d27b41b440c5b082e8783adfeced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.864456 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_23244abf4f804e5cb4b3ab312c84df41" } new_table_name: "default.Table_43112c4d7050453dad8984408f75baf3" modify_external_catalogs: true
I20260616 19:51:50.865131 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96913044d566481e8a22d3dec765cdf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.866912 758 tablet_service.cc:1511] Processing CreateTablet for tablet 1369a97caf7246479b1a12ac38674eed (DEFAULT_TABLE table=default.Table_7358903e7e734fe7bdf88a99a0cd40ef [id=b04cd7f15b3f43968eec7989c20caa41]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:50.867372 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 52c1eff6222046bfa1b19720a558068d because the tablet was not found. No further retry: Not found: Tablet not found: 52c1eff6222046bfa1b19720a558068d
W20260616 19:51:50.867704 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet ec8b1cb4a9d34a798ec287782f1219ee because the tablet was not found. No further retry: Not found: Tablet not found: ec8b1cb4a9d34a798ec287782f1219ee
I20260616 19:51:50.869232 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.870141 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e2ac5db03f4278b341d01a58441100. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:50.870786 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2124e4b923ba439893788bb7350cdae9 because the tablet was not found. No further retry: Not found: Tablet not found: 2124e4b923ba439893788bb7350cdae9
I20260616 19:51:50.871918 1196 tablet_bootstrap.cc:492] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:50.872510 756 tablet_service.cc:1511] Processing CreateTablet for tablet 2df7d27b41b440c5b082e8783adfeced (DEFAULT_TABLE table=default.Table_2ab0cf99b6014917bcbbecd656555ecd [id=249e27015542469da4f6d70df62e6008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.872989 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet ec8b1cb4a9d34a798ec287782f1219ee (table default.Table_2ab0cf99b6014917bcbbecd656555ecd [id=249e27015542469da4f6d70df62e6008]) successfully deleted
I20260616 19:51:50.873202 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df7d27b41b440c5b082e8783adfeced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.874059 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1369a97caf7246479b1a12ac38674eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.874523 904 tablet_service.cc:1511] Processing CreateTablet for tablet 2df7d27b41b440c5b082e8783adfeced (DEFAULT_TABLE table=default.Table_2ab0cf99b6014917bcbbecd656555ecd [id=249e27015542469da4f6d70df62e6008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.874975 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df7d27b41b440c5b082e8783adfeced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.879276 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ed170d4e035643bbbf55255b5552d47d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:50.880178 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed170d4e035643bbbf55255b5552d47d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:50.889132 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 2124e4b923ba439893788bb7350cdae9 with delete_type TABLET_DATA_DELETED (replaced by tablet a8e2ac5db03f4278b341d01a58441100) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:50.891527 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 08330a8219574829834e36523ec6408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:50.892863 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 2124e4b923ba439893788bb7350cdae9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2124e4b923ba439893788bb7350cdae9 already in progress: creating tablet
W20260616 19:51:50.894604 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 08330a8219574829834e36523ec6408e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08330a8219574829834e36523ec6408e already in progress: creating tablet
I20260616 19:51:50.895993 901 tablet_service.cc:1511] Processing CreateTablet for tablet 1369a97caf7246479b1a12ac38674eed (DEFAULT_TABLE table=default.Table_7358903e7e734fe7bdf88a99a0cd40ef [id=b04cd7f15b3f43968eec7989c20caa41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.899730 1196 tablet_bootstrap.cc:654] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:50.899792 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1369a97caf7246479b1a12ac38674eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.901686 1196 log.cc:826] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767: Log is configured to *not* fsync() on all Append() calls
I20260616 19:51:50.906028 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7358903e7e734fe7bdf88a99a0cd40ef" } new_table_name: "default.Table_5f871d83f28b40d6839cc165a1c29263" modify_external_catalogs: true
I20260616 19:51:50.906630 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6898df1fd20f49e29b1037b27d922358" } new_table_name: "default.Table_7a89013a7c0743aca3abec84809337dd" modify_external_catalogs: true
I20260616 19:51:50.907771 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d2d12fbda8d1404e80407f7d41a6607d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:50.908233 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2ab0cf99b6014917bcbbecd656555ecd" } modify_external_catalogs: true
I20260616 19:51:50.908490 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2ab0cf99b6014917bcbbecd656555ecd" } modify_external_catalogs: true
W20260616 19:51:50.909077 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8e2ac5db03f4278b341d01a58441100 consensus state has no leader
I20260616 19:51:50.909305 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3b3dce47cfdc420eba859affc6ad8f5f" } modify_external_catalogs: true
I20260616 19:51:50.909446 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f10ac61e4fa442ee98b5c4d07dae39b3" } modify_external_catalogs: true
I20260616 19:51:50.909473 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3b3dce47cfdc420eba859affc6ad8f5f" } modify_external_catalogs: true
I20260616 19:51:50.909658 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f10ac61e4fa442ee98b5c4d07dae39b3" } modify_external_catalogs: true
W20260616 19:51:50.908505 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2d12fbda8d1404e80407f7d41a6607d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:50.910565 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 consensus state has no leader
I20260616 19:51:50.914045 1198 tablet_bootstrap.cc:492] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:50.915567 1196 tablet_bootstrap.cc:492] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:50.915899 1196 ts_tablet_manager.cc:1403] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.044s user 0.008s sys 0.002s
I20260616 19:51:50.920894 1192 tablet_bootstrap.cc:492] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:50.921129 1192 ts_tablet_manager.cc:1403] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.097s user 0.026s sys 0.056s
I20260616 19:51:50.921859 1192 raft_consensus.cc:359] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:50.922161 1192 raft_consensus.cc:385] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:50.922272 1192 raft_consensus.cc:740] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:50.922572 1192 consensus_queue.cc:260] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:50.925833 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5c46e26441ec423090e08d2e315b9eb1" } modify_external_catalogs: true
I20260616 19:51:50.926051 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5c46e26441ec423090e08d2e315b9eb1" } modify_external_catalogs: true
I20260616 19:51:50.926687 1198 tablet_bootstrap.cc:654] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:50.927332 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ae4095e00e384ff7b71ca9f98ef00fca" } new_table_name: "default.Table_836a3f95e80c4694b0f23dc42274d582" modify_external_catalogs: true
I20260616 19:51:50.926997 1196 raft_consensus.cc:359] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:50.927563 1196 raft_consensus.cc:385] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:50.927695 1196 raft_consensus.cc:740] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:50.928066 1198 log.cc:826] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: Log is configured to *not* fsync() on all Append() calls
I20260616 19:51:50.928833 1192 ts_tablet_manager.cc:1434] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260616 19:51:50.929279 1196 consensus_queue.cc:260] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:50.930640 1192 tablet_bootstrap.cc:492] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:50.933213 1192 tablet_bootstrap.cc:654] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:50.938112 1198 tablet_bootstrap.cc:492] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:50.938436 1192 tablet_bootstrap.cc:492] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:50.938486 1198 ts_tablet_manager.cc:1403] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.004s
I20260616 19:51:50.938608 1192 ts_tablet_manager.cc:1403] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.002s
I20260616 19:51:50.939493 1192 raft_consensus.cc:359] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:50.939687 1192 raft_consensus.cc:385] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:50.939790 1192 raft_consensus.cc:740] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:50.940099 1192 consensus_queue.cc:260] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:50.940622 1192 ts_tablet_manager.cc:1434] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:50.940934 1192 tablet_bootstrap.cc:492] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:50.942781 1192 tablet_bootstrap.cc:654] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:50.951223 1198 raft_consensus.cc:359] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:50.951902 1198 raft_consensus.cc:385] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:50.952107 1198 raft_consensus.cc:740] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:50.956352 1198 consensus_queue.cc:260] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:51:50.971596 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1369a97caf7246479b1a12ac38674eed consensus state has no leader
I20260616 19:51:50.972223 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_43112c4d7050453dad8984408f75baf3" } modify_external_catalogs: true
I20260616 19:51:50.972504 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_43112c4d7050453dad8984408f75baf3" } modify_external_catalogs: true
W20260616 19:51:50.976133 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61c66c72987941428a449601683fba68 consensus state has no leader
I20260616 19:51:50.977800 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd2cd6063dc430e89188ed00e76a760 (DEFAULT_TABLE table=default.Table_3b3dce47cfdc420eba859affc6ad8f5f [id=02b198713aff4f2c967d63e708d57699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.978358 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd2cd6063dc430e89188ed00e76a760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.979737 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 52c1eff6222046bfa1b19720a558068d with delete_type TABLET_DATA_DELETED (replaced by tablet 1369a97caf7246479b1a12ac38674eed) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:50.980150 1190 tablet_replica.cc:333] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:50.980438 1190 raft_consensus.cc:2243] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:50.980685 1190 raft_consensus.cc:2272] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:50.980751 452 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet c625de6905b84c3aa0b447621b5ce4ce
I20260616 19:51:50.981760 1190 ts_tablet_manager.cc:1916] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:50.984997 904 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd2cd6063dc430e89188ed00e76a760 (DEFAULT_TABLE table=default.Table_3b3dce47cfdc420eba859affc6ad8f5f [id=02b198713aff4f2c967d63e708d57699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:50.985782 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd2cd6063dc430e89188ed00e76a760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:50.995884 1190 ts_tablet_manager.cc:1929] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260616 19:51:51.006086 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b657c023023d4070b3dfb16da1b35181 has no consensus state
I20260616 19:51:51.002339 1195 raft_consensus.cc:493] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:51.006536 1195 raft_consensus.cc:515] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.007279 765 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd2cd6063dc430e89188ed00e76a760 (DEFAULT_TABLE table=default.Table_3b3dce47cfdc420eba859affc6ad8f5f [id=02b198713aff4f2c967d63e708d57699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.007754 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd2cd6063dc430e89188ed00e76a760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.008749 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 61c66c72987941428a449601683fba68 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.009176 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 61c66c72987941428a449601683fba68 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.010095 459 master_service.cc:960] ReplaceTablet: received request to replace tablet 52c1eff6222046bfa1b19720a558068d from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.010891 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 61c66c72987941428a449601683fba68 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.011902 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 08330a8219574829834e36523ec6408e from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.015671 1195 leader_election.cc:290] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:51.027642 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61c66c72987941428a449601683fba68" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:51.028138 785 raft_consensus.cc:2468] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:51.029032 860 leader_election.cc:304] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:51.029660 1195 raft_consensus.cc:2804] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:51.029935 1195 raft_consensus.cc:493] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:51.030171 1195 raft_consensus.cc:3060] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:51.035503 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasknFdngH/build/asan/bin/kudu
/tmp/dist-test-tasknFdngH/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:34219
--webserver_interface=127.0.105.188
--webserver_port=35247
--builtin_ntp_servers=127.0.105.148:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260616 19:51:51.048548 1195 raft_consensus.cc:515] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.054705 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c50bd97ac24a49f3a5b56d4f5731d562"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.055594 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c50bd97ac24a49f3a5b56d4f5731d562 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.079870 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1
I20260616 19:51:51.082547 1034 tablet_service.cc:1511] Processing CreateTablet for tablet c789abf00da24981be5bb72c0b5752d1 (DEFAULT_TABLE table=default.Table_c654445815a9494491a390790185534e [id=2158cc9d64824b9b8836ff772169d936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.083194 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c789abf00da24981be5bb72c0b5752d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.085469 763 tablet_service.cc:1511] Processing CreateTablet for tablet 302997d0e3b247ebaceec9151f580c3a (DEFAULT_TABLE table=default.Table_d885b36210f04c1b9e68247e2ae26734 [id=a67f3f850e8e4696ba2c178ad1de8360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.085889 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302997d0e3b247ebaceec9151f580c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.086194 765 tablet_service.cc:1511] Processing CreateTablet for tablet c789abf00da24981be5bb72c0b5752d1 (DEFAULT_TABLE table=default.Table_c654445815a9494491a390790185534e [id=2158cc9d64824b9b8836ff772169d936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.086671 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c789abf00da24981be5bb72c0b5752d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.088317 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61c66c72987941428a449601683fba68" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:51.088577 785 raft_consensus.cc:3060] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:51.088645 756 tablet_service.cc:1558] Processing DeleteTablet for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.089020 760 tablet_service.cc:1511] Processing CreateTablet for tablet a6dd15b09ec246ee90bdc73fd93f862a (DEFAULT_TABLE table=default.Table_21a0653003a3493e952199c335c04c55 [id=d8ed14afa8ef43db8e963aab86921ed6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.089392 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6dd15b09ec246ee90bdc73fd93f862a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.090459 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.090927 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 302997d0e3b247ebaceec9151f580c3a (DEFAULT_TABLE table=default.Table_d885b36210f04c1b9e68247e2ae26734 [id=a67f3f850e8e4696ba2c178ad1de8360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.091293 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302997d0e3b247ebaceec9151f580c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.091907 785 raft_consensus.cc:2468] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:51.092370 898 tablet_service.cc:1558] Processing DeleteTablet for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.092579 860 leader_election.cc:304] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:51.092804 899 tablet_service.cc:1511] Processing CreateTablet for tablet c789abf00da24981be5bb72c0b5752d1 (DEFAULT_TABLE table=default.Table_c654445815a9494491a390790185534e [id=2158cc9d64824b9b8836ff772169d936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.093197 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c789abf00da24981be5bb72c0b5752d1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:51.093381 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 already in progress: creating tablet
I20260616 19:51:51.096801 1036 tablet_service.cc:1511] Processing CreateTablet for tablet a6dd15b09ec246ee90bdc73fd93f862a (DEFAULT_TABLE table=default.Table_21a0653003a3493e952199c335c04c55 [id=d8ed14afa8ef43db8e963aab86921ed6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.097196 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6dd15b09ec246ee90bdc73fd93f862a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.084151 1190 log.cc:1199] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/52c1eff6222046bfa1b19720a558068d
I20260616 19:51:51.101143 903 tablet_service.cc:1511] Processing CreateTablet for tablet 302997d0e3b247ebaceec9151f580c3a (DEFAULT_TABLE table=default.Table_d885b36210f04c1b9e68247e2ae26734 [id=a67f3f850e8e4696ba2c178ad1de8360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.101423 1190 ts_tablet_manager.cc:1950] T 52c1eff6222046bfa1b19720a558068d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:51.101562 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302997d0e3b247ebaceec9151f580c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.102269 1211 raft_consensus.cc:2804] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:51.102547 1190 tablet_replica.cc:333] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:51.102754 1190 raft_consensus.cc:2243] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.102967 1190 raft_consensus.cc:2272] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:51.103231 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 already in progress: creating tablet
I20260616 19:51:51.106842 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 52c1eff6222046bfa1b19720a558068d (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]) successfully deleted
I20260616 19:51:51.106948 1037 tablet_service.cc:1511] Processing CreateTablet for tablet b657c023023d4070b3dfb16da1b35181 (DEFAULT_TABLE table=default.Table_836a3f95e80c4694b0f23dc42274d582 [id=b92002b768ab4133b08391019758714a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.107335 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b657c023023d4070b3dfb16da1b35181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.107740 763 tablet_service.cc:1511] Processing CreateTablet for tablet b657c023023d4070b3dfb16da1b35181 (DEFAULT_TABLE table=default.Table_836a3f95e80c4694b0f23dc42274d582 [id=b92002b768ab4133b08391019758714a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.108160 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b657c023023d4070b3dfb16da1b35181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.108454 898 tablet_service.cc:1511] Processing CreateTablet for tablet b657c023023d4070b3dfb16da1b35181 (DEFAULT_TABLE table=default.Table_836a3f95e80c4694b0f23dc42274d582 [id=b92002b768ab4133b08391019758714a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.108978 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b657c023023d4070b3dfb16da1b35181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.110306 760 tablet_service.cc:1511] Processing CreateTablet for tablet 63a2448644894be186e2ab62f3d662be (DEFAULT_TABLE table=default.Table_6d6c3518a8c24d2a8e9b450d7058b3ce [id=122f88b500c0425e833926b349605d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.110698 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a2448644894be186e2ab62f3d662be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.110993 902 tablet_service.cc:1511] Processing CreateTablet for tablet 63a2448644894be186e2ab62f3d662be (DEFAULT_TABLE table=default.Table_6d6c3518a8c24d2a8e9b450d7058b3ce [id=122f88b500c0425e833926b349605d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.111332 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a2448644894be186e2ab62f3d662be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.112813 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 63a2448644894be186e2ab62f3d662be (DEFAULT_TABLE table=default.Table_6d6c3518a8c24d2a8e9b450d7058b3ce [id=122f88b500c0425e833926b349605d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.113204 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a2448644894be186e2ab62f3d662be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.121918 1195 leader_election.cc:290] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:51.122661 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6a9c2eded2954f7282a8fa6d68278896"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.123454 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a9c2eded2954f7282a8fa6d68278896 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.124881 1190 ts_tablet_manager.cc:1916] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.125140 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6d6c3518a8c24d2a8e9b450d7058b3ce" } new_table_name: "default.Table_fe6074841b0642f99392ef14431b9c15" modify_external_catalogs: true
I20260616 19:51:51.125469 904 tablet_service.cc:1511] Processing CreateTablet for tablet a6dd15b09ec246ee90bdc73fd93f862a (DEFAULT_TABLE table=default.Table_21a0653003a3493e952199c335c04c55 [id=d8ed14afa8ef43db8e963aab86921ed6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.125871 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6dd15b09ec246ee90bdc73fd93f862a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.126783 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0ed7b3aa00c145f49e22f9cbc892bc0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.127389 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ed7b3aa00c145f49e22f9cbc892bc0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.128835 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d885b36210f04c1b9e68247e2ae26734" } new_table_name: "default.Table_fca913263b4846dea884088bbe9d2529" modify_external_catalogs: true
I20260616 19:51:51.131575 1190 ts_tablet_manager.cc:1929] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.131695 1190 log.cc:1199] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/a4c8528b6f3b4a3a99dae8eb4f7e8bf1
I20260616 19:51:51.132069 1190 ts_tablet_manager.cc:1950] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:51.137298 1211 raft_consensus.cc:697] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:51:51.137832 1211 consensus_queue.cc:237] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.140882 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 (table default.Table_43112c4d7050453dad8984408f75baf3 [id=5fcb69f72f9a4146a022e60757c42e09]) successfully deleted
I20260616 19:51:51.144582 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 5fd2cd6063dc430e89188ed00e76a760
I20260616 19:51:51.145577 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6e469684e5b844a5b7f13a1047fd933a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:51.146055 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fd2cd6063dc430e89188ed00e76a760 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:51.146325 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e469684e5b844a5b7f13a1047fd933a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:51.146950 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 5fd2cd6063dc430e89188ed00e76a760 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fd2cd6063dc430e89188ed00e76a760 already in progress: creating tablet
I20260616 19:51:51.148515 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fd2cd6063dc430e89188ed00e76a760 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.148860 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2df7d27b41b440c5b082e8783adfeced
I20260616 19:51:51.149387 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fd2cd6063dc430e89188ed00e76a760 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.149708 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bbce6eb152884f1ead7ffb2b0acfbfa7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:51.150211 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 2df7d27b41b440c5b082e8783adfeced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:51.150364 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbce6eb152884f1ead7ffb2b0acfbfa7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:51.150980 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2df7d27b41b440c5b082e8783adfeced because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df7d27b41b440c5b082e8783adfeced already in progress: creating tablet
W20260616 19:51:51.151873 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 5fd2cd6063dc430e89188ed00e76a760 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fd2cd6063dc430e89188ed00e76a760 already in progress: creating tablet
I20260616 19:51:51.152488 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 2df7d27b41b440c5b082e8783adfeced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:51.152724 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 5fd2cd6063dc430e89188ed00e76a760 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fd2cd6063dc430e89188ed00e76a760 already in progress: creating tablet
I20260616 19:51:51.153005 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 2df7d27b41b440c5b082e8783adfeced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:51.153128 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 2df7d27b41b440c5b082e8783adfeced because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df7d27b41b440c5b082e8783adfeced already in progress: creating tablet
W20260616 19:51:51.153738 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2df7d27b41b440c5b082e8783adfeced because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df7d27b41b440c5b082e8783adfeced already in progress: creating tablet
I20260616 19:51:51.161240 1034 tablet_service.cc:1511] Processing CreateTablet for tablet fe2ac7d4df6a48d6a93d40c7eef38c9c (DEFAULT_TABLE table=default.Table_ec5cab88a5f44540b0d789bd2543b79a [id=1e3bc78bafc8405c8e57142c8236aef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.161888 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2ac7d4df6a48d6a93d40c7eef38c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.175030 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61c66c72987941428a449601683fba68" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:51.175616 1196 ts_tablet_manager.cc:1434] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.260s user 0.063s sys 0.128s
I20260616 19:51:51.176731 765 tablet_service.cc:1511] Processing CreateTablet for tablet fe2ac7d4df6a48d6a93d40c7eef38c9c (DEFAULT_TABLE table=default.Table_ec5cab88a5f44540b0d789bd2543b79a [id=1e3bc78bafc8405c8e57142c8236aef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.177166 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2ac7d4df6a48d6a93d40c7eef38c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.177189 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 96913044d566481e8a22d3dec765cdf2
I20260616 19:51:51.177943 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 96913044d566481e8a22d3dec765cdf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.178846 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 61c66c72987941428a449601683fba68
I20260616 19:51:51.179363 453 catalog_manager.cc:6784] ReplaceTablet: tablet 61c66c72987941428a449601683fba68 deleted and replaced by tablet 383589f0e211418bbdf5046ed90db410
I20260616 19:51:51.179314 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ae8591a97fd047dba2de2cdf593b8c17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:51.179633 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6db02b65da9f42279f9442335b438b91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.179878 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae8591a97fd047dba2de2cdf593b8c17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:51.180155 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6db02b65da9f42279f9442335b438b91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.180326 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61c66c72987941428a449601683fba68" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:51:51.181206 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 96913044d566481e8a22d3dec765cdf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.181483 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_da0f5ea5650e41c096177b0280640e72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.181929 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da0f5ea5650e41c096177b0280640e72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:51.182977 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 96913044d566481e8a22d3dec765cdf2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96913044d566481e8a22d3dec765cdf2 already in progress: creating tablet
I20260616 19:51:51.183195 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 61c66c72987941428a449601683fba68 with delete_type TABLET_DATA_DELETED (replaced by tablet 383589f0e211418bbdf5046ed90db410) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.183475 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 96913044d566481e8a22d3dec765cdf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:51.183854 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 61c66c72987941428a449601683fba68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61c66c72987941428a449601683fba68 already in progress: creating tablet
W20260616 19:51:51.183980 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 96913044d566481e8a22d3dec765cdf2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96913044d566481e8a22d3dec765cdf2 already in progress: creating tablet
W20260616 19:51:51.185127 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 96913044d566481e8a22d3dec765cdf2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96913044d566481e8a22d3dec765cdf2 already in progress: creating tablet
I20260616 19:51:51.185117 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 61c66c72987941428a449601683fba68 with delete_type TABLET_DATA_DELETED (replaced by tablet 383589f0e211418bbdf5046ed90db410) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.185353 1190 tablet_replica.cc:333] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:51.185535 1190 raft_consensus.cc:2243] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:51.185702 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 61c66c72987941428a449601683fba68 with delete_type TABLET_DATA_DELETED (replaced by tablet 383589f0e211418bbdf5046ed90db410) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.186012 1190 pending_rounds.cc:70] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:51:51.186064 1193 tablet_replica.cc:333] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:51.186209 1190 pending_rounds.cc:77] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595437625745408 op_type: NO_OP noop_request { }
I20260616 19:51:51.186371 1190 raft_consensus.cc:2889] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:51.186509 1190 raft_consensus.cc:2272] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.186522 1193 raft_consensus.cc:2243] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.186887 1193 raft_consensus.cc:2272] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:51.186951 858 leader_election.cc:343] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:51.187531 1190 ts_tablet_manager.cc:1916] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:51:51.187556 858 leader_election.cc:343] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:51.188781 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ed170d4e035643bbbf55255b5552d47d" } new_table_name: "default.Table_66491a1a28a6487194eaf8e06bd30094" modify_external_catalogs: true
I20260616 19:51:51.189730 904 tablet_service.cc:1511] Processing CreateTablet for tablet fe2ac7d4df6a48d6a93d40c7eef38c9c (DEFAULT_TABLE table=default.Table_ec5cab88a5f44540b0d789bd2543b79a [id=1e3bc78bafc8405c8e57142c8236aef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.190830 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2ac7d4df6a48d6a93d40c7eef38c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.191599 1192 tablet_bootstrap.cc:492] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:51.191828 1192 ts_tablet_manager.cc:1403] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.251s user 0.056s sys 0.122s
I20260616 19:51:51.192827 1192 raft_consensus.cc:359] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.193150 1192 raft_consensus.cc:385] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.193274 1192 raft_consensus.cc:740] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.193606 1192 consensus_queue.cc:260] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.194147 1190 ts_tablet_manager.cc:1929] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:51.194286 1190 log.cc:1199] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/61c66c72987941428a449601683fba68
I20260616 19:51:51.194734 1190 ts_tablet_manager.cc:1950] T 61c66c72987941428a449601683fba68 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:51.196022 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 61c66c72987941428a449601683fba68 (table default.Table_7a89013a7c0743aca3abec84809337dd [id=e75a6e5e4f0047d9b398ce230b170131]) successfully deleted
I20260616 19:51:51.194180 1192 ts_tablet_manager.cc:1434] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:51:51.197969 1192 tablet_bootstrap.cc:492] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:51.198869 831 heartbeater.cc:499] Master 127.0.105.190:35857 was elected leader, sending a full tablet report...
I20260616 19:51:51.199802 1192 tablet_bootstrap.cc:654] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.203255 1193 ts_tablet_manager.cc:1916] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.211880 1198 ts_tablet_manager.cc:1434] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.273s user 0.035s sys 0.024s
I20260616 19:51:51.220777 1193 ts_tablet_manager.cc:1929] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.221001 1193 log.cc:1199] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/61c66c72987941428a449601683fba68
I20260616 19:51:51.221539 1193 ts_tablet_manager.cc:1950] T 61c66c72987941428a449601683fba68 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:51.222360 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 61c66c72987941428a449601683fba68 (table default.Table_7a89013a7c0743aca3abec84809337dd [id=e75a6e5e4f0047d9b398ce230b170131]) successfully deleted
I20260616 19:51:51.223882 1106 heartbeater.cc:499] Master 127.0.105.190:35857 was elected leader, sending a full tablet report...
I20260616 19:51:51.224774 1196 tablet_bootstrap.cc:492] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:51.224838 1198 tablet_bootstrap.cc:492] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:51.226543 1196 tablet_bootstrap.cc:654] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.226588 1198 tablet_bootstrap.cc:654] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.227834 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 2124e4b923ba439893788bb7350cdae9 with delete_type TABLET_DATA_DELETED (replaced by tablet a8e2ac5db03f4278b341d01a58441100) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.228188 1190 tablet_replica.cc:333] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:51.228448 1190 raft_consensus.cc:2243] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.228715 1190 raft_consensus.cc:2272] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.229637 1190 ts_tablet_manager.cc:1916] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.230455 1198 tablet_bootstrap.cc:492] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:51.230660 1198 ts_tablet_manager.cc:1403] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20260616 19:51:51.231894 1198 raft_consensus.cc:359] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.232193 1198 raft_consensus.cc:385] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.232336 1198 raft_consensus.cc:740] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.232626 1198 consensus_queue.cc:260] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.233215 1198 ts_tablet_manager.cc:1434] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:51.233584 1198 tablet_bootstrap.cc:492] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:51.235494 1198 tablet_bootstrap.cc:654] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.241070 1190 ts_tablet_manager.cc:1929] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.241276 1190 log.cc:1199] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/2124e4b923ba439893788bb7350cdae9
I20260616 19:51:51.241719 1190 ts_tablet_manager.cc:1950] T 2124e4b923ba439893788bb7350cdae9 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:51.243534 1198 tablet_bootstrap.cc:492] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:51.243906 1198 ts_tablet_manager.cc:1403] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260616 19:51:51.244874 1198 raft_consensus.cc:359] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.245139 1198 raft_consensus.cc:385] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.245268 1198 raft_consensus.cc:740] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.245600 1198 consensus_queue.cc:260] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.246253 1198 ts_tablet_manager.cc:1434] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:51.246568 1198 tablet_bootstrap.cc:492] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:51.248344 1198 tablet_bootstrap.cc:654] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.251497 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 2124e4b923ba439893788bb7350cdae9 (table default.Table_4a48e35891a940babfcf8b6d6add8062 [id=48ebc382fbde40f8a05ccb60001efe00]) successfully deleted
I20260616 19:51:51.258303 1196 tablet_bootstrap.cc:492] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:51.258399 1192 tablet_bootstrap.cc:492] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:51.258466 1196 ts_tablet_manager.cc:1403] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.034s user 0.015s sys 0.004s
I20260616 19:51:51.258651 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d2d12fbda8d1404e80407f7d41a6607d" } new_table_name: "default.Table_706eec36e3ea4af0ae45a2d1207ac09b" modify_external_catalogs: true
I20260616 19:51:51.258723 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8e9484dea8b04f599db7ea8a9019cff9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:51.258827 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7a89013a7c0743aca3abec84809337dd" } new_table_name: "default.Table_7cd14c1ea1ae4a9099fc559a154ac754" modify_external_catalogs: true
W20260616 19:51:51.259271 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e9484dea8b04f599db7ea8a9019cff9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.259305 1196 raft_consensus.cc:359] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.259483 1196 raft_consensus.cc:385] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.259584 1196 raft_consensus.cc:740] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.259855 1196 consensus_queue.cc:260] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.260175 1208 raft_consensus.cc:493] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:51.260382 1208 raft_consensus.cc:515] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.261085 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8e9779ca629145e5a02fa8f315397264"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.261533 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e9779ca629145e5a02fa8f315397264 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.262369 1208 leader_election.cc:290] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:51.263118 1196 ts_tablet_manager.cc:1434] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:51:51.263139 1198 tablet_bootstrap.cc:492] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
W20260616 19:51:51.263206 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf89adf3cbe54beab939645f7ebbb616 has no consensus state
I20260616 19:51:51.263392 1198 ts_tablet_manager.cc:1403] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.004s
I20260616 19:51:51.263562 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_836a3f95e80c4694b0f23dc42274d582" } modify_external_catalogs: true
I20260616 19:51:51.263727 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_836a3f95e80c4694b0f23dc42274d582" } modify_external_catalogs: true
I20260616 19:51:51.264495 1198 raft_consensus.cc:359] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.264734 1198 raft_consensus.cc:385] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.265534 1198 raft_consensus.cc:740] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.265866 1196 tablet_bootstrap.cc:492] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:51.265820 1198 consensus_queue.cc:260] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.267906 1196 tablet_bootstrap.cc:654] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.268229 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 2124e4b923ba439893788bb7350cdae9 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.268946 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_aae711c3f7864a7e8c54875a5682ebf8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.269549 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aae711c3f7864a7e8c54875a5682ebf8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.264210 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 2124e4b923ba439893788bb7350cdae9 with delete_type TABLET_DATA_DELETED (replaced by tablet a8e2ac5db03f4278b341d01a58441100) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.258548 1192 ts_tablet_manager.cc:1403] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.061s user 0.013s sys 0.033s
W20260616 19:51:51.273406 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 2124e4b923ba439893788bb7350cdae9 because the tablet was not found. No further retry: Not found: Tablet not found: 2124e4b923ba439893788bb7350cdae9
I20260616 19:51:51.274051 1192 raft_consensus.cc:359] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:51.274386 1192 raft_consensus.cc:385] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.274515 1192 raft_consensus.cc:740] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.275210 1198 ts_tablet_manager.cc:1434] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260616 19:51:51.276293 1192 consensus_queue.cc:260] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:51.278080 1196 tablet_bootstrap.cc:492] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:51.278245 1196 ts_tablet_manager.cc:1403] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.001s
I20260616 19:51:51.278537 1198 tablet_bootstrap.cc:492] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:51.279196 1196 raft_consensus.cc:359] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.279410 1196 raft_consensus.cc:385] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.279500 1196 raft_consensus.cc:740] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.279736 1196 consensus_queue.cc:260] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.280686 1192 ts_tablet_manager.cc:1434] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260616 19:51:51.282845 1192 tablet_bootstrap.cc:492] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:51.283690 1198 tablet_bootstrap.cc:654] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.284298 1196 ts_tablet_manager.cc:1434] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:51:51.285979 1192 tablet_bootstrap.cc:654] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.287240 1196 tablet_bootstrap.cc:492] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:51.289121 1196 tablet_bootstrap.cc:654] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.290546 765 tablet_service.cc:1511] Processing CreateTablet for tablet 2808592f581e4605a814a2658401dfed (DEFAULT_TABLE table=default.Table_c50bd97ac24a49f3a5b56d4f5731d562 [id=4e76c4bf11684b8094f076e37bb2be48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.290786 904 tablet_service.cc:1511] Processing CreateTablet for tablet 2808592f581e4605a814a2658401dfed (DEFAULT_TABLE table=default.Table_c50bd97ac24a49f3a5b56d4f5731d562 [id=4e76c4bf11684b8094f076e37bb2be48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.290958 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2808592f581e4605a814a2658401dfed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.291181 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2808592f581e4605a814a2658401dfed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.292047 763 tablet_service.cc:1511] Processing CreateTablet for tablet cf89adf3cbe54beab939645f7ebbb616 (DEFAULT_TABLE table=default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.292452 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf89adf3cbe54beab939645f7ebbb616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.296779 760 tablet_service.cc:1511] Processing CreateTablet for tablet 383589f0e211418bbdf5046ed90db410 (DEFAULT_TABLE table=default.Table_7a89013a7c0743aca3abec84809337dd [id=e75a6e5e4f0047d9b398ce230b170131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.297186 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383589f0e211418bbdf5046ed90db410. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:51.298100 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 51fa9bd399d54a86875db081081a8814 consensus state has no leader
I20260616 19:51:51.299999 901 tablet_service.cc:1511] Processing CreateTablet for tablet cf89adf3cbe54beab939645f7ebbb616 (DEFAULT_TABLE table=default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.300387 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf89adf3cbe54beab939645f7ebbb616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.304740 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2808592f581e4605a814a2658401dfed (DEFAULT_TABLE table=default.Table_c50bd97ac24a49f3a5b56d4f5731d562 [id=4e76c4bf11684b8094f076e37bb2be48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.304924 898 tablet_service.cc:1511] Processing CreateTablet for tablet 383589f0e211418bbdf5046ed90db410 (DEFAULT_TABLE table=default.Table_7a89013a7c0743aca3abec84809337dd [id=e75a6e5e4f0047d9b398ce230b170131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.305392 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2808592f581e4605a814a2658401dfed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.305439 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383589f0e211418bbdf5046ed90db410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.306161 903 tablet_service.cc:1511] Processing CreateTablet for tablet 51fa9bd399d54a86875db081081a8814 (DEFAULT_TABLE table=default.Table_706eec36e3ea4af0ae45a2d1207ac09b [id=dadf8402246843219b213be49e8ad54b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.306553 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fa9bd399d54a86875db081081a8814. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:51.309053 1108 tablet.cc:2406] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260616 19:51:51.309643 1037 tablet_service.cc:1511] Processing CreateTablet for tablet cf89adf3cbe54beab939645f7ebbb616 (DEFAULT_TABLE table=default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.310029 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf89adf3cbe54beab939645f7ebbb616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.313012 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 383589f0e211418bbdf5046ed90db410 (DEFAULT_TABLE table=default.Table_7a89013a7c0743aca3abec84809337dd [id=e75a6e5e4f0047d9b398ce230b170131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.313335 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383589f0e211418bbdf5046ed90db410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.317062 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 51fa9bd399d54a86875db081081a8814 (DEFAULT_TABLE table=default.Table_706eec36e3ea4af0ae45a2d1207ac09b [id=dadf8402246843219b213be49e8ad54b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.317414 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fa9bd399d54a86875db081081a8814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.321137 756 tablet_service.cc:1511] Processing CreateTablet for tablet 51fa9bd399d54a86875db081081a8814 (DEFAULT_TABLE table=default.Table_706eec36e3ea4af0ae45a2d1207ac09b [id=dadf8402246843219b213be49e8ad54b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.321508 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fa9bd399d54a86875db081081a8814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.328039 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96913044d566481e8a22d3dec765cdf2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:51.330629 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 63a2448644894be186e2ab62f3d662be from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.331894 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c50bd97ac24a49f3a5b56d4f5731d562" } modify_external_catalogs: true
I20260616 19:51:51.332073 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c50bd97ac24a49f3a5b56d4f5731d562" } modify_external_catalogs: true
I20260616 19:51:51.333343 1196 tablet_bootstrap.cc:492] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:51.333503 1196 ts_tablet_manager.cc:1403] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.046s user 0.007s sys 0.002s
I20260616 19:51:51.334378 1196 raft_consensus.cc:359] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.334576 1196 raft_consensus.cc:385] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.334684 1196 raft_consensus.cc:740] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.334964 1196 consensus_queue.cc:260] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.338792 454 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet a8e2ac5db03f4278b341d01a58441100 (table default.Table_4a48e35891a940babfcf8b6d6add8062 [id=48ebc382fbde40f8a05ccb60001efe00]). Expected version 1 got 0
I20260616 19:51:51.339125 454 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 1369a97caf7246479b1a12ac38674eed (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]). Expected version 2 got 0
I20260616 19:51:51.339385 1196 ts_tablet_manager.cc:1434] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260616 19:51:51.342209 456 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet a8e2ac5db03f4278b341d01a58441100 (table default.Table_4a48e35891a940babfcf8b6d6add8062 [id=48ebc382fbde40f8a05ccb60001efe00]). Expected version 1 got 0
W20260616 19:51:51.343408 996 leader_election.cc:343] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:51.344403 456 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 1369a97caf7246479b1a12ac38674eed (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]). Expected version 2 got 0
I20260616 19:51:51.345556 1196 tablet_bootstrap.cc:492] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:51:51.345670 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 63a2448644894be186e2ab62f3d662be consensus state has no leader
W20260616 19:51:51.346001 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 302997d0e3b247ebaceec9151f580c3a consensus state has no leader
I20260616 19:51:51.346294 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet b657c023023d4070b3dfb16da1b35181
I20260616 19:51:51.346387 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2808592f581e4605a814a2658401dfed
W20260616 19:51:51.346936 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 383589f0e211418bbdf5046ed90db410 consensus state has no leader
I20260616 19:51:51.347779 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 2808592f581e4605a814a2658401dfed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.348073 901 tablet_service.cc:1558] Processing DeleteTablet for tablet b657c023023d4070b3dfb16da1b35181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.350052 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 08330a8219574829834e36523ec6408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.350503 1190 tablet_replica.cc:333] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:51.350728 1190 raft_consensus.cc:2243] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.350940 1190 raft_consensus.cc:2272] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:51.351290 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 2808592f581e4605a814a2658401dfed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2808592f581e4605a814a2658401dfed already in progress: creating tablet
W20260616 19:51:51.351625 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet b657c023023d4070b3dfb16da1b35181 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b657c023023d4070b3dfb16da1b35181 already in progress: creating tablet
I20260616 19:51:51.352401 1190 ts_tablet_manager.cc:1916] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.354578 760 tablet_service.cc:1558] Processing DeleteTablet for tablet b657c023023d4070b3dfb16da1b35181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.354861 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 2808592f581e4605a814a2658401dfed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.355145 1196 tablet_bootstrap.cc:654] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:51.356027 833 tablet.cc:2406] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260616 19:51:51.356340 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_21a0653003a3493e952199c335c04c55" } modify_external_catalogs: true
I20260616 19:51:51.356395 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_da0f5ea5650e41c096177b0280640e72" } modify_external_catalogs: true
I20260616 19:51:51.356555 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_21a0653003a3493e952199c335c04c55" } modify_external_catalogs: true
I20260616 19:51:51.356617 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_da0f5ea5650e41c096177b0280640e72" } modify_external_catalogs: true
W20260616 19:51:51.358165 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet b657c023023d4070b3dfb16da1b35181 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b657c023023d4070b3dfb16da1b35181 already in progress: creating tablet
W20260616 19:51:51.358518 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2808592f581e4605a814a2658401dfed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2808592f581e4605a814a2658401dfed already in progress: creating tablet
I20260616 19:51:51.359092 1190 ts_tablet_manager.cc:1929] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.359222 1190 log.cc:1199] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/08330a8219574829834e36523ec6408e
I20260616 19:51:51.359583 1190 ts_tablet_manager.cc:1950] T 08330a8219574829834e36523ec6408e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:51.360600 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 08330a8219574829834e36523ec6408e (table default.Table_1a3a46499a29471cbd3f312ef6f2c560 [id=f8770615f8d94929983c07bb73f3116f]) successfully deleted
I20260616 19:51:51.363368 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96913044d566481e8a22d3dec765cdf2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:51:51.364394 993 leader_election.cc:343] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:51.364594 993 leader_election.cc:304] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:51.365478 1208 raft_consensus.cc:2749] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:51.365743 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 63a2448644894be186e2ab62f3d662be
I20260616 19:51:51.366271 455 catalog_manager.cc:6784] ReplaceTablet: tablet 63a2448644894be186e2ab62f3d662be deleted and replaced by tablet ab33d99d857145dfbda54ff2f7464486
I20260616 19:51:51.366990 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a2448644894be186e2ab62f3d662be with delete_type TABLET_DATA_DELETED (replaced by tablet ab33d99d857145dfbda54ff2f7464486) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:51.367895 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 63a2448644894be186e2ab62f3d662be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63a2448644894be186e2ab62f3d662be already in progress: creating tablet
I20260616 19:51:51.368168 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a2448644894be186e2ab62f3d662be with delete_type TABLET_DATA_DELETED (replaced by tablet ab33d99d857145dfbda54ff2f7464486) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.368453 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet ec8b1cb4a9d34a798ec287782f1219ee with delete_type TABLET_DATA_DELETED (replaced by tablet 2df7d27b41b440c5b082e8783adfeced) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.368584 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 08330a8219574829834e36523ec6408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.368759 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 2df7d27b41b440c5b082e8783adfeced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.368922 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 52c1eff6222046bfa1b19720a558068d with delete_type TABLET_DATA_DELETED (replaced by tablet 1369a97caf7246479b1a12ac38674eed) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.369026 1191 tablet_replica.cc:333] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:51.369271 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fd2cd6063dc430e89188ed00e76a760 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.369513 1191 raft_consensus.cc:2243] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.369626 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 96913044d566481e8a22d3dec765cdf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.369938 1191 raft_consensus.cc:2272] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.370179 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a2448644894be186e2ab62f3d662be with delete_type TABLET_DATA_DELETED (replaced by tablet ab33d99d857145dfbda54ff2f7464486) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.370410 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.369961 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 61c66c72987941428a449601683fba68 with delete_type TABLET_DATA_DELETED (replaced by tablet 383589f0e211418bbdf5046ed90db410) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.370635 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 2808592f581e4605a814a2658401dfed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.370813 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 2124e4b923ba439893788bb7350cdae9 with delete_type TABLET_DATA_DELETED (replaced by tablet a8e2ac5db03f4278b341d01a58441100) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.371042 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet b657c023023d4070b3dfb16da1b35181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.371963 1191 ts_tablet_manager.cc:1916] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.379496 1198 tablet_bootstrap.cc:492] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:51.379693 1198 ts_tablet_manager.cc:1403] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.101s user 0.003s sys 0.001s
I20260616 19:51:51.382447 1205 raft_consensus.cc:493] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:51:51.382679 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 63a2448644894be186e2ab62f3d662be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63a2448644894be186e2ab62f3d662be already in progress: creating tablet
I20260616 19:51:51.382694 1205 raft_consensus.cc:515] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.383163 1198 raft_consensus.cc:359] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.383376 1198 raft_consensus.cc:385] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.383456 1198 raft_consensus.cc:740] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.383569 1191 ts_tablet_manager.cc:1929] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.383723 1191 log.cc:1199] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/ec8b1cb4a9d34a798ec287782f1219ee
I20260616 19:51:51.384248 1191 ts_tablet_manager.cc:1950] T ec8b1cb4a9d34a798ec287782f1219ee P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:51.385236 1205 leader_election.cc:290] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:51.385911 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet ec8b1cb4a9d34a798ec287782f1219ee (table default.Table_2ab0cf99b6014917bcbbecd656555ecd [id=249e27015542469da4f6d70df62e6008]) successfully deleted
I20260616 19:51:51.387936 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8e9484dea8b04f599db7ea8a9019cff9" } modify_external_catalogs: true
I20260616 19:51:51.388139 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8e9484dea8b04f599db7ea8a9019cff9" } modify_external_catalogs: true
I20260616 19:51:51.389706 453 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 78309da814514db6b976a6af96cbdb9c
I20260616 19:51:51.390986 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a6dd15b09ec246ee90bdc73fd93f862a
I20260616 19:51:51.391932 901 tablet_service.cc:1558] Processing DeleteTablet for tablet a6dd15b09ec246ee90bdc73fd93f862a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.392557 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 1369a97caf7246479b1a12ac38674eed from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.393033 765 tablet_service.cc:1558] Processing DeleteTablet for tablet a6dd15b09ec246ee90bdc73fd93f862a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:51.393049 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 08330a8219574829834e36523ec6408e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08330a8219574829834e36523ec6408e already in progress: creating tablet
W20260616 19:51:51.393286 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2df7d27b41b440c5b082e8783adfeced because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df7d27b41b440c5b082e8783adfeced already in progress: creating tablet
I20260616 19:51:51.393296 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet a6dd15b09ec246ee90bdc73fd93f862a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.393530 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet ec8b1cb4a9d34a798ec287782f1219ee with delete_type TABLET_DATA_DELETED (replaced by tablet 2df7d27b41b440c5b082e8783adfeced) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.393791 1191 tablet_replica.cc:333] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:51.394007 1191 raft_consensus.cc:2243] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.394202 1191 raft_consensus.cc:2272] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.394994 1191 ts_tablet_manager.cc:1916] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.397589 762 tablet_service.cc:1558] Processing DeleteTablet for tablet ec8b1cb4a9d34a798ec287782f1219ee with delete_type TABLET_DATA_DELETED (replaced by tablet 2df7d27b41b440c5b082e8783adfeced) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.397892 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fd2cd6063dc430e89188ed00e76a760 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.398159 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 08330a8219574829834e36523ec6408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.398398 763 tablet_service.cc:1558] Processing DeleteTablet for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.398663 759 tablet_service.cc:1558] Processing DeleteTablet for tablet b657c023023d4070b3dfb16da1b35181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.398859 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 2124e4b923ba439893788bb7350cdae9 with delete_type TABLET_DATA_DELETED (replaced by tablet a8e2ac5db03f4278b341d01a58441100) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.399045 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 2df7d27b41b440c5b082e8783adfeced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.399220 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 96913044d566481e8a22d3dec765cdf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.399423 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 52c1eff6222046bfa1b19720a558068d with delete_type TABLET_DATA_DELETED (replaced by tablet 1369a97caf7246479b1a12ac38674eed) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.399539 455 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 993c8fb82db04af2a2d47f0fde23422a
I20260616 19:51:51.399617 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 61c66c72987941428a449601683fba68 with delete_type TABLET_DATA_DELETED (replaced by tablet 383589f0e211418bbdf5046ed90db410) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.400628 1193 tablet_replica.cc:333] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:51.400888 1193 raft_consensus.cc:2243] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.401077 1193 raft_consensus.cc:2272] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:51.402715 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a6dd15b09ec246ee90bdc73fd93f862a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6dd15b09ec246ee90bdc73fd93f862a already in progress: creating tablet
I20260616 19:51:51.405267 1198 consensus_queue.cc:260] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.405987 1198 ts_tablet_manager.cc:1434] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260616 19:51:51.406368 1198 tablet_bootstrap.cc:492] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:51:51.407428 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a6dd15b09ec246ee90bdc73fd93f862a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6dd15b09ec246ee90bdc73fd93f862a already in progress: creating tablet
W20260616 19:51:51.407917 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet ec8b1cb4a9d34a798ec287782f1219ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec8b1cb4a9d34a798ec287782f1219ee already in progress: creating tablet
W20260616 19:51:51.408150 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 5fd2cd6063dc430e89188ed00e76a760 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fd2cd6063dc430e89188ed00e76a760 already in progress: creating tablet
W20260616 19:51:51.408367 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 08330a8219574829834e36523ec6408e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08330a8219574829834e36523ec6408e already in progress: creating tablet
I20260616 19:51:51.408597 455 master_service.cc:960] ReplaceTablet: received request to replace tablet a8e2ac5db03f4278b341d01a58441100 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.409976 1193 ts_tablet_manager.cc:1916] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.410324 454 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet a8e2ac5db03f4278b341d01a58441100 (table default.Table_4a48e35891a940babfcf8b6d6add8062 [id=48ebc382fbde40f8a05ccb60001efe00]). Expected version 1 got 0
I20260616 19:51:51.411448 901 tablet_service.cc:1511] Processing CreateTablet for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d (DEFAULT_TABLE table=default.Table_bbce6eb152884f1ead7ffb2b0acfbfa7 [id=d104c5ac8acc4a6f9ed7cc87879d661b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.411876 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.414916 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e2ac5db03f4278b341d01a58441100" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:51:51.415707 718 leader_election.cc:343] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:51:51.417371 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 already in progress: creating tablet
W20260616 19:51:51.417652 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet b657c023023d4070b3dfb16da1b35181 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b657c023023d4070b3dfb16da1b35181 already in progress: creating tablet
W20260616 19:51:51.417906 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2124e4b923ba439893788bb7350cdae9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2124e4b923ba439893788bb7350cdae9 already in progress: creating tablet
I20260616 19:51:51.418169 898 tablet_service.cc:1511] Processing CreateTablet for tablet 387ba2086bca4a15b388700044e3c45d (DEFAULT_TABLE table=default.Table_6e469684e5b844a5b7f13a1047fd933a [id=7d5a7b1d32b147a3a8b5426c661dda2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.418572 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387ba2086bca4a15b388700044e3c45d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:51.418164 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2df7d27b41b440c5b082e8783adfeced because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df7d27b41b440c5b082e8783adfeced already in progress: creating tablet
I20260616 19:51:51.419601 762 tablet_service.cc:1511] Processing CreateTablet for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d (DEFAULT_TABLE table=default.Table_bbce6eb152884f1ead7ffb2b0acfbfa7 [id=d104c5ac8acc4a6f9ed7cc87879d661b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.420092 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.420747 903 tablet_service.cc:1511] Processing CreateTablet for tablet fcfc9231ffeb487cb15ed2a3788730ba (DEFAULT_TABLE table=default.Table_6a9c2eded2954f7282a8fa6d68278896 [id=54246691d67e4a68a4a9d955919d998c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.421104 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcfc9231ffeb487cb15ed2a3788730ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.422428 1205 raft_consensus.cc:493] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:51.422614 1205 raft_consensus.cc:515] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.423254 1205 leader_election.cc:290] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:51.424113 765 tablet_service.cc:1511] Processing CreateTablet for tablet 387ba2086bca4a15b388700044e3c45d (DEFAULT_TABLE table=default.Table_6e469684e5b844a5b7f13a1047fd933a [id=7d5a7b1d32b147a3a8b5426c661dda2f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:51.424240 718 leader_election.cc:343] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: 52c1eff6222046bfa1b19720a558068d
I20260616 19:51:51.424526 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387ba2086bca4a15b388700044e3c45d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.424746 904 tablet_service.cc:1511] Processing CreateTablet for tablet 6d94eb734df94a309a7b171d907c81da (DEFAULT_TABLE table=default.Table_0ed7b3aa00c145f49e22f9cbc892bc0c [id=6067524c64a14af0976b29a9776de33b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.425107 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d94eb734df94a309a7b171d907c81da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.428721 902 tablet_service.cc:1511] Processing CreateTablet for tablet 154ca8a6bce84b4bab932e69ec7f1f8e (DEFAULT_TABLE table=default.Table_6db02b65da9f42279f9442335b438b91 [id=2c8430ecae1842458fb35770d90409f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.429049 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154ca8a6bce84b4bab932e69ec7f1f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.429188 757 tablet_service.cc:1511] Processing CreateTablet for tablet fcfc9231ffeb487cb15ed2a3788730ba (DEFAULT_TABLE table=default.Table_6a9c2eded2954f7282a8fa6d68278896 [id=54246691d67e4a68a4a9d955919d998c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.429622 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcfc9231ffeb487cb15ed2a3788730ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.432791 899 tablet_service.cc:1511] Processing CreateTablet for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd (DEFAULT_TABLE table=default.Table_ae8591a97fd047dba2de2cdf593b8c17 [id=a7db76f5ed24476baf504282f03ed0c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.433128 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.437472 761 tablet_service.cc:1511] Processing CreateTablet for tablet 6d94eb734df94a309a7b171d907c81da (DEFAULT_TABLE table=default.Table_0ed7b3aa00c145f49e22f9cbc892bc0c [id=6067524c64a14af0976b29a9776de33b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.437915 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d94eb734df94a309a7b171d907c81da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.441244 758 tablet_service.cc:1511] Processing CreateTablet for tablet 154ca8a6bce84b4bab932e69ec7f1f8e (DEFAULT_TABLE table=default.Table_6db02b65da9f42279f9442335b438b91 [id=2c8430ecae1842458fb35770d90409f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.441691 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154ca8a6bce84b4bab932e69ec7f1f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.445223 759 tablet_service.cc:1511] Processing CreateTablet for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd (DEFAULT_TABLE table=default.Table_ae8591a97fd047dba2de2cdf593b8c17 [id=a7db76f5ed24476baf504282f03ed0c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.445487 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1369a97caf7246479b1a12ac38674eed
I20260616 19:51:51.445679 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.446134 457 catalog_manager.cc:6784] ReplaceTablet: tablet 1369a97caf7246479b1a12ac38674eed deleted and replaced by tablet 54ceb5a01be24dfb9c08001d662a9ac4
I20260616 19:51:51.447225 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 1369a97caf7246479b1a12ac38674eed with delete_type TABLET_DATA_DELETED (replaced by tablet 54ceb5a01be24dfb9c08001d662a9ac4) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:51.447993 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 1369a97caf7246479b1a12ac38674eed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1369a97caf7246479b1a12ac38674eed already in progress: creating tablet
I20260616 19:51:51.453833 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a8e2ac5db03f4278b341d01a58441100
I20260616 19:51:51.454303 455 catalog_manager.cc:6784] ReplaceTablet: tablet a8e2ac5db03f4278b341d01a58441100 deleted and replaced by tablet a2b6158b31b34419aa3619f3ce8242b3
I20260616 19:51:51.455030 900 tablet_service.cc:1558] Processing DeleteTablet for tablet a8e2ac5db03f4278b341d01a58441100 with delete_type TABLET_DATA_DELETED (replaced by tablet a2b6158b31b34419aa3619f3ce8242b3) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:51.455760 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a8e2ac5db03f4278b341d01a58441100 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8e2ac5db03f4278b341d01a58441100 already in progress: creating tablet
I20260616 19:51:51.465240 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_73d451214e35437c85c4e33d7cfbd65f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:51.465709 455 master_service.cc:960] ReplaceTablet: received request to replace tablet cf89adf3cbe54beab939645f7ebbb616 from {username='slave'} at 127.0.0.1:41696
W20260616 19:51:51.465900 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73d451214e35437c85c4e33d7cfbd65f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.467259 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_fe763512a640490ebb25dca52b04788a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:51.467326 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2d821dc335024cba9f1635d15a76a3b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.467741 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe763512a640490ebb25dca52b04788a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:51.467942 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d821dc335024cba9f1635d15a76a3b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.468917 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0a8e8bad0ecf48ec9f2529ef83e5b3c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.469448 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a8e8bad0ecf48ec9f2529ef83e5b3c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.469822 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 1369a97caf7246479b1a12ac38674eed with delete_type TABLET_DATA_DELETED (replaced by tablet 54ceb5a01be24dfb9c08001d662a9ac4) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.470824 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5ad3a183f911465da5f24ce69f9d6256"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:51.471004 763 tablet_service.cc:1558] Processing DeleteTablet for tablet a8e2ac5db03f4278b341d01a58441100 with delete_type TABLET_DATA_DELETED (replaced by tablet a2b6158b31b34419aa3619f3ce8242b3) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:51.471302 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ad3a183f911465da5f24ce69f9d6256 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.473313 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f29c0729614141a183a4aa7787c0a612"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.473809 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f29c0729614141a183a4aa7787c0a612 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.481139 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_706eec36e3ea4af0ae45a2d1207ac09b" } new_table_name: "default.Table_325b56a356ab458faf0ff8db3223e304" modify_external_catalogs: true
I20260616 19:51:51.482920 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 387ba2086bca4a15b388700044e3c45d from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.482868 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9b1ad03c6fbd44778ac1413338735443"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.483372 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b1ad03c6fbd44778ac1413338735443 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.492219 1193 ts_tablet_manager.cc:1929] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.492424 1193 log.cc:1199] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/96913044d566481e8a22d3dec765cdf2
I20260616 19:51:51.492945 1193 ts_tablet_manager.cc:1950] T 96913044d566481e8a22d3dec765cdf2 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:51.496614 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d (DEFAULT_TABLE table=default.Table_bbce6eb152884f1ead7ffb2b0acfbfa7 [id=d104c5ac8acc4a6f9ed7cc87879d661b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.497035 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.497143 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 96913044d566481e8a22d3dec765cdf2 (table default.Table_f10ac61e4fa442ee98b5c4d07dae39b3 [id=7b8e6e89495c4b509590e87f3e542079]) successfully deleted
I20260616 19:51:51.497445 1193 tablet_replica.cc:333] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:51.497620 1193 raft_consensus.cc:2243] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.497777 1193 raft_consensus.cc:2272] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.500509 1192 tablet_bootstrap.cc:492] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:51.500726 1192 ts_tablet_manager.cc:1403] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.218s user 0.014s sys 0.043s
I20260616 19:51:51.501549 1192 raft_consensus.cc:359] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.501747 1192 raft_consensus.cc:385] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.501820 1192 raft_consensus.cc:740] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.502058 1192 consensus_queue.cc:260] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.502547 1192 ts_tablet_manager.cc:1434] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:51:51.502913 1192 tablet_bootstrap.cc:492] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:51.504846 1193 ts_tablet_manager.cc:1916] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.505903 1036 tablet_service.cc:1511] Processing CreateTablet for tablet fcfc9231ffeb487cb15ed2a3788730ba (DEFAULT_TABLE table=default.Table_6a9c2eded2954f7282a8fa6d68278896 [id=54246691d67e4a68a4a9d955919d998c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.506582 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 154ca8a6bce84b4bab932e69ec7f1f8e (DEFAULT_TABLE table=default.Table_6db02b65da9f42279f9442335b438b91 [id=2c8430ecae1842458fb35770d90409f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.507170 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd (DEFAULT_TABLE table=default.Table_ae8591a97fd047dba2de2cdf593b8c17 [id=a7db76f5ed24476baf504282f03ed0c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.507418 1196 tablet_bootstrap.cc:492] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:51.507552 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 1369a97caf7246479b1a12ac38674eed with delete_type TABLET_DATA_DELETED (replaced by tablet 54ceb5a01be24dfb9c08001d662a9ac4) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.507598 1196 ts_tablet_manager.cc:1403] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.162s user 0.029s sys 0.070s
I20260616 19:51:51.507793 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet a8e2ac5db03f4278b341d01a58441100 with delete_type TABLET_DATA_DELETED (replaced by tablet a2b6158b31b34419aa3619f3ce8242b3) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.508102 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 6d94eb734df94a309a7b171d907c81da (DEFAULT_TABLE table=default.Table_0ed7b3aa00c145f49e22f9cbc892bc0c [id=6067524c64a14af0976b29a9776de33b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.508481 1196 raft_consensus.cc:359] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.508728 1196 raft_consensus.cc:385] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.508821 1196 raft_consensus.cc:740] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.509099 1196 consensus_queue.cc:260] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.509888 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 387ba2086bca4a15b388700044e3c45d (DEFAULT_TABLE table=default.Table_6e469684e5b844a5b7f13a1047fd933a [id=7d5a7b1d32b147a3a8b5426c661dda2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.510764 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387ba2086bca4a15b388700044e3c45d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.512406 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcfc9231ffeb487cb15ed2a3788730ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.513131 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8e9779ca629145e5a02fa8f315397264" } new_table_name: "default.Table_e1afc98c2d9741a9a1b9196cec4c5390" modify_external_catalogs: true
I20260616 19:51:51.513806 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet cf89adf3cbe54beab939645f7ebbb616
I20260616 19:51:51.514308 455 catalog_manager.cc:6784] ReplaceTablet: tablet cf89adf3cbe54beab939645f7ebbb616 deleted and replaced by tablet c5657b6b56af4b8f8eff1fa18836df9b
I20260616 19:51:51.514603 1196 ts_tablet_manager.cc:1434] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260616 19:51:51.515115 1196 tablet_bootstrap.cc:492] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:51.517272 901 tablet_service.cc:1558] Processing DeleteTablet for tablet cf89adf3cbe54beab939645f7ebbb616 with delete_type TABLET_DATA_DELETED (replaced by tablet c5657b6b56af4b8f8eff1fa18836df9b) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.517549 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 96913044d566481e8a22d3dec765cdf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.518517 1196 tablet_bootstrap.cc:654] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.521664 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d94eb734df94a309a7b171d907c81da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.523196 765 tablet_service.cc:1558] Processing DeleteTablet for tablet cf89adf3cbe54beab939645f7ebbb616 with delete_type TABLET_DATA_DELETED (replaced by tablet c5657b6b56af4b8f8eff1fa18836df9b) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.523447 1190 tablet_replica.cc:333] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:51.523512 1192 tablet_bootstrap.cc:654] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:51.523873 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet cf89adf3cbe54beab939645f7ebbb616 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf89adf3cbe54beab939645f7ebbb616 already in progress: creating tablet
I20260616 19:51:51.523909 1190 raft_consensus.cc:2243] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.524235 1190 raft_consensus.cc:2272] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.526556 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154ca8a6bce84b4bab932e69ec7f1f8e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:51.526952 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 51fa9bd399d54a86875db081081a8814 consensus state has no leader
I20260616 19:51:51.527516 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet cf89adf3cbe54beab939645f7ebbb616 with delete_type TABLET_DATA_DELETED (replaced by tablet c5657b6b56af4b8f8eff1fa18836df9b) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.528755 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.530274 1196 tablet_bootstrap.cc:492] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:51.530433 1196 ts_tablet_manager.cc:1403] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.006s
I20260616 19:51:51.531167 1196 raft_consensus.cc:359] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.531363 1196 raft_consensus.cc:385] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.531456 1196 raft_consensus.cc:740] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.531693 1196 consensus_queue.cc:260] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.532758 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_baf21e2369ea4aa6aa6cbf2370be11b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:51.533037 1196 ts_tablet_manager.cc:1434] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:51:51.533327 1196 tablet_bootstrap.cc:492] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:51:51.533319 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_baf21e2369ea4aa6aa6cbf2370be11b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:51.534310 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91336c7847ea4739a0be7fdd9d199cca has no consensus state
I20260616 19:51:51.534920 1191 ts_tablet_manager.cc:1929] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.528409 1193 ts_tablet_manager.cc:1929] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.535506 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 387ba2086bca4a15b388700044e3c45d
I20260616 19:51:51.535661 1193 log.cc:1199] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/52c1eff6222046bfa1b19720a558068d
I20260616 19:51:51.536026 452 catalog_manager.cc:6784] ReplaceTablet: tablet 387ba2086bca4a15b388700044e3c45d deleted and replaced by tablet de0ea6ca79ff4ed09f63fc7bb98eaabd
I20260616 19:51:51.536712 1193 ts_tablet_manager.cc:1950] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:51.536877 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 387ba2086bca4a15b388700044e3c45d with delete_type TABLET_DATA_DELETED (replaced by tablet de0ea6ca79ff4ed09f63fc7bb98eaabd) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.537515 1193 tablet_replica.cc:333] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:51.537563 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 52c1eff6222046bfa1b19720a558068d (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]) successfully deleted
W20260616 19:51:51.537999 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 61c66c72987941428a449601683fba68 because the tablet was not found. No further retry: Not found: Tablet not found: 61c66c72987941428a449601683fba68
I20260616 19:51:51.537973 1196 tablet_bootstrap.cc:654] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.538559 1191 log.cc:1199] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/52c1eff6222046bfa1b19720a558068d
I20260616 19:51:51.538767 1193 raft_consensus.cc:2243] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.538952 1193 raft_consensus.cc:2272] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.539880 1191 ts_tablet_manager.cc:1950] T 52c1eff6222046bfa1b19720a558068d P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:51.541285 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1405b760086447f6b6ce471ca0c9b683"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.541833 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1405b760086447f6b6ce471ca0c9b683 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.543228 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_fc71d18f9d8540bf8012eb3491c6921d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.543685 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc71d18f9d8540bf8012eb3491c6921d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.546682 765 tablet_service.cc:1558] Processing DeleteTablet for tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.548086 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 52c1eff6222046bfa1b19720a558068d (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]) successfully deleted
I20260616 19:51:51.548600 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 387ba2086bca4a15b388700044e3c45d with delete_type TABLET_DATA_DELETED (replaced by tablet de0ea6ca79ff4ed09f63fc7bb98eaabd) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.552428 1208 raft_consensus.cc:493] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:51.552613 1208 raft_consensus.cc:515] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.554085 1208 leader_election.cc:290] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:51.554214 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fca913263b4846dea884088bbe9d2529" } modify_external_catalogs: true
I20260616 19:51:51.554332 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e2ac5db03f4278b341d01a58441100" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:51.554387 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fca913263b4846dea884088bbe9d2529" } modify_external_catalogs: true
I20260616 19:51:51.554912 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ae8591a97fd047dba2de2cdf593b8c17" } modify_external_catalogs: true
I20260616 19:51:51.555075 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ae8591a97fd047dba2de2cdf593b8c17" } modify_external_catalogs: true
I20260616 19:51:51.555588 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4a48e35891a940babfcf8b6d6add8062" } new_table_name: "default.Table_62044432f4a549d8846c6d9d17274c1a" modify_external_catalogs: true
I20260616 19:51:51.555817 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c8528b6f3b4a3a99dae8eb4f7e8bf1" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:51.556072 785 raft_consensus.cc:2468] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
W20260616 19:51:51.556694 719 leader_election.cc:343] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:51.556833 996 leader_election.cc:304] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:51:51.556833 719 leader_election.cc:304] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:51.557022 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_aae711c3f7864a7e8c54875a5682ebf8" } new_table_name: "default.Table_bc295d9b3a204384b0b59c474c04bd59" modify_external_catalogs: true
I20260616 19:51:51.557116 1208 raft_consensus.cc:2804] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:51.557217 1208 raft_consensus.cc:493] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:51.557305 1208 raft_consensus.cc:3060] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:51:51.557561 719 leader_election.cc:343] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 52c1eff6222046bfa1b19720a558068d
I20260616 19:51:51.557682 719 leader_election.cc:304] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:51:51.557888 719 raft_consensus.cc:2686] T 52c1eff6222046bfa1b19720a558068d P 7245e7dab0ec474a876537be514c8767: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:51:51.558308 1205 raft_consensus.cc:2749] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:51.559139 1193 ts_tablet_manager.cc:1916] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.561789 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0a8e8bad0ecf48ec9f2529ef83e5b3c8" } new_table_name: "default.Table_2bcad1cc946c4bea8e3eedee12ee1629" modify_external_catalogs: true
W20260616 19:51:51.566252 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8351427cb34466f82ee74fb60b6798b has no consensus state
W20260616 19:51:51.571691 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a2b6158b31b34419aa3619f3ce8242b3 has no consensus state
W20260616 19:51:51.572197 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a56168eb4f5e449a8f9eed5c8cfad9df has no consensus state
I20260616 19:51:51.576759 765 tablet_service.cc:1511] Processing CreateTablet for tablet 543ef0fcac3d47928c5dd1d13f9aba92 (DEFAULT_TABLE table=default.Table_5ad3a183f911465da5f24ce69f9d6256 [id=91705098b83a4cbd80112158f1b82022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.577229 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543ef0fcac3d47928c5dd1d13f9aba92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.581324 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 543ef0fcac3d47928c5dd1d13f9aba92 (DEFAULT_TABLE table=default.Table_5ad3a183f911465da5f24ce69f9d6256 [id=91705098b83a4cbd80112158f1b82022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.581461 762 tablet_service.cc:1511] Processing CreateTablet for tablet b5f60e9778dd429c8bdbf96261901a56 (DEFAULT_TABLE table=default.Table_73d451214e35437c85c4e33d7cfbd65f [id=91db6a529c234ab1b026fba00e18a7ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.581722 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543ef0fcac3d47928c5dd1d13f9aba92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.581810 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f60e9778dd429c8bdbf96261901a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.582005 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 302997d0e3b247ebaceec9151f580c3a
I20260616 19:51:51.582731 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 6ddc4929e1dc4c9284cd78dfa6b6febd
I20260616 19:51:51.584517 758 tablet_service.cc:1511] Processing CreateTablet for tablet a2b6158b31b34419aa3619f3ce8242b3 (DEFAULT_TABLE table=default.Table_62044432f4a549d8846c6d9d17274c1a [id=48ebc382fbde40f8a05ccb60001efe00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.584862 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b6158b31b34419aa3619f3ce8242b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.585453 1035 tablet_service.cc:1511] Processing CreateTablet for tablet b5f60e9778dd429c8bdbf96261901a56 (DEFAULT_TABLE table=default.Table_73d451214e35437c85c4e33d7cfbd65f [id=91db6a529c234ab1b026fba00e18a7ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.585803 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f60e9778dd429c8bdbf96261901a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.588518 756 tablet_service.cc:1511] Processing CreateTablet for tablet ab33d99d857145dfbda54ff2f7464486 (DEFAULT_TABLE table=default.Table_fe6074841b0642f99392ef14431b9c15 [id=122f88b500c0425e833926b349605d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.588887 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab33d99d857145dfbda54ff2f7464486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.588860 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 302997d0e3b247ebaceec9151f580c3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.589438 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 54ceb5a01be24dfb9c08001d662a9ac4 (DEFAULT_TABLE table=default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.589782 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ceb5a01be24dfb9c08001d662a9ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.591773 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 302997d0e3b247ebaceec9151f580c3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.591979 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.592165 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e1afc98c2d9741a9a1b9196cec4c5390" } modify_external_catalogs: true
I20260616 19:51:51.592278 759 tablet_service.cc:1511] Processing CreateTablet for tablet 54ceb5a01be24dfb9c08001d662a9ac4 (DEFAULT_TABLE table=default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.592322 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e1afc98c2d9741a9a1b9196cec4c5390" } modify_external_catalogs: true
I20260616 19:51:51.592617 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ceb5a01be24dfb9c08001d662a9ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.592852 1030 tablet_service.cc:1511] Processing CreateTablet for tablet a2b6158b31b34419aa3619f3ce8242b3 (DEFAULT_TABLE table=default.Table_62044432f4a549d8846c6d9d17274c1a [id=48ebc382fbde40f8a05ccb60001efe00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.593389 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b6158b31b34419aa3619f3ce8242b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.594437 1193 ts_tablet_manager.cc:1929] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.594600 1193 log.cc:1199] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/1369a97caf7246479b1a12ac38674eed
I20260616 19:51:51.594950 1193 ts_tablet_manager.cc:1950] T 1369a97caf7246479b1a12ac38674eed P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:51.596043 763 tablet_service.cc:1511] Processing CreateTablet for tablet e8351427cb34466f82ee74fb60b6798b (DEFAULT_TABLE table=default.Table_bc295d9b3a204384b0b59c474c04bd59 [id=69f6da4c9974486e9b1b7d5a3d28b373]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.596385 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8351427cb34466f82ee74fb60b6798b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.596350 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2bcad1cc946c4bea8e3eedee12ee1629" } modify_external_catalogs: true
I20260616 19:51:51.596545 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2bcad1cc946c4bea8e3eedee12ee1629" } modify_external_catalogs: true
I20260616 19:51:51.596902 1028 tablet_service.cc:1511] Processing CreateTablet for tablet ab33d99d857145dfbda54ff2f7464486 (DEFAULT_TABLE table=default.Table_fe6074841b0642f99392ef14431b9c15 [id=122f88b500c0425e833926b349605d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.597425 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab33d99d857145dfbda54ff2f7464486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.598971 1208 raft_consensus.cc:515] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.600193 1208 leader_election.cc:290] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:51.600687 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.601153 1029 tablet_service.cc:1511] Processing CreateTablet for tablet e8351427cb34466f82ee74fb60b6798b (DEFAULT_TABLE table=default.Table_bc295d9b3a204384b0b59c474c04bd59 [id=69f6da4c9974486e9b1b7d5a3d28b373]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.601675 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8351427cb34466f82ee74fb60b6798b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.603173 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c8528b6f3b4a3a99dae8eb4f7e8bf1" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:51.603343 785 raft_consensus.cc:3060] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:51.604959 1198 tablet_bootstrap.cc:654] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.606101 785 raft_consensus.cc:2468] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:51.606282 1191 tablet_replica.cc:333] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:51:51.606698 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 5fd2cd6063dc430e89188ed00e76a760 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fd2cd6063dc430e89188ed00e76a760 already in progress: creating tablet
I20260616 19:51:51.606765 996 leader_election.cc:304] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:51:51.607303 1208 raft_consensus.cc:2804] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:51.607869 1191 raft_consensus.cc:2243] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.608076 1191 raft_consensus.cc:2272] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.608800 1191 ts_tablet_manager.cc:1916] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.609579 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 91336c7847ea4739a0be7fdd9d199cca
I20260616 19:51:51.609943 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_62044432f4a549d8846c6d9d17274c1a" } modify_external_catalogs: true
I20260616 19:51:51.610131 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_62044432f4a549d8846c6d9d17274c1a" } modify_external_catalogs: true
I20260616 19:51:51.611888 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 91336c7847ea4739a0be7fdd9d199cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.615574 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a56168eb4f5e449a8f9eed5c8cfad9df
I20260616 19:51:51.616601 761 tablet_service.cc:1558] Processing DeleteTablet for tablet a56168eb4f5e449a8f9eed5c8cfad9df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.620582 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a2b6158b31b34419aa3619f3ce8242b3
W20260616 19:51:51.620683 993 leader_election.cc:343] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: a4c8528b6f3b4a3a99dae8eb4f7e8bf1
I20260616 19:51:51.621618 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet a56168eb4f5e449a8f9eed5c8cfad9df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.621892 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 91336c7847ea4739a0be7fdd9d199cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.623396 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet a2b6158b31b34419aa3619f3ce8242b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.624001 1040 tablet_service.cc:1511] Processing CreateTablet for tablet c557049a020a4b318bb6e8a53710a6cc (DEFAULT_TABLE table=default.Table_f29c0729614141a183a4aa7787c0a612 [id=7792ca664dbe4df5865c5a17ebd30d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.624435 757 tablet_service.cc:1511] Processing CreateTablet for tablet c557049a020a4b318bb6e8a53710a6cc (DEFAULT_TABLE table=default.Table_f29c0729614141a183a4aa7787c0a612 [id=7792ca664dbe4df5865c5a17ebd30d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.624779 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c557049a020a4b318bb6e8a53710a6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.624919 1196 tablet_bootstrap.cc:492] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:51.625100 1196 ts_tablet_manager.cc:1403] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.092s user 0.021s sys 0.019s
I20260616 19:51:51.625204 761 tablet_service.cc:1558] Processing DeleteTablet for tablet a2b6158b31b34419aa3619f3ce8242b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.624933 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c557049a020a4b318bb6e8a53710a6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.625978 1196 raft_consensus.cc:359] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.626192 1196 raft_consensus.cc:385] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.626281 1196 raft_consensus.cc:740] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.626530 1196 consensus_queue.cc:260] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.627091 1196 ts_tablet_manager.cc:1434] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:51:51.627440 1196 tablet_bootstrap.cc:492] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:51.629355 761 tablet_service.cc:1511] Processing CreateTablet for tablet c5657b6b56af4b8f8eff1fa18836df9b (DEFAULT_TABLE table=default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.629717 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5657b6b56af4b8f8eff1fa18836df9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.630851 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 2124e4b923ba439893788bb7350cdae9 with delete_type TABLET_DATA_DELETED (replaced by tablet a8e2ac5db03f4278b341d01a58441100) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.631413 1033 tablet_service.cc:1511] Processing CreateTablet for tablet c5657b6b56af4b8f8eff1fa18836df9b (DEFAULT_TABLE table=default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.631814 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5657b6b56af4b8f8eff1fa18836df9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.632846 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 1369a97caf7246479b1a12ac38674eed from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.636502 1196 tablet_bootstrap.cc:654] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.637812 1191 ts_tablet_manager.cc:1929] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.637933 1191 log.cc:1199] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/96913044d566481e8a22d3dec765cdf2
I20260616 19:51:51.638304 1191 ts_tablet_manager.cc:1950] T 96913044d566481e8a22d3dec765cdf2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:51.639346 1191 tablet_replica.cc:333] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:51.639335 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 96913044d566481e8a22d3dec765cdf2 (table default.Table_f10ac61e4fa442ee98b5c4d07dae39b3 [id=7b8e6e89495c4b509590e87f3e542079]) successfully deleted
I20260616 19:51:51.639384 765 tablet_service.cc:1511] Processing CreateTablet for tablet 91336c7847ea4739a0be7fdd9d199cca (DEFAULT_TABLE table=default.Table_e1afc98c2d9741a9a1b9196cec4c5390 [id=9f6df425186b463d830a66539d63bcdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.639760 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91336c7847ea4739a0be7fdd9d199cca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:51.640086 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 63a2448644894be186e2ab62f3d662be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63a2448644894be186e2ab62f3d662be already in progress: creating tablet
I20260616 19:51:51.640625 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 91336c7847ea4739a0be7fdd9d199cca (DEFAULT_TABLE table=default.Table_e1afc98c2d9741a9a1b9196cec4c5390 [id=9f6df425186b463d830a66539d63bcdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.641009 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91336c7847ea4739a0be7fdd9d199cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.649346 1198 tablet_bootstrap.cc:492] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:51.649499 1198 ts_tablet_manager.cc:1403] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.243s user 0.004s sys 0.009s
I20260616 19:51:51.650245 1198 raft_consensus.cc:359] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:51.650461 1198 raft_consensus.cc:385] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.650569 1198 raft_consensus.cc:740] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.650790 1208 raft_consensus.cc:697] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:51.651202 1208 consensus_queue.cc:237] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.653487 1198 consensus_queue.cc:260] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:51.653995 1198 ts_tablet_manager.cc:1434] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260616 19:51:51.654527 765 tablet_service.cc:1511] Processing CreateTablet for tablet e4705cacd95a45888fac6a76745eae4e (DEFAULT_TABLE table=default.Table_fe763512a640490ebb25dca52b04788a [id=ad67f2c8f60f4c8c9b4ca2e57ffdb6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.654912 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4705cacd95a45888fac6a76745eae4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.656234 1198 tablet_bootstrap.cc:492] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:51.657481 1030 tablet_service.cc:1511] Processing CreateTablet for tablet e4705cacd95a45888fac6a76745eae4e (DEFAULT_TABLE table=default.Table_fe763512a640490ebb25dca52b04788a [id=ad67f2c8f60f4c8c9b4ca2e57ffdb6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.658350 1198 tablet_bootstrap.cc:654] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.658833 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4705cacd95a45888fac6a76745eae4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.661846 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 387ba2086bca4a15b388700044e3c45d with delete_type TABLET_DATA_DELETED (replaced by tablet de0ea6ca79ff4ed09f63fc7bb98eaabd) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.662278 1190 ts_tablet_manager.cc:1916] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.662395 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 97afcb75fdc2440d913ad421534a4ef3 (DEFAULT_TABLE table=default.Table_2d821dc335024cba9f1635d15a76a3b9 [id=475a74cfa2ba41998c3ba29ce388cdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.662742 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97afcb75fdc2440d913ad421534a4ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.662038 901 tablet_service.cc:1511] Processing CreateTablet for tablet 543ef0fcac3d47928c5dd1d13f9aba92 (DEFAULT_TABLE table=default.Table_5ad3a183f911465da5f24ce69f9d6256 [id=91705098b83a4cbd80112158f1b82022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.667034 902 tablet_service.cc:1511] Processing CreateTablet for tablet 54ceb5a01be24dfb9c08001d662a9ac4 (DEFAULT_TABLE table=default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:51.667352 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 91336c7847ea4739a0be7fdd9d199cca (table default.Table_e1afc98c2d9741a9a1b9196cec4c5390 [id=9f6df425186b463d830a66539d63bcdd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 91336c7847ea4739a0be7fdd9d199cca consensus state has no leader
I20260616 19:51:51.667518 904 tablet_service.cc:1511] Processing CreateTablet for tablet b5f60e9778dd429c8bdbf96261901a56 (DEFAULT_TABLE table=default.Table_73d451214e35437c85c4e33d7cfbd65f [id=91db6a529c234ab1b026fba00e18a7ef]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:51.667725 993 leader_election.cc:343] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: a4c8528b6f3b4a3a99dae8eb4f7e8bf1
I20260616 19:51:51.667788 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543ef0fcac3d47928c5dd1d13f9aba92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.668300 1033 tablet_service.cc:1511] Processing CreateTablet for tablet a56168eb4f5e449a8f9eed5c8cfad9df (DEFAULT_TABLE table=default.Table_2bcad1cc946c4bea8e3eedee12ee1629 [id=9ec0598716a64236aaba17b464849f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.668804 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a56168eb4f5e449a8f9eed5c8cfad9df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.670463 1198 tablet_bootstrap.cc:492] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:51.670629 1198 ts_tablet_manager.cc:1403] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260616 19:51:51.672501 1198 raft_consensus.cc:359] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.672720 1198 raft_consensus.cc:385] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.672808 1198 raft_consensus.cc:740] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.672920 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ceb5a01be24dfb9c08001d662a9ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.673436 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 302997d0e3b247ebaceec9151f580c3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.674934 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f60e9778dd429c8bdbf96261901a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.675622 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.676512 1191 raft_consensus.cc:2243] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:51.681257 897 tablet_service.cc:1558] Processing DeleteTablet for tablet a56168eb4f5e449a8f9eed5c8cfad9df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.681777 1191 pending_rounds.cc:70] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: Trying to abort 1 pending ops.
I20260616 19:51:51.681963 1191 pending_rounds.cc:77] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595439727935488 op_type: NO_OP noop_request { }
I20260616 19:51:51.682147 1191 raft_consensus.cc:2889] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:51.682298 1191 raft_consensus.cc:2272] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.682797 1198 consensus_queue.cc:260] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.683580 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 08330a8219574829834e36523ec6408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.684587 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 91336c7847ea4739a0be7fdd9d199cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.686928 1198 ts_tablet_manager.cc:1434] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260616 19:51:51.687287 452 master_service.cc:960] ReplaceTablet: received request to replace tablet b657c023023d4070b3dfb16da1b35181 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.689868 1198 tablet_bootstrap.cc:492] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:51.690691 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9df52ea3bbc442d483f9c47bdfaeeca2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:51.690831 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7fbe0c396a244071881a37948e4fe722"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.691294 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9df52ea3bbc442d483f9c47bdfaeeca2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:51.691372 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fbe0c396a244071881a37948e4fe722 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.691738 1198 tablet_bootstrap.cc:654] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.693228 1191 ts_tablet_manager.cc:1916] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.694258 896 tablet_service.cc:1558] Processing DeleteTablet for tablet a2b6158b31b34419aa3619f3ce8242b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.694752 897 tablet_service.cc:1511] Processing CreateTablet for tablet c557049a020a4b318bb6e8a53710a6cc (DEFAULT_TABLE table=default.Table_f29c0729614141a183a4aa7787c0a612 [id=7792ca664dbe4df5865c5a17ebd30d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.695243 903 tablet_service.cc:1511] Processing CreateTablet for tablet a2b6158b31b34419aa3619f3ce8242b3 (DEFAULT_TABLE table=default.Table_62044432f4a549d8846c6d9d17274c1a [id=48ebc382fbde40f8a05ccb60001efe00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.695992 899 tablet_service.cc:1511] Processing CreateTablet for tablet e8351427cb34466f82ee74fb60b6798b (DEFAULT_TABLE table=default.Table_bc295d9b3a204384b0b59c474c04bd59 [id=69f6da4c9974486e9b1b7d5a3d28b373]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.696574 898 tablet_service.cc:1511] Processing CreateTablet for tablet ab33d99d857145dfbda54ff2f7464486 (DEFAULT_TABLE table=default.Table_fe6074841b0642f99392ef14431b9c15 [id=122f88b500c0425e833926b349605d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.698360 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c557049a020a4b318bb6e8a53710a6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.699592 900 tablet_service.cc:1511] Processing CreateTablet for tablet 91336c7847ea4739a0be7fdd9d199cca (DEFAULT_TABLE table=default.Table_e1afc98c2d9741a9a1b9196cec4c5390 [id=9f6df425186b463d830a66539d63bcdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.700420 1191 ts_tablet_manager.cc:1929] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:51.700567 1191 log.cc:1199] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/a4c8528b6f3b4a3a99dae8eb4f7e8bf1
I20260616 19:51:51.700965 1191 ts_tablet_manager.cc:1950] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:51.701923 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 (table default.Table_43112c4d7050453dad8984408f75baf3 [id=5fcb69f72f9a4146a022e60757c42e09]) successfully deleted
I20260616 19:51:51.702160 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab33d99d857145dfbda54ff2f7464486. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:51.702504 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 61c66c72987941428a449601683fba68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61c66c72987941428a449601683fba68 already in progress: creating tablet
I20260616 19:51:51.702585 1191 tablet_replica.cc:333] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:51.702760 1191 raft_consensus.cc:2243] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260616 19:51:51.702790 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2808592f581e4605a814a2658401dfed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2808592f581e4605a814a2658401dfed already in progress: creating tablet
I20260616 19:51:51.702919 1191 raft_consensus.cc:2272] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.704602 1198 tablet_bootstrap.cc:492] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:51.704746 1198 ts_tablet_manager.cc:1403] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260616 19:51:51.705530 1198 raft_consensus.cc:359] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.705698 1198 raft_consensus.cc:385] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.705785 1198 raft_consensus.cc:740] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.706044 1198 consensus_queue.cc:260] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.707782 1191 ts_tablet_manager.cc:1916] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.709750 1198 ts_tablet_manager.cc:1434] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260616 19:51:51.711730 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 31d22240d294454cbeb2ca5b07d45273 (DEFAULT_TABLE table=default.Table_9b1ad03c6fbd44778ac1413338735443 [id=3f2766ea54a141eb84ccb6625a0d04b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.712116 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d22240d294454cbeb2ca5b07d45273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.713202 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8351427cb34466f82ee74fb60b6798b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.714967 1198 tablet_bootstrap.cc:492] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:51.716832 1198 tablet_bootstrap.cc:654] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.718225 1033 tablet_service.cc:1511] Processing CreateTablet for tablet bb2fdea2d4ab42708fcd3102ea54bdb6 (DEFAULT_TABLE table=default.Table_baf21e2369ea4aa6aa6cbf2370be11b9 [id=bb9e8ac09e824ad58ba1ce8f021968a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.718582 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2fdea2d4ab42708fcd3102ea54bdb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.719050 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_04333ee3e94448f19dec006a4bef21cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.719767 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04333ee3e94448f19dec006a4bef21cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.720685 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_30518ca6d22549d9a2d8a4b5b6451a7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.721153 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30518ca6d22549d9a2d8a4b5b6451a7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.722225 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f4d10be30e3f471eb57724a33c8bb316"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.722745 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4d10be30e3f471eb57724a33c8bb316 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.724799 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bd62e9b749144fb28a1f58d92574d60a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.725299 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd62e9b749144fb28a1f58d92574d60a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.729343 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1405b760086447f6b6ce471ca0c9b683" } new_table_name: "default.Table_c7d27c7befea4f3b8554b44d79fc352a" modify_external_catalogs: true
I20260616 19:51:51.729265 756 tablet_service.cc:1511] Processing CreateTablet for tablet bb2fdea2d4ab42708fcd3102ea54bdb6 (DEFAULT_TABLE table=default.Table_baf21e2369ea4aa6aa6cbf2370be11b9 [id=bb9e8ac09e824ad58ba1ce8f021968a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.735145 762 tablet_service.cc:1511] Processing CreateTablet for tablet a56168eb4f5e449a8f9eed5c8cfad9df (DEFAULT_TABLE table=default.Table_2bcad1cc946c4bea8e3eedee12ee1629 [id=9ec0598716a64236aaba17b464849f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.737321 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_db0e8de4550f4b6c8a2d31081d0c7a93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.737771 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db0e8de4550f4b6c8a2d31081d0c7a93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.738472 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a56168eb4f5e449a8f9eed5c8cfad9df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.742662 758 tablet_service.cc:1511] Processing CreateTablet for tablet 31d22240d294454cbeb2ca5b07d45273 (DEFAULT_TABLE table=default.Table_9b1ad03c6fbd44778ac1413338735443 [id=3f2766ea54a141eb84ccb6625a0d04b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.744943 759 tablet_service.cc:1511] Processing CreateTablet for tablet 97afcb75fdc2440d913ad421534a4ef3 (DEFAULT_TABLE table=default.Table_2d821dc335024cba9f1635d15a76a3b9 [id=475a74cfa2ba41998c3ba29ce388cdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.715441 894 tablet_service.cc:1511] Processing CreateTablet for tablet 97afcb75fdc2440d913ad421534a4ef3 (DEFAULT_TABLE table=default.Table_2d821dc335024cba9f1635d15a76a3b9 [id=475a74cfa2ba41998c3ba29ce388cdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.746914 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_30518ca6d22549d9a2d8a4b5b6451a7a" } new_table_name: "default.Table_4d5cc10e0f904a91b1750515a22226d1" modify_external_catalogs: true
I20260616 19:51:51.748342 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b6158b31b34419aa3619f3ce8242b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:51.752213 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d916b2f553ce41df8934e1190fa32120 consensus state has no leader
I20260616 19:51:51.746691 896 tablet_service.cc:1511] Processing CreateTablet for tablet c5657b6b56af4b8f8eff1fa18836df9b (DEFAULT_TABLE table=default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:51.753433 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7161894b9f9047fda9ed3f2180518a59 has no consensus state
I20260616 19:51:51.754532 1033 tablet_service.cc:1511] Processing CreateTablet for tablet d916b2f553ce41df8934e1190fa32120 (DEFAULT_TABLE table=default.Table_1405b760086447f6b6ce471ca0c9b683 [id=7b17c97ad92b4ead8f60bf602853cd61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.754909 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d916b2f553ce41df8934e1190fa32120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.756431 1040 tablet_service.cc:1511] Processing CreateTablet for tablet da380823d0ae437d9f1d9d0f633f74bb (DEFAULT_TABLE table=default.Table_fc71d18f9d8540bf8012eb3491c6921d [id=46c822de2dc2471d847af2e018102efc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.756422 763 tablet_service.cc:1511] Processing CreateTablet for tablet d916b2f553ce41df8934e1190fa32120 (DEFAULT_TABLE table=default.Table_c7d27c7befea4f3b8554b44d79fc352a [id=7b17c97ad92b4ead8f60bf602853cd61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.756767 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da380823d0ae437d9f1d9d0f633f74bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.758735 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91336c7847ea4739a0be7fdd9d199cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.759981 1032 tablet_service.cc:1511] Processing CreateTablet for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd (DEFAULT_TABLE table=default.Table_6e469684e5b844a5b7f13a1047fd933a [id=7d5a7b1d32b147a3a8b5426c661dda2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.760362 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.760288 760 tablet_service.cc:1511] Processing CreateTablet for tablet da380823d0ae437d9f1d9d0f633f74bb (DEFAULT_TABLE table=default.Table_fc71d18f9d8540bf8012eb3491c6921d [id=46c822de2dc2471d847af2e018102efc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.761425 764 tablet_service.cc:1511] Processing CreateTablet for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd (DEFAULT_TABLE table=default.Table_6e469684e5b844a5b7f13a1047fd933a [id=7d5a7b1d32b147a3a8b5426c661dda2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.763252 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8e4aaf1fba6a46d897cccbdb69567c8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:51.764196 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97afcb75fdc2440d913ad421534a4ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.764170 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_fce6c0a420e74d889b4665e221e3c559"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.764787 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fce6c0a420e74d889b4665e221e3c559 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.763480 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_81e67ee241e34396b9e1c159338b192a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.766774 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81e67ee241e34396b9e1c159338b192a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:51.768708 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e4aaf1fba6a46d897cccbdb69567c8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.770010 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9b1ad03c6fbd44778ac1413338735443" } new_table_name: "default.Table_41371955e37644fda9a23d0fba091c86" modify_external_catalogs: true
I20260616 19:51:51.771150 458 master_service.cc:960] ReplaceTablet: received request to replace tablet 4e37f42ce8ec47fca1cf8aa75bc0202d from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.769888 895 tablet_service.cc:1511] Processing CreateTablet for tablet e4705cacd95a45888fac6a76745eae4e (DEFAULT_TABLE table=default.Table_fe763512a640490ebb25dca52b04788a [id=ad67f2c8f60f4c8c9b4ca2e57ffdb6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.775846 1208 raft_consensus.cc:493] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:51.776028 1208 raft_consensus.cc:515] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.776757 1208 leader_election.cc:290] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:51.777017 893 tablet_service.cc:1511] Processing CreateTablet for tablet a56168eb4f5e449a8f9eed5c8cfad9df (DEFAULT_TABLE table=default.Table_2bcad1cc946c4bea8e3eedee12ee1629 [id=9ec0598716a64236aaba17b464849f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.777387 890 tablet_service.cc:1511] Processing CreateTablet for tablet d916b2f553ce41df8934e1190fa32120 (DEFAULT_TABLE table=default.Table_1405b760086447f6b6ce471ca0c9b683 [id=7b17c97ad92b4ead8f60bf602853cd61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.777861 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1369a97caf7246479b1a12ac38674eed" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:51:51.778611 993 leader_election.cc:343] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:51.782930 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4705cacd95a45888fac6a76745eae4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.784868 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a56168eb4f5e449a8f9eed5c8cfad9df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.786434 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d916b2f553ce41df8934e1190fa32120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.788615 1191 ts_tablet_manager.cc:1929] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.789039 1191 log.cc:1199] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/2124e4b923ba439893788bb7350cdae9
I20260616 19:51:51.789608 1191 ts_tablet_manager.cc:1950] T 2124e4b923ba439893788bb7350cdae9 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:51.789806 891 tablet_service.cc:1511] Processing CreateTablet for tablet 31d22240d294454cbeb2ca5b07d45273 (DEFAULT_TABLE table=default.Table_9b1ad03c6fbd44778ac1413338735443 [id=3f2766ea54a141eb84ccb6625a0d04b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.790823 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d22240d294454cbeb2ca5b07d45273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.792330 1191 tablet_replica.cc:333] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:51.792635 1191 raft_consensus.cc:2243] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.792938 1191 raft_consensus.cc:2272] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.792094 892 tablet_service.cc:1511] Processing CreateTablet for tablet bb2fdea2d4ab42708fcd3102ea54bdb6 (DEFAULT_TABLE table=default.Table_baf21e2369ea4aa6aa6cbf2370be11b9 [id=bb9e8ac09e824ad58ba1ce8f021968a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.793817 1191 ts_tablet_manager.cc:1916] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.795599 889 tablet_service.cc:1511] Processing CreateTablet for tablet da380823d0ae437d9f1d9d0f633f74bb (DEFAULT_TABLE table=default.Table_fc71d18f9d8540bf8012eb3491c6921d [id=46c822de2dc2471d847af2e018102efc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.796521 888 tablet_service.cc:1511] Processing CreateTablet for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd (DEFAULT_TABLE table=default.Table_6e469684e5b844a5b7f13a1047fd933a [id=7d5a7b1d32b147a3a8b5426c661dda2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.798962 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5657b6b56af4b8f8eff1fa18836df9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.799930 1191 ts_tablet_manager.cc:1929] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.800040 1191 log.cc:1199] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/1369a97caf7246479b1a12ac38674eed
I20260616 19:51:51.800037 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da380823d0ae437d9f1d9d0f633f74bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.800371 1191 ts_tablet_manager.cc:1950] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:51.801026 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.801080 1191 tablet_replica.cc:333] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:51.801249 1191 raft_consensus.cc:2243] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.801397 1191 raft_consensus.cc:2272] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.801743 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2fdea2d4ab42708fcd3102ea54bdb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.801980 1191 ts_tablet_manager.cc:1916] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.808238 1191 ts_tablet_manager.cc:1929] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.808408 1191 log.cc:1199] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/a8e2ac5db03f4278b341d01a58441100
I20260616 19:51:51.808825 1191 ts_tablet_manager.cc:1950] T a8e2ac5db03f4278b341d01a58441100 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:51.811887 1191 tablet_replica.cc:333] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:51.812062 1191 raft_consensus.cc:2243] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.812237 1191 raft_consensus.cc:2272] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.812984 1191 ts_tablet_manager.cc:1916] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.818763 1191 ts_tablet_manager.cc:1929] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.818881 1191 log.cc:1199] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/08330a8219574829834e36523ec6408e
I20260616 19:51:51.819439 1191 ts_tablet_manager.cc:1950] T 08330a8219574829834e36523ec6408e P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:51.855716 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_325b56a356ab458faf0ff8db3223e304" } new_table_name: "default.Table_1009b1ce9fe84b8a8a3e63ac3dc43857" modify_external_catalogs: true
W20260616 19:51:51.856600 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet b657c023023d4070b3dfb16da1b35181 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b657c023023d4070b3dfb16da1b35181 already in progress: creating tablet
W20260616 19:51:51.856817 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 65244.6us
W20260616 19:51:51.857196 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a6dd15b09ec246ee90bdc73fd93f862a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6dd15b09ec246ee90bdc73fd93f862a already in progress: creating tablet
W20260616 19:51:51.857431 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ec8b1cb4a9d34a798ec287782f1219ee because the tablet was not found. No further retry: Not found: Tablet not found: ec8b1cb4a9d34a798ec287782f1219ee
I20260616 19:51:51.857610 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 1369a97caf7246479b1a12ac38674eed (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]) successfully deleted
W20260616 19:51:51.857883 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet cf89adf3cbe54beab939645f7ebbb616 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf89adf3cbe54beab939645f7ebbb616 already in progress: creating tablet
W20260616 19:51:51.858103 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 387ba2086bca4a15b388700044e3c45d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 387ba2086bca4a15b388700044e3c45d already in progress: creating tablet
W20260616 19:51:51.858306 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 302997d0e3b247ebaceec9151f580c3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 302997d0e3b247ebaceec9151f580c3a already in progress: creating tablet
W20260616 19:51:51.858513 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ddc4929e1dc4c9284cd78dfa6b6febd already in progress: creating tablet
W20260616 19:51:51.858763 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a56168eb4f5e449a8f9eed5c8cfad9df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a56168eb4f5e449a8f9eed5c8cfad9df already in progress: creating tablet
W20260616 19:51:51.858981 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 91336c7847ea4739a0be7fdd9d199cca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91336c7847ea4739a0be7fdd9d199cca already in progress: creating tablet
W20260616 19:51:51.859184 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a2b6158b31b34419aa3619f3ce8242b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2b6158b31b34419aa3619f3ce8242b3 already in progress: creating tablet
I20260616 19:51:51.859357 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 08330a8219574829834e36523ec6408e (table default.Table_1a3a46499a29471cbd3f312ef6f2c560 [id=f8770615f8d94929983c07bb73f3116f]) successfully deleted
I20260616 19:51:51.860447 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c654445815a9494491a390790185534e" } modify_external_catalogs: true
I20260616 19:51:51.860522 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6e469684e5b844a5b7f13a1047fd933a" } modify_external_catalogs: true
I20260616 19:51:51.860656 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c654445815a9494491a390790185534e" } modify_external_catalogs: true
I20260616 19:51:51.860739 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6e469684e5b844a5b7f13a1047fd933a" } modify_external_catalogs: true
I20260616 19:51:51.860896 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bd62e9b749144fb28a1f58d92574d60a" } modify_external_catalogs: true
I20260616 19:51:51.861049 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bd62e9b749144fb28a1f58d92574d60a" } modify_external_catalogs: true
I20260616 19:51:51.863153 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bbce6eb152884f1ead7ffb2b0acfbfa7" } new_table_name: "default.Table_7290a282713e456c9a18c3983f90e218" modify_external_catalogs: true
I20260616 19:51:51.879326 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2d821dc335024cba9f1635d15a76a3b9" } modify_external_catalogs: true
I20260616 19:51:51.879539 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2d821dc335024cba9f1635d15a76a3b9" } modify_external_catalogs: true
W20260616 19:51:51.880273 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31d22240d294454cbeb2ca5b07d45273 consensus state has no leader
I20260616 19:51:51.880594 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6a9c2eded2954f7282a8fa6d68278896" } modify_external_catalogs: true
I20260616 19:51:51.880748 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6a9c2eded2954f7282a8fa6d68278896" } modify_external_catalogs: true
W20260616 19:51:51.883535 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 51fa9bd399d54a86875db081081a8814 consensus state has no leader
W20260616 19:51:51.885293 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e37f42ce8ec47fca1cf8aa75bc0202d consensus state has no leader
I20260616 19:51:51.904932 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.904971 1030 tablet_service.cc:1511] Processing CreateTablet for tablet eac603a84d3c4f96bd444c54f28d278d (DEFAULT_TABLE table=default.Table_db0e8de4550f4b6c8a2d31081d0c7a93 [id=a67306640a5b4c0a91a283892a3a8062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.905387 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac603a84d3c4f96bd444c54f28d278d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.905911 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 4e37f42ce8ec47fca1cf8aa75bc0202d
I20260616 19:51:51.906338 458 catalog_manager.cc:6784] ReplaceTablet: tablet 4e37f42ce8ec47fca1cf8aa75bc0202d deleted and replaced by tablet d61873c8aa094d7f899a61307a36f895
I20260616 19:51:51.907881 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d with delete_type TABLET_DATA_DELETED (replaced by tablet d61873c8aa094d7f899a61307a36f895) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.910308 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da380823d0ae437d9f1d9d0f633f74bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:51.913127 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e37f42ce8ec47fca1cf8aa75bc0202d already in progress: creating tablet
I20260616 19:51:51.915452 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1369a97caf7246479b1a12ac38674eed" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:51.916131 996 leader_election.cc:343] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: Tablet not RUNNING: STOPPED
I20260616 19:51:51.916343 996 leader_election.cc:304] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:51:51.916564 996 raft_consensus.cc:2686] T 1369a97caf7246479b1a12ac38674eed P 61c874fef3684d10a272a9c7f280e0e2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:51:51.917048 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d916b2f553ce41df8934e1190fa32120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.917819 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 21408288aae545cba9aa65afbc29a0e3 (DEFAULT_TABLE table=default.Table_04333ee3e94448f19dec006a4bef21cf [id=0342973a46bc4b93b84b0220163e9975]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.918283 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21408288aae545cba9aa65afbc29a0e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.923553 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97afcb75fdc2440d913ad421534a4ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.924443 1193 tablet_replica.cc:333] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:51.924705 1193 raft_consensus.cc:2243] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.924954 1193 raft_consensus.cc:2272] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:51.925529 1193 ts_tablet_manager.cc:1916] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.925665 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 79efb1de93bc4c1e81f4b2e15f621417
I20260616 19:51:51.927218 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 97afcb75fdc2440d913ad421534a4ef3
I20260616 19:51:51.928649 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2fdea2d4ab42708fcd3102ea54bdb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.929239 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 79efb1de93bc4c1e81f4b2e15f621417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.929414 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 97afcb75fdc2440d913ad421534a4ef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:51.930217 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 79efb1de93bc4c1e81f4b2e15f621417 because the tablet was not found. No further retry: Not found: Tablet not found: 79efb1de93bc4c1e81f4b2e15f621417
W20260616 19:51:51.930505 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 97afcb75fdc2440d913ad421534a4ef3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97afcb75fdc2440d913ad421534a4ef3 already in progress: creating tablet
I20260616 19:51:51.934540 1198 tablet_bootstrap.cc:492] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:51.934705 1198 ts_tablet_manager.cc:1403] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.220s user 0.045s sys 0.047s
I20260616 19:51:51.935530 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d22240d294454cbeb2ca5b07d45273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.935527 1198 raft_consensus.cc:359] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.935755 1198 raft_consensus.cc:385] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:51.935837 1198 raft_consensus.cc:740] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:51.936074 1198 consensus_queue.cc:260] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:51.937300 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c789abf00da24981be5bb72c0b5752d1
I20260616 19:51:51.938797 1198 ts_tablet_manager.cc:1434] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260616 19:51:51.940032 1198 tablet_bootstrap.cc:492] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:51.941722 1198 tablet_bootstrap.cc:654] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:51.945676 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 97afcb75fdc2440d913ad421534a4ef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.946050 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d with delete_type TABLET_DATA_DELETED (replaced by tablet d61873c8aa094d7f899a61307a36f895) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.947479 757 tablet_service.cc:1511] Processing CreateTablet for tablet 21408288aae545cba9aa65afbc29a0e3 (DEFAULT_TABLE table=default.Table_04333ee3e94448f19dec006a4bef21cf [id=0342973a46bc4b93b84b0220163e9975]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.947919 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21408288aae545cba9aa65afbc29a0e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.952126 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fcfc9231ffeb487cb15ed2a3788730ba
I20260616 19:51:51.952374 891 tablet_service.cc:1511] Processing CreateTablet for tablet eac603a84d3c4f96bd444c54f28d278d (DEFAULT_TABLE table=default.Table_db0e8de4550f4b6c8a2d31081d0c7a93 [id=a67306640a5b4c0a91a283892a3a8062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.952797 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac603a84d3c4f96bd444c54f28d278d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.952811 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet de0ea6ca79ff4ed09f63fc7bb98eaabd
I20260616 19:51:51.955968 762 tablet_service.cc:1511] Processing CreateTablet for tablet eac603a84d3c4f96bd444c54f28d278d (DEFAULT_TABLE table=default.Table_db0e8de4550f4b6c8a2d31081d0c7a93 [id=a67306640a5b4c0a91a283892a3a8062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.941907 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 7161894b9f9047fda9ed3f2180518a59 (DEFAULT_TABLE table=default.Table_4d5cc10e0f904a91b1750515a22226d1 [id=a69482262948439783492742dcbf0b43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.956523 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7161894b9f9047fda9ed3f2180518a59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.959170 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 776841d895d6431fbee76b7c4e28d973 (DEFAULT_TABLE table=default.Table_f4d10be30e3f471eb57724a33c8bb316 [id=4d2238911f8d432095e4a20ee0dc6217]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.959201 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet c789abf00da24981be5bb72c0b5752d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.959502 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776841d895d6431fbee76b7c4e28d973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.946389 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet a8e2ac5db03f4278b341d01a58441100 with delete_type TABLET_DATA_DELETED (replaced by tablet a2b6158b31b34419aa3619f3ce8242b3) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.948705 1033 tablet_service.cc:1511] Processing CreateTablet for tablet fd5a513aeb224609afaee1ded6ede5e6 (DEFAULT_TABLE table=default.Table_7fbe0c396a244071881a37948e4fe722 [id=c7d1624942fb42aa95ad085062052262]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:51.960852 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c789abf00da24981be5bb72c0b5752d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c789abf00da24981be5bb72c0b5752d1 already in progress: creating tablet
I20260616 19:51:51.961071 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5a513aeb224609afaee1ded6ede5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.961371 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c6a3c639c2574d04a358f1ce11073269"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.961994 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6a3c639c2574d04a358f1ce11073269 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.965657 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d with delete_type TABLET_DATA_DELETED (replaced by tablet d61873c8aa094d7f899a61307a36f895) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.966524 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6d7c8b4a63044ff78221b0a47f41d5a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.967027 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d7c8b4a63044ff78221b0a47f41d5a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.967125 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 79efb1de93bc4c1e81f4b2e15f621417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.969404 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_75ff35530aa041f0a81c83741b88c5cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.969846 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75ff35530aa041f0a81c83741b88c5cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.972579 890 tablet_service.cc:1558] Processing DeleteTablet for tablet c789abf00da24981be5bb72c0b5752d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:51.973519 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2836dd728d0d4df497738e4959ed3bc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.973992 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2836dd728d0d4df497738e4959ed3bc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:51.974758 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a8e2ac5db03f4278b341d01a58441100 because the tablet was not found. No further retry: Not found: Tablet not found: a8e2ac5db03f4278b341d01a58441100
I20260616 19:51:51.975453 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b34131cb606f45af969cab4e285a435c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.975993 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b34131cb606f45af969cab4e285a435c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.977487 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bed17ff52ac5410784b004e2ef370bac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:51.977947 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bed17ff52ac5410784b004e2ef370bac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.978471 454 master_service.cc:960] ReplaceTablet: received request to replace tablet e4705cacd95a45888fac6a76745eae4e from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.978914 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 51fa9bd399d54a86875db081081a8814 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.979674 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f (DEFAULT_TABLE table=default.Table_9df52ea3bbc442d483f9c47bdfaeeca2 [id=f99403687f45449d84c7ad8b490f6c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.980170 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.950398 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 2df7d27b41b440c5b082e8783adfeced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.953913 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet fcfc9231ffeb487cb15ed2a3788730ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.954901 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:51.983744 1190 ts_tablet_manager.cc:1929] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.983845 1191 tablet_replica.cc:333] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:51.984036 1191 raft_consensus.cc:2243] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:51.984184 1191 raft_consensus.cc:2272] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:51.985153 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet fcfc9231ffeb487cb15ed2a3788730ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcfc9231ffeb487cb15ed2a3788730ba already in progress: creating tablet
W20260616 19:51:51.985478 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de0ea6ca79ff4ed09f63fc7bb98eaabd already in progress: creating tablet
I20260616 19:51:51.985544 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_873136a2abfb41018a2cec78a9f5fbc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:51.985924 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 79efb1de93bc4c1e81f4b2e15f621417 (DEFAULT_TABLE table=default.Table_bd62e9b749144fb28a1f58d92574d60a [id=3624f762ccce461390df6f711254aa05]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:51.986088 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_873136a2abfb41018a2cec78a9f5fbc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:51.986279 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79efb1de93bc4c1e81f4b2e15f621417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.988431 1190 log.cc:1199] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/96913044d566481e8a22d3dec765cdf2
I20260616 19:51:51.988610 902 tablet_service.cc:1511] Processing CreateTablet for tablet 21408288aae545cba9aa65afbc29a0e3 (DEFAULT_TABLE table=default.Table_04333ee3e94448f19dec006a4bef21cf [id=0342973a46bc4b93b84b0220163e9975]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.989020 1191 ts_tablet_manager.cc:1916] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:51.990590 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 1369a97caf7246479b1a12ac38674eed (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]) successfully deleted
I20260616 19:51:51.996769 1191 ts_tablet_manager.cc:1929] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:51.996941 1191 log.cc:1199] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/2df7d27b41b440c5b082e8783adfeced
I20260616 19:51:51.997303 1191 ts_tablet_manager.cc:1950] T 2df7d27b41b440c5b082e8783adfeced P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:51.999490 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 2df7d27b41b440c5b082e8783adfeced (table default.Table_2ab0cf99b6014917bcbbecd656555ecd [id=249e27015542469da4f6d70df62e6008]) successfully deleted
I20260616 19:51:52.000571 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21408288aae545cba9aa65afbc29a0e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:51.965636 764 tablet_service.cc:1511] Processing CreateTablet for tablet 7161894b9f9047fda9ed3f2180518a59 (DEFAULT_TABLE table=default.Table_4d5cc10e0f904a91b1750515a22226d1 [id=a69482262948439783492742dcbf0b43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.988070 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 79efb1de93bc4c1e81f4b2e15f621417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.992758 755 tablet_service.cc:1511] Processing CreateTablet for tablet fd5a513aeb224609afaee1ded6ede5e6 (DEFAULT_TABLE table=default.Table_7fbe0c396a244071881a37948e4fe722 [id=c7d1624942fb42aa95ad085062052262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.993753 754 tablet_service.cc:1558] Processing DeleteTablet for tablet fcfc9231ffeb487cb15ed2a3788730ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.995651 753 tablet_service.cc:1558] Processing DeleteTablet for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:51.996755 752 tablet_service.cc:1511] Processing CreateTablet for tablet 776841d895d6431fbee76b7c4e28d973 (DEFAULT_TABLE table=default.Table_f4d10be30e3f471eb57724a33c8bb316 [id=4d2238911f8d432095e4a20ee0dc6217]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.997875 751 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f (DEFAULT_TABLE table=default.Table_9df52ea3bbc442d483f9c47bdfaeeca2 [id=f99403687f45449d84c7ad8b490f6c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:51.998430 750 tablet_service.cc:1511] Processing CreateTablet for tablet 79efb1de93bc4c1e81f4b2e15f621417 (DEFAULT_TABLE table=default.Table_bd62e9b749144fb28a1f58d92574d60a [id=3624f762ccce461390df6f711254aa05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.003619 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7161894b9f9047fda9ed3f2180518a59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.007254 1190 ts_tablet_manager.cc:1950] T 96913044d566481e8a22d3dec765cdf2 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:52.007490 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79efb1de93bc4c1e81f4b2e15f621417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.012843 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776841d895d6431fbee76b7c4e28d973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.012921 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 97afcb75fdc2440d913ad421534a4ef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.013180 900 tablet_service.cc:1511] Processing CreateTablet for tablet 79efb1de93bc4c1e81f4b2e15f621417 (DEFAULT_TABLE table=default.Table_bd62e9b749144fb28a1f58d92574d60a [id=3624f762ccce461390df6f711254aa05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.013571 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79efb1de93bc4c1e81f4b2e15f621417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.016969 898 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f (DEFAULT_TABLE table=default.Table_9df52ea3bbc442d483f9c47bdfaeeca2 [id=f99403687f45449d84c7ad8b490f6c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.017233 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5a513aeb224609afaee1ded6ede5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.017338 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.020505 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.029693 461 master_service.cc:960] ReplaceTablet: received request to replace tablet 387ba2086bca4a15b388700044e3c45d from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:52.030408 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bc295d9b3a204384b0b59c474c04bd59" } new_table_name: "default.Table_cd728ab6319e49a395bee4e74aff4e22" modify_external_catalogs: true
I20260616 19:51:52.038882 459 master_service.cc:960] ReplaceTablet: received request to replace tablet fcfc9231ffeb487cb15ed2a3788730ba from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:51.999972 765 tablet_service.cc:1558] Processing DeleteTablet for tablet c789abf00da24981be5bb72c0b5752d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.043825 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac603a84d3c4f96bd444c54f28d278d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.056702 1196 tablet_bootstrap.cc:492] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:52.056994 1196 ts_tablet_manager.cc:1403] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.430s user 0.053s sys 0.078s
I20260616 19:51:52.058007 1196 raft_consensus.cc:359] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.058328 1196 raft_consensus.cc:385] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.058458 1196 raft_consensus.cc:740] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.058736 1196 consensus_queue.cc:260] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.062608 1196 ts_tablet_manager.cc:1434] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260616 19:51:52.065018 897 tablet_service.cc:1511] Processing CreateTablet for tablet 7161894b9f9047fda9ed3f2180518a59 (DEFAULT_TABLE table=default.Table_4d5cc10e0f904a91b1750515a22226d1 [id=a69482262948439783492742dcbf0b43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.065096 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 96913044d566481e8a22d3dec765cdf2 (table default.Table_f10ac61e4fa442ee98b5c4d07dae39b3 [id=7b8e6e89495c4b509590e87f3e542079]) successfully deleted
I20260616 19:51:52.066558 1196 tablet_bootstrap.cc:492] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:52.066594 888 tablet_service.cc:1511] Processing CreateTablet for tablet 776841d895d6431fbee76b7c4e28d973 (DEFAULT_TABLE table=default.Table_f4d10be30e3f471eb57724a33c8bb316 [id=4d2238911f8d432095e4a20ee0dc6217]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.066758 904 tablet_service.cc:1511] Processing CreateTablet for tablet fd5a513aeb224609afaee1ded6ede5e6 (DEFAULT_TABLE table=default.Table_7fbe0c396a244071881a37948e4fe722 [id=c7d1624942fb42aa95ad085062052262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.069770 894 tablet_service.cc:1558] Processing DeleteTablet for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:52.070673 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 302997d0e3b247ebaceec9151f580c3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 302997d0e3b247ebaceec9151f580c3a already in progress: creating tablet
W20260616 19:51:52.072561 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ddc4929e1dc4c9284cd78dfa6b6febd already in progress: creating tablet
I20260616 19:51:52.072767 1196 tablet_bootstrap.cc:654] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.073933 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet e4705cacd95a45888fac6a76745eae4e
I20260616 19:51:52.074611 454 catalog_manager.cc:6784] ReplaceTablet: tablet e4705cacd95a45888fac6a76745eae4e deleted and replaced by tablet 0da93e4052094862a44812990df1136a
I20260616 19:51:52.074900 894 tablet_service.cc:1558] Processing DeleteTablet for tablet e4705cacd95a45888fac6a76745eae4e with delete_type TABLET_DATA_DELETED (replaced by tablet 0da93e4052094862a44812990df1136a) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.075196 1198 tablet_bootstrap.cc:492] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:52.075714 1198 ts_tablet_manager.cc:1403] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.136s user 0.002s sys 0.002s
I20260616 19:51:52.076604 1198 raft_consensus.cc:359] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.076786 1198 raft_consensus.cc:385] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.076895 1198 raft_consensus.cc:740] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.077047 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 51fa9bd399d54a86875db081081a8814
I20260616 19:51:52.077586 460 catalog_manager.cc:6784] ReplaceTablet: tablet 51fa9bd399d54a86875db081081a8814 deleted and replaced by tablet 2cfb2238cbdb421a8f5001dc729e9bb5
I20260616 19:51:52.077757 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 51fa9bd399d54a86875db081081a8814 with delete_type TABLET_DATA_DELETED (replaced by tablet 2cfb2238cbdb421a8f5001dc729e9bb5) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.077167 1198 consensus_queue.cc:260] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.079553 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 51fa9bd399d54a86875db081081a8814 with delete_type TABLET_DATA_DELETED (replaced by tablet 2cfb2238cbdb421a8f5001dc729e9bb5) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.080905 1198 ts_tablet_manager.cc:1434] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260616 19:51:52.081429 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 51fa9bd399d54a86875db081081a8814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51fa9bd399d54a86875db081081a8814 already in progress: creating tablet
I20260616 19:51:52.082142 1198 tablet_bootstrap.cc:492] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:52.082993 1193 ts_tablet_manager.cc:1929] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.083200 1193 log.cc:1199] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/a8e2ac5db03f4278b341d01a58441100
I20260616 19:51:52.084157 1193 ts_tablet_manager.cc:1950] T a8e2ac5db03f4278b341d01a58441100 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:52.086989 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7af2cb04d4654ceabe58936f5a687406"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.088064 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7af2cb04d4654ceabe58936f5a687406 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.088778 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 61c66c72987941428a449601683fba68 with delete_type TABLET_DATA_DELETED (replaced by tablet 383589f0e211418bbdf5046ed90db410) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:52.088835 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8351427cb34466f82ee74fb60b6798b consensus state has no leader
I20260616 19:51:52.089327 1191 tablet_replica.cc:333] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:52.089497 1191 raft_consensus.cc:2243] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.089694 1191 raft_consensus.cc:2272] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.090416 1191 ts_tablet_manager.cc:1916] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.092190 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7fbe0c396a244071881a37948e4fe722" } new_table_name: "default.Table_71d7f131eebd4f7a91eaa3b20b52e82b" modify_external_catalogs: true
I20260616 19:51:52.092604 1198 tablet_bootstrap.cc:654] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.099408 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7cd14c1ea1ae4a9099fc559a154ac754" } new_table_name: "default.Table_4a9b0e9a1c6648f8bb08c587a4750e4f" modify_external_catalogs: true
I20260616 19:51:52.100682 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a2b65bc7877e47aa81d6910a62df9c75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:52.102296 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7290a282713e456c9a18c3983f90e218" } new_table_name: "default.Table_6a6d8516df114593b27d86140407b724" modify_external_catalogs: true
I20260616 19:51:52.102922 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_db0e8de4550f4b6c8a2d31081d0c7a93" } new_table_name: "default.Table_969ffb30ff464eea9255cf085e7bf42d" modify_external_catalogs: true
I20260616 19:51:52.104987 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_740f48968d6f4b38a0bd0dbcd42b9303"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:52.112255 760 tablet_service.cc:1558] Processing DeleteTablet for tablet e4705cacd95a45888fac6a76745eae4e with delete_type TABLET_DATA_DELETED (replaced by tablet 0da93e4052094862a44812990df1136a) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:52.114620 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd5a513aeb224609afaee1ded6ede5e6 consensus state has no leader
W20260616 19:51:52.115093 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 383589f0e211418bbdf5046ed90db410 consensus state has no leader
I20260616 19:51:52.118290 1029 tablet_service.cc:1511] Processing CreateTablet for tablet db75a5169c0b4650a551b8a76a724469 (DEFAULT_TABLE table=default.Table_8e4aaf1fba6a46d897cccbdb69567c8e [id=7a7fd9801283464ea1f9ac454219c3d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.119226 901 tablet_service.cc:1511] Processing CreateTablet for tablet db75a5169c0b4650a551b8a76a724469 (DEFAULT_TABLE table=default.Table_8e4aaf1fba6a46d897cccbdb69567c8e [id=7a7fd9801283464ea1f9ac454219c3d4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:52.120256 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2b65bc7877e47aa81d6910a62df9c75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:52.121869 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_740f48968d6f4b38a0bd0dbcd42b9303 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.122781 762 tablet_service.cc:1511] Processing CreateTablet for tablet dfee6a9e6d57487bb7d9482f7798e6b6 (DEFAULT_TABLE table=default.Table_81e67ee241e34396b9e1c159338b192a [id=074446fd6e71497cb644841e5bbd0510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.123226 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfee6a9e6d57487bb7d9482f7798e6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.124380 765 tablet_service.cc:1511] Processing CreateTablet for tablet 5c90188c0181467ea3deee14fa5568b3 (DEFAULT_TABLE table=default.Table_fce6c0a420e74d889b4665e221e3c559 [id=0d6caa2121db47609b15d8b087a3752a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.124764 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c90188c0181467ea3deee14fa5568b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:52.125398 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a56168eb4f5e449a8f9eed5c8cfad9df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a56168eb4f5e449a8f9eed5c8cfad9df already in progress: creating tablet
W20260616 19:51:52.126590 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 91336c7847ea4739a0be7fdd9d199cca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91336c7847ea4739a0be7fdd9d199cca already in progress: creating tablet
W20260616 19:51:52.126829 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a2b6158b31b34419aa3619f3ce8242b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2b6158b31b34419aa3619f3ce8242b3 already in progress: creating tablet
W20260616 19:51:52.127039 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e37f42ce8ec47fca1cf8aa75bc0202d already in progress: creating tablet
I20260616 19:51:52.127032 1036 tablet_service.cc:1511] Processing CreateTablet for tablet dfee6a9e6d57487bb7d9482f7798e6b6 (DEFAULT_TABLE table=default.Table_81e67ee241e34396b9e1c159338b192a [id=074446fd6e71497cb644841e5bbd0510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.127574 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet e4705cacd95a45888fac6a76745eae4e with delete_type TABLET_DATA_DELETED (replaced by tablet 0da93e4052094862a44812990df1136a) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:52.127612 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 79efb1de93bc4c1e81f4b2e15f621417 because the tablet was not found. No further retry: Not found: Tablet not found: 79efb1de93bc4c1e81f4b2e15f621417
I20260616 19:51:52.127755 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 5c90188c0181467ea3deee14fa5568b3 (DEFAULT_TABLE table=default.Table_fce6c0a420e74d889b4665e221e3c559 [id=0d6caa2121db47609b15d8b087a3752a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:52.128006 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c789abf00da24981be5bb72c0b5752d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c789abf00da24981be5bb72c0b5752d1 already in progress: creating tablet
W20260616 19:51:52.128343 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 97afcb75fdc2440d913ad421534a4ef3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97afcb75fdc2440d913ad421534a4ef3 already in progress: creating tablet
W20260616 19:51:52.128760 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de0ea6ca79ff4ed09f63fc7bb98eaabd already in progress: creating tablet
I20260616 19:51:52.130870 751 tablet_service.cc:1511] Processing CreateTablet for tablet d61873c8aa094d7f899a61307a36f895 (DEFAULT_TABLE table=default.Table_7290a282713e456c9a18c3983f90e218 [id=d104c5ac8acc4a6f9ed7cc87879d661b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.131062 891 tablet_service.cc:1511] Processing CreateTablet for tablet 5c90188c0181467ea3deee14fa5568b3 (DEFAULT_TABLE table=default.Table_fce6c0a420e74d889b4665e221e3c559 [id=0d6caa2121db47609b15d8b087a3752a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.131253 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d61873c8aa094d7f899a61307a36f895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.131529 889 tablet_service.cc:1558] Processing DeleteTablet for tablet fcfc9231ffeb487cb15ed2a3788730ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:52.133641 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eac603a84d3c4f96bd444c54f28d278d consensus state has no leader
I20260616 19:51:52.139467 889 tablet_service.cc:1511] Processing CreateTablet for tablet d61873c8aa094d7f899a61307a36f895 (DEFAULT_TABLE table=default.Table_7290a282713e456c9a18c3983f90e218 [id=d104c5ac8acc4a6f9ed7cc87879d661b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:52.141369 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d61873c8aa094d7f899a61307a36f895 consensus state has no leader
W20260616 19:51:52.143205 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet cf89adf3cbe54beab939645f7ebbb616 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf89adf3cbe54beab939645f7ebbb616 already in progress: creating tablet
I20260616 19:51:52.144912 1038 tablet_service.cc:1511] Processing CreateTablet for tablet d61873c8aa094d7f899a61307a36f895 (DEFAULT_TABLE table=default.Table_7290a282713e456c9a18c3983f90e218 [id=d104c5ac8acc4a6f9ed7cc87879d661b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.145592 762 tablet_service.cc:1558] Processing DeleteTablet for tablet ec8b1cb4a9d34a798ec287782f1219ee with delete_type TABLET_DATA_DELETED (replaced by tablet 2df7d27b41b440c5b082e8783adfeced) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.145988 1193 tablet_replica.cc:333] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:52.147197 760 tablet_service.cc:1511] Processing CreateTablet for tablet db75a5169c0b4650a551b8a76a724469 (DEFAULT_TABLE table=default.Table_8e4aaf1fba6a46d897cccbdb69567c8e [id=7a7fd9801283464ea1f9ac454219c3d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.148903 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db75a5169c0b4650a551b8a76a724469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.149518 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfee6a9e6d57487bb7d9482f7798e6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.150038 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c90188c0181467ea3deee14fa5568b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.155334 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a2b65bc7877e47aa81d6910a62df9c75" } modify_external_catalogs: true
I20260616 19:51:52.155629 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a2b65bc7877e47aa81d6910a62df9c75" } modify_external_catalogs: true
I20260616 19:51:52.157577 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6db02b65da9f42279f9442335b438b91" } modify_external_catalogs: true
I20260616 19:51:52.157696 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6d7c8b4a63044ff78221b0a47f41d5a1" } modify_external_catalogs: true
I20260616 19:51:52.158071 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6d7c8b4a63044ff78221b0a47f41d5a1" } modify_external_catalogs: true
I20260616 19:51:52.157755 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6db02b65da9f42279f9442335b438b91" } modify_external_catalogs: true
I20260616 19:51:52.159824 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d61873c8aa094d7f899a61307a36f895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.164286 461 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 5fa56cfda36b409ca2b6e6b0606b25ae
I20260616 19:51:52.165483 903 tablet_service.cc:1511] Processing CreateTablet for tablet dfee6a9e6d57487bb7d9482f7798e6b6 (DEFAULT_TABLE table=default.Table_81e67ee241e34396b9e1c159338b192a [id=074446fd6e71497cb644841e5bbd0510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.166101 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 51fa9bd399d54a86875db081081a8814 with delete_type TABLET_DATA_DELETED (replaced by tablet 2cfb2238cbdb421a8f5001dc729e9bb5) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.166409 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db75a5169c0b4650a551b8a76a724469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.167769 1193 raft_consensus.cc:2243] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.168802 1205 raft_consensus.cc:493] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:52.168998 1205 raft_consensus.cc:515] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.168953 1193 raft_consensus.cc:2272] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.169484 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7161894b9f9047fda9ed3f2180518a59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.169694 1205 leader_election.cc:290] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:51:52.171064 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet e4705cacd95a45888fac6a76745eae4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4705cacd95a45888fac6a76745eae4e already in progress: creating tablet
W20260616 19:51:52.171628 719 leader_election.cc:343] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 2124e4b923ba439893788bb7350cdae9
W20260616 19:51:52.172415 718 leader_election.cc:343] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: 2124e4b923ba439893788bb7350cdae9
I20260616 19:51:52.172544 718 leader_election.cc:304] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:51:52.172582 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet fcfc9231ffeb487cb15ed2a3788730ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcfc9231ffeb487cb15ed2a3788730ba already in progress: creating tablet
W20260616 19:51:52.172816 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 51fa9bd399d54a86875db081081a8814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51fa9bd399d54a86875db081081a8814 already in progress: creating tablet
I20260616 19:51:52.173079 1205 raft_consensus.cc:2749] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:52.173110 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db75a5169c0b4650a551b8a76a724469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.173216 1192 tablet_bootstrap.cc:492] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:52.173379 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d61873c8aa094d7f899a61307a36f895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.173629 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c90188c0181467ea3deee14fa5568b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.179993 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776841d895d6431fbee76b7c4e28d973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.181377 1193 ts_tablet_manager.cc:1916] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.188858 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfee6a9e6d57487bb7d9482f7798e6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.190960 453 master_service.cc:960] ReplaceTablet: received request to replace tablet fcfc9231ffeb487cb15ed2a3788730ba from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:52.173491 1192 ts_tablet_manager.cc:1403] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.671s user 0.002s sys 0.006s
I20260616 19:51:52.194310 1192 raft_consensus.cc:359] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.194550 1192 raft_consensus.cc:385] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.194658 1192 raft_consensus.cc:740] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.196439 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5a513aeb224609afaee1ded6ede5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.198102 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_41371955e37644fda9a23d0fba091c86" } modify_external_catalogs: true
I20260616 19:51:52.198326 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_41371955e37644fda9a23d0fba091c86" } modify_external_catalogs: true
I20260616 19:51:52.202785 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cd728ab6319e49a395bee4e74aff4e22" } modify_external_catalogs: true
I20260616 19:51:52.202982 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cd728ab6319e49a395bee4e74aff4e22" } modify_external_catalogs: true
I20260616 19:51:52.204643 1192 consensus_queue.cc:260] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.207345 1198 tablet_bootstrap.cc:492] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:52.207985 1198 ts_tablet_manager.cc:1403] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.126s user 0.011s sys 0.014s
I20260616 19:51:52.209363 1198 raft_consensus.cc:359] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.209594 1198 raft_consensus.cc:385] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.209668 1198 raft_consensus.cc:740] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.209909 1198 consensus_queue.cc:260] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.212716 1198 ts_tablet_manager.cc:1434] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260616 19:51:52.216742 1198 tablet_bootstrap.cc:492] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:52.217090 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fd2cd6063dc430e89188ed00e76a760 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.218545 1198 tablet_bootstrap.cc:654] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.220716 1196 tablet_bootstrap.cc:492] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:52.220939 1196 ts_tablet_manager.cc:1403] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.154s user 0.028s sys 0.027s
I20260616 19:51:52.221938 1196 raft_consensus.cc:359] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.222241 1196 raft_consensus.cc:385] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.225478 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0f061d4bc90f42409eb99987059e6656
I20260616 19:51:52.222332 1196 raft_consensus.cc:740] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.225967 1196 consensus_queue.cc:260] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.228027 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f061d4bc90f42409eb99987059e6656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.228731 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f061d4bc90f42409eb99987059e6656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.230159 1196 ts_tablet_manager.cc:1434] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260616 19:51:52.230513 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 154ca8a6bce84b4bab932e69ec7f1f8e
I20260616 19:51:52.230628 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 31d22240d294454cbeb2ca5b07d45273
I20260616 19:51:52.231896 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 154ca8a6bce84b4bab932e69ec7f1f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.232779 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d22240d294454cbeb2ca5b07d45273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.232925 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d22240d294454cbeb2ca5b07d45273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.233549 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 154ca8a6bce84b4bab932e69ec7f1f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.234175 1196 tablet_bootstrap.cc:492] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:52.234407 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d22240d294454cbeb2ca5b07d45273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:52.235013 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 0f061d4bc90f42409eb99987059e6656 because the tablet was not found. No further retry: Not found: Tablet not found: 0f061d4bc90f42409eb99987059e6656
W20260616 19:51:52.235337 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 31d22240d294454cbeb2ca5b07d45273 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31d22240d294454cbeb2ca5b07d45273 already in progress: creating tablet
I20260616 19:51:52.235388 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d6350e9b4bf443519e2849b4c42a6252"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.235667 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 154ca8a6bce84b4bab932e69ec7f1f8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 154ca8a6bce84b4bab932e69ec7f1f8e already in progress: creating tablet
I20260616 19:51:52.236584 1196 tablet_bootstrap.cc:654] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.238626 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 2df7d27b41b440c5b082e8783adfeced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.241194 1198 tablet_bootstrap.cc:492] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:52.241355 1198 ts_tablet_manager.cc:1403] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.000s
I20260616 19:51:52.242218 1198 raft_consensus.cc:359] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.242403 1198 raft_consensus.cc:385] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.242491 1198 raft_consensus.cc:740] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.243146 1198 consensus_queue.cc:260] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.247574 1198 ts_tablet_manager.cc:1434] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260616 19:51:52.250496 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a2448644894be186e2ab62f3d662be with delete_type TABLET_DATA_DELETED (replaced by tablet ab33d99d857145dfbda54ff2f7464486) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.251557 1191 ts_tablet_manager.cc:1929] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.251629 1198 tablet_bootstrap.cc:492] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:52.251698 1191 log.cc:1199] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/61c66c72987941428a449601683fba68
I20260616 19:51:52.252149 1191 ts_tablet_manager.cc:1950] T 61c66c72987941428a449601683fba68 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:52.254729 1196 tablet_bootstrap.cc:492] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:52.254874 1196 ts_tablet_manager.cc:1403] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.003s
I20260616 19:51:52.243012 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6e88deb681d2401ab28118463139df63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:52.255685 1196 raft_consensus.cc:359] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:52.255837 1196 raft_consensus.cc:385] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.255915 1196 raft_consensus.cc:740] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
W20260616 19:51:52.256285 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e88deb681d2401ab28118463139df63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.243247 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ce91ab4603cc400d94cf6e1fcfe99048"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.257329 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce91ab4603cc400d94cf6e1fcfe99048 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.257290 1196 consensus_queue.cc:260] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:52.243409 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_29d4c487ede340ee9de12af6c3092aec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.257871 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29d4c487ede340ee9de12af6c3092aec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.258255 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 61c66c72987941428a449601683fba68 (table default.Table_4a9b0e9a1c6648f8bb08c587a4750e4f [id=e75a6e5e4f0047d9b398ce230b170131]) successfully deleted
I20260616 19:51:52.243703 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a8fd992451b342788f8d4177fe2bf450"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:52.259457 1196 ts_tablet_manager.cc:1434] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260616 19:51:52.259766 1196 tablet_bootstrap.cc:492] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:51:52.259785 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8fd992451b342788f8d4177fe2bf450 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:52.236310 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6350e9b4bf443519e2849b4c42a6252 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.261641 1196 tablet_bootstrap.cc:654] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.245349 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet e8351427cb34466f82ee74fb60b6798b
W20260616 19:51:52.262387 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet e4705cacd95a45888fac6a76745eae4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4705cacd95a45888fac6a76745eae4e already in progress: creating tablet
I20260616 19:51:52.251226 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 51fa9bd399d54a86875db081081a8814 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:52.263502 1198 tablet_bootstrap.cc:654] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.266198 759 tablet_service.cc:1558] Processing DeleteTablet for tablet e8351427cb34466f82ee74fb60b6798b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.273823 1191 tablet_replica.cc:333] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:52.281770 901 tablet_service.cc:1558] Processing DeleteTablet for tablet e8351427cb34466f82ee74fb60b6798b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.281919 672 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0f061d4bc90f42409eb99987059e6656
I20260616 19:51:52.284952 1191 raft_consensus.cc:2243] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.285288 1191 raft_consensus.cc:2272] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.285509 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet e8351427cb34466f82ee74fb60b6798b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:52.287874 447 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111) [suppressed 13 similar messages]
I20260616 19:51:52.291993 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f061d4bc90f42409eb99987059e6656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.293354 901 tablet_service.cc:1511] Processing CreateTablet for tablet 21eb01a4b2424d63affa5d9d71e2fa64 (DEFAULT_TABLE table=default.Table_873136a2abfb41018a2cec78a9f5fbc9 [id=1938e4f4794c4c3ebd2ea294477e38cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.293798 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21eb01a4b2424d63affa5d9d71e2fa64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.295938 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8498a9716d0241898b3508012accd7e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.296777 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8498a9716d0241898b3508012accd7e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.300855 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_dc293d30aea14e2385f75dbc8b66b349"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.301810 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc293d30aea14e2385f75dbc8b66b349 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.303436 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c7d27c7befea4f3b8554b44d79fc352a" } new_table_name: "default.Table_a77f9aa2275c48a3b5d23484f1560d13" modify_external_catalogs: true
I20260616 19:51:52.305418 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f061d4bc90f42409eb99987059e6656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:52.320119 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet e8351427cb34466f82ee74fb60b6798b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8351427cb34466f82ee74fb60b6798b already in progress: creating tablet
I20260616 19:51:52.320756 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f061d4bc90f42409eb99987059e6656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.322100 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 21eb01a4b2424d63affa5d9d71e2fa64 (DEFAULT_TABLE table=default.Table_873136a2abfb41018a2cec78a9f5fbc9 [id=1938e4f4794c4c3ebd2ea294477e38cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.322683 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21eb01a4b2424d63affa5d9d71e2fa64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.329113 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fc71d18f9d8540bf8012eb3491c6921d" } new_table_name: "default.Table_086d9859d5ca4cb0a6e3cfca328cc80f" modify_external_catalogs: true
W20260616 19:51:52.330816 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 0f061d4bc90f42409eb99987059e6656 because the tablet was not found. No further retry: Not found: Tablet not found: 0f061d4bc90f42409eb99987059e6656
I20260616 19:51:52.334681 760 tablet_service.cc:1511] Processing CreateTablet for tablet 21eb01a4b2424d63affa5d9d71e2fa64 (DEFAULT_TABLE table=default.Table_873136a2abfb41018a2cec78a9f5fbc9 [id=1938e4f4794c4c3ebd2ea294477e38cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.337364 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 154ca8a6bce84b4bab932e69ec7f1f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.337677 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 79efb1de93bc4c1e81f4b2e15f621417 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:52.340077 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fe6074841b0642f99392ef14431b9c15" } new_table_name: "default.Table_8e54ce683c7944fd86ca59195d417d0f" modify_external_catalogs: true
I20260616 19:51:52.340407 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7713a34d9f7e4031a42f66ee98382545"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.341374 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7713a34d9f7e4031a42f66ee98382545 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:52.343240 1210 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260616 19:51:52.343695 1210 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260616 19:51:52.343834 1210 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260616 19:51:52.345436 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 08330a8219574829834e36523ec6408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.349226 1191 ts_tablet_manager.cc:1916] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.355695 901 tablet_service.cc:1511] Processing CreateTablet for tablet 19832d0517524c0facf1f97486b1e58e (DEFAULT_TABLE table=default.Table_b34131cb606f45af969cab4e285a435c [id=f26741a3387e47f2905c06b1d7eecb17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.356256 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19832d0517524c0facf1f97486b1e58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.360378 1193 ts_tablet_manager.cc:1929] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.360559 1193 log.cc:1199] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/a4c8528b6f3b4a3a99dae8eb4f7e8bf1
I20260616 19:51:52.360906 1193 ts_tablet_manager.cc:1950] T a4c8528b6f3b4a3a99dae8eb4f7e8bf1 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:52.361286 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f061d4bc90f42409eb99987059e6656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.362159 1191 ts_tablet_manager.cc:1929] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.362315 1191 log.cc:1199] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/5fd2cd6063dc430e89188ed00e76a760
I20260616 19:51:52.362633 1191 ts_tablet_manager.cc:1950] T 5fd2cd6063dc430e89188ed00e76a760 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:52.362890 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 19832d0517524c0facf1f97486b1e58e (DEFAULT_TABLE table=default.Table_b34131cb606f45af969cab4e285a435c [id=f26741a3387e47f2905c06b1d7eecb17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.363332 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19832d0517524c0facf1f97486b1e58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.363632 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21eb01a4b2424d63affa5d9d71e2fa64. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:52.364154 1210 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260616 19:51:52.364264 1210 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260616 19:51:52.364364 1210 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260616 19:51:52.365466 1198 tablet_bootstrap.cc:492] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:52.365669 1198 ts_tablet_manager.cc:1403] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.114s user 0.005s sys 0.001s
I20260616 19:51:52.366545 1198 raft_consensus.cc:359] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.366739 1198 raft_consensus.cc:385] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.366811 1198 raft_consensus.cc:740] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.367120 1198 consensus_queue.cc:260] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.369711 758 tablet_service.cc:1511] Processing CreateTablet for tablet 19832d0517524c0facf1f97486b1e58e (DEFAULT_TABLE table=default.Table_b34131cb606f45af969cab4e285a435c [id=f26741a3387e47f2905c06b1d7eecb17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.370324 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19832d0517524c0facf1f97486b1e58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.371135 1198 ts_tablet_manager.cc:1434] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:51:52.372725 1198 tablet_bootstrap.cc:492] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:51:52.364447 1210 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260616 19:51:52.375052 1198 tablet_bootstrap.cc:654] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.376888 1192 ts_tablet_manager.cc:1434] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.183s user 0.037s sys 0.050s
I20260616 19:51:52.377630 1192 tablet_bootstrap.cc:492] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:52.379288 1192 tablet_bootstrap.cc:654] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.387692 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 387ba2086bca4a15b388700044e3c45d from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:52.388190 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 54ceb5a01be24dfb9c08001d662a9ac4 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:52.388360 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet a6dd15b09ec246ee90bdc73fd93f862a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.389801 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4d5cc10e0f904a91b1750515a22226d1" } new_table_name: "default.Table_ad352a2aedbf45969134e05256cde7c2" modify_external_catalogs: true
W20260616 19:51:52.391471 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da380823d0ae437d9f1d9d0f633f74bb consensus state has no leader
I20260616 19:51:52.391749 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9df52ea3bbc442d483f9c47bdfaeeca2" } new_table_name: "default.Table_0531204d83954cb3a55ad0f218d390a1" modify_external_catalogs: true
I20260616 19:51:52.392125 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0a2742804d7d48fcb8acc6f20ae3536b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.392863 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a2742804d7d48fcb8acc6f20ae3536b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.395744 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b28a102fcc514ff4ad1152a5fdf07cae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.396238 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b28a102fcc514ff4ad1152a5fdf07cae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:52.398217 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d916b2f553ce41df8934e1190fa32120 consensus state has no leader
I20260616 19:51:52.398550 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fce6c0a420e74d889b4665e221e3c559" } modify_external_catalogs: true
I20260616 19:51:52.398770 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fce6c0a420e74d889b4665e221e3c559" } modify_external_catalogs: true
I20260616 19:51:52.405287 1193 tablet_replica.cc:333] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:52.405642 1193 raft_consensus.cc:2243] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.405958 1193 raft_consensus.cc:2272] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.406841 1193 ts_tablet_manager.cc:1916] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.407156 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet a4c8528b6f3b4a3a99dae8eb4f7e8bf1 (table default.Table_43112c4d7050453dad8984408f75baf3 [id=5fcb69f72f9a4146a022e60757c42e09]) successfully deleted
W20260616 19:51:52.407581 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 302997d0e3b247ebaceec9151f580c3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 302997d0e3b247ebaceec9151f580c3a already in progress: creating tablet
W20260616 19:51:52.407842 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ddc4929e1dc4c9284cd78dfa6b6febd already in progress: creating tablet
W20260616 19:51:52.408108 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 91336c7847ea4739a0be7fdd9d199cca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91336c7847ea4739a0be7fdd9d199cca already in progress: creating tablet
W20260616 19:51:52.408352 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a56168eb4f5e449a8f9eed5c8cfad9df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a56168eb4f5e449a8f9eed5c8cfad9df already in progress: creating tablet
I20260616 19:51:52.408324 1210 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:34219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.188
--webserver_port=35247
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 16 Jun 2026 19:43:22 UTC on bdcb31816ec0
build id 12426
ASAN enabled
W20260616 19:51:52.408885 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a2b6158b31b34419aa3619f3ce8242b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2b6158b31b34419aa3619f3ce8242b3 already in progress: creating tablet
I20260616 19:51:52.410495 1210 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260616 19:51:52.412392 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 54ceb5a01be24dfb9c08001d662a9ac4 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:52.413430 1210 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260616 19:51:52.414223 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 362e7ff9bea3459ca018d1a7febb2ce4 (DEFAULT_TABLE table=default.Table_2836dd728d0d4df497738e4959ed3bc0 [id=d37e43e64c414245a12d2a86ebcbc24b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.414664 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362e7ff9bea3459ca018d1a7febb2ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.423898 1191 tablet_replica.cc:333] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:52.424091 1191 raft_consensus.cc:2243] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.424252 1191 raft_consensus.cc:2272] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.425102 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 5fd2cd6063dc430e89188ed00e76a760 (table default.Table_3b3dce47cfdc420eba859affc6ad8f5f [id=02b198713aff4f2c967d63e708d57699]) successfully deleted
W20260616 19:51:52.425395 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0f061d4bc90f42409eb99987059e6656 because the tablet was not found. No further retry: Not found: Tablet not found: 0f061d4bc90f42409eb99987059e6656
W20260616 19:51:52.425593 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 154ca8a6bce84b4bab932e69ec7f1f8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 154ca8a6bce84b4bab932e69ec7f1f8e already in progress: creating tablet
W20260616 19:51:52.425807 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 31d22240d294454cbeb2ca5b07d45273 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31d22240d294454cbeb2ca5b07d45273 already in progress: creating tablet
I20260616 19:51:52.426512 1191 ts_tablet_manager.cc:1916] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.426452 904 tablet_service.cc:1511] Processing CreateTablet for tablet 362e7ff9bea3459ca018d1a7febb2ce4 (DEFAULT_TABLE table=default.Table_2836dd728d0d4df497738e4959ed3bc0 [id=d37e43e64c414245a12d2a86ebcbc24b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.426906 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362e7ff9bea3459ca018d1a7febb2ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.427884 903 tablet_service.cc:1558] Processing DeleteTablet for tablet a8e2ac5db03f4278b341d01a58441100 with delete_type TABLET_DATA_DELETED (replaced by tablet a2b6158b31b34419aa3619f3ce8242b3) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.428148 1190 tablet_replica.cc:333] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:52.428566 1190 raft_consensus.cc:2243] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.428759 1190 raft_consensus.cc:2272] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.429524 1190 ts_tablet_manager.cc:1916] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.436370 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf54b260fc941599cffb12581e8116a (DEFAULT_TABLE table=default.Table_7af2cb04d4654ceabe58936f5a687406 [id=7f7faf7145fd4ea5babd783d76d44821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.437206 759 tablet_service.cc:1511] Processing CreateTablet for tablet 0f061d4bc90f42409eb99987059e6656 (DEFAULT_TABLE table=default.Table_6d7c8b4a63044ff78221b0a47f41d5a1 [id=b90ab6d60662478db8d946925f66450b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.437727 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f061d4bc90f42409eb99987059e6656. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:52.444231 1256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:51:52.446377 756 tablet_service.cc:1511] Processing CreateTablet for tablet 362e7ff9bea3459ca018d1a7febb2ce4 (DEFAULT_TABLE table=default.Table_2836dd728d0d4df497738e4959ed3bc0 [id=d37e43e64c414245a12d2a86ebcbc24b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.447042 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362e7ff9bea3459ca018d1a7febb2ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.449254 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf54b260fc941599cffb12581e8116a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.452160 1190 ts_tablet_manager.cc:1929] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.452325 1190 log.cc:1199] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/a8e2ac5db03f4278b341d01a58441100
I20260616 19:51:52.456382 1190 ts_tablet_manager.cc:1950] T a8e2ac5db03f4278b341d01a58441100 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:52.467854 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 0f061d4bc90f42409eb99987059e6656 (DEFAULT_TABLE table=default.Table_6d7c8b4a63044ff78221b0a47f41d5a1 [id=b90ab6d60662478db8d946925f66450b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:52.470168 1257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:51:52.483323 904 tablet_service.cc:1511] Processing CreateTablet for tablet 0f061d4bc90f42409eb99987059e6656 (DEFAULT_TABLE table=default.Table_6d7c8b4a63044ff78221b0a47f41d5a1 [id=b90ab6d60662478db8d946925f66450b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.483990 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f061d4bc90f42409eb99987059e6656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.494726 1205 raft_consensus.cc:493] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:52.494966 1205 raft_consensus.cc:515] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:52.495852 1205 leader_election.cc:290] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:51:52.497419 719 leader_election.cc:343] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 08330a8219574829834e36523ec6408e
W20260616 19:51:52.498128 718 leader_election.cc:343] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: 08330a8219574829834e36523ec6408e
I20260616 19:51:52.498240 718 leader_election.cc:304] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:52.498263 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet a8e2ac5db03f4278b341d01a58441100 (table default.Table_62044432f4a549d8846c6d9d17274c1a [id=48ebc382fbde40f8a05ccb60001efe00]) successfully deleted
I20260616 19:51:52.498716 1205 raft_consensus.cc:2749] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:52.501758 1196 tablet_bootstrap.cc:492] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:52.501991 1196 ts_tablet_manager.cc:1403] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.242s user 0.081s sys 0.100s
I20260616 19:51:52.503175 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 99551210f5974332bf6a16ee74b220f6 (DEFAULT_TABLE table=default.Table_75ff35530aa041f0a81c83741b88c5cf [id=4fbf7d11df5448f4b249f9c831241f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.504163 756 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf54b260fc941599cffb12581e8116a (DEFAULT_TABLE table=default.Table_7af2cb04d4654ceabe58936f5a687406 [id=7f7faf7145fd4ea5babd783d76d44821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.504567 762 tablet_service.cc:1511] Processing CreateTablet for tablet 2cfb2238cbdb421a8f5001dc729e9bb5 (DEFAULT_TABLE table=default.Table_1009b1ce9fe84b8a8a3e63ac3dc43857 [id=dadf8402246843219b213be49e8ad54b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.504776 759 tablet_service.cc:1511] Processing CreateTablet for tablet 99551210f5974332bf6a16ee74b220f6 (DEFAULT_TABLE table=default.Table_75ff35530aa041f0a81c83741b88c5cf [id=4fbf7d11df5448f4b249f9c831241f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.505121 1196 raft_consensus.cc:359] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.505321 1196 raft_consensus.cc:385] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.505398 1196 raft_consensus.cc:740] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.506211 903 tablet_service.cc:1511] Processing CreateTablet for tablet 99551210f5974332bf6a16ee74b220f6 (DEFAULT_TABLE table=default.Table_75ff35530aa041f0a81c83741b88c5cf [id=4fbf7d11df5448f4b249f9c831241f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.506639 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99551210f5974332bf6a16ee74b220f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.507349 1196 consensus_queue.cc:260] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.508889 1196 ts_tablet_manager.cc:1434] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260616 19:51:52.509195 1196 tablet_bootstrap.cc:492] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:52.511523 1196 tablet_bootstrap.cc:654] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.515846 1198 tablet_bootstrap.cc:492] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:52.516113 1198 ts_tablet_manager.cc:1403] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.143s user 0.010s sys 0.013s
I20260616 19:51:52.517297 1198 raft_consensus.cc:359] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.517633 1198 raft_consensus.cc:385] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.517792 1198 raft_consensus.cc:740] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.518181 1198 consensus_queue.cc:260] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.521500 1198 ts_tablet_manager.cc:1434] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260616 19:51:52.523000 1198 tablet_bootstrap.cc:492] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:52.534339 904 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf54b260fc941599cffb12581e8116a (DEFAULT_TABLE table=default.Table_7af2cb04d4654ceabe58936f5a687406 [id=7f7faf7145fd4ea5babd783d76d44821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.535001 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf54b260fc941599cffb12581e8116a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.535943 1191 ts_tablet_manager.cc:1929] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.536098 1191 log.cc:1199] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/63a2448644894be186e2ab62f3d662be
I20260616 19:51:52.536494 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99551210f5974332bf6a16ee74b220f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.539372 1191 ts_tablet_manager.cc:1950] T 63a2448644894be186e2ab62f3d662be P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:52.540886 1191 tablet_replica.cc:333] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:52.541097 1191 raft_consensus.cc:2243] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.541698 1191 raft_consensus.cc:2272] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.542479 1191 ts_tablet_manager.cc:1916] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.542874 1198 tablet_bootstrap.cc:654] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.542870 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 63a2448644894be186e2ab62f3d662be (table default.Table_fe6074841b0642f99392ef14431b9c15 [id=122f88b500c0425e833926b349605d6f]) successfully deleted
W20260616 19:51:52.543226 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet e8351427cb34466f82ee74fb60b6798b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8351427cb34466f82ee74fb60b6798b already in progress: creating tablet
W20260616 19:51:52.543550 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0f061d4bc90f42409eb99987059e6656 because the tablet was not found. No further retry: Not found: Tablet not found: 0f061d4bc90f42409eb99987059e6656
I20260616 19:51:52.548530 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f061d4bc90f42409eb99987059e6656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.548873 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf54b260fc941599cffb12581e8116a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.549551 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cfb2238cbdb421a8f5001dc729e9bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.550032 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99551210f5974332bf6a16ee74b220f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.561347 1198 tablet_bootstrap.cc:492] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:52.561591 1198 ts_tablet_manager.cc:1403] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.001s
I20260616 19:51:52.569896 1198 raft_consensus.cc:359] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.570227 1198 raft_consensus.cc:385] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.570411 1196 tablet_bootstrap.cc:492] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:52.570531 1198 raft_consensus.cc:740] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.570662 1196 ts_tablet_manager.cc:1403] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.062s user 0.018s sys 0.026s
I20260616 19:51:52.571022 1198 consensus_queue.cc:260] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.571631 1196 raft_consensus.cc:359] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.571837 1196 raft_consensus.cc:385] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.571930 1196 raft_consensus.cc:740] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.572197 1196 consensus_queue.cc:260] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.573132 1196 ts_tablet_manager.cc:1434] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260616 19:51:52.573460 1196 tablet_bootstrap.cc:492] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:52.575224 1196 tablet_bootstrap.cc:654] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.575688 1198 ts_tablet_manager.cc:1434] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.014s user 0.002s sys 0.002s
I20260616 19:51:52.578250 1198 tablet_bootstrap.cc:492] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:52.584717 1196 tablet_bootstrap.cc:492] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:52.584908 1196 ts_tablet_manager.cc:1403] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260616 19:51:52.584951 1198 tablet_bootstrap.cc:654] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.585775 1196 raft_consensus.cc:359] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.585964 1196 raft_consensus.cc:385] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.586030 1196 raft_consensus.cc:740] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.586247 1196 consensus_queue.cc:260] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.586927 1196 ts_tablet_manager.cc:1434] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:52.589552 1198 tablet_bootstrap.cc:492] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:52.589685 1198 ts_tablet_manager.cc:1403] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20260616 19:51:52.590469 1198 raft_consensus.cc:359] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.590664 1198 raft_consensus.cc:385] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.590741 1198 raft_consensus.cc:740] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.590934 1198 consensus_queue.cc:260] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.593686 1191 ts_tablet_manager.cc:1929] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.593816 1191 log.cc:1199] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/a6dd15b09ec246ee90bdc73fd93f862a
I20260616 19:51:52.594141 1191 ts_tablet_manager.cc:1950] T a6dd15b09ec246ee90bdc73fd93f862a P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:52.594496 1196 tablet_bootstrap.cc:492] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:52.596858 1196 tablet_bootstrap.cc:654] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.597067 1193 ts_tablet_manager.cc:1929] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.597185 1193 log.cc:1199] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/2124e4b923ba439893788bb7350cdae9
I20260616 19:51:52.597589 1193 ts_tablet_manager.cc:1950] T 2124e4b923ba439893788bb7350cdae9 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:52.598608 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 2124e4b923ba439893788bb7350cdae9 (table default.Table_62044432f4a549d8846c6d9d17274c1a [id=48ebc382fbde40f8a05ccb60001efe00]) successfully deleted
I20260616 19:51:52.601419 1198 ts_tablet_manager.cc:1434] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260616 19:51:52.604301 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet a6dd15b09ec246ee90bdc73fd93f862a (table default.Table_21a0653003a3493e952199c335c04c55 [id=d8ed14afa8ef43db8e963aab86921ed6]) successfully deleted
I20260616 19:51:52.607074 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_81e67ee241e34396b9e1c159338b192a" } modify_external_catalogs: true
I20260616 19:51:52.607268 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_81e67ee241e34396b9e1c159338b192a" } modify_external_catalogs: true
W20260616 19:51:52.608532 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab33d99d857145dfbda54ff2f7464486 consensus state has no leader
I20260616 19:51:52.608906 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_baf21e2369ea4aa6aa6cbf2370be11b9" } modify_external_catalogs: true
I20260616 19:51:52.609047 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_baf21e2369ea4aa6aa6cbf2370be11b9" } modify_external_catalogs: true
I20260616 19:51:52.609850 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 54ceb5a01be24dfb9c08001d662a9ac4
I20260616 19:51:52.610265 455 catalog_manager.cc:6784] ReplaceTablet: tablet 54ceb5a01be24dfb9c08001d662a9ac4 deleted and replaced by tablet 122a8b15e62f4b23b465e2dbc816df62
I20260616 19:51:52.610565 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6e88deb681d2401ab28118463139df63" } modify_external_catalogs: true
I20260616 19:51:52.610726 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6e88deb681d2401ab28118463139df63" } modify_external_catalogs: true
W20260616 19:51:52.611809 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7161894b9f9047fda9ed3f2180518a59 consensus state has no leader
I20260616 19:51:52.612114 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0ed7b3aa00c145f49e22f9cbc892bc0c" } modify_external_catalogs: true
I20260616 19:51:52.612241 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0ed7b3aa00c145f49e22f9cbc892bc0c" } modify_external_catalogs: true
W20260616 19:51:52.613489 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f consensus state has no leader
I20260616 19:51:52.613732 457 master_service.cc:960] ReplaceTablet: received request to replace tablet fd5a513aeb224609afaee1ded6ede5e6 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:52.614503 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 54ceb5a01be24dfb9c08001d662a9ac4 with delete_type TABLET_DATA_DELETED (replaced by tablet 122a8b15e62f4b23b465e2dbc816df62) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.615145 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6cb59d68dcc344deae0b9679df0f26d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.615801 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cb59d68dcc344deae0b9679df0f26d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.617131 458 master_service.cc:960] ReplaceTablet: received request to replace tablet bb2fdea2d4ab42708fcd3102ea54bdb6 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:52.618460 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_11377e6262de467fbd54d3ab881b4362"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.618940 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11377e6262de467fbd54d3ab881b4362 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.620388 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 54ceb5a01be24dfb9c08001d662a9ac4 with delete_type TABLET_DATA_DELETED (replaced by tablet 122a8b15e62f4b23b465e2dbc816df62) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.621592 903 tablet_service.cc:1511] Processing CreateTablet for tablet 2cfb2238cbdb421a8f5001dc729e9bb5 (DEFAULT_TABLE table=default.Table_1009b1ce9fe84b8a8a3e63ac3dc43857 [id=dadf8402246843219b213be49e8ad54b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.622105 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cfb2238cbdb421a8f5001dc729e9bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.622195 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fd2cd6063dc430e89188ed00e76a760 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.623523 1198 tablet_bootstrap.cc:492] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:52.625335 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_71d7f131eebd4f7a91eaa3b20b52e82b" } new_table_name: "default.Table_60319baa28b942b29f5c6ec9005c162e" modify_external_catalogs: true
I20260616 19:51:52.627912 1192 tablet_bootstrap.cc:492] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:52.628137 1192 ts_tablet_manager.cc:1403] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.251s user 0.040s sys 0.083s
I20260616 19:51:52.628276 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet a6dd15b09ec246ee90bdc73fd93f862a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.628531 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 0da93e4052094862a44812990df1136a (DEFAULT_TABLE table=default.Table_fe763512a640490ebb25dca52b04788a [id=ad67f2c8f60f4c8c9b4ca2e57ffdb6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.628782 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 2cfb2238cbdb421a8f5001dc729e9bb5 (DEFAULT_TABLE table=default.Table_1009b1ce9fe84b8a8a3e63ac3dc43857 [id=dadf8402246843219b213be49e8ad54b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.628906 1198 tablet_bootstrap.cc:654] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.628958 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da93e4052094862a44812990df1136a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.628937 1192 raft_consensus.cc:359] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.629127 1192 raft_consensus.cc:385] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.629194 1192 raft_consensus.cc:740] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.629244 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cfb2238cbdb421a8f5001dc729e9bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.628537 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 54ceb5a01be24dfb9c08001d662a9ac4 with delete_type TABLET_DATA_DELETED (replaced by tablet 122a8b15e62f4b23b465e2dbc816df62) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.629441 1192 consensus_queue.cc:260] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.630053 1192 ts_tablet_manager.cc:1434] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:52.630390 1192 tablet_bootstrap.cc:492] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:52.632037 1192 tablet_bootstrap.cc:654] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.632973 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 5af9bdceae184f8dbb9e5db67a11ee63 (DEFAULT_TABLE table=default.Table_bed17ff52ac5410784b004e2ef370bac [id=d948f287146b431dbce6363443e953a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.633386 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af9bdceae184f8dbb9e5db67a11ee63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.636732 1033 tablet_service.cc:1511] Processing CreateTablet for tablet d51a6fb4c49e461583a5aba1813b2a3e (DEFAULT_TABLE table=default.Table_c6a3c639c2574d04a358f1ce11073269 [id=2d4376cceca648ef87dcf561d1e9e701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.637084 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51a6fb4c49e461583a5aba1813b2a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.643823 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0da93e4052094862a44812990df1136a (DEFAULT_TABLE table=default.Table_fe763512a640490ebb25dca52b04788a [id=ad67f2c8f60f4c8c9b4ca2e57ffdb6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.644035 889 tablet_service.cc:1511] Processing CreateTablet for tablet d51a6fb4c49e461583a5aba1813b2a3e (DEFAULT_TABLE table=default.Table_c6a3c639c2574d04a358f1ce11073269 [id=2d4376cceca648ef87dcf561d1e9e701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.644373 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da93e4052094862a44812990df1136a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.645247 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51a6fb4c49e461583a5aba1813b2a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.643857 901 tablet_service.cc:1511] Processing CreateTablet for tablet 5af9bdceae184f8dbb9e5db67a11ee63 (DEFAULT_TABLE table=default.Table_bed17ff52ac5410784b004e2ef370bac [id=d948f287146b431dbce6363443e953a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.646262 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af9bdceae184f8dbb9e5db67a11ee63. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:52.648080 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 54ceb5a01be24dfb9c08001d662a9ac4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54ceb5a01be24dfb9c08001d662a9ac4 already in progress: creating tablet
W20260616 19:51:52.649964 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a6dd15b09ec246ee90bdc73fd93f862a because the tablet was not found. No further retry: Not found: Tablet not found: a6dd15b09ec246ee90bdc73fd93f862a
W20260616 19:51:52.650238 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 54ceb5a01be24dfb9c08001d662a9ac4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54ceb5a01be24dfb9c08001d662a9ac4 already in progress: creating tablet
I20260616 19:51:52.655799 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 5c90188c0181467ea3deee14fa5568b3
I20260616 19:51:52.659243 1193 tablet_replica.cc:333] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:52.659474 1193 raft_consensus.cc:2243] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.659670 1193 raft_consensus.cc:2272] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.660283 1193 ts_tablet_manager.cc:1916] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.663326 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 302997d0e3b247ebaceec9151f580c3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.663633 1191 tablet_replica.cc:333] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:52.663815 1191 raft_consensus.cc:2243] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.664005 1191 raft_consensus.cc:2272] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.664598 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c90188c0181467ea3deee14fa5568b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.664793 1191 ts_tablet_manager.cc:1916] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.664842 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 2df7d27b41b440c5b082e8783adfeced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.665266 1190 tablet_replica.cc:333] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:52.665261 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet b657c023023d4070b3dfb16da1b35181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.665441 1190 raft_consensus.cc:2243] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.665594 1190 raft_consensus.cc:2272] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.668502 1190 ts_tablet_manager.cc:1916] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.668594 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet c789abf00da24981be5bb72c0b5752d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:52.669059 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 5c90188c0181467ea3deee14fa5568b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c90188c0181467ea3deee14fa5568b3 already in progress: creating tablet
I20260616 19:51:52.670027 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c90188c0181467ea3deee14fa5568b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.672797 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_161547cc1ad140baabf119e9187c3d4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:52.672938 760 tablet_service.cc:1511] Processing CreateTablet for tablet 5af9bdceae184f8dbb9e5db67a11ee63 (DEFAULT_TABLE table=default.Table_bed17ff52ac5410784b004e2ef370bac [id=d948f287146b431dbce6363443e953a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.673525 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af9bdceae184f8dbb9e5db67a11ee63. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:52.673516 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_161547cc1ad140baabf119e9187c3d4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.674207 1190 ts_tablet_manager.cc:1929] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260616 19:51:52.674207 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f (table default.Table_0531204d83954cb3a55ad0f218d390a1 [id=f99403687f45449d84c7ad8b490f6c2a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f consensus state has no leader
I20260616 19:51:52.674340 1190 log.cc:1199] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/2df7d27b41b440c5b082e8783adfeced
I20260616 19:51:52.674671 1190 ts_tablet_manager.cc:1950] T 2df7d27b41b440c5b082e8783adfeced P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:52.675678 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 2df7d27b41b440c5b082e8783adfeced (table default.Table_2ab0cf99b6014917bcbbecd656555ecd [id=249e27015542469da4f6d70df62e6008]) successfully deleted
I20260616 19:51:52.677018 1191 ts_tablet_manager.cc:1929] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.677155 1191 log.cc:1199] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/302997d0e3b247ebaceec9151f580c3a
I20260616 19:51:52.677554 1191 ts_tablet_manager.cc:1950] T 302997d0e3b247ebaceec9151f580c3a P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:52.678604 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 302997d0e3b247ebaceec9151f580c3a (table default.Table_fca913263b4846dea884088bbe9d2529 [id=a67f3f850e8e4696ba2c178ad1de8360]) successfully deleted
I20260616 19:51:52.678941 1191 tablet_replica.cc:333] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:52.679173 1191 raft_consensus.cc:2243] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.679344 1191 raft_consensus.cc:2272] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.680195 1191 ts_tablet_manager.cc:1916] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.681507 759 tablet_service.cc:1511] Processing CreateTablet for tablet d51a6fb4c49e461583a5aba1813b2a3e (DEFAULT_TABLE table=default.Table_c6a3c639c2574d04a358f1ce11073269 [id=2d4376cceca648ef87dcf561d1e9e701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.681988 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51a6fb4c49e461583a5aba1813b2a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.689677 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c90188c0181467ea3deee14fa5568b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.690474 762 tablet_service.cc:1558] Processing DeleteTablet for tablet a6dd15b09ec246ee90bdc73fd93f862a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.690963 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 302997d0e3b247ebaceec9151f580c3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:52.691543 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 97afcb75fdc2440d913ad421534a4ef3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97afcb75fdc2440d913ad421534a4ef3 already in progress: creating tablet
W20260616 19:51:52.691792 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e37f42ce8ec47fca1cf8aa75bc0202d already in progress: creating tablet
W20260616 19:51:52.692029 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet fcfc9231ffeb487cb15ed2a3788730ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcfc9231ffeb487cb15ed2a3788730ba already in progress: creating tablet
W20260616 19:51:52.692260 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de0ea6ca79ff4ed09f63fc7bb98eaabd already in progress: creating tablet
W20260616 19:51:52.692514 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 79efb1de93bc4c1e81f4b2e15f621417 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79efb1de93bc4c1e81f4b2e15f621417 already in progress: creating tablet
W20260616 19:51:52.692801 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c789abf00da24981be5bb72c0b5752d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c789abf00da24981be5bb72c0b5752d1 already in progress: creating tablet
W20260616 19:51:52.693086 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 51fa9bd399d54a86875db081081a8814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51fa9bd399d54a86875db081081a8814 already in progress: creating tablet
W20260616 19:51:52.693356 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet e4705cacd95a45888fac6a76745eae4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4705cacd95a45888fac6a76745eae4e already in progress: creating tablet
I20260616 19:51:52.693770 759 tablet_service.cc:1511] Processing CreateTablet for tablet 0da93e4052094862a44812990df1136a (DEFAULT_TABLE table=default.Table_fe763512a640490ebb25dca52b04788a [id=ad67f2c8f60f4c8c9b4ca2e57ffdb6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.694307 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da93e4052094862a44812990df1136a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.694758 1193 ts_tablet_manager.cc:1929] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.694928 1193 log.cc:1199] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/ec8b1cb4a9d34a798ec287782f1219ee
I20260616 19:51:52.695376 1193 ts_tablet_manager.cc:1950] T ec8b1cb4a9d34a798ec287782f1219ee P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:52.696599 1193 tablet_replica.cc:333] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:52.696810 1193 raft_consensus.cc:2243] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.697016 1193 raft_consensus.cc:2272] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.697526 1191 ts_tablet_manager.cc:1929] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.697711 1191 log.cc:1199] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/b657c023023d4070b3dfb16da1b35181
I20260616 19:51:52.698134 1191 ts_tablet_manager.cc:1950] T b657c023023d4070b3dfb16da1b35181 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:52.699196 1191 tablet_replica.cc:333] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:52.699379 1191 raft_consensus.cc:2243] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.699599 1191 raft_consensus.cc:2272] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.699328 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet b657c023023d4070b3dfb16da1b35181 (table default.Table_836a3f95e80c4694b0f23dc42274d582 [id=b92002b768ab4133b08391019758714a]) successfully deleted
I20260616 19:51:52.708817 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet ec8b1cb4a9d34a798ec287782f1219ee (table default.Table_2ab0cf99b6014917bcbbecd656555ecd [id=249e27015542469da4f6d70df62e6008]) successfully deleted
W20260616 19:51:52.709074 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 31d22240d294454cbeb2ca5b07d45273 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31d22240d294454cbeb2ca5b07d45273 already in progress: creating tablet
I20260616 19:51:52.710427 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet dfee6a9e6d57487bb7d9482f7798e6b6
I20260616 19:51:52.711215 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4d3d9fe6e0b84d6f923e9e134082daf6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.711810 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d3d9fe6e0b84d6f923e9e134082daf6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.713260 889 tablet_service.cc:1558] Processing DeleteTablet for tablet dfee6a9e6d57487bb7d9482f7798e6b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:52.714216 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet dfee6a9e6d57487bb7d9482f7798e6b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfee6a9e6d57487bb7d9482f7798e6b6 already in progress: creating tablet
I20260616 19:51:52.714617 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet dfee6a9e6d57487bb7d9482f7798e6b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.714821 760 tablet_service.cc:1558] Processing DeleteTablet for tablet dfee6a9e6d57487bb7d9482f7798e6b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.715590 1198 tablet_bootstrap.cc:492] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:52.715763 1198 ts_tablet_manager.cc:1403] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.092s user 0.007s sys 0.008s
I20260616 19:51:52.716562 1198 raft_consensus.cc:359] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.716768 1198 raft_consensus.cc:385] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.716861 1198 raft_consensus.cc:740] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.718102 455 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 4b5ea7c0f6c9406bb6b1f8ab79dd0431
I20260616 19:51:52.719987 1196 tablet_bootstrap.cc:492] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:52.720137 1196 ts_tablet_manager.cc:1403] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.133s user 0.041s sys 0.043s
I20260616 19:51:52.720299 1198 consensus_queue.cc:260] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:51:52.720839 1265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:51:52.720978 1198 ts_tablet_manager.cc:1434] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260616 19:51:52.721323 1198 tablet_bootstrap.cc:492] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:52.721334 1196 raft_consensus.cc:359] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.721525 1196 raft_consensus.cc:385] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.721621 1196 raft_consensus.cc:740] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.721889 1196 consensus_queue.cc:260] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.723140 1198 tablet_bootstrap.cc:654] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.723626 1196 ts_tablet_manager.cc:1434] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:51:52.723903 1196 tablet_bootstrap.cc:492] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:52.724519 1192 tablet_bootstrap.cc:492] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:52.724664 1192 ts_tablet_manager.cc:1403] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.094s user 0.009s sys 0.019s
I20260616 19:51:52.725543 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6813dd9e1dba43d2adf02fa586cb4c8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:52.725907 1192 raft_consensus.cc:359] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.726091 1192 raft_consensus.cc:385] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260616 19:51:52.726116 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6813dd9e1dba43d2adf02fa586cb4c8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.726169 1192 raft_consensus.cc:740] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.726375 1192 consensus_queue.cc:260] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:52.727234 1196 tablet_bootstrap.cc:654] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.727291 1192 ts_tablet_manager.cc:1434] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:51:52.727579 1192 tablet_bootstrap.cc:492] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:52.729369 1192 tablet_bootstrap.cc:654] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.730803 1191 ts_tablet_manager.cc:1916] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.731984 1193 ts_tablet_manager.cc:1916] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.740074 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 6d94eb734df94a309a7b171d907c81da
I20260616 19:51:52.741667 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d94eb734df94a309a7b171d907c81da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.743407 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d94eb734df94a309a7b171d907c81da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.744221 1191 ts_tablet_manager.cc:1929] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.744356 1191 log.cc:1199] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/c789abf00da24981be5bb72c0b5752d1
W20260616 19:51:52.744638 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 6d94eb734df94a309a7b171d907c81da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d94eb734df94a309a7b171d907c81da already in progress: creating tablet
I20260616 19:51:52.744791 1191 ts_tablet_manager.cc:1950] T c789abf00da24981be5bb72c0b5752d1 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:52.745942 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet c789abf00da24981be5bb72c0b5752d1 (table default.Table_c654445815a9494491a390790185534e [id=2158cc9d64824b9b8836ff772169d936]) successfully deleted
I20260616 19:51:52.751435 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d94eb734df94a309a7b171d907c81da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.751703 759 tablet_service.cc:1558] Processing DeleteTablet for tablet c789abf00da24981be5bb72c0b5752d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.752126 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 1369a97caf7246479b1a12ac38674eed with delete_type TABLET_DATA_DELETED (replaced by tablet 54ceb5a01be24dfb9c08001d662a9ac4) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.752434 1190 tablet_replica.cc:333] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:52.752657 1190 raft_consensus.cc:2243] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.752849 1190 raft_consensus.cc:2272] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.752432 1192 tablet_bootstrap.cc:492] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
W20260616 19:51:52.753108 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 5c90188c0181467ea3deee14fa5568b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c90188c0181467ea3deee14fa5568b3 already in progress: creating tablet
I20260616 19:51:52.753283 1192 ts_tablet_manager.cc:1403] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.026s user 0.012s sys 0.001s
I20260616 19:51:52.753911 1190 ts_tablet_manager.cc:1916] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.754110 1192 raft_consensus.cc:359] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.754316 1192 raft_consensus.cc:385] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.754388 1192 raft_consensus.cc:740] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.754410 1196 tablet_bootstrap.cc:492] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:52.754645 1192 consensus_queue.cc:260] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.754767 1196 ts_tablet_manager.cc:1403] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.007s
I20260616 19:51:52.755599 1198 tablet_bootstrap.cc:492] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:52.755558 1196 raft_consensus.cc:359] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.755724 1198 ts_tablet_manager.cc:1403] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.013s
I20260616 19:51:52.755743 1196 raft_consensus.cc:385] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.755818 1196 raft_consensus.cc:740] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.755779 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1009b1ce9fe84b8a8a3e63ac3dc43857" } new_table_name: "default.Table_f6d740d1faed4c4fa615d5711262ccf9" modify_external_catalogs: true
I20260616 19:51:52.756052 1196 consensus_queue.cc:260] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.756412 1198 raft_consensus.cc:359] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.756625 1198 raft_consensus.cc:385] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.756722 1198 raft_consensus.cc:740] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.756955 1198 consensus_queue.cc:260] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.757182 1210 server_base.cc:1061] running on GCE node
I20260616 19:51:52.757558 1198 ts_tablet_manager.cc:1434] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:52.758001 1198 tablet_bootstrap.cc:492] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:52.758278 1210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260616 19:51:52.760072 1198 tablet_bootstrap.cc:654] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.761261 1192 ts_tablet_manager.cc:1434] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260616 19:51:52.761605 1192 tablet_bootstrap.cc:492] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:52.763203 1192 tablet_bootstrap.cc:654] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.763435 1196 ts_tablet_manager.cc:1434] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260616 19:51:52.763785 1196 tablet_bootstrap.cc:492] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:52.771077 1190 ts_tablet_manager.cc:1929] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.771428 1210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260616 19:51:52.771865 1190 log.cc:1199] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/1369a97caf7246479b1a12ac38674eed
I20260616 19:51:52.772505 1190 ts_tablet_manager.cc:1950] T 1369a97caf7246479b1a12ac38674eed P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:52.773473 1196 tablet_bootstrap.cc:654] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:52.773451 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet dfee6a9e6d57487bb7d9482f7798e6b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfee6a9e6d57487bb7d9482f7798e6b6 already in progress: creating tablet
I20260616 19:51:52.774073 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fd5a513aeb224609afaee1ded6ede5e6
I20260616 19:51:52.774645 457 catalog_manager.cc:6784] ReplaceTablet: tablet fd5a513aeb224609afaee1ded6ede5e6 deleted and replaced by tablet 3de0e62cfd33410490a0b460fd5f69e9
I20260616 19:51:52.774986 759 tablet_service.cc:1558] Processing DeleteTablet for tablet fd5a513aeb224609afaee1ded6ede5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3de0e62cfd33410490a0b460fd5f69e9) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:52.775666 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 6d94eb734df94a309a7b171d907c81da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d94eb734df94a309a7b171d907c81da already in progress: creating tablet
I20260616 19:51:52.777626 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet fd5a513aeb224609afaee1ded6ede5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3de0e62cfd33410490a0b460fd5f69e9) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.778019 759 tablet_service.cc:1558] Processing DeleteTablet for tablet b657c023023d4070b3dfb16da1b35181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.778048 1192 tablet_bootstrap.cc:492] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:52.778191 1192 ts_tablet_manager.cc:1403] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.005s
I20260616 19:51:52.778923 1210 hybrid_clock.cc:648] HybridClock initialized: now 1781639512778880 us; error 58 us; skew 500 ppm
W20260616 19:51:52.778978 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet fd5a513aeb224609afaee1ded6ede5e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd5a513aeb224609afaee1ded6ede5e6 already in progress: creating tablet
I20260616 19:51:52.778967 1192 raft_consensus.cc:359] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.779152 1192 raft_consensus.cc:385] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.779243 1192 raft_consensus.cc:740] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.779440 1210 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260616 19:51:52.779451 1192 consensus_queue.cc:260] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.780015 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 1369a97caf7246479b1a12ac38674eed (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]) successfully deleted
I20260616 19:51:52.780104 1192 ts_tablet_manager.cc:1434] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:52.780419 1192 tablet_bootstrap.cc:492] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:52.780534 889 tablet_service.cc:1558] Processing DeleteTablet for tablet fd5a513aeb224609afaee1ded6ede5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3de0e62cfd33410490a0b460fd5f69e9) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.780635 1198 tablet_bootstrap.cc:492] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:52.780800 1198 ts_tablet_manager.cc:1403] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.002s
I20260616 19:51:52.781579 1198 raft_consensus.cc:359] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.781772 1198 raft_consensus.cc:385] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.781840 1198 raft_consensus.cc:740] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.782086 1198 consensus_queue.cc:260] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.782570 1198 ts_tablet_manager.cc:1434] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:51:52.782876 1198 tablet_bootstrap.cc:492] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:52.785037 1198 tablet_bootstrap.cc:654] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.785790 1196 tablet_bootstrap.cc:492] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
W20260616 19:51:52.785845 447 consensus_peers.cc:597] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 -> Peer c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219): Couldn't send request to peer c404c91cd2194cf6838fddd212f2f4ae. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260616 19:51:52.785945 1196 ts_tablet_manager.cc:1403] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.003s
I20260616 19:51:52.786723 1196 raft_consensus.cc:359] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.786945 1196 raft_consensus.cc:385] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.787040 1196 raft_consensus.cc:740] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.787304 1196 consensus_queue.cc:260] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.787808 1192 tablet_bootstrap.cc:654] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.789201 1196 ts_tablet_manager.cc:1434] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:51:52.789547 1196 tablet_bootstrap.cc:492] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:52.790275 1192 tablet_bootstrap.cc:492] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:52.790431 1192 ts_tablet_manager.cc:1403] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260616 19:51:52.791281 1196 tablet_bootstrap.cc:654] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.792560 1192 raft_consensus.cc:359] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.793490 1192 raft_consensus.cc:385] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.793596 1192 raft_consensus.cc:740] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.793835 1192 consensus_queue.cc:260] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.794428 1192 ts_tablet_manager.cc:1434] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260616 19:51:52.794706 1192 tablet_bootstrap.cc:492] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:52.795717 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet cf89adf3cbe54beab939645f7ebbb616 with delete_type TABLET_DATA_DELETED (replaced by tablet c5657b6b56af4b8f8eff1fa18836df9b) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.795954 1191 tablet_replica.cc:333] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:52.796157 1191 raft_consensus.cc:2243] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.796300 1191 raft_consensus.cc:2272] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.797009 1191 ts_tablet_manager.cc:1916] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.800994 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_289acf4951fa4f4888dae7ce3ef0fb6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.801819 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3de0e62cfd33410490a0b460fd5f69e9 has no consensus state
I20260616 19:51:52.802080 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 21eb01a4b2424d63affa5d9d71e2fa64 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:52.803193 1191 ts_tablet_manager.cc:1929] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.803313 1191 log.cc:1199] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/cf89adf3cbe54beab939645f7ebbb616
I20260616 19:51:52.803797 1191 ts_tablet_manager.cc:1950] T cf89adf3cbe54beab939645f7ebbb616 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:52.805140 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet cf89adf3cbe54beab939645f7ebbb616 (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]) successfully deleted
W20260616 19:51:52.805172 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_289acf4951fa4f4888dae7ce3ef0fb6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.805707 1192 tablet_bootstrap.cc:654] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.808444 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet bb2fdea2d4ab42708fcd3102ea54bdb6
I20260616 19:51:52.809393 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet bb2fdea2d4ab42708fcd3102ea54bdb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:52.810086 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet bb2fdea2d4ab42708fcd3102ea54bdb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb2fdea2d4ab42708fcd3102ea54bdb6 already in progress: creating tablet
I20260616 19:51:52.810667 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a2448644894be186e2ab62f3d662be with delete_type TABLET_DATA_DELETED (replaced by tablet ab33d99d857145dfbda54ff2f7464486) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.810734 901 tablet_service.cc:1558] Processing DeleteTablet for tablet c789abf00da24981be5bb72c0b5752d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.810871 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fd2cd6063dc430e89188ed00e76a760 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:50 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.811237 759 tablet_service.cc:1558] Processing DeleteTablet for tablet bb2fdea2d4ab42708fcd3102ea54bdb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.814239 1210 webserver.cc:533] Webserver started at http://127.0.105.188:35247/ using document root <none> and password file <none>
I20260616 19:51:52.815143 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8e54ce683c7944fd86ca59195d417d0f" } new_table_name: "default.Table_de7cf8cf7c43409b9c41391ff6e8ba35" modify_external_catalogs: true
I20260616 19:51:52.815186 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_955814ce18d044e2b9e30c0074b7a8b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.815779 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_955814ce18d044e2b9e30c0074b7a8b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.817217 1210 fs_manager.cc:362] Metadata directory not provided
I20260616 19:51:52.817380 1210 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260616 19:51:52.818254 1196 tablet_bootstrap.cc:492] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:52.818459 1196 ts_tablet_manager.cc:1403] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.001s
I20260616 19:51:52.819437 1196 raft_consensus.cc:359] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.819778 1196 raft_consensus.cc:385] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.819867 1196 raft_consensus.cc:740] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.820216 1196 consensus_queue.cc:260] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.821632 1196 ts_tablet_manager.cc:1434] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260616 19:51:52.822134 1196 tablet_bootstrap.cc:492] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:52.824518 1196 tablet_bootstrap.cc:654] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.826421 1192 tablet_bootstrap.cc:492] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:52.826624 1192 ts_tablet_manager.cc:1403] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.013s
I20260616 19:51:52.827423 1192 raft_consensus.cc:359] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.827662 1192 raft_consensus.cc:385] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.827778 1192 raft_consensus.cc:740] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.828035 1192 consensus_queue.cc:260] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.828789 1192 ts_tablet_manager.cc:1434] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:52.829134 1192 tablet_bootstrap.cc:492] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:52.829962 1245 raft_consensus.cc:493] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:52.830091 1245 raft_consensus.cc:515] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.830837 889 tablet_service.cc:1558] Processing DeleteTablet for tablet bb2fdea2d4ab42708fcd3102ea54bdb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.830890 1245 leader_election.cc:290] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:52.831429 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2448644894be186e2ab62f3d662be" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:52.831624 785 raft_consensus.cc:2468] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:52.832114 860 leader_election.cc:304] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:52.832357 1245 raft_consensus.cc:2804] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:52.832445 1245 raft_consensus.cc:493] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:52.832561 1245 raft_consensus.cc:3060] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:51:52.833925 858 leader_election.cc:343] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 63a2448644894be186e2ab62f3d662be
I20260616 19:51:52.834816 1190 tablet_replica.cc:333] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
W20260616 19:51:52.835227 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet fd5a513aeb224609afaee1ded6ede5e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd5a513aeb224609afaee1ded6ede5e6 already in progress: creating tablet
I20260616 19:51:52.836009 1245 raft_consensus.cc:515] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.836638 1245 leader_election.cc:290] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:52.837076 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2448644894be186e2ab62f3d662be" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:52.837246 785 raft_consensus.cc:3060] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:52.832167 1192 tablet_bootstrap.cc:654] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.840037 785 raft_consensus.cc:2468] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:52.840623 1210 fs_manager.cc:714] Time spent opening directory manager: real 0.021s user 0.000s sys 0.007s
I20260616 19:51:52.840680 860 leader_election.cc:304] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:52.840909 1245 raft_consensus.cc:2804] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
W20260616 19:51:52.843829 858 leader_election.cc:343] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 63a2448644894be186e2ab62f3d662be
W20260616 19:51:52.850086 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2cfb2238cbdb421a8f5001dc729e9bb5 consensus state has no leader
I20260616 19:51:52.851316 1245 raft_consensus.cc:697] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:51:52.851603 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c6a3c639c2574d04a358f1ce11073269" } new_table_name: "default.Table_b3d1ae6133974de8942b6f6a2ae9f310" modify_external_catalogs: true
I20260616 19:51:52.851606 1245 consensus_queue.cc:237] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.852308 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a77f9aa2275c48a3b5d23484f1560d13" } new_table_name: "default.Table_90bb7cc8733044f09ab4c22857942e93" modify_external_catalogs: true
I20260616 19:51:52.854194 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 51fa9bd399d54a86875db081081a8814 with delete_type TABLET_DATA_DELETED (replaced by tablet 2cfb2238cbdb421a8f5001dc729e9bb5) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:52.854492 1191 tablet_replica.cc:333] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:52.854674 1191 raft_consensus.cc:2243] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.854836 1192 tablet_bootstrap.cc:492] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:52.854856 1191 raft_consensus.cc:2272] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.854984 1192 ts_tablet_manager.cc:1403] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.001s
I20260616 19:51:52.855440 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_718b661372f441feb171907daff44e2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:52.855626 1191 ts_tablet_manager.cc:1916] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.855785 1192 raft_consensus.cc:359] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.855962 1192 raft_consensus.cc:385] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260616 19:51:52.855962 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_718b661372f441feb171907daff44e2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.856042 1192 raft_consensus.cc:740] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.857038 1192 consensus_queue.cc:260] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.857489 1192 ts_tablet_manager.cc:1434] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:52.857800 1192 tablet_bootstrap.cc:492] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:52.859427 1192 tablet_bootstrap.cc:654] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.860970 889 tablet_service.cc:1558] Processing DeleteTablet for tablet b657c023023d4070b3dfb16da1b35181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.863261 1191 ts_tablet_manager.cc:1929] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.863447 1190 raft_consensus.cc:2243] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:52.863492 1191 log.cc:1199] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/51fa9bd399d54a86875db081081a8814
I20260616 19:51:52.863920 1191 ts_tablet_manager.cc:1950] T 51fa9bd399d54a86875db081081a8814 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:52.864059 1190 pending_rounds.cc:70] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:51:52.864188 1190 pending_rounds.cc:77] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595444642701312 op_type: NO_OP noop_request { }
I20260616 19:51:52.864336 1190 raft_consensus.cc:2889] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:52.864698 1190 raft_consensus.cc:2272] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.865559 1196 tablet_bootstrap.cc:492] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:52.865753 1196 ts_tablet_manager.cc:1403] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.005s
I20260616 19:51:52.866115 1190 ts_tablet_manager.cc:1916] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.866811 1196 raft_consensus.cc:359] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.867070 1196 raft_consensus.cc:385] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.867173 1196 raft_consensus.cc:740] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.867404 1196 consensus_queue.cc:260] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.867920 1196 ts_tablet_manager.cc:1434] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:52.869474 1196 tablet_bootstrap.cc:492] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:52.871711 1196 tablet_bootstrap.cc:654] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.877418 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 51fa9bd399d54a86875db081081a8814 (table default.Table_f6d740d1faed4c4fa615d5711262ccf9 [id=dadf8402246843219b213be49e8ad54b]) successfully deleted
I20260616 19:51:52.877508 1245 raft_consensus.cc:493] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:52.877619 1193 ts_tablet_manager.cc:1929] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.877755 1193 log.cc:1199] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/2df7d27b41b440c5b082e8783adfeced
I20260616 19:51:52.877671 1245 raft_consensus.cc:515] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.878196 1193 ts_tablet_manager.cc:1950] T 2df7d27b41b440c5b082e8783adfeced P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:52.878422 1245 leader_election.cc:290] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:52.878996 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b657c023023d4070b3dfb16da1b35181" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:52.879299 785 raft_consensus.cc:2468] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
W20260616 19:51:52.879454 858 leader_election.cc:343] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: b657c023023d4070b3dfb16da1b35181
I20260616 19:51:52.879762 860 leader_election.cc:304] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:52.880069 1245 raft_consensus.cc:2804] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:52.880164 1245 raft_consensus.cc:493] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:52.880291 1245 raft_consensus.cc:3060] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:52.882054 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 2df7d27b41b440c5b082e8783adfeced (table default.Table_2ab0cf99b6014917bcbbecd656555ecd [id=249e27015542469da4f6d70df62e6008]) successfully deleted
W20260616 19:51:52.883394 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet e8351427cb34466f82ee74fb60b6798b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8351427cb34466f82ee74fb60b6798b already in progress: creating tablet
I20260616 19:51:52.883584 1245 raft_consensus.cc:515] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.883908 1205 raft_consensus.cc:493] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:52.884088 1205 raft_consensus.cc:515] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.884646 1196 tablet_bootstrap.cc:492] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:52.884763 1205 leader_election.cc:290] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:52.884806 1196 ts_tablet_manager.cc:1403] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.003s
I20260616 19:51:52.885591 1196 raft_consensus.cc:359] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.885772 1196 raft_consensus.cc:385] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.885849 1196 raft_consensus.cc:740] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
W20260616 19:51:52.886008 719 leader_election.cc:343] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 302997d0e3b247ebaceec9151f580c3a
I20260616 19:51:52.886080 1196 consensus_queue.cc:260] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.886530 1196 ts_tablet_manager.cc:1434] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:51:52.886868 1196 tablet_bootstrap.cc:492] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:52.887024 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302997d0e3b247ebaceec9151f580c3a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:52.887300 923 raft_consensus.cc:2468] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:51:52.889206 718 leader_election.cc:304] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:52.889673 1205 raft_consensus.cc:2804] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:52.889765 1205 raft_consensus.cc:493] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:52.889858 1205 raft_consensus.cc:3060] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:52.892652 1205 raft_consensus.cc:515] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.893543 1190 ts_tablet_manager.cc:1929] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:52.893676 1190 log.cc:1199] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/63a2448644894be186e2ab62f3d662be
W20260616 19:51:52.894055 719 leader_election.cc:343] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 302997d0e3b247ebaceec9151f580c3a
I20260616 19:51:52.894112 1190 ts_tablet_manager.cc:1950] T 63a2448644894be186e2ab62f3d662be P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:52.894860 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302997d0e3b247ebaceec9151f580c3a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:52.895004 1190 tablet_replica.cc:333] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:52.895094 923 raft_consensus.cc:3060] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:52.895092 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 63a2448644894be186e2ab62f3d662be (table default.Table_8e54ce683c7944fd86ca59195d417d0f [id=122f88b500c0425e833926b349605d6f]) successfully deleted
I20260616 19:51:52.895215 1190 raft_consensus.cc:2243] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:52.895314 1205 leader_election.cc:290] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:52.896063 1196 tablet_bootstrap.cc:654] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.896754 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b657c023023d4070b3dfb16da1b35181" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:52.897086 785 raft_consensus.cc:3060] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:52.898010 1291 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260616 19:51:52.899745 1190 raft_consensus.cc:2272] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.899678 1245 leader_election.cc:290] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:52.900667 1190 ts_tablet_manager.cc:1916] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.901202 785 raft_consensus.cc:2468] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:52.902066 1210 fs_manager.cc:730] Time spent opening block manager: real 0.060s user 0.007s sys 0.003s
I20260616 19:51:52.902263 1210 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data,/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
uuid: "c404c91cd2194cf6838fddd212f2f4ae"
format_stamp: "Formatted at 2026-06-16 19:51:47 on dist-test-slave-s7fg"
I20260616 19:51:52.903271 1210 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260616 19:51:52.906383 1190 ts_tablet_manager.cc:1929] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:52.906517 1190 log.cc:1199] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/c789abf00da24981be5bb72c0b5752d1
I20260616 19:51:52.906545 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 7161894b9f9047fda9ed3f2180518a59 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:52.906816 1190 ts_tablet_manager.cc:1950] T c789abf00da24981be5bb72c0b5752d1 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:52.907135 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_dcc7faba5fed46d1a4e0ce7486ac8a85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.907881 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcc7faba5fed46d1a4e0ce7486ac8a85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.908095 1190 tablet_replica.cc:333] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:52.908308 1190 raft_consensus.cc:2243] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
W20260616 19:51:52.908519 858 leader_election.cc:343] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: b657c023023d4070b3dfb16da1b35181
W20260616 19:51:52.908854 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab33d99d857145dfbda54ff2f7464486 consensus state has no leader
I20260616 19:51:52.909340 1196 tablet_bootstrap.cc:492] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:52.909471 1196 ts_tablet_manager.cc:1403] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.002s
I20260616 19:51:52.909317 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e5e5e46d5e204e50a6583125f8d267e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:52.909943 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5e5e46d5e204e50a6583125f8d267e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:52.910266 1196 raft_consensus.cc:359] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.910411 1196 raft_consensus.cc:385] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.910485 1196 raft_consensus.cc:740] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.910734 1196 consensus_queue.cc:260] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.911252 1196 ts_tablet_manager.cc:1434] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:51:52.911549 1196 tablet_bootstrap.cc:492] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:52.911914 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5ad3a183f911465da5f24ce69f9d6256" } modify_external_catalogs: true
I20260616 19:51:52.912106 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5ad3a183f911465da5f24ce69f9d6256" } modify_external_catalogs: true
I20260616 19:51:52.913375 1196 tablet_bootstrap.cc:654] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:52.915095 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet c789abf00da24981be5bb72c0b5752d1 (table default.Table_c654445815a9494491a390790185534e [id=2158cc9d64824b9b8836ff772169d936]) successfully deleted
I20260616 19:51:52.919718 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a2448644894be186e2ab62f3d662be with delete_type TABLET_DATA_DELETED (replaced by tablet ab33d99d857145dfbda54ff2f7464486) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.924870 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 59812b232848488b9894e8f8057e9def (DEFAULT_TABLE table=default.Table_0a2742804d7d48fcb8acc6f20ae3536b [id=1beb7d130df7492ab9b834d005eba63a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.925225 458 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_4a9b0e9a1c6648f8bb08c587a4750e4f [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 4 got 0
I20260616 19:51:52.925406 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59812b232848488b9894e8f8057e9def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.926653 458 master_service.cc:960] ReplaceTablet: received request to replace tablet 31d22240d294454cbeb2ca5b07d45273 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:52.927155 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8498a9716d0241898b3508012accd7e4" } modify_external_catalogs: true
I20260616 19:51:52.927312 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8498a9716d0241898b3508012accd7e4" } modify_external_catalogs: true
I20260616 19:51:52.929801 1033 tablet_service.cc:1511] Processing CreateTablet for tablet f2c392b2fecd483d9da12e30e37f27ad (DEFAULT_TABLE table=default.Table_ce91ab4603cc400d94cf6e1fcfe99048 [id=e05ed7086cba4c24b2a2d5968338a743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.930272 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c392b2fecd483d9da12e30e37f27ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.930630 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 2b7f591d97bc4571b294b06d990d4065 (DEFAULT_TABLE table=default.Table_b28a102fcc514ff4ad1152a5fdf07cae [id=e28d99c40da7450bb6878e43b20ff0c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.931031 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b7f591d97bc4571b294b06d990d4065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.931113 759 tablet_service.cc:1558] Processing DeleteTablet for tablet cf89adf3cbe54beab939645f7ebbb616 with delete_type TABLET_DATA_DELETED (replaced by tablet c5657b6b56af4b8f8eff1fa18836df9b) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.931892 759 tablet_service.cc:1511] Processing CreateTablet for tablet 59812b232848488b9894e8f8057e9def (DEFAULT_TABLE table=default.Table_0a2742804d7d48fcb8acc6f20ae3536b [id=1beb7d130df7492ab9b834d005eba63a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.931919 1036 tablet_service.cc:1511] Processing CreateTablet for tablet eb04ccc26e64484a9a29c515d4b954fe (DEFAULT_TABLE table=default.Table_29d4c487ede340ee9de12af6c3092aec [id=87e3217093844e81ac448e2e9d8fa3ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.932253 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59812b232848488b9894e8f8057e9def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.932343 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb04ccc26e64484a9a29c515d4b954fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.938611 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 51fa9bd399d54a86875db081081a8814 with delete_type TABLET_DATA_DELETED (replaced by tablet 2cfb2238cbdb421a8f5001dc729e9bb5) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:52.939244 760 tablet_service.cc:1511] Processing CreateTablet for tablet f2c392b2fecd483d9da12e30e37f27ad (DEFAULT_TABLE table=default.Table_ce91ab4603cc400d94cf6e1fcfe99048 [id=e05ed7086cba4c24b2a2d5968338a743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.939642 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c392b2fecd483d9da12e30e37f27ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.940840 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c6d6071d862241e196a83a23bc939af4 (DEFAULT_TABLE table=default.Table_a8fd992451b342788f8d4177fe2bf450 [id=62b01f98d4a940ed90cb63411348c3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.941233 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d6071d862241e196a83a23bc939af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.945113 762 tablet_service.cc:1511] Processing CreateTablet for tablet eb04ccc26e64484a9a29c515d4b954fe (DEFAULT_TABLE table=default.Table_29d4c487ede340ee9de12af6c3092aec [id=87e3217093844e81ac448e2e9d8fa3ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.945541 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb04ccc26e64484a9a29c515d4b954fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.948526 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc92bc15da14504a1ff5feda5aff7cf (DEFAULT_TABLE table=default.Table_740f48968d6f4b38a0bd0dbcd42b9303 [id=8c7791625cfd4d39ad0dff83be1c7089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.948956 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc92bc15da14504a1ff5feda5aff7cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.953439 756 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc92bc15da14504a1ff5feda5aff7cf (DEFAULT_TABLE table=default.Table_740f48968d6f4b38a0bd0dbcd42b9303 [id=8c7791625cfd4d39ad0dff83be1c7089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.953912 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc92bc15da14504a1ff5feda5aff7cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.956004 762 tablet_service.cc:1511] Processing CreateTablet for tablet 2b7f591d97bc4571b294b06d990d4065 (DEFAULT_TABLE table=default.Table_b28a102fcc514ff4ad1152a5fdf07cae [id=e28d99c40da7450bb6878e43b20ff0c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.956360 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b7f591d97bc4571b294b06d990d4065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.958856 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f6d740d1faed4c4fa615d5711262ccf9" } modify_external_catalogs: true
I20260616 19:51:52.959048 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f6d740d1faed4c4fa615d5711262ccf9" } modify_external_catalogs: true
I20260616 19:51:52.962087 759 tablet_service.cc:1511] Processing CreateTablet for tablet c6d6071d862241e196a83a23bc939af4 (DEFAULT_TABLE table=default.Table_a8fd992451b342788f8d4177fe2bf450 [id=62b01f98d4a940ed90cb63411348c3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.962509 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d6071d862241e196a83a23bc939af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.962409 1029 tablet_service.cc:1511] Processing CreateTablet for tablet d3645fc39d974bffa8fe52c62e1c7eff (DEFAULT_TABLE table=default.Table_8498a9716d0241898b3508012accd7e4 [id=684dd57c6c084da39a4046776066b1da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.962883 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3645fc39d974bffa8fe52c62e1c7eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.963675 756 tablet_service.cc:1511] Processing CreateTablet for tablet d3645fc39d974bffa8fe52c62e1c7eff (DEFAULT_TABLE table=default.Table_8498a9716d0241898b3508012accd7e4 [id=684dd57c6c084da39a4046776066b1da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.964047 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3645fc39d974bffa8fe52c62e1c7eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.965610 1193 tablet_replica.cc:333] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:51:52.965579 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0f061d4bc90f42409eb99987059e6656 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f061d4bc90f42409eb99987059e6656 already in progress: creating tablet
I20260616 19:51:52.965842 1193 raft_consensus.cc:2243] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260616 19:51:52.966008 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 154ca8a6bce84b4bab932e69ec7f1f8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 154ca8a6bce84b4bab932e69ec7f1f8e already in progress: creating tablet
I20260616 19:51:52.966023 1193 raft_consensus.cc:2272] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:52.966729 1193 ts_tablet_manager.cc:1916] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:52.969074 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 815d213bf1904353b4f0b2e2f8954db9 (DEFAULT_TABLE table=default.Table_d6350e9b4bf443519e2849b4c42a6252 [id=4819ad51aafb4dd4a283d2240306d7a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.969575 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815d213bf1904353b4f0b2e2f8954db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.970780 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 122a8b15e62f4b23b465e2dbc816df62 (DEFAULT_TABLE table=default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.971086 860 leader_election.cc:304] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:52.971191 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 122a8b15e62f4b23b465e2dbc816df62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.971434 1245 raft_consensus.cc:2804] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:52.973593 904 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc92bc15da14504a1ff5feda5aff7cf (DEFAULT_TABLE table=default.Table_740f48968d6f4b38a0bd0dbcd42b9303 [id=8c7791625cfd4d39ad0dff83be1c7089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.976354 923 raft_consensus.cc:2468] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:51:52.969589 1198 tablet_bootstrap.cc:492] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:52.978036 888 tablet_service.cc:1511] Processing CreateTablet for tablet c6d6071d862241e196a83a23bc939af4 (DEFAULT_TABLE table=default.Table_a8fd992451b342788f8d4177fe2bf450 [id=62b01f98d4a940ed90cb63411348c3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.978103 894 tablet_service.cc:1511] Processing CreateTablet for tablet 122a8b15e62f4b23b465e2dbc816df62 (DEFAULT_TABLE table=default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.978891 1198 ts_tablet_manager.cc:1403] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.196s user 0.003s sys 0.029s
I20260616 19:51:52.979552 1245 raft_consensus.cc:697] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
W20260616 19:51:52.979456 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 69758.6us
I20260616 19:51:52.980000 1192 tablet_bootstrap.cc:492] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:52.979931 1245 consensus_queue.cc:237] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.980170 1192 ts_tablet_manager.cc:1403] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.122s user 0.011s sys 0.010s
I20260616 19:51:52.981671 1192 raft_consensus.cc:359] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.981895 1192 raft_consensus.cc:385] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:52.982003 1192 raft_consensus.cc:740] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:52.982277 1192 consensus_queue.cc:260] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:52.982920 1192 ts_tablet_manager.cc:1434] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260616 19:51:52.983314 1192 tablet_bootstrap.cc:492] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:52.983608 901 tablet_service.cc:1511] Processing CreateTablet for tablet f2c392b2fecd483d9da12e30e37f27ad (DEFAULT_TABLE table=default.Table_ce91ab4603cc400d94cf6e1fcfe99048 [id=e05ed7086cba4c24b2a2d5968338a743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.984027 891 tablet_service.cc:1511] Processing CreateTablet for tablet 2b7f591d97bc4571b294b06d990d4065 (DEFAULT_TABLE table=default.Table_b28a102fcc514ff4ad1152a5fdf07cae [id=e28d99c40da7450bb6878e43b20ff0c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.984560 889 tablet_service.cc:1511] Processing CreateTablet for tablet 59812b232848488b9894e8f8057e9def (DEFAULT_TABLE table=default.Table_0a2742804d7d48fcb8acc6f20ae3536b [id=1beb7d130df7492ab9b834d005eba63a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.984936 903 tablet_service.cc:1511] Processing CreateTablet for tablet eb04ccc26e64484a9a29c515d4b954fe (DEFAULT_TABLE table=default.Table_29d4c487ede340ee9de12af6c3092aec [id=87e3217093844e81ac448e2e9d8fa3ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.984395 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a2448644894be186e2ab62f3d662be with delete_type TABLET_DATA_DELETED (replaced by tablet ab33d99d857145dfbda54ff2f7464486) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:52.985432 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc92bc15da14504a1ff5feda5aff7cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.985711 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d6071d862241e196a83a23bc939af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.985687 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 2c31c8e977da4a70bca1beb00f364627 (DEFAULT_TABLE table=default.Table_dc293d30aea14e2385f75dbc8b66b349 [id=cb4c50d05fdd4c0a85828222eeb0f06a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.985857 900 tablet_service.cc:1511] Processing CreateTablet for tablet 815d213bf1904353b4f0b2e2f8954db9 (DEFAULT_TABLE table=default.Table_d6350e9b4bf443519e2849b4c42a6252 [id=4819ad51aafb4dd4a283d2240306d7a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.986006 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c31c8e977da4a70bca1beb00f364627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.986310 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815d213bf1904353b4f0b2e2f8954db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.989624 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59812b232848488b9894e8f8057e9def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.990083 897 tablet_service.cc:1511] Processing CreateTablet for tablet 2c31c8e977da4a70bca1beb00f364627 (DEFAULT_TABLE table=default.Table_dc293d30aea14e2385f75dbc8b66b349 [id=cb4c50d05fdd4c0a85828222eeb0f06a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.992589 898 tablet_service.cc:1511] Processing CreateTablet for tablet d3645fc39d974bffa8fe52c62e1c7eff (DEFAULT_TABLE table=default.Table_8498a9716d0241898b3508012accd7e4 [id=684dd57c6c084da39a4046776066b1da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:52.993352 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c31c8e977da4a70bca1beb00f364627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.997155 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 122a8b15e62f4b23b465e2dbc816df62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.998339 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c392b2fecd483d9da12e30e37f27ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.999553 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3645fc39d974bffa8fe52c62e1c7eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.000363 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b7f591d97bc4571b294b06d990d4065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:52.979883 1190 raft_consensus.cc:2272] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.002595 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb04ccc26e64484a9a29c515d4b954fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.005671 718 leader_election.cc:304] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:53.006031 758 tablet_service.cc:1511] Processing CreateTablet for tablet 122a8b15e62f4b23b465e2dbc816df62 (DEFAULT_TABLE table=default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.007997 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 122a8b15e62f4b23b465e2dbc816df62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.008735 1198 raft_consensus.cc:359] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.008965 1198 raft_consensus.cc:385] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.009063 1198 raft_consensus.cc:740] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.009398 1198 consensus_queue.cc:260] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.013412 1198 ts_tablet_manager.cc:1434] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.034s user 0.003s sys 0.000s
W20260616 19:51:53.014235 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d916b2f553ce41df8934e1190fa32120 consensus state has no leader
I20260616 19:51:53.014680 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bed17ff52ac5410784b004e2ef370bac" } modify_external_catalogs: true
I20260616 19:51:53.014879 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bed17ff52ac5410784b004e2ef370bac" } modify_external_catalogs: true
I20260616 19:51:53.015736 1198 tablet_bootstrap.cc:492] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.016630 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ad352a2aedbf45969134e05256cde7c2" } new_table_name: "default.Table_0957b27c92aa48bdb6898b1cafddbf11" modify_external_catalogs: true
I20260616 19:51:53.018088 1198 tablet_bootstrap.cc:654] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:53.018460 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d51a6fb4c49e461583a5aba1813b2a3e consensus state has no leader
I20260616 19:51:53.025261 1192 tablet_bootstrap.cc:654] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.026883 454 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_4a9b0e9a1c6648f8bb08c587a4750e4f [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 4 got 0
I20260616 19:51:53.027833 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1663625bb19f4fcba05c5277abaf688f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:53.034356 1192 tablet_bootstrap.cc:492] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.034579 1192 ts_tablet_manager.cc:1403] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.003s
I20260616 19:51:53.036124 1192 raft_consensus.cc:359] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.036516 1192 raft_consensus.cc:385] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.036639 1192 raft_consensus.cc:740] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.036947 1192 consensus_queue.cc:260] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.037920 1192 ts_tablet_manager.cc:1434] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260616 19:51:53.038343 1192 tablet_bootstrap.cc:492] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.039618 430 master_runner.cc:187] Error getting master registration for 127.0.105.188:34219: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111),
I20260616 19:51:53.039798 430 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260616 19:51:53.040052 1192 tablet_bootstrap.cc:654] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.034583 1190 ts_tablet_manager.cc:1916] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.049235 1192 tablet_bootstrap.cc:492] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.049474 1192 ts_tablet_manager.cc:1403] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s
I20260616 19:51:53.049479 1198 tablet_bootstrap.cc:492] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.050849 1192 raft_consensus.cc:359] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.051020 1198 ts_tablet_manager.cc:1403] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20260616 19:51:53.051163 1192 raft_consensus.cc:385] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.051339 1192 raft_consensus.cc:740] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.051800 1192 consensus_queue.cc:260] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.051785 1198 raft_consensus.cc:359] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.051995 1198 raft_consensus.cc:385] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.052070 1198 raft_consensus.cc:740] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.052299 1198 consensus_queue.cc:260] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.052760 1198 ts_tablet_manager.cc:1434] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:51:53.053092 1198 tablet_bootstrap.cc:492] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.054023 1192 ts_tablet_manager.cc:1434] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260616 19:51:53.054937 1198 tablet_bootstrap.cc:654] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.056559 1192 tablet_bootstrap.cc:492] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.057940 1190 ts_tablet_manager.cc:1929] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.058538 1190 log.cc:1199] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/5fd2cd6063dc430e89188ed00e76a760
I20260616 19:51:53.059042 1192 tablet_bootstrap.cc:654] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.059895 1190 ts_tablet_manager.cc:1950] T 5fd2cd6063dc430e89188ed00e76a760 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
W20260616 19:51:53.066865 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1663625bb19f4fcba05c5277abaf688f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.069679 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 5fd2cd6063dc430e89188ed00e76a760 (table default.Table_3b3dce47cfdc420eba859affc6ad8f5f [id=02b198713aff4f2c967d63e708d57699]) successfully deleted
I20260616 19:51:53.070227 1198 tablet_bootstrap.cc:492] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.070395 1198 ts_tablet_manager.cc:1403] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.001s
W20260616 19:51:53.070379 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet bb2fdea2d4ab42708fcd3102ea54bdb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb2fdea2d4ab42708fcd3102ea54bdb6 already in progress: creating tablet
I20260616 19:51:53.070693 1190 tablet_replica.cc:333] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:53.070969 1190 raft_consensus.cc:2243] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:53.071266 1190 pending_rounds.cc:70] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:51:53.071223 1198 raft_consensus.cc:359] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.071447 1198 raft_consensus.cc:385] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.071542 1198 raft_consensus.cc:740] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.071398 1190 pending_rounds.cc:77] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595445169319936 op_type: NO_OP noop_request { }
I20260616 19:51:53.071792 1190 raft_consensus.cc:2889] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:53.071789 1198 consensus_queue.cc:260] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.073725 1190 raft_consensus.cc:2272] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.074586 1198 ts_tablet_manager.cc:1434] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260616 19:51:53.074908 1198 tablet_bootstrap.cc:492] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.075917 1190 ts_tablet_manager.cc:1916] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.076619 1198 tablet_bootstrap.cc:654] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.076934 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_4a9b0e9a1c6648f8bb08c587a4750e4f [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 4 got 0
I20260616 19:51:53.080372 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 21eb01a4b2424d63affa5d9d71e2fa64
I20260616 19:51:53.081005 456 catalog_manager.cc:6784] ReplaceTablet: tablet 21eb01a4b2424d63affa5d9d71e2fa64 deleted and replaced by tablet 2e7e298c8e374f46aecbb0711760c06c
I20260616 19:51:53.081389 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8fff86d5c2344e2fb59db9872ee90b74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.082093 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fff86d5c2344e2fb59db9872ee90b74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.083233 1190 ts_tablet_manager.cc:1929] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:53.083338 1190 log.cc:1199] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/b657c023023d4070b3dfb16da1b35181
I20260616 19:51:53.083632 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 543ef0fcac3d47928c5dd1d13f9aba92
I20260616 19:51:53.083709 1190 ts_tablet_manager.cc:1950] T b657c023023d4070b3dfb16da1b35181 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:53.084507 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_873136a2abfb41018a2cec78a9f5fbc9" } modify_external_catalogs: true
I20260616 19:51:53.084728 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_873136a2abfb41018a2cec78a9f5fbc9" } modify_external_catalogs: true
I20260616 19:51:53.086120 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7161894b9f9047fda9ed3f2180518a59
I20260616 19:51:53.086184 1198 tablet_bootstrap.cc:492] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.086320 1198 ts_tablet_manager.cc:1403] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.003s
I20260616 19:51:53.086615 452 catalog_manager.cc:6784] ReplaceTablet: tablet 7161894b9f9047fda9ed3f2180518a59 deleted and replaced by tablet 4ffce2dc22e24d1684e6eae92c487cea
I20260616 19:51:53.086856 452 master_service.cc:960] ReplaceTablet: received request to replace tablet eac603a84d3c4f96bd444c54f28d278d from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:53.086977 1198 raft_consensus.cc:359] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.087152 1198 raft_consensus.cc:385] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.087204 1198 raft_consensus.cc:740] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.087433 1198 consensus_queue.cc:260] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.087941 1198 ts_tablet_manager.cc:1434] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:51:53.088281 1198 tablet_bootstrap.cc:492] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.089170 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 21eb01a4b2424d63affa5d9d71e2fa64 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e7e298c8e374f46aecbb0711760c06c) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.089426 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 543ef0fcac3d47928c5dd1d13f9aba92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.089607 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 7161894b9f9047fda9ed3f2180518a59 with delete_type TABLET_DATA_DELETED (replaced by tablet 4ffce2dc22e24d1684e6eae92c487cea) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.089745 1192 tablet_bootstrap.cc:492] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
W20260616 19:51:53.090237 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 21eb01a4b2424d63affa5d9d71e2fa64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21eb01a4b2424d63affa5d9d71e2fa64 already in progress: creating tablet
W20260616 19:51:53.090467 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 543ef0fcac3d47928c5dd1d13f9aba92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 543ef0fcac3d47928c5dd1d13f9aba92 already in progress: creating tablet
W20260616 19:51:53.090644 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 7161894b9f9047fda9ed3f2180518a59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7161894b9f9047fda9ed3f2180518a59 already in progress: creating tablet
I20260616 19:51:53.092197 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_92a53fd7dd1a4e9892c00c79c31c53f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.092835 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92a53fd7dd1a4e9892c00c79c31c53f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.093513 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet b657c023023d4070b3dfb16da1b35181 (table default.Table_836a3f95e80c4694b0f23dc42274d582 [id=b92002b768ab4133b08391019758714a]) successfully deleted
I20260616 19:51:53.094480 1198 tablet_bootstrap.cc:654] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.095033 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 543ef0fcac3d47928c5dd1d13f9aba92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.095284 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 7161894b9f9047fda9ed3f2180518a59 with delete_type TABLET_DATA_DELETED (replaced by tablet 4ffce2dc22e24d1684e6eae92c487cea) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.095513 892 tablet_service.cc:1558] Processing DeleteTablet for tablet cf89adf3cbe54beab939645f7ebbb616 with delete_type TABLET_DATA_DELETED (replaced by tablet c5657b6b56af4b8f8eff1fa18836df9b) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.095625 890 tablet_service.cc:1558] Processing DeleteTablet for tablet a6dd15b09ec246ee90bdc73fd93f862a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.089910 1192 ts_tablet_manager.cc:1403] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.033s user 0.007s sys 0.022s
I20260616 19:51:53.098294 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d3645fc39d974bffa8fe52c62e1c7eff
I20260616 19:51:53.097263 1192 raft_consensus.cc:359] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.098521 1192 raft_consensus.cc:385] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.098623 1192 raft_consensus.cc:740] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.098850 1192 consensus_queue.cc:260] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.099298 1192 ts_tablet_manager.cc:1434] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260616 19:51:53.099604 1192 tablet_bootstrap.cc:492] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.100695 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet d3645fc39d974bffa8fe52c62e1c7eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.101217 1192 tablet_bootstrap.cc:654] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.102667 1190 tablet_replica.cc:333] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:53.102937 1190 raft_consensus.cc:2243] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.103128 1190 raft_consensus.cc:2272] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:53.104183 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d3645fc39d974bffa8fe52c62e1c7eff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3645fc39d974bffa8fe52c62e1c7eff already in progress: creating tablet
I20260616 19:51:53.104211 890 tablet_service.cc:1558] Processing DeleteTablet for tablet d3645fc39d974bffa8fe52c62e1c7eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.107016 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 21eb01a4b2424d63affa5d9d71e2fa64 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e7e298c8e374f46aecbb0711760c06c) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.112331 1192 tablet_bootstrap.cc:492] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.114296 765 tablet_service.cc:1511] Processing CreateTablet for tablet 2c31c8e977da4a70bca1beb00f364627 (DEFAULT_TABLE table=default.Table_dc293d30aea14e2385f75dbc8b66b349 [id=cb4c50d05fdd4c0a85828222eeb0f06a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:53.114959 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 63a2448644894be186e2ab62f3d662be because the tablet was not found. No further retry: Not found: Tablet not found: 63a2448644894be186e2ab62f3d662be
W20260616 19:51:53.115252 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 543ef0fcac3d47928c5dd1d13f9aba92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 543ef0fcac3d47928c5dd1d13f9aba92 already in progress: creating tablet
W20260616 19:51:53.115682 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 7161894b9f9047fda9ed3f2180518a59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7161894b9f9047fda9ed3f2180518a59 already in progress: creating tablet
I20260616 19:51:53.116729 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_90bb7cc8733044f09ab4c22857942e93" } new_table_name: "default.Table_647cdefd19814321b51ee0898effc29c" modify_external_catalogs: true
I20260616 19:51:53.116881 1198 tablet_bootstrap.cc:492] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.117023 1198 ts_tablet_manager.cc:1403] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.006s
I20260616 19:51:53.117755 1198 raft_consensus.cc:359] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.117926 1198 raft_consensus.cc:385] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.118006 1198 raft_consensus.cc:740] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.118238 1198 consensus_queue.cc:260] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.118723 1198 ts_tablet_manager.cc:1434] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:51:53.120911 1198 tablet_bootstrap.cc:492] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.122764 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 5af9bdceae184f8dbb9e5db67a11ee63
I20260616 19:51:53.123167 1198 tablet_bootstrap.cc:654] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.124164 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2cfb2238cbdb421a8f5001dc729e9bb5
I20260616 19:51:53.124842 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_77c7656d4f3a49f1ac1ef9398f720934"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.125442 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77c7656d4f3a49f1ac1ef9398f720934 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.125874 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 5af9bdceae184f8dbb9e5db67a11ee63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.126121 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cfb2238cbdb421a8f5001dc729e9bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.126997 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_161547cc1ad140baabf119e9187c3d4d" } new_table_name: "default.Table_2e10c27b05e243a2a85134e81dc2a126" modify_external_catalogs: true
I20260616 19:51:53.124867 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5bfbe9967f534a958045a36d7e269580"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.127799 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5bfbe9967f534a958045a36d7e269580 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.128288 760 tablet_service.cc:1511] Processing CreateTablet for tablet 815d213bf1904353b4f0b2e2f8954db9 (DEFAULT_TABLE table=default.Table_d6350e9b4bf443519e2849b4c42a6252 [id=4819ad51aafb4dd4a283d2240306d7a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.129231 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 7161894b9f9047fda9ed3f2180518a59 with delete_type TABLET_DATA_DELETED (replaced by tablet 4ffce2dc22e24d1684e6eae92c487cea) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:53.129408 1198 tablet_bootstrap.cc:492] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.129455 1205 raft_consensus.cc:2804] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:53.129545 1198 ts_tablet_manager.cc:1403] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.003s
W20260616 19:51:53.129799 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ffce2dc22e24d1684e6eae92c487cea has no consensus state
I20260616 19:51:53.129886 1192 ts_tablet_manager.cc:1403] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.000s
I20260616 19:51:53.130240 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a70aca898ad449b481395f5ffc808a22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:53.130276 1198 raft_consensus.cc:359] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.130441 1198 raft_consensus.cc:385] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.130496 1198 raft_consensus.cc:740] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
W20260616 19:51:53.130693 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a70aca898ad449b481395f5ffc808a22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:53.132786 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 5af9bdceae184f8dbb9e5db67a11ee63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5af9bdceae184f8dbb9e5db67a11ee63 already in progress: creating tablet
W20260616 19:51:53.133085 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2cfb2238cbdb421a8f5001dc729e9bb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cfb2238cbdb421a8f5001dc729e9bb5 already in progress: creating tablet
I20260616 19:51:53.130685 1198 consensus_queue.cc:260] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.133718 1198 ts_tablet_manager.cc:1434] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260616 19:51:53.134032 1198 tablet_bootstrap.cc:492] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.135862 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 302997d0e3b247ebaceec9151f580c3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.135380 1192 raft_consensus.cc:359] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.137876 1192 raft_consensus.cc:385] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.138967 1198 tablet_bootstrap.cc:654] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.139303 1192 raft_consensus.cc:740] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.139585 1192 consensus_queue.cc:260] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.142498 1192 ts_tablet_manager.cc:1434] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260616 19:51:53.145988 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 5af9bdceae184f8dbb9e5db67a11ee63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.146273 1198 tablet_bootstrap.cc:492] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.146245 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cfb2238cbdb421a8f5001dc729e9bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.146399 1198 ts_tablet_manager.cc:1403] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.004s
I20260616 19:51:53.146586 1190 ts_tablet_manager.cc:1916] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.147176 1198 raft_consensus.cc:359] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.147329 1198 raft_consensus.cc:385] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.147396 1198 raft_consensus.cc:740] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.148150 455 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 2e7e298c8e374f46aecbb0711760c06c
I20260616 19:51:53.149230 1198 consensus_queue.cc:260] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.149437 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_61b32c8d9ca6461c8f3edd6bf27c79bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:53.149760 1198 ts_tablet_manager.cc:1434] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
W20260616 19:51:53.149948 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61b32c8d9ca6461c8f3edd6bf27c79bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.150025 1198 tablet_bootstrap.cc:492] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.154711 1198 tablet_bootstrap.cc:654] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.157109 1192 tablet_bootstrap.cc:492] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.157970 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet eac603a84d3c4f96bd444c54f28d278d
I20260616 19:51:53.158519 452 catalog_manager.cc:6784] ReplaceTablet: tablet eac603a84d3c4f96bd444c54f28d278d deleted and replaced by tablet bfff9d60bb7e4a86b14687b581b45efe
I20260616 19:51:53.159077 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet eac603a84d3c4f96bd444c54f28d278d with delete_type TABLET_DATA_DELETED (replaced by tablet bfff9d60bb7e4a86b14687b581b45efe) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:53.159742 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet eac603a84d3c4f96bd444c54f28d278d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eac603a84d3c4f96bd444c54f28d278d already in progress: creating tablet
I20260616 19:51:53.161935 1198 tablet_bootstrap.cc:492] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.161911 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 51fa9bd399d54a86875db081081a8814 with delete_type TABLET_DATA_DELETED (replaced by tablet 2cfb2238cbdb421a8f5001dc729e9bb5) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.162086 1198 ts_tablet_manager.cc:1403] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.004s
I20260616 19:51:53.162860 1198 raft_consensus.cc:359] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.163065 1198 raft_consensus.cc:385] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.163137 1198 raft_consensus.cc:740] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.165050 1198 consensus_queue.cc:260] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.165496 1198 ts_tablet_manager.cc:1434] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260616 19:51:53.165781 1198 tablet_bootstrap.cc:492] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.166260 1210 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260616 19:51:53.167112 904 tablet_service.cc:1558] Processing DeleteTablet for tablet eac603a84d3c4f96bd444c54f28d278d with delete_type TABLET_DATA_DELETED (replaced by tablet bfff9d60bb7e4a86b14687b581b45efe) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.167708 1198 tablet_bootstrap.cc:654] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.168725 1210 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260616 19:51:53.169121 1210 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260616 19:51:53.173417 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d916b2f553ce41df8934e1190fa32120 consensus state has no leader
I20260616 19:51:53.173951 1198 tablet_bootstrap.cc:492] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.174124 1198 ts_tablet_manager.cc:1403] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
W20260616 19:51:53.174235 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b99740ab59f947aabcac88dc2bf2de86 has no consensus state
I20260616 19:51:53.175096 1198 raft_consensus.cc:359] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.177211 1198 raft_consensus.cc:385] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.177333 1198 raft_consensus.cc:740] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.177660 1198 consensus_queue.cc:260] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.178318 1198 ts_tablet_manager.cc:1434] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260616 19:51:53.178647 1198 tablet_bootstrap.cc:492] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.184094 1198 tablet_bootstrap.cc:654] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.188153 1208 raft_consensus.cc:493] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.188297 1208 raft_consensus.cc:515] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.189000 1208 leader_election.cc:290] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:53.189148 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c31c8e977da4a70bca1beb00f364627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.189688 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 543ef0fcac3d47928c5dd1d13f9aba92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:53.190201 1245 raft_consensus.cc:493] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.190346 1245 raft_consensus.cc:515] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.190905 1190 ts_tablet_manager.cc:1929] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.192332 1245 leader_election.cc:290] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:53.193158 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 19832d0517524c0facf1f97486b1e58e from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:53.193615 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d94eb734df94a309a7b171d907c81da" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:51:53.194775 993 leader_election.cc:343] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.195346 1198 tablet_bootstrap.cc:492] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.195529 1198 ts_tablet_manager.cc:1403] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.002s
I20260616 19:51:53.195756 461 master_service.cc:960] ReplaceTablet: received request to replace tablet 0da93e4052094862a44812990df1136a from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:53.196281 1198 raft_consensus.cc:359] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.196456 1198 raft_consensus.cc:385] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.196557 1198 raft_consensus.cc:740] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.196823 1198 consensus_queue.cc:260] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.197319 1198 ts_tablet_manager.cc:1434] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:53.198868 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 21eb01a4b2424d63affa5d9d71e2fa64 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e7e298c8e374f46aecbb0711760c06c) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:53.199083 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 5af9bdceae184f8dbb9e5db67a11ee63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:53.199235 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fa9bd399d54a86875db081081a8814" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:53.199429 785 raft_consensus.cc:2468] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
W20260616 19:51:53.200973 858 leader_election.cc:343] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 51fa9bd399d54a86875db081081a8814
I20260616 19:51:53.201200 1198 tablet_bootstrap.cc:492] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.201566 1192 tablet_bootstrap.cc:654] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.203445 1198 tablet_bootstrap.cc:654] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.205268 860 leader_election.cc:304] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:53.205936 1245 raft_consensus.cc:2804] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:53.206070 1245 raft_consensus.cc:493] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:53.206179 1245 raft_consensus.cc:3060] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:53.206560 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815d213bf1904353b4f0b2e2f8954db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.210461 1245 raft_consensus.cc:515] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.217738 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0da93e4052094862a44812990df1136a
I20260616 19:51:53.218468 461 catalog_manager.cc:6784] ReplaceTablet: tablet 0da93e4052094862a44812990df1136a deleted and replaced by tablet 49e88f4e88a64eca8aafc325f1834f54
I20260616 19:51:53.219501 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 0da93e4052094862a44812990df1136a with delete_type TABLET_DATA_DELETED (replaced by tablet 49e88f4e88a64eca8aafc325f1834f54) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:53.220602 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0da93e4052094862a44812990df1136a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0da93e4052094862a44812990df1136a already in progress: creating tablet
I20260616 19:51:53.223644 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 2808592f581e4605a814a2658401dfed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.223923 1191 tablet_replica.cc:333] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.224118 1191 raft_consensus.cc:2243] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.224288 1191 raft_consensus.cc:2272] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.224586 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 154ca8a6bce84b4bab932e69ec7f1f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.224925 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a8fd992451b342788f8d4177fe2bf450" } new_table_name: "default.Table_b30d3eb9400f41859828b301e68cfec4" modify_external_catalogs: true
I20260616 19:51:53.225564 1191 ts_tablet_manager.cc:1916] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.229619 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_78964cf02d6e4b94be59a534e00ada50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.230386 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78964cf02d6e4b94be59a534e00ada50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.231299 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 19832d0517524c0facf1f97486b1e58e
I20260616 19:51:53.231737 1191 ts_tablet_manager.cc:1929] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.231889 1191 log.cc:1199] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/2808592f581e4605a814a2658401dfed
I20260616 19:51:53.232190 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 19832d0517524c0facf1f97486b1e58e with delete_type TABLET_DATA_DELETED (replaced by tablet 9c77fd138ce9463b8f2d6f4182a56559) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.232321 1191 ts_tablet_manager.cc:1950] T 2808592f581e4605a814a2658401dfed P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:53.232635 453 catalog_manager.cc:6784] ReplaceTablet: tablet 19832d0517524c0facf1f97486b1e58e deleted and replaced by tablet 9c77fd138ce9463b8f2d6f4182a56559
I20260616 19:51:53.222128 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 0da93e4052094862a44812990df1136a with delete_type TABLET_DATA_DELETED (replaced by tablet 49e88f4e88a64eca8aafc325f1834f54) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.226872 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 2808592f581e4605a814a2658401dfed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.233269 1245 leader_election.cc:290] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:53.234290 1191 tablet_replica.cc:333] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.234480 1191 raft_consensus.cc:2243] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.234443 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 2808592f581e4605a814a2658401dfed (table default.Table_c50bd97ac24a49f3a5b56d4f5731d562 [id=4e76c4bf11684b8094f076e37bb2be48]) successfully deleted
I20260616 19:51:53.234649 1191 raft_consensus.cc:2272] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:53.234946 858 leader_election.cc:343] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 51fa9bd399d54a86875db081081a8814
I20260616 19:51:53.235239 461 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet ab33d99d857145dfbda54ff2f7464486 (table default.Table_de7cf8cf7c43409b9c41391ff6e8ba35 [id=122f88b500c0425e833926b349605d6f]). Expected version 3 got 0
I20260616 19:51:53.235432 1191 ts_tablet_manager.cc:1916] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.235850 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 19832d0517524c0facf1f97486b1e58e with delete_type TABLET_DATA_DELETED (replaced by tablet 9c77fd138ce9463b8f2d6f4182a56559) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.235678 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d6350e9b4bf443519e2849b4c42a6252" } new_table_name: "default.Table_cb8601ac90d549099be33b639d901c21" modify_external_catalogs: true
I20260616 19:51:53.232589 1190 log.cc:1199] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/cf89adf3cbe54beab939645f7ebbb616
I20260616 19:51:53.238024 1192 tablet_bootstrap.cc:492] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.238183 1192 ts_tablet_manager.cc:1403] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.092s user 0.002s sys 0.001s
I20260616 19:51:53.238991 1192 raft_consensus.cc:359] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.239235 1192 raft_consensus.cc:385] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.239596 1192 raft_consensus.cc:740] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.239899 1192 consensus_queue.cc:260] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.240370 1192 ts_tablet_manager.cc:1434] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:53.240484 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 543ef0fcac3d47928c5dd1d13f9aba92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.240744 1192 tablet_bootstrap.cc:492] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.242151 1191 ts_tablet_manager.cc:1929] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.242282 1191 log.cc:1199] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/154ca8a6bce84b4bab932e69ec7f1f8e
I20260616 19:51:53.242647 1191 ts_tablet_manager.cc:1950] T 154ca8a6bce84b4bab932e69ec7f1f8e P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:53.242952 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet fcfc9231ffeb487cb15ed2a3788730ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.243741 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 154ca8a6bce84b4bab932e69ec7f1f8e (table default.Table_6db02b65da9f42279f9442335b438b91 [id=2c8430ecae1842458fb35770d90409f8]) successfully deleted
I20260616 19:51:53.244539 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d with delete_type TABLET_DATA_DELETED (replaced by tablet d61873c8aa094d7f899a61307a36f895) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.245170 1190 ts_tablet_manager.cc:1950] T cf89adf3cbe54beab939645f7ebbb616 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:53.246241 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 387ba2086bca4a15b388700044e3c45d with delete_type TABLET_DATA_DELETED (replaced by tablet de0ea6ca79ff4ed09f63fc7bb98eaabd) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.246521 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet cf89adf3cbe54beab939645f7ebbb616 (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]) successfully deleted
I20260616 19:51:53.247725 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_4a9b0e9a1c6648f8bb08c587a4750e4f [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 4 got 0
W20260616 19:51:53.249538 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 19832d0517524c0facf1f97486b1e58e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19832d0517524c0facf1f97486b1e58e already in progress: creating tablet
I20260616 19:51:53.250547 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d94eb734df94a309a7b171d907c81da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.251138 1191 tablet_replica.cc:333] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.251579 1191 raft_consensus.cc:2243] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260616 19:51:53.251760 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6d6071d862241e196a83a23bc939af4 consensus state has no leader
I20260616 19:51:53.252460 1191 raft_consensus.cc:2272] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.254276 1029 tablet_service.cc:1511] Processing CreateTablet for tablet a93dd295602840319f72e7021ddfd61a (DEFAULT_TABLE table=default.Table_289acf4951fa4f4888dae7ce3ef0fb6e [id=ec0c3e3aef034429b5cb31a106143a3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.254686 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93dd295602840319f72e7021ddfd61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.256230 889 tablet_service.cc:1511] Processing CreateTablet for tablet 662e2d573bd7489a81697c17393ce088 (DEFAULT_TABLE table=default.Table_11377e6262de467fbd54d3ab881b4362 [id=543aa36f72844ba182c88e2510bfe65c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.256641 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 662e2d573bd7489a81697c17393ce088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.257364 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 662e2d573bd7489a81697c17393ce088 (DEFAULT_TABLE table=default.Table_11377e6262de467fbd54d3ab881b4362 [id=543aa36f72844ba182c88e2510bfe65c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.257706 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 662e2d573bd7489a81697c17393ce088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.258818 750 tablet_service.cc:1558] Processing DeleteTablet for tablet d3645fc39d974bffa8fe52c62e1c7eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:53.260759 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 3de0e62cfd33410490a0b460fd5f69e9 (DEFAULT_TABLE table=default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.261103 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3de0e62cfd33410490a0b460fd5f69e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.261097 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cfb2238cbdb421a8f5001dc729e9bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:53.262197 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d94eb734df94a309a7b171d907c81da" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:53.262595 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fa9bd399d54a86875db081081a8814" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:53.262866 784 raft_consensus.cc:3060] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:53.265291 903 tablet_service.cc:1511] Processing CreateTablet for tablet 350453721d13427a946ac5c5ee7c62a0 (DEFAULT_TABLE table=default.Table_955814ce18d044e2b9e30c0074b7a8b0 [id=baa5ee1fdc8f4fb785c49501ba1c8144]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.265662 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350453721d13427a946ac5c5ee7c62a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.266887 784 raft_consensus.cc:2468] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:53.267832 860 leader_election.cc:304] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:53.268440 1191 ts_tablet_manager.cc:1916] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.268571 1286 raft_consensus.cc:2804] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:53.268718 1286 raft_consensus.cc:697] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:51:53.269114 1286 consensus_queue.cc:237] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.275122 901 tablet_service.cc:1511] Processing CreateTablet for tablet a93dd295602840319f72e7021ddfd61a (DEFAULT_TABLE table=default.Table_289acf4951fa4f4888dae7ce3ef0fb6e [id=ec0c3e3aef034429b5cb31a106143a3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.275612 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93dd295602840319f72e7021ddfd61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.277216 764 tablet_service.cc:1558] Processing DeleteTablet for tablet eac603a84d3c4f96bd444c54f28d278d with delete_type TABLET_DATA_DELETED (replaced by tablet bfff9d60bb7e4a86b14687b581b45efe) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:53.278613 1191 ts_tablet_manager.cc:1929] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.278745 1191 log.cc:1199] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/543ef0fcac3d47928c5dd1d13f9aba92
I20260616 19:51:53.279127 1191 ts_tablet_manager.cc:1950] T 543ef0fcac3d47928c5dd1d13f9aba92 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
W20260616 19:51:53.279163 996 leader_election.cc:343] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.279314 996 leader_election.cc:304] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:53.279754 1208 raft_consensus.cc:2749] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:53.281241 891 tablet_service.cc:1511] Processing CreateTablet for tablet 3de0e62cfd33410490a0b460fd5f69e9 (DEFAULT_TABLE table=default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.281821 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3de0e62cfd33410490a0b460fd5f69e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.283509 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 0da93e4052094862a44812990df1136a with delete_type TABLET_DATA_DELETED (replaced by tablet 49e88f4e88a64eca8aafc325f1834f54) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:53.283819 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 19832d0517524c0facf1f97486b1e58e with delete_type TABLET_DATA_DELETED (replaced by tablet 9c77fd138ce9463b8f2d6f4182a56559) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:53.285651 764 tablet_service.cc:1511] Processing CreateTablet for tablet a93dd295602840319f72e7021ddfd61a (DEFAULT_TABLE table=default.Table_289acf4951fa4f4888dae7ce3ef0fb6e [id=ec0c3e3aef034429b5cb31a106143a3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.286672 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93dd295602840319f72e7021ddfd61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.292972 755 tablet_service.cc:1511] Processing CreateTablet for tablet 3de0e62cfd33410490a0b460fd5f69e9 (DEFAULT_TABLE table=default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.294346 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3de0e62cfd33410490a0b460fd5f69e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.299115 750 tablet_service.cc:1511] Processing CreateTablet for tablet 662e2d573bd7489a81697c17393ce088 (DEFAULT_TABLE table=default.Table_11377e6262de467fbd54d3ab881b4362 [id=543aa36f72844ba182c88e2510bfe65c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.299494 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 662e2d573bd7489a81697c17393ce088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.302181 1192 tablet_bootstrap.cc:654] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.310156 1245 raft_consensus.cc:493] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.310412 1245 raft_consensus.cc:515] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.312742 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2ac7d4df6a48d6a93d40c7eef38c9c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:53.313050 1059 raft_consensus.cc:2468] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:53.313550 858 leader_election.cc:304] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:53.317111 1190 tablet_replica.cc:333] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:53.317380 1190 raft_consensus.cc:2243] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.317651 1190 raft_consensus.cc:2272] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.318409 1190 ts_tablet_manager.cc:1916] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.320151 1193 ts_tablet_manager.cc:1929] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.320329 1193 log.cc:1199] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/08330a8219574829834e36523ec6408e
I20260616 19:51:53.331398 1196 tablet_bootstrap.cc:492] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:53.331580 1196 ts_tablet_manager.cc:1403] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.420s user 0.041s sys 0.108s
I20260616 19:51:53.332381 1196 raft_consensus.cc:359] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.332621 1196 raft_consensus.cc:385] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.332703 1196 raft_consensus.cc:740] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.332939 1196 consensus_queue.cc:260] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.334093 1328 raft_consensus.cc:493] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.334275 1328 raft_consensus.cc:515] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.335992 1192 tablet_bootstrap.cc:492] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.336009 1325 raft_consensus.cc:493] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.336160 1192 ts_tablet_manager.cc:1403] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.096s user 0.004s sys 0.001s
I20260616 19:51:53.337637 1192 raft_consensus.cc:359] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.337913 1192 raft_consensus.cc:385] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.338029 1192 raft_consensus.cc:740] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.338308 1192 consensus_queue.cc:260] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.341500 1245 leader_election.cc:290] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:53.341748 1245 raft_consensus.cc:2804] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:53.343832 1198 tablet_bootstrap.cc:492] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.344017 1198 ts_tablet_manager.cc:1403] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.143s user 0.004s sys 0.053s
I20260616 19:51:53.345682 1198 raft_consensus.cc:359] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.346097 1198 raft_consensus.cc:385] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.346226 1198 raft_consensus.cc:740] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.346550 1198 consensus_queue.cc:260] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.347685 1198 ts_tablet_manager.cc:1434] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:51:53.348162 1198 tablet_bootstrap.cc:492] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.342445 1190 ts_tablet_manager.cc:1929] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.348803 1190 log.cc:1199] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/a6dd15b09ec246ee90bdc73fd93f862a
I20260616 19:51:53.343281 1192 ts_tablet_manager.cc:1434] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260616 19:51:53.349197 1190 ts_tablet_manager.cc:1950] T a6dd15b09ec246ee90bdc73fd93f862a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:53.349326 1192 tablet_bootstrap.cc:492] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.350494 1190 tablet_replica.cc:333] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:53.350734 1190 raft_consensus.cc:2243] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.350922 1190 raft_consensus.cc:2272] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.351576 1192 tablet_bootstrap.cc:654] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.351786 1190 ts_tablet_manager.cc:1916] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.351787 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet a6dd15b09ec246ee90bdc73fd93f862a (table default.Table_21a0653003a3493e952199c335c04c55 [id=d8ed14afa8ef43db8e963aab86921ed6]) successfully deleted
W20260616 19:51:53.352069 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d3645fc39d974bffa8fe52c62e1c7eff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3645fc39d974bffa8fe52c62e1c7eff already in progress: creating tablet
I20260616 19:51:53.353180 1245 raft_consensus.cc:493] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:53.353314 1245 raft_consensus.cc:3060] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:53.353480 1193 ts_tablet_manager.cc:1950] T 08330a8219574829834e36523ec6408e P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:53.353955 1196 ts_tablet_manager.cc:1434] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260616 19:51:53.357002 1198 tablet_bootstrap.cc:654] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.360432 1190 ts_tablet_manager.cc:1929] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.360633 1190 log.cc:1199] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/302997d0e3b247ebaceec9151f580c3a
I20260616 19:51:53.360985 1190 ts_tablet_manager.cc:1950] T 302997d0e3b247ebaceec9151f580c3a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:53.361904 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 302997d0e3b247ebaceec9151f580c3a (table default.Table_fca913263b4846dea884088bbe9d2529 [id=a67f3f850e8e4696ba2c178ad1de8360]) successfully deleted
I20260616 19:51:53.362164 1190 tablet_replica.cc:333] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
W20260616 19:51:53.362344 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 5af9bdceae184f8dbb9e5db67a11ee63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5af9bdceae184f8dbb9e5db67a11ee63 already in progress: creating tablet
W20260616 19:51:53.362754 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 2cfb2238cbdb421a8f5001dc729e9bb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cfb2238cbdb421a8f5001dc729e9bb5 already in progress: creating tablet
I20260616 19:51:53.336158 1325 raft_consensus.cc:515] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.366151 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383589f0e211418bbdf5046ed90db410" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:53.366475 1059 raft_consensus.cc:2468] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:51:53.366977 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383589f0e211418bbdf5046ed90db410" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:53.367268 923 raft_consensus.cc:2468] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:51:53.367879 719 leader_election.cc:304] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:51:53.373291 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fe763512a640490ebb25dca52b04788a" } modify_external_catalogs: true
I20260616 19:51:53.373502 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fe763512a640490ebb25dca52b04788a" } modify_external_catalogs: true
I20260616 19:51:53.373831 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_4a9b0e9a1c6648f8bb08c587a4750e4f [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 4 got 0
I20260616 19:51:53.374020 1192 tablet_bootstrap.cc:492] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.374217 1192 ts_tablet_manager.cc:1403] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.009s
I20260616 19:51:53.374738 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dcc7faba5fed46d1a4e0ce7486ac8a85" } modify_external_catalogs: true
I20260616 19:51:53.374883 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dcc7faba5fed46d1a4e0ce7486ac8a85" } modify_external_catalogs: true
I20260616 19:51:53.375083 1192 raft_consensus.cc:359] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.375311 1192 raft_consensus.cc:385] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.375422 1192 raft_consensus.cc:740] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.375674 1192 consensus_queue.cc:260] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.376013 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f29c0729614141a183a4aa7787c0a612" } modify_external_catalogs: true
I20260616 19:51:53.376176 1192 ts_tablet_manager.cc:1434] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260616 19:51:53.376186 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f29c0729614141a183a4aa7787c0a612" } modify_external_catalogs: true
I20260616 19:51:53.376542 1192 tablet_bootstrap.cc:492] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.377835 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e5e5e46d5e204e50a6583125f8d267e0" } new_table_name: "default.Table_10a5c35013c14fe1b8d9d1c77589d321" modify_external_catalogs: true
I20260616 19:51:53.378100 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet e8351427cb34466f82ee74fb60b6798b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.376387 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e2695b46a446427381c2ea1d260bed78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.379040 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2695b46a446427381c2ea1d260bed78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.380043 1192 tablet_bootstrap.cc:654] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.381143 1196 tablet_bootstrap.cc:492] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:53.381373 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2ac7d4df6a48d6a93d40c7eef38c9c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:53.382125 1198 tablet_bootstrap.cc:492] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.382337 1198 ts_tablet_manager.cc:1403] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.034s user 0.012s sys 0.000s
I20260616 19:51:53.384613 784 raft_consensus.cc:2468] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:53.384858 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 105) took 1019 ms. Trace:
I20260616 19:51:53.385450 1198 raft_consensus.cc:359] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.385653 1198 raft_consensus.cc:385] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.356405 1245 raft_consensus.cc:515] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.385712 1198 raft_consensus.cc:740] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.386397 1245 leader_election.cc:290] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:53.385988 1198 consensus_queue.cc:260] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.387907 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_289acf4951fa4f4888dae7ce3ef0fb6e" } modify_external_catalogs: true
I20260616 19:51:53.388083 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_289acf4951fa4f4888dae7ce3ef0fb6e" } modify_external_catalogs: true
I20260616 19:51:53.389338 1198 ts_tablet_manager.cc:1434] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260616 19:51:53.390133 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5f98dbc56e0e44ba93e5e67cb2a74652"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:53.386942 1328 leader_election.cc:290] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:51:53.390830 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f98dbc56e0e44ba93e5e67cb2a74652 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.390961 1328 raft_consensus.cc:493] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.391912 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1a330c132b3f4982b52e492c2ded8be7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.392405 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a330c132b3f4982b52e492c2ded8be7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.392957 1198 tablet_bootstrap.cc:492] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:51:53.393594 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 815d213bf1904353b4f0b2e2f8954db9 consensus state has no leader
I20260616 19:51:53.393913 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_955814ce18d044e2b9e30c0074b7a8b0" } modify_external_catalogs: true
I20260616 19:51:53.384979 1193 rpcz_store.cc:276] 0616 19:51:52.344753 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.345330 (+ 577us) service_pool.cc:224] Handling call
0616 19:51:52.965546 (+620216us) ts_tablet_manager.cc:1151] Deleting tablet 08330a8219574829834e36523ec6408e
0616 19:51:52.965554 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:53.282510 (+316956us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:53.320069 (+ 37559us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:53.363799 (+ 43730us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":619886}
I20260616 19:51:53.394073 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_955814ce18d044e2b9e30c0074b7a8b0" } modify_external_catalogs: true
W20260616 19:51:53.394343 718 leader_election.cc:343] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: 5fd2cd6063dc430e89188ed00e76a760
I20260616 19:51:53.395102 1325 leader_election.cc:290] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:53.395231 1198 tablet_bootstrap.cc:654] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.395242 1325 raft_consensus.cc:493] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.395473 1325 raft_consensus.cc:515] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.396270 1328 raft_consensus.cc:515] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.396786 1328 leader_election.cc:290] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:53.397639 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 08330a8219574829834e36523ec6408e (table default.Table_1a3a46499a29471cbd3f312ef6f2c560 [id=f8770615f8d94929983c07bb73f3116f]) successfully deleted
I20260616 19:51:53.400017 459 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 49e88f4e88a64eca8aafc325f1834f54
I20260616 19:51:53.400343 1192 tablet_bootstrap.cc:492] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.400524 1192 ts_tablet_manager.cc:1403] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.002s
I20260616 19:51:53.401564 1192 raft_consensus.cc:359] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.401784 1192 raft_consensus.cc:385] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.401882 1192 raft_consensus.cc:740] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.402120 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 98) took 1165 ms. Trace:
I20260616 19:51:53.402218 1193 rpcz_store.cc:276] 0616 19:51:52.228721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.361171 (+132450us) service_pool.cc:224] Handling call
0616 19:51:53.394156 (+1032985us) ts_tablet_manager.cc:1151] Deleting tablet 0f061d4bc90f42409eb99987059e6656
0616 19:51:53.394166 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:53.394287 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1032757}
I20260616 19:51:53.402305 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cfe1476b261844838747bb5597d50449"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:53.402649 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.402738 1193 tablet_replica.cc:333] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:53.402917 1193 raft_consensus.cc:2243] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.403103 1193 raft_consensus.cc:2272] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.403103 1192 consensus_queue.cc:260] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.403622 1193 ts_tablet_manager.cc:1916] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.403772 1192 ts_tablet_manager.cc:1434] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260616 19:51:53.404137 719 leader_election.cc:343] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 5fd2cd6063dc430e89188ed00e76a760
I20260616 19:51:53.404556 719 leader_election.cc:304] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:51:53.404825 719 raft_consensus.cc:2686] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:51:53.405120 1192 tablet_bootstrap.cc:492] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.405238 1329 raft_consensus.cc:2804] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:53.405337 1329 raft_consensus.cc:493] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:53.405452 1329 raft_consensus.cc:3060] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:51:53.405751 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfe1476b261844838747bb5597d50449 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.406921 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ca73591123cf4e2982da39e8b7095cb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.407461 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca73591123cf4e2982da39e8b7095cb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:53.408591 719 leader_election.cc:343] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: c789abf00da24981be5bb72c0b5752d1
I20260616 19:51:53.408800 1192 tablet_bootstrap.cc:654] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:53.408840 719 leader_election.cc:343] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: a6dd15b09ec246ee90bdc73fd93f862a
W20260616 19:51:53.409098 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0f061d4bc90f42409eb99987059e6656 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f061d4bc90f42409eb99987059e6656 already in progress: creating tablet
W20260616 19:51:53.409370 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 54ceb5a01be24dfb9c08001d662a9ac4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54ceb5a01be24dfb9c08001d662a9ac4 already in progress: creating tablet
I20260616 19:51:53.409651 1325 leader_election.cc:290] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:53.414475 1198 tablet_bootstrap.cc:492] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.414655 454 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 31cd232f91da43d38d30d7075cf33249
I20260616 19:51:53.414680 1198 ts_tablet_manager.cc:1403] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.003s
I20260616 19:51:53.415732 1198 raft_consensus.cc:359] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.415968 1198 raft_consensus.cc:385] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.416110 1198 raft_consensus.cc:740] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.416442 1198 consensus_queue.cc:260] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.418393 1198 ts_tablet_manager.cc:1434] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260616 19:51:53.418764 1198 tablet_bootstrap.cc:492] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.420698 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_04333ee3e94448f19dec006a4bef21cf" } new_table_name: "default.Table_e6fa01673a5f49c5b6198541d6d74674" modify_external_catalogs: true
I20260616 19:51:53.421672 1198 tablet_bootstrap.cc:654] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.424013 1192 tablet_bootstrap.cc:492] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.424217 1192 ts_tablet_manager.cc:1403] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.001s
I20260616 19:51:53.424770 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2ac7d4df6a48d6a93d40c7eef38c9c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:53.425024 784 raft_consensus.cc:3060] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:53.425264 1192 raft_consensus.cc:359] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.425539 1192 raft_consensus.cc:385] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.425629 1192 raft_consensus.cc:740] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.426107 1192 consensus_queue.cc:260] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.427541 784 raft_consensus.cc:2468] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:53.427812 1192 ts_tablet_manager.cc:1434] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
W20260616 19:51:53.428844 718 leader_election.cc:343] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: a6dd15b09ec246ee90bdc73fd93f862a
I20260616 19:51:53.429001 718 leader_election.cc:304] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:53.429057 1192 tablet_bootstrap.cc:492] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:51:53.429361 718 leader_election.cc:343] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: c789abf00da24981be5bb72c0b5752d1
I20260616 19:51:53.429482 718 leader_election.cc:304] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:53.429893 860 leader_election.cc:304] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:53.430218 1328 raft_consensus.cc:2749] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:53.430316 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c557049a020a4b318bb6e8a53710a6cc
I20260616 19:51:53.430401 1328 raft_consensus.cc:2749] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:53.430657 1245 raft_consensus.cc:2804] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:53.430804 1245 raft_consensus.cc:697] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:51:53.431094 1245 consensus_queue.cc:237] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.431360 1192 tablet_bootstrap.cc:654] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.431689 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet c557049a020a4b318bb6e8a53710a6cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.432973 891 tablet_service.cc:1558] Processing DeleteTablet for tablet c557049a020a4b318bb6e8a53710a6cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.434108 1198 tablet_bootstrap.cc:492] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.434362 1198 ts_tablet_manager.cc:1403] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.004s
I20260616 19:51:53.435319 1198 raft_consensus.cc:359] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:53.435590 1198 raft_consensus.cc:385] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.435673 1198 raft_consensus.cc:740] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.435961 1198 consensus_queue.cc:260] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:53.436266 1325 raft_consensus.cc:493] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.436494 1198 ts_tablet_manager.cc:1434] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:51:53.436803 1198 tablet_bootstrap.cc:492] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.436424 1325 raft_consensus.cc:515] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.437402 1325 leader_election.cc:290] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:53.437602 1190 raft_consensus.cc:2243] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:53.438777 750 tablet_service.cc:1558] Processing DeleteTablet for tablet c557049a020a4b318bb6e8a53710a6cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:53.439049 719 leader_election.cc:343] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: cf89adf3cbe54beab939645f7ebbb616
I20260616 19:51:53.439435 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 350453721d13427a946ac5c5ee7c62a0 (DEFAULT_TABLE table=default.Table_955814ce18d044e2b9e30c0074b7a8b0 [id=baa5ee1fdc8f4fb785c49501ba1c8144]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.439872 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350453721d13427a946ac5c5ee7c62a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.441524 1198 tablet_bootstrap.cc:654] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.442319 1190 pending_rounds.cc:70] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:51:53.442420 1190 pending_rounds.cc:77] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595446354059264 op_type: NO_OP noop_request { }
I20260616 19:51:53.445442 1329 raft_consensus.cc:515] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.446612 1329 leader_election.cc:290] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:53.446642 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383589f0e211418bbdf5046ed90db410" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:51:53.446929 1060 raft_consensus.cc:3060] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:53.447320 1196 tablet_bootstrap.cc:654] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.448315 1190 raft_consensus.cc:2889] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:53.448534 1190 raft_consensus.cc:2272] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:53.451073 718 leader_election.cc:343] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: cf89adf3cbe54beab939645f7ebbb616
I20260616 19:51:53.451234 718 leader_election.cc:304] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:53.451768 1190 ts_tablet_manager.cc:1916] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.453727 1329 raft_consensus.cc:2749] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:53.457826 1060 raft_consensus.cc:2468] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:51:53.460935 719 leader_election.cc:304] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:51:53.462311 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383589f0e211418bbdf5046ed90db410" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:53.462664 923 raft_consensus.cc:3060] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:53.462731 1329 raft_consensus.cc:2804] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:53.463022 1329 raft_consensus.cc:697] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:51:53.463486 1329 consensus_queue.cc:237] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.466359 1190 ts_tablet_manager.cc:1929] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:53.468158 1190 log.cc:1199] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/51fa9bd399d54a86875db081081a8814
I20260616 19:51:53.470209 1190 ts_tablet_manager.cc:1950] T 51fa9bd399d54a86875db081081a8814 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:53.470523 923 raft_consensus.cc:2468] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:51:53.462517 1198 tablet_bootstrap.cc:492] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.471338 1190 tablet_replica.cc:333] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:53.471465 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 51fa9bd399d54a86875db081081a8814 (table default.Table_f6d740d1faed4c4fa615d5711262ccf9 [id=dadf8402246843219b213be49e8ad54b]) successfully deleted
I20260616 19:51:53.471599 1190 raft_consensus.cc:2243] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
W20260616 19:51:53.471760 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet eac603a84d3c4f96bd444c54f28d278d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eac603a84d3c4f96bd444c54f28d278d already in progress: creating tablet
I20260616 19:51:53.471774 1192 tablet_bootstrap.cc:492] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.472004 1190 raft_consensus.cc:2272] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.472250 1192 ts_tablet_manager.cc:1403] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.044s user 0.005s sys 0.005s
I20260616 19:51:53.473007 1198 ts_tablet_manager.cc:1403] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.007s
W20260616 19:51:53.473258 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 125099us
I20260616 19:51:53.473657 1192 raft_consensus.cc:359] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.473867 1192 raft_consensus.cc:385] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.473815 1198 raft_consensus.cc:359] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.474411 1192 raft_consensus.cc:740] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.474409 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2ac7d4df6a48d6a93d40c7eef38c9c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:51:53.474522 1190 ts_tablet_manager.cc:1916] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.474645 1060 raft_consensus.cc:3060] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:53.474776 1192 consensus_queue.cc:260] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.475411 1192 ts_tablet_manager.cc:1434] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:51:53.480391 1193 ts_tablet_manager.cc:1929] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.474411 1198 raft_consensus.cc:385] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.480583 1193 log.cc:1199] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/5fd2cd6063dc430e89188ed00e76a760
I20260616 19:51:53.480639 1198 raft_consensus.cc:740] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.480924 1198 consensus_queue.cc:260] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.481621 1198 ts_tablet_manager.cc:1434] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260616 19:51:53.481943 1198 tablet_bootstrap.cc:492] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.484081 1198 tablet_bootstrap.cc:654] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.477929 1060 raft_consensus.cc:2468] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:53.486058 1192 tablet_bootstrap.cc:492] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.488703 750 tablet_service.cc:1511] Processing CreateTablet for tablet 350453721d13427a946ac5c5ee7c62a0 (DEFAULT_TABLE table=default.Table_955814ce18d044e2b9e30c0074b7a8b0 [id=baa5ee1fdc8f4fb785c49501ba1c8144]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.488813 1033 tablet_service.cc:1511] Processing CreateTablet for tablet b99740ab59f947aabcac88dc2bf2de86 (DEFAULT_TABLE table=default.Table_2e10c27b05e243a2a85134e81dc2a126 [id=d641d7d6fc004dc384ee5f82769bbfbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.489140 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350453721d13427a946ac5c5ee7c62a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.489640 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b99740ab59f947aabcac88dc2bf2de86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.495396 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6425c298b87c4b6ba30e2944f06792d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.496001 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6425c298b87c4b6ba30e2944f06792d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.503890 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 8125dce4d32a416498b42a1b599355fd (DEFAULT_TABLE table=default.Table_7713a34d9f7e4031a42f66ee98382545 [id=6f77a88fd07a47cfbef0a061968dda5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.504329 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8125dce4d32a416498b42a1b599355fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.507730 750 tablet_service.cc:1511] Processing CreateTablet for tablet b99740ab59f947aabcac88dc2bf2de86 (DEFAULT_TABLE table=default.Table_2e10c27b05e243a2a85134e81dc2a126 [id=d641d7d6fc004dc384ee5f82769bbfbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.508276 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b99740ab59f947aabcac88dc2bf2de86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.511073 1192 tablet_bootstrap.cc:654] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.512063 891 tablet_service.cc:1511] Processing CreateTablet for tablet b99740ab59f947aabcac88dc2bf2de86 (DEFAULT_TABLE table=default.Table_2e10c27b05e243a2a85134e81dc2a126 [id=d641d7d6fc004dc384ee5f82769bbfbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.512815 1205 raft_consensus.cc:697] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:51:53.513007 901 tablet_service.cc:1511] Processing CreateTablet for tablet 8125dce4d32a416498b42a1b599355fd (DEFAULT_TABLE table=default.Table_7713a34d9f7e4031a42f66ee98382545 [id=6f77a88fd07a47cfbef0a061968dda5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.513085 1205 consensus_queue.cc:237] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.513479 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8125dce4d32a416498b42a1b599355fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.516314 764 tablet_service.cc:1511] Processing CreateTablet for tablet 8125dce4d32a416498b42a1b599355fd (DEFAULT_TABLE table=default.Table_7713a34d9f7e4031a42f66ee98382545 [id=6f77a88fd07a47cfbef0a061968dda5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.516573 1286 raft_consensus.cc:493] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.516726 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8125dce4d32a416498b42a1b599355fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.517043 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 39f52eebdc79460a9ff33191086e87c6 (DEFAULT_TABLE table=default.Table_6cb59d68dcc344deae0b9679df0f26d9 [id=23f3d793560846b7a0701ec470588cbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.517603 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f52eebdc79460a9ff33191086e87c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.523083 1286 raft_consensus.cc:515] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.524533 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b99740ab59f947aabcac88dc2bf2de86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.526566 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcfc9231ffeb487cb15ed2a3788730ba" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:53.527485 1193 ts_tablet_manager.cc:1950] T 5fd2cd6063dc430e89188ed00e76a760 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:51:53.527885 860 leader_election.cc:343] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.529301 1190 ts_tablet_manager.cc:1929] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.529445 1190 log.cc:1199] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/2808592f581e4605a814a2658401dfed
I20260616 19:51:53.530354 1196 tablet_bootstrap.cc:492] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:53.530548 1196 ts_tablet_manager.cc:1403] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.176s user 0.005s sys 0.005s
W20260616 19:51:53.530565 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da51a682de41402cb537ab113f876a2d has no consensus state
I20260616 19:51:53.531407 1196 raft_consensus.cc:359] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.531729 1196 raft_consensus.cc:385] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.528714 1286 leader_election.cc:290] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:53.533773 903 tablet_service.cc:1511] Processing CreateTablet for tablet 39f52eebdc79460a9ff33191086e87c6 (DEFAULT_TABLE table=default.Table_6cb59d68dcc344deae0b9679df0f26d9 [id=23f3d793560846b7a0701ec470588cbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.534168 1196 raft_consensus.cc:740] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.534219 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f52eebdc79460a9ff33191086e87c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.534567 1196 consensus_queue.cc:260] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.535753 1196 ts_tablet_manager.cc:1434] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:51:53.534052 1329 raft_consensus.cc:493] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.536428 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 543ef0fcac3d47928c5dd1d13f9aba92 (table default.Table_5ad3a183f911465da5f24ce69f9d6256 [id=91705098b83a4cbd80112158f1b82022]) successfully deleted
I20260616 19:51:53.536628 1329 raft_consensus.cc:515] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:51:53.537151 1191 tablet_replica.cc:333] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.537622 1329 leader_election.cc:290] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:51:53.538209 719 leader_election.cc:343] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 2808592f581e4605a814a2658401dfed
I20260616 19:51:53.538925 1190 ts_tablet_manager.cc:1950] T 2808592f581e4605a814a2658401dfed P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:53.539599 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f4d10be30e3f471eb57724a33c8bb316" } new_table_name: "default.Table_c74d12fe512847eb94953b8f78c6b753" modify_external_catalogs: true
I20260616 19:51:53.542001 1191 raft_consensus.cc:2243] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.543601 1191 raft_consensus.cc:2272] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.542380 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet a2b6158b31b34419aa3619f3ce8242b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.545229 1191 ts_tablet_manager.cc:1916] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.547181 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 2808592f581e4605a814a2658401dfed (table default.Table_c50bd97ac24a49f3a5b56d4f5731d562 [id=4e76c4bf11684b8094f076e37bb2be48]) successfully deleted
W20260616 19:51:53.547585 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 19832d0517524c0facf1f97486b1e58e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19832d0517524c0facf1f97486b1e58e already in progress: creating tablet
W20260616 19:51:53.547816 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c557049a020a4b318bb6e8a53710a6cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c557049a020a4b318bb6e8a53710a6cc already in progress: creating tablet
W20260616 19:51:53.547869 718 leader_election.cc:343] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: 2808592f581e4605a814a2658401dfed
I20260616 19:51:53.548030 718 leader_election.cc:304] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:53.548275 889 tablet_service.cc:1511] Processing CreateTablet for tablet d5741b92cafb4d53987dbeeef66ccd56 (DEFAULT_TABLE table=default.Table_6813dd9e1dba43d2adf02fa586cb4c8f [id=ee6ce577050e45c5b9b014d3827e5046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.543187 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcfc9231ffeb487cb15ed2a3788730ba" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:53.549577 764 tablet_service.cc:1511] Processing CreateTablet for tablet 39f52eebdc79460a9ff33191086e87c6 (DEFAULT_TABLE table=default.Table_6cb59d68dcc344deae0b9679df0f26d9 [id=23f3d793560846b7a0701ec470588cbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.550477 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f52eebdc79460a9ff33191086e87c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.553087 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5741b92cafb4d53987dbeeef66ccd56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.553305 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_08665ae0b3d543ee85db56ca306c7f4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.554024 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08665ae0b3d543ee85db56ca306c7f4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:53.554508 858 leader_election.cc:343] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.555577 1036 tablet_service.cc:1511] Processing CreateTablet for tablet d5741b92cafb4d53987dbeeef66ccd56 (DEFAULT_TABLE table=default.Table_6813dd9e1dba43d2adf02fa586cb4c8f [id=ee6ce577050e45c5b9b014d3827e5046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.555969 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5741b92cafb4d53987dbeeef66ccd56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.561299 755 tablet_service.cc:1511] Processing CreateTablet for tablet d5741b92cafb4d53987dbeeef66ccd56 (DEFAULT_TABLE table=default.Table_6813dd9e1dba43d2adf02fa586cb4c8f [id=ee6ce577050e45c5b9b014d3827e5046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.561717 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5741b92cafb4d53987dbeeef66ccd56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.563797 904 tablet_service.cc:1511] Processing CreateTablet for tablet eb024637294148c18b74bef47fb2fcce (DEFAULT_TABLE table=default.Table_4d3d9fe6e0b84d6f923e9e134082daf6 [id=fb8670837a3f4c7086c4f112b7319a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.564495 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb024637294148c18b74bef47fb2fcce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.570775 1329 raft_consensus.cc:2749] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:53.579348 858 leader_election.cc:304] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:53.579785 1286 raft_consensus.cc:2749] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:53.580086 1208 raft_consensus.cc:493] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.580292 1208 raft_consensus.cc:515] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.581107 1208 leader_election.cc:290] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:53.582020 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a93dd295602840319f72e7021ddfd61a
I20260616 19:51:53.582399 1191 ts_tablet_manager.cc:1929] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.582516 1191 log.cc:1199] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/fcfc9231ffeb487cb15ed2a3788730ba
I20260616 19:51:53.582888 1191 ts_tablet_manager.cc:1950] T fcfc9231ffeb487cb15ed2a3788730ba P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:53.582777 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_daf95e025c454ee1b78a61861cc1a23d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.583431 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daf95e025c454ee1b78a61861cc1a23d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.585498 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 91336c7847ea4739a0be7fdd9d199cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.585947 1191 tablet_replica.cc:333] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.586175 1191 raft_consensus.cc:2243] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.586349 1191 raft_consensus.cc:2272] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.586474 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet fcfc9231ffeb487cb15ed2a3788730ba (table default.Table_6a9c2eded2954f7282a8fa6d68278896 [id=54246691d67e4a68a4a9d955919d998c]) successfully deleted
I20260616 19:51:53.587013 1036 tablet_service.cc:1511] Processing CreateTablet for tablet eb024637294148c18b74bef47fb2fcce (DEFAULT_TABLE table=default.Table_4d3d9fe6e0b84d6f923e9e134082daf6 [id=fb8670837a3f4c7086c4f112b7319a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.587477 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb024637294148c18b74bef47fb2fcce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.584380 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_da45e8ccd8434d46b81a74258f6bd98a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.588183 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da45e8ccd8434d46b81a74258f6bd98a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.590091 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f60e9778dd429c8bdbf96261901a56" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:53.590219 756 tablet_service.cc:1558] Processing DeleteTablet for tablet a93dd295602840319f72e7021ddfd61a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:53.590642 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f60e9778dd429c8bdbf96261901a56" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:53.593344 1193 tablet_replica.cc:333] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:51:53.594002 993 leader_election.cc:343] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.594681 1193 raft_consensus.cc:2243] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.594993 1193 raft_consensus.cc:2272] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:53.595217 996 leader_election.cc:343] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.595338 996 leader_election.cc:304] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:53.595719 1208 raft_consensus.cc:2749] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:53.596179 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 5fd2cd6063dc430e89188ed00e76a760 (table default.Table_3b3dce47cfdc420eba859affc6ad8f5f [id=02b198713aff4f2c967d63e708d57699]) successfully deleted
W20260616 19:51:53.596557 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 5c90188c0181467ea3deee14fa5568b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c90188c0181467ea3deee14fa5568b3 already in progress: creating tablet
I20260616 19:51:53.596819 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 54ceb5a01be24dfb9c08001d662a9ac4 with delete_type TABLET_DATA_DELETED (replaced by tablet 122a8b15e62f4b23b465e2dbc816df62) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.597056 1208 raft_consensus.cc:493] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.597172 1208 raft_consensus.cc:515] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.597311 755 tablet_service.cc:1511] Processing CreateTablet for tablet eb024637294148c18b74bef47fb2fcce (DEFAULT_TABLE table=default.Table_4d3d9fe6e0b84d6f923e9e134082daf6 [id=fb8670837a3f4c7086c4f112b7319a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.597738 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb024637294148c18b74bef47fb2fcce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.597774 1208 leader_election.cc:290] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:53.598491 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91336c7847ea4739a0be7fdd9d199cca" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:53.598912 996 leader_election.cc:343] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.599815 457 catalog_manager.cc:5696] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } }
I20260616 19:51:53.600813 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet a93dd295602840319f72e7021ddfd61a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.612015 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 350453721d13427a946ac5c5ee7c62a0
I20260616 19:51:53.613003 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4d3d9fe6e0b84d6f923e9e134082daf6" } new_table_name: "default.Table_1dbd90a0e47a4f1eb2efa82ae31c9b74" modify_external_catalogs: true
I20260616 19:51:53.613488 461 master_service.cc:960] ReplaceTablet: received request to replace tablet 0f061d4bc90f42409eb99987059e6656 from {username='slave'} at 127.0.0.1:41696
W20260616 19:51:53.614530 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21408288aae545cba9aa65afbc29a0e3 consensus state has no leader
I20260616 19:51:53.614810 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 19832d0517524c0facf1f97486b1e58e from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:53.615497 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_83077797e50a4defa55132113e80d358"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.616070 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83077797e50a4defa55132113e80d358 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.616394 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_086d9859d5ca4cb0a6e3cfca328cc80f" } new_table_name: "default.Table_fdb76eb70534433eae79f807fd35fb90" modify_external_catalogs: true
I20260616 19:51:53.618109 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_10a5c35013c14fe1b8d9d1c77589d321" } modify_external_catalogs: true
I20260616 19:51:53.618254 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_10a5c35013c14fe1b8d9d1c77589d321" } modify_external_catalogs: true
I20260616 19:51:53.618368 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 350453721d13427a946ac5c5ee7c62a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:53.618470 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 350453721d13427a946ac5c5ee7c62a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:53.618628 891 tablet_service.cc:1558] Processing DeleteTablet for tablet a93dd295602840319f72e7021ddfd61a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.618986 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91336c7847ea4739a0be7fdd9d199cca" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:51:53.620143 993 leader_election.cc:343] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.620296 993 leader_election.cc:304] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:53.620719 1208 raft_consensus.cc:2749] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:53.622112 1192 tablet_bootstrap.cc:492] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.622352 1192 ts_tablet_manager.cc:1403] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.136s user 0.002s sys 0.020s
I20260616 19:51:53.623255 1192 raft_consensus.cc:359] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.623531 1192 raft_consensus.cc:385] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.623641 1192 raft_consensus.cc:740] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.623948 1192 consensus_queue.cc:260] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:51:53.624006 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a93dd295602840319f72e7021ddfd61a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a93dd295602840319f72e7021ddfd61a already in progress: creating tablet
I20260616 19:51:53.625939 1192 ts_tablet_manager.cc:1434] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:51:53.625715 1191 ts_tablet_manager.cc:1916] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.626443 1192 tablet_bootstrap.cc:492] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.628165 1192 tablet_bootstrap.cc:654] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.629017 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 350453721d13427a946ac5c5ee7c62a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:53.629871 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 350453721d13427a946ac5c5ee7c62a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 350453721d13427a946ac5c5ee7c62a0 already in progress: creating tablet
I20260616 19:51:53.630481 1205 raft_consensus.cc:493] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.630641 1205 raft_consensus.cc:515] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.631819 1205 leader_election.cc:290] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:53.632673 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e37f42ce8ec47fca1cf8aa75bc0202d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:53.632697 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e37f42ce8ec47fca1cf8aa75bc0202d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:53.632863 923 raft_consensus.cc:2468] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:51:53.633198 1196 tablet_bootstrap.cc:492] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:53.633345 718 leader_election.cc:304] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:53.633741 1245 raft_consensus.cc:493] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:51:53.633767 719 leader_election.cc:343] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: Tablet not RUNNING: STOPPED
I20260616 19:51:53.633890 1245 raft_consensus.cc:515] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.634230 1205 raft_consensus.cc:2804] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:53.634348 1205 raft_consensus.cc:493] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:53.634476 1205 raft_consensus.cc:3060] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:53.634936 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddc4929e1dc4c9284cd78dfa6b6febd" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:53.635228 1196 tablet_bootstrap.cc:654] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:53.635509 860 leader_election.cc:343] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.636061 1191 ts_tablet_manager.cc:1929] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.636207 1191 log.cc:1199] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/4e37f42ce8ec47fca1cf8aa75bc0202d
I20260616 19:51:53.636260 1245 leader_election.cc:290] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:53.636210 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddc4929e1dc4c9284cd78dfa6b6febd" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:53.636631 1060 raft_consensus.cc:2468] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:53.636855 1191 ts_tablet_manager.cc:1950] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:53.637408 858 leader_election.cc:304] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:51:53.637761 1205 raft_consensus.cc:515] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.637877 1245 raft_consensus.cc:2804] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:53.637919 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 4e37f42ce8ec47fca1cf8aa75bc0202d (table default.Table_6a6d8516df114593b27d86140407b724 [id=d104c5ac8acc4a6f9ed7cc87879d661b]) successfully deleted
I20260616 19:51:53.637979 1245 raft_consensus.cc:493] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:53.638075 1245 raft_consensus.cc:3060] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:53.638850 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e37f42ce8ec47fca1cf8aa75bc0202d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:53.639094 923 raft_consensus.cc:3060] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:53.639505 1191 tablet_replica.cc:333] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.639674 1191 raft_consensus.cc:2243] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.640929 1245 raft_consensus.cc:515] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.641716 923 raft_consensus.cc:2468] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:51:53.641764 1191 raft_consensus.cc:2272] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.641882 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddc4929e1dc4c9284cd78dfa6b6febd" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:53.642380 718 leader_election.cc:304] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:53.642455 1191 ts_tablet_manager.cc:1916] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:51:53.642733 860 leader_election.cc:343] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.642782 1205 leader_election.cc:290] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:53.642967 1205 raft_consensus.cc:2804] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
W20260616 19:51:53.643290 719 leader_election.cc:343] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 4e37f42ce8ec47fca1cf8aa75bc0202d
I20260616 19:51:53.643949 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddc4929e1dc4c9284cd78dfa6b6febd" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:51:53.644150 1060 raft_consensus.cc:3060] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:53.643167 1205 raft_consensus.cc:697] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:51:53.644906 1205 consensus_queue.cc:237] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:51:53.645489 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 776841d895d6431fbee76b7c4e28d973 consensus state has no leader
I20260616 19:51:53.645807 455 master_service.cc:960] ReplaceTablet: received request to replace tablet d3645fc39d974bffa8fe52c62e1c7eff from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:53.646291 455 master_service.cc:960] ReplaceTablet: received request to replace tablet d61873c8aa094d7f899a61307a36f895 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:53.646790 1060 raft_consensus.cc:2468] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:53.647246 858 leader_election.cc:304] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:51:53.647539 1286 raft_consensus.cc:2804] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:53.647686 1286 raft_consensus.cc:697] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:51:53.647949 1286 consensus_queue.cc:237] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.649638 1191 ts_tablet_manager.cc:1929] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.649838 1191 log.cc:1199] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/387ba2086bca4a15b388700044e3c45d
I20260616 19:51:53.650319 1191 ts_tablet_manager.cc:1950] T 387ba2086bca4a15b388700044e3c45d P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:53.651577 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 387ba2086bca4a15b388700044e3c45d (table default.Table_6e469684e5b844a5b7f13a1047fd933a [id=7d5a7b1d32b147a3a8b5426c661dda2f]) successfully deleted
I20260616 19:51:53.652031 1191 tablet_replica.cc:333] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.652341 1191 raft_consensus.cc:2243] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.652607 1191 raft_consensus.cc:2272] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.653570 1191 ts_tablet_manager.cc:1916] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.657836 456 master_service.cc:960] ReplaceTablet: received request to replace tablet c557049a020a4b318bb6e8a53710a6cc from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:53.658079 1245 leader_election.cc:290] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:53.660763 1191 ts_tablet_manager.cc:1929] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.661031 1191 log.cc:1199] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/6d94eb734df94a309a7b171d907c81da
I20260616 19:51:53.661475 1191 ts_tablet_manager.cc:1950] T 6d94eb734df94a309a7b171d907c81da P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:53.661666 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2e10c27b05e243a2a85134e81dc2a126" } modify_external_catalogs: true
I20260616 19:51:53.662326 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2e10c27b05e243a2a85134e81dc2a126" } modify_external_catalogs: true
I20260616 19:51:53.662844 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 6d94eb734df94a309a7b171d907c81da (table default.Table_0ed7b3aa00c145f49e22f9cbc892bc0c [id=6067524c64a14af0976b29a9776de33b]) successfully deleted
I20260616 19:51:53.663339 1191 tablet_replica.cc:333] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.663560 1191 raft_consensus.cc:2243] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.663798 1191 raft_consensus.cc:2272] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.664604 1191 ts_tablet_manager.cc:1916] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.669668 1192 tablet_bootstrap.cc:492] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.669839 1192 ts_tablet_manager.cc:1403] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.002s
I20260616 19:51:53.670674 1192 raft_consensus.cc:359] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.670858 1192 raft_consensus.cc:385] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.670941 1192 raft_consensus.cc:740] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.671388 1191 ts_tablet_manager.cc:1929] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.671545 1191 log.cc:1199] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/e8351427cb34466f82ee74fb60b6798b
I20260616 19:51:53.672014 1191 ts_tablet_manager.cc:1950] T e8351427cb34466f82ee74fb60b6798b P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:53.672348 1192 consensus_queue.cc:260] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.673274 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet e8351427cb34466f82ee74fb60b6798b (table default.Table_cd728ab6319e49a395bee4e74aff4e22 [id=69f6da4c9974486e9b1b7d5a3d28b373]) successfully deleted
I20260616 19:51:53.673628 1191 tablet_replica.cc:333] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.673846 1191 raft_consensus.cc:2243] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.674044 1191 raft_consensus.cc:2272] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.674875 1191 ts_tablet_manager.cc:1916] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.677922 1192 ts_tablet_manager.cc:1434] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260616 19:51:53.596014 1193 ts_tablet_manager.cc:1916] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.678514 1192 tablet_bootstrap.cc:492] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.681797 1191 ts_tablet_manager.cc:1929] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.682021 1191 log.cc:1199] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/6ddc4929e1dc4c9284cd78dfa6b6febd
I20260616 19:51:53.682425 1191 ts_tablet_manager.cc:1950] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:53.682991 1192 tablet_bootstrap.cc:654] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.683575 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 6ddc4929e1dc4c9284cd78dfa6b6febd (table default.Table_ae8591a97fd047dba2de2cdf593b8c17 [id=a7db76f5ed24476baf504282f03ed0c7]) successfully deleted
W20260616 19:51:53.684118 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet d916b2f553ce41df8934e1190fa32120 (table default.Table_647cdefd19814321b51ee0898effc29c [id=7b17c97ad92b4ead8f60bf602853cd61], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet d916b2f553ce41df8934e1190fa32120 consensus state has no leader
W20260616 19:51:53.684405 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c557049a020a4b318bb6e8a53710a6cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c557049a020a4b318bb6e8a53710a6cc already in progress: creating tablet
I20260616 19:51:53.684818 1191 tablet_replica.cc:333] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.685045 1191 raft_consensus.cc:2243] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.685245 1191 raft_consensus.cc:2272] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.685482 1198 tablet_bootstrap.cc:492] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.685707 1198 ts_tablet_manager.cc:1403] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.204s user 0.014s sys 0.032s
I20260616 19:51:53.686087 1191 ts_tablet_manager.cc:1916] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.686811 1198 raft_consensus.cc:359] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.687060 1198 raft_consensus.cc:385] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.687165 1198 raft_consensus.cc:740] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.687530 1198 consensus_queue.cc:260] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.689731 1198 ts_tablet_manager.cc:1434] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260616 19:51:53.690197 1198 tablet_bootstrap.cc:492] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.692512 1208 raft_consensus.cc:493] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.692669 1208 raft_consensus.cc:515] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.694389 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab33d99d857145dfbda54ff2f7464486" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:53.694859 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab33d99d857145dfbda54ff2f7464486" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:53.693240 1191 ts_tablet_manager.cc:1929] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.710556 1192 tablet_bootstrap.cc:492] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.711100 1192 ts_tablet_manager.cc:1403] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.005s
I20260616 19:51:53.712287 1192 raft_consensus.cc:359] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.712656 1192 raft_consensus.cc:385] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.712838 1192 raft_consensus.cc:740] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.713218 1192 consensus_queue.cc:260] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.713997 1192 ts_tablet_manager.cc:1434] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260616 19:51:53.714643 1192 tablet_bootstrap.cc:492] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.714674 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a70aca898ad449b481395f5ffc808a22" } modify_external_catalogs: true
I20260616 19:51:53.714905 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a70aca898ad449b481395f5ffc808a22" } modify_external_catalogs: true
W20260616 19:51:53.716639 996 leader_election.cc:343] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.716940 1208 leader_election.cc:290] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:53.716975 1191 log.cc:1199] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/a2b6158b31b34419aa3619f3ce8242b3
W20260616 19:51:53.717056 993 leader_election.cc:343] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.717553 1191 ts_tablet_manager.cc:1950] T a2b6158b31b34419aa3619f3ce8242b3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:53.717525 993 leader_election.cc:304] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:53.717935 1208 raft_consensus.cc:2749] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:53.718552 1191 tablet_replica.cc:333] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.718672 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet a2b6158b31b34419aa3619f3ce8242b3 (table default.Table_62044432f4a549d8846c6d9d17274c1a [id=48ebc382fbde40f8a05ccb60001efe00]) successfully deleted
I20260616 19:51:53.718786 1191 raft_consensus.cc:2243] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.718959 1191 raft_consensus.cc:2272] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.719827 1191 ts_tablet_manager.cc:1916] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.721613 1196 tablet_bootstrap.cc:492] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:53.721787 1196 ts_tablet_manager.cc:1403] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.186s user 0.002s sys 0.001s
I20260616 19:51:53.723182 1196 raft_consensus.cc:359] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.723394 1196 raft_consensus.cc:385] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.723481 1196 raft_consensus.cc:740] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.723758 1196 consensus_queue.cc:260] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.724259 1196 ts_tablet_manager.cc:1434] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:53.726173 1191 ts_tablet_manager.cc:1929] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.726346 1191 log.cc:1199] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/91336c7847ea4739a0be7fdd9d199cca
I20260616 19:51:53.726723 1191 ts_tablet_manager.cc:1950] T 91336c7847ea4739a0be7fdd9d199cca P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:53.726940 1196 tablet_bootstrap.cc:492] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:53.727639 1191 tablet_replica.cc:333] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.727784 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 91336c7847ea4739a0be7fdd9d199cca (table default.Table_e1afc98c2d9741a9a1b9196cec4c5390 [id=9f6df425186b463d830a66539d63bcdd]) successfully deleted
I20260616 19:51:53.727821 1191 raft_consensus.cc:2243] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.728003 1191 raft_consensus.cc:2272] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.716485 1198 tablet_bootstrap.cc:654] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.731173 1196 tablet_bootstrap.cc:654] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.732070 1192 tablet_bootstrap.cc:654] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.734375 1193 ts_tablet_manager.cc:1929] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.737178 1191 ts_tablet_manager.cc:1916] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.740536 1193 log.cc:1199] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/a6dd15b09ec246ee90bdc73fd93f862a
I20260616 19:51:53.740981 1193 ts_tablet_manager.cc:1950] T a6dd15b09ec246ee90bdc73fd93f862a P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:53.741961 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 118) took 1051 ms. Trace:
I20260616 19:51:53.742077 1193 rpcz_store.cc:276] 0616 19:51:52.690346 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.690388 (+ 42us) service_pool.cc:224] Handling call
0616 19:51:53.593270 (+902882us) ts_tablet_manager.cc:1151] Deleting tablet a6dd15b09ec246ee90bdc73fd93f862a
0616 19:51:53.593279 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:53.681678 (+ 88399us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:53.734306 (+ 52628us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:53.741849 (+ 7543us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":902691}
I20260616 19:51:53.748728 1193 tablet_replica.cc:333] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:53.749017 1193 raft_consensus.cc:2243] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:53.748971 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet a6dd15b09ec246ee90bdc73fd93f862a (table default.Table_21a0653003a3493e952199c335c04c55 [id=d8ed14afa8ef43db8e963aab86921ed6]) successfully deleted
I20260616 19:51:53.749593 1193 pending_rounds.cc:70] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:51:53.749830 1193 pending_rounds.cc:77] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595447352315904 op_type: NO_OP noop_request { }
I20260616 19:51:53.750063 1193 raft_consensus.cc:2889] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:53.750211 1193 raft_consensus.cc:2272] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.750818 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d94eb734df94a309a7b171d907c81da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.751196 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 387ba2086bca4a15b388700044e3c45d with delete_type TABLET_DATA_DELETED (replaced by tablet de0ea6ca79ff4ed09f63fc7bb98eaabd) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.751444 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 154ca8a6bce84b4bab932e69ec7f1f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.751684 901 tablet_service.cc:1558] Processing DeleteTablet for tablet fcfc9231ffeb487cb15ed2a3788730ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.752027 1190 tablet_replica.cc:333] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:53.752318 1190 raft_consensus.cc:2243] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.752554 1190 raft_consensus.cc:2272] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.754284 1190 ts_tablet_manager.cc:1916] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.760964 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.767707 1191 ts_tablet_manager.cc:1929] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.773077 1286 raft_consensus.cc:493] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.773276 1286 raft_consensus.cc:515] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.774091 1286 leader_election.cc:290] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:53.775897 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ba2086bca4a15b388700044e3c45d" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:53.776119 1190 ts_tablet_manager.cc:1929] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:53.776152 784 raft_consensus.cc:2468] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:53.776279 1190 log.cc:1199] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/6d94eb734df94a309a7b171d907c81da
I20260616 19:51:53.776715 1191 log.cc:1199] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/54ceb5a01be24dfb9c08001d662a9ac4
W20260616 19:51:53.777072 858 leader_election.cc:343] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 387ba2086bca4a15b388700044e3c45d
I20260616 19:51:53.777421 860 leader_election.cc:304] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:53.777520 1191 ts_tablet_manager.cc:1950] T 54ceb5a01be24dfb9c08001d662a9ac4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:53.777961 1286 raft_consensus.cc:2804] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:53.778091 1286 raft_consensus.cc:493] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:53.778190 1286 raft_consensus.cc:3060] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:53.778329 1193 ts_tablet_manager.cc:1916] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.778903 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 54ceb5a01be24dfb9c08001d662a9ac4 (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]) successfully deleted
I20260616 19:51:53.781208 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8e4aaf1fba6a46d897cccbdb69567c8e" } new_table_name: "default.Table_be0f2a85266c49789e5476fc2f376467" modify_external_catalogs: true
I20260616 19:51:53.782266 1286 raft_consensus.cc:515] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.783816 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ba2086bca4a15b388700044e3c45d" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:53.784061 784 raft_consensus.cc:3060] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:51:53.785403 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a93dd295602840319f72e7021ddfd61a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a93dd295602840319f72e7021ddfd61a already in progress: creating tablet
W20260616 19:51:53.786659 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 350453721d13427a946ac5c5ee7c62a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 350453721d13427a946ac5c5ee7c62a0 already in progress: creating tablet
I20260616 19:51:53.787221 784 raft_consensus.cc:2468] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:53.787936 860 leader_election.cc:304] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:53.788264 1245 raft_consensus.cc:2804] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:53.789186 1245 raft_consensus.cc:697] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:51:53.789642 1245 consensus_queue.cc:237] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.790515 1286 leader_election.cc:290] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:51:53.791108 858 leader_election.cc:343] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 387ba2086bca4a15b388700044e3c45d
W20260616 19:51:53.791217 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb024637294148c18b74bef47fb2fcce consensus state has no leader
I20260616 19:51:53.795400 1286 raft_consensus.cc:493] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:53.795601 1286 raft_consensus.cc:515] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.796092 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9dacb90aa08e434d99c33e3a4f49fbe3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:53.796309 1286 leader_election.cc:290] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:51:53.797008 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9dacb90aa08e434d99c33e3a4f49fbe3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.798156 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8351427cb34466f82ee74fb60b6798b" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:53.798835 858 leader_election.cc:343] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: e8351427cb34466f82ee74fb60b6798b
W20260616 19:51:53.799131 860 leader_election.cc:343] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:53.799278 860 leader_election.cc:304] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:53.799746 1286 raft_consensus.cc:2749] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:53.805832 1190 ts_tablet_manager.cc:1950] T 6d94eb734df94a309a7b171d907c81da P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:53.808365 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 6d94eb734df94a309a7b171d907c81da (table default.Table_0ed7b3aa00c145f49e22f9cbc892bc0c [id=6067524c64a14af0976b29a9776de33b]) successfully deleted
I20260616 19:51:53.817247 1196 tablet_bootstrap.cc:492] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:53.817476 1196 ts_tablet_manager.cc:1403] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.092s user 0.002s sys 0.015s
I20260616 19:51:53.818423 1196 raft_consensus.cc:359] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.818742 1196 raft_consensus.cc:385] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.818821 1196 raft_consensus.cc:740] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.819067 1196 consensus_queue.cc:260] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.820278 1196 ts_tablet_manager.cc:1434] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:51:53.821151 1196 tablet_bootstrap.cc:492] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:53.822826 1196 tablet_bootstrap.cc:654] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.831624 1198 tablet_bootstrap.cc:492] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.831827 1198 ts_tablet_manager.cc:1403] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.142s user 0.003s sys 0.003s
I20260616 19:51:53.833199 1198 raft_consensus.cc:359] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.833405 1198 raft_consensus.cc:385] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.833503 1198 raft_consensus.cc:740] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.834393 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1bfaf142b33c42df9480c0fd9ec9b5ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.835111 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bfaf142b33c42df9480c0fd9ec9b5ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.837796 1196 tablet_bootstrap.cc:492] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:53.838001 1196 ts_tablet_manager.cc:1403] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.002s
I20260616 19:51:53.838737 1196 raft_consensus.cc:359] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.838979 1196 raft_consensus.cc:385] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.839083 1196 raft_consensus.cc:740] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.839399 1196 consensus_queue.cc:260] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.840432 1196 ts_tablet_manager.cc:1434] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:53.842377 1196 tablet_bootstrap.cc:492] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:53.844697 1196 tablet_bootstrap.cc:654] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:53.850381 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da380823d0ae437d9f1d9d0f633f74bb consensus state has no leader
I20260616 19:51:53.855238 1196 tablet_bootstrap.cc:492] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:53.855417 1196 ts_tablet_manager.cc:1403] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260616 19:51:53.856161 1196 raft_consensus.cc:359] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.856343 1196 raft_consensus.cc:385] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.856448 1196 raft_consensus.cc:740] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.856779 1196 consensus_queue.cc:260] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.860854 1190 tablet_replica.cc:333] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:53.861164 1190 raft_consensus.cc:2243] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:53.861596 1190 pending_rounds.cc:70] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:51:53.861727 1190 pending_rounds.cc:77] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595448485232640 op_type: NO_OP noop_request { }
I20260616 19:51:53.861974 1190 raft_consensus.cc:2889] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:53.862157 1190 raft_consensus.cc:2272] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.863420 1190 ts_tablet_manager.cc:1916] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.868755 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_da45e8ccd8434d46b81a74258f6bd98a" } modify_external_catalogs: true
I20260616 19:51:53.869382 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d with delete_type TABLET_DATA_DELETED (replaced by tablet d61873c8aa094d7f899a61307a36f895) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.869645 901 tablet_service.cc:1558] Processing DeleteTablet for tablet e8351427cb34466f82ee74fb60b6798b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.869884 903 tablet_service.cc:1558] Processing DeleteTablet for tablet a56168eb4f5e449a8f9eed5c8cfad9df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:53.873018 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_da45e8ccd8434d46b81a74258f6bd98a" } modify_external_catalogs: true
I20260616 19:51:53.878201 452 catalog_manager.cc:5696] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:51:53.878674 452 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_4a9b0e9a1c6648f8bb08c587a4750e4f [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 4 got 0
I20260616 19:51:53.881878 453 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet c5657b6b56af4b8f8eff1fa18836df9b (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]). Expected version 1 got 0
W20260616 19:51:53.882476 453 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet c5657b6b56af4b8f8eff1fa18836df9b (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c5657b6b56af4b8f8eff1fa18836df9b consensus state has no leader
I20260616 19:51:53.890205 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 36ea9b8ba668410bae016a008cf37910 (DEFAULT_TABLE table=default.Table_78964cf02d6e4b94be59a534e00ada50 [id=7ba83bcdb62c4bc9804589f54ddb86d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.890839 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ea9b8ba668410bae016a008cf37910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.894170 903 tablet_service.cc:1511] Processing CreateTablet for tablet 36ea9b8ba668410bae016a008cf37910 (DEFAULT_TABLE table=default.Table_78964cf02d6e4b94be59a534e00ada50 [id=7ba83bcdb62c4bc9804589f54ddb86d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.894759 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ea9b8ba668410bae016a008cf37910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.908885 1198 consensus_queue.cc:260] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.910364 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 1d368ec65b624ea58f7b750097a78ede (DEFAULT_TABLE table=default.Table_5bfbe9967f534a958045a36d7e269580 [id=0745df538b5e4be8b0ba20653abe53ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.910849 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d368ec65b624ea58f7b750097a78ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.915158 1198 ts_tablet_manager.cc:1434] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.083s user 0.000s sys 0.003s
I20260616 19:51:53.919436 1198 tablet_bootstrap.cc:492] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.920845 903 tablet_service.cc:1511] Processing CreateTablet for tablet 1d368ec65b624ea58f7b750097a78ede (DEFAULT_TABLE table=default.Table_5bfbe9967f534a958045a36d7e269580 [id=0745df538b5e4be8b0ba20653abe53ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.922212 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d368ec65b624ea58f7b750097a78ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.923477 1192 tablet_bootstrap.cc:492] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.924158 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 10fc1d2ecaa746bab980a708dd8eb93a (DEFAULT_TABLE table=default.Table_61b32c8d9ca6461c8f3edd6bf27c79bc [id=8196a6bddad24186971f3213f68e4cfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.924633 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10fc1d2ecaa746bab980a708dd8eb93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.924551 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4df4f4584b034b46be562b220a3b256e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.925448 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4df4f4584b034b46be562b220a3b256e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.930768 1196 ts_tablet_manager.cc:1434] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:51:53.931205 1196 tablet_bootstrap.cc:492] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:53.924912 901 tablet_service.cc:1511] Processing CreateTablet for tablet 10fc1d2ecaa746bab980a708dd8eb93a (DEFAULT_TABLE table=default.Table_61b32c8d9ca6461c8f3edd6bf27c79bc [id=8196a6bddad24186971f3213f68e4cfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.932111 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10fc1d2ecaa746bab980a708dd8eb93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.934434 750 tablet_service.cc:1511] Processing CreateTablet for tablet 1d368ec65b624ea58f7b750097a78ede (DEFAULT_TABLE table=default.Table_5bfbe9967f534a958045a36d7e269580 [id=0745df538b5e4be8b0ba20653abe53ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.934931 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d368ec65b624ea58f7b750097a78ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.930893 1192 ts_tablet_manager.cc:1403] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.216s user 0.041s sys 0.094s
I20260616 19:51:53.935602 764 tablet_service.cc:1511] Processing CreateTablet for tablet 36ea9b8ba668410bae016a008cf37910 (DEFAULT_TABLE table=default.Table_78964cf02d6e4b94be59a534e00ada50 [id=7ba83bcdb62c4bc9804589f54ddb86d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.935957 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ea9b8ba668410bae016a008cf37910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.938925 1192 raft_consensus.cc:359] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.939209 1192 raft_consensus.cc:385] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.939322 1192 raft_consensus.cc:740] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.939625 1192 consensus_queue.cc:260] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.943125 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 3587c1ab487a424eb82f378ae081f514 (DEFAULT_TABLE table=default.Table_1663625bb19f4fcba05c5277abaf688f [id=4f2b128cff5248f98e3506bb72a39391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.943584 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3587c1ab487a424eb82f378ae081f514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.946758 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 99b211692aca478bb40f0f2c3f50ca44 (DEFAULT_TABLE table=default.Table_718b661372f441feb171907daff44e2d [id=a5404ca6c40f44b8b881ef582d703fd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.947252 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b211692aca478bb40f0f2c3f50ca44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.947431 1198 tablet_bootstrap.cc:654] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:53.950111 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db75a5169c0b4650a551b8a76a724469 consensus state has no leader
I20260616 19:51:53.940354 1192 ts_tablet_manager.cc:1434] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260616 19:51:53.950920 1192 tablet_bootstrap.cc:492] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:53.951134 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet c5657b6b56af4b8f8eff1fa18836df9b (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]). Expected version 1 got 0
I20260616 19:51:53.952348 457 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet c5657b6b56af4b8f8eff1fa18836df9b (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]). Expected version 1 got 0
I20260616 19:51:53.946133 904 tablet_service.cc:1511] Processing CreateTablet for tablet 3587c1ab487a424eb82f378ae081f514 (DEFAULT_TABLE table=default.Table_1663625bb19f4fcba05c5277abaf688f [id=4f2b128cff5248f98e3506bb72a39391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.953300 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3587c1ab487a424eb82f378ae081f514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.953379 1192 tablet_bootstrap.cc:654] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:53.958863 1029 tablet_service.cc:1511] Processing CreateTablet for tablet fdc6222db09d4cd987cbdf70e4d40f70 (DEFAULT_TABLE table=default.Table_92a53fd7dd1a4e9892c00c79c31c53f1 [id=d5fe1c6faa0d446ca84e71bbdfb4018d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.959271 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc6222db09d4cd987cbdf70e4d40f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.960421 889 tablet_service.cc:1511] Processing CreateTablet for tablet 99b211692aca478bb40f0f2c3f50ca44 (DEFAULT_TABLE table=default.Table_718b661372f441feb171907daff44e2d [id=a5404ca6c40f44b8b881ef582d703fd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.960855 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b211692aca478bb40f0f2c3f50ca44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.965615 1198 tablet_bootstrap.cc:492] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:53.965669 1192 tablet_bootstrap.cc:492] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:53.965809 1198 ts_tablet_manager.cc:1403] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.000s
I20260616 19:51:53.965819 1192 ts_tablet_manager.cc:1403] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.004s
I20260616 19:51:53.966660 1192 raft_consensus.cc:359] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.966671 1198 raft_consensus.cc:359] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.966898 1192 raft_consensus.cc:385] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.966898 1198 raft_consensus.cc:385] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:53.966988 1192 raft_consensus.cc:740] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.967005 1198 raft_consensus.cc:740] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:53.967200 1029 tablet_service.cc:1511] Processing CreateTablet for tablet c44422ddb8ce45a48bb9aaeb6c209f21 (DEFAULT_TABLE table=default.Table_a70aca898ad449b481395f5ffc808a22 [id=ac53389fae904a0ea6ddcb9e82000d78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.967200 891 tablet_service.cc:1511] Processing CreateTablet for tablet fdc6222db09d4cd987cbdf70e4d40f70 (DEFAULT_TABLE table=default.Table_92a53fd7dd1a4e9892c00c79c31c53f1 [id=d5fe1c6faa0d446ca84e71bbdfb4018d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.967312 1198 consensus_queue.cc:260] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.967307 1192 consensus_queue.cc:260] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:53.967581 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc6222db09d4cd987cbdf70e4d40f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.967571 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44422ddb8ce45a48bb9aaeb6c209f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.967880 1192 ts_tablet_manager.cc:1434] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:53.970618 1198 ts_tablet_manager.cc:1434] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260616 19:51:53.971275 1198 tablet_bootstrap.cc:492] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:53.973412 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b03768997ca94dd897aed95bee7efc2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:53.973759 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 97afcb75fdc2440d913ad421534a4ef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:53.974642 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b03768997ca94dd897aed95bee7efc2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.975266 1191 tablet_replica.cc:333] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:53.975570 1191 raft_consensus.cc:2243] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:53.975790 1191 raft_consensus.cc:2272] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:53.979019 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 8eab5bd3967c42e1b6b79558df742946 (DEFAULT_TABLE table=default.Table_8fff86d5c2344e2fb59db9872ee90b74 [id=06f5d602dcec42a884b5eb53f9d0a27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.979611 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eab5bd3967c42e1b6b79558df742946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.981902 1028 tablet_service.cc:1511] Processing CreateTablet for tablet da51a682de41402cb537ab113f876a2d (DEFAULT_TABLE table=default.Table_10a5c35013c14fe1b8d9d1c77589d321 [id=c53bc843f4974b08965984db1910d6d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.982311 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da51a682de41402cb537ab113f876a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:53.983924 1191 ts_tablet_manager.cc:1916] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:53.984730 888 tablet_service.cc:1511] Processing CreateTablet for tablet 8eab5bd3967c42e1b6b79558df742946 (DEFAULT_TABLE table=default.Table_8fff86d5c2344e2fb59db9872ee90b74 [id=06f5d602dcec42a884b5eb53f9d0a27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:53.988771 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_097cc1cefc2845c9811c04a380239f0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:53.989337 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_097cc1cefc2845c9811c04a380239f0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:53.990692 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2836dd728d0d4df497738e4959ed3bc0" } new_table_name: "default.Table_a8aa8e529ab0432d9abaf953a3aa73cf" modify_external_catalogs: true
I20260616 19:51:53.993184 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet c557049a020a4b318bb6e8a53710a6cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.002853 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d61873c8aa094d7f899a61307a36f895
I20260616 19:51:54.003343 455 catalog_manager.cc:6784] ReplaceTablet: tablet d61873c8aa094d7f899a61307a36f895 deleted and replaced by tablet 31592a5ffb04429c9315a4fd72308f28
I20260616 19:51:54.004750 461 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 7044c06eb5a0460c993381c585a267bd
I20260616 19:51:54.005121 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cb8601ac90d549099be33b639d901c21" } modify_external_catalogs: true
I20260616 19:51:54.005318 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cb8601ac90d549099be33b639d901c21" } modify_external_catalogs: true
I20260616 19:51:54.005501 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet d61873c8aa094d7f899a61307a36f895 with delete_type TABLET_DATA_DELETED (replaced by tablet 31592a5ffb04429c9315a4fd72308f28) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.005904 455 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet c5657b6b56af4b8f8eff1fa18836df9b (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]). Expected version 1 got 0
I20260616 19:51:54.006229 1196 tablet_bootstrap.cc:654] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.006752 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c44422ddb8ce45a48bb9aaeb6c209f21
I20260616 19:51:54.006819 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 362e7ff9bea3459ca018d1a7febb2ce4 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:54.007426 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 39f52eebdc79460a9ff33191086e87c6 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:54.007546 755 tablet_service.cc:1511] Processing CreateTablet for tablet 3587c1ab487a424eb82f378ae081f514 (DEFAULT_TABLE table=default.Table_1663625bb19f4fcba05c5277abaf688f [id=4f2b128cff5248f98e3506bb72a39391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.007469 750 tablet_service.cc:1511] Processing CreateTablet for tablet 10fc1d2ecaa746bab980a708dd8eb93a (DEFAULT_TABLE table=default.Table_61b32c8d9ca6461c8f3edd6bf27c79bc [id=8196a6bddad24186971f3213f68e4cfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.008419 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3587c1ab487a424eb82f378ae081f514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.008563 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet b99740ab59f947aabcac88dc2bf2de86
I20260616 19:51:54.009202 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_75ff35530aa041f0a81c83741b88c5cf" } new_table_name: "default.Table_7d684a6e485e4d9885757678979cb78f" modify_external_catalogs: true
I20260616 19:51:54.009815 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet b99740ab59f947aabcac88dc2bf2de86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.011396 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_02b5fcd9202443e28e603c3a9998ff94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.011914 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02b5fcd9202443e28e603c3a9998ff94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.013191 756 tablet_service.cc:1511] Processing CreateTablet for tablet 99b211692aca478bb40f0f2c3f50ca44 (DEFAULT_TABLE table=default.Table_718b661372f441feb171907daff44e2d [id=a5404ca6c40f44b8b881ef582d703fd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.013787 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10fc1d2ecaa746bab980a708dd8eb93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.014967 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b211692aca478bb40f0f2c3f50ca44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.016613 760 tablet_service.cc:1511] Processing CreateTablet for tablet fdc6222db09d4cd987cbdf70e4d40f70 (DEFAULT_TABLE table=default.Table_92a53fd7dd1a4e9892c00c79c31c53f1 [id=d5fe1c6faa0d446ca84e71bbdfb4018d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.016995 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc6222db09d4cd987cbdf70e4d40f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.020105 758 tablet_service.cc:1511] Processing CreateTablet for tablet bbf73c4c1133405bb46df19c0559ab92 (DEFAULT_TABLE table=default.Table_77c7656d4f3a49f1ac1ef9398f720934 [id=3875e9f7e8ef471cb793134e7bc06a32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.021391 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet c44422ddb8ce45a48bb9aaeb6c209f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.021522 759 tablet_service.cc:1511] Processing CreateTablet for tablet 8eab5bd3967c42e1b6b79558df742946 (DEFAULT_TABLE table=default.Table_8fff86d5c2344e2fb59db9872ee90b74 [id=06f5d602dcec42a884b5eb53f9d0a27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.021661 900 tablet_service.cc:1511] Processing CreateTablet for tablet bbf73c4c1133405bb46df19c0559ab92 (DEFAULT_TABLE table=default.Table_77c7656d4f3a49f1ac1ef9398f720934 [id=3875e9f7e8ef471cb793134e7bc06a32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.021864 751 tablet_service.cc:1558] Processing DeleteTablet for tablet b99740ab59f947aabcac88dc2bf2de86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.022053 752 tablet_service.cc:1558] Processing DeleteTablet for tablet c44422ddb8ce45a48bb9aaeb6c209f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.022208 762 tablet_service.cc:1558] Processing DeleteTablet for tablet d61873c8aa094d7f899a61307a36f895 with delete_type TABLET_DATA_DELETED (replaced by tablet 31592a5ffb04429c9315a4fd72308f28) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.022505 765 tablet_service.cc:1511] Processing CreateTablet for tablet c44422ddb8ce45a48bb9aaeb6c209f21 (DEFAULT_TABLE table=default.Table_a70aca898ad449b481395f5ffc808a22 [id=ac53389fae904a0ea6ddcb9e82000d78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.022666 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eab5bd3967c42e1b6b79558df742946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.023109 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf73c4c1133405bb46df19c0559ab92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.024614 1198 tablet_bootstrap.cc:654] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.027369 894 tablet_service.cc:1558] Processing DeleteTablet for tablet b99740ab59f947aabcac88dc2bf2de86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.027923 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf73c4c1133405bb46df19c0559ab92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.028479 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e37f42ce8ec47fca1cf8aa75bc0202d with delete_type TABLET_DATA_DELETED (replaced by tablet d61873c8aa094d7f899a61307a36f895) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.028637 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44422ddb8ce45a48bb9aaeb6c209f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.030524 1190 ts_tablet_manager.cc:1929] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:54.030680 1190 log.cc:1199] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/387ba2086bca4a15b388700044e3c45d
I20260616 19:51:54.031127 1190 ts_tablet_manager.cc:1950] T 387ba2086bca4a15b388700044e3c45d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:54.032383 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 387ba2086bca4a15b388700044e3c45d (table default.Table_6e469684e5b844a5b7f13a1047fd933a [id=7d5a7b1d32b147a3a8b5426c661dda2f]) successfully deleted
I20260616 19:51:54.025113 1033 tablet_service.cc:1511] Processing CreateTablet for tablet bbf73c4c1133405bb46df19c0559ab92 (DEFAULT_TABLE table=default.Table_77c7656d4f3a49f1ac1ef9398f720934 [id=3875e9f7e8ef471cb793134e7bc06a32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.034199 1191 ts_tablet_manager.cc:1929] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.034380 1191 log.cc:1199] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/97afcb75fdc2440d913ad421534a4ef3
I20260616 19:51:54.034406 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf73c4c1133405bb46df19c0559ab92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.034744 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eab5bd3967c42e1b6b79558df742946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.034940 1190 tablet_replica.cc:333] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:54.035147 1190 raft_consensus.cc:2243] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.035353 1190 raft_consensus.cc:2272] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.035950 1190 ts_tablet_manager.cc:1916] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.037148 901 tablet_service.cc:1558] Processing DeleteTablet for tablet c44422ddb8ce45a48bb9aaeb6c209f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.038748 889 tablet_service.cc:1511] Processing CreateTablet for tablet da51a682de41402cb537ab113f876a2d (DEFAULT_TABLE table=default.Table_10a5c35013c14fe1b8d9d1c77589d321 [id=c53bc843f4974b08965984db1910d6d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.039186 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da51a682de41402cb537ab113f876a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.040903 1191 ts_tablet_manager.cc:1950] T 97afcb75fdc2440d913ad421534a4ef3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:54.042035 1191 tablet_replica.cc:333] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:54.042249 1191 raft_consensus.cc:2243] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.042433 1191 raft_consensus.cc:2272] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.044306 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 97afcb75fdc2440d913ad421534a4ef3 (table default.Table_2d821dc335024cba9f1635d15a76a3b9 [id=475a74cfa2ba41998c3ba29ce388cdc8]) successfully deleted
I20260616 19:51:54.044617 904 tablet_service.cc:1558] Processing DeleteTablet for tablet e4705cacd95a45888fac6a76745eae4e with delete_type TABLET_DATA_DELETED (replaced by tablet 0da93e4052094862a44812990df1136a) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.044876 891 tablet_service.cc:1558] Processing DeleteTablet for tablet d61873c8aa094d7f899a61307a36f895 with delete_type TABLET_DATA_DELETED (replaced by tablet 31592a5ffb04429c9315a4fd72308f28) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.045770 903 tablet_service.cc:1511] Processing CreateTablet for tablet c44422ddb8ce45a48bb9aaeb6c209f21 (DEFAULT_TABLE table=default.Table_a70aca898ad449b481395f5ffc808a22 [id=ac53389fae904a0ea6ddcb9e82000d78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.046214 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44422ddb8ce45a48bb9aaeb6c209f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.047683 1192 tablet_bootstrap.cc:492] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:54.047789 1191 ts_tablet_manager.cc:1916] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.051546 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet da51a682de41402cb537ab113f876a2d
I20260616 19:51:54.054232 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 4ffce2dc22e24d1684e6eae92c487cea (DEFAULT_TABLE table=default.Table_0957b27c92aa48bdb6898b1cafddbf11 [id=a69482262948439783492742dcbf0b43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.054400 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 15d6a025b9a248c5ab9422fe1c340f3e (DEFAULT_TABLE table=default.Table_e2695b46a446427381c2ea1d260bed78 [id=4f3dc165f3d84700856eebc8f3243acf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.054823 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ffce2dc22e24d1684e6eae92c487cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.055138 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d6a025b9a248c5ab9422fe1c340f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.055328 891 tablet_service.cc:1558] Processing DeleteTablet for tablet da51a682de41402cb537ab113f876a2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.055781 904 tablet_service.cc:1511] Processing CreateTablet for tablet 15d6a025b9a248c5ab9422fe1c340f3e (DEFAULT_TABLE table=default.Table_e2695b46a446427381c2ea1d260bed78 [id=4f3dc165f3d84700856eebc8f3243acf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.056167 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d6a025b9a248c5ab9422fe1c340f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.059460 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 8125dce4d32a416498b42a1b599355fd from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:54.060359 891 tablet_service.cc:1511] Processing CreateTablet for tablet bfff9d60bb7e4a86b14687b581b45efe (DEFAULT_TABLE table=default.Table_969ffb30ff464eea9255cf085e7bf42d [id=a67306640a5b4c0a91a283892a3a8062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.060839 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfff9d60bb7e4a86b14687b581b45efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.064801 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 2808592f581e4605a814a2658401dfed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.065460 752 tablet_service.cc:1511] Processing CreateTablet for tablet da51a682de41402cb537ab113f876a2d (DEFAULT_TABLE table=default.Table_10a5c35013c14fe1b8d9d1c77589d321 [id=c53bc843f4974b08965984db1910d6d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.065871 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da51a682de41402cb537ab113f876a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.066968 762 tablet_service.cc:1511] Processing CreateTablet for tablet 4ffce2dc22e24d1684e6eae92c487cea (DEFAULT_TABLE table=default.Table_0957b27c92aa48bdb6898b1cafddbf11 [id=a69482262948439783492742dcbf0b43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.067335 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ffce2dc22e24d1684e6eae92c487cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.072181 1192 tablet_bootstrap.cc:654] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.076072 763 tablet_service.cc:1511] Processing CreateTablet for tablet bfff9d60bb7e4a86b14687b581b45efe (DEFAULT_TABLE table=default.Table_969ffb30ff464eea9255cf085e7bf42d [id=a67306640a5b4c0a91a283892a3a8062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.076478 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfff9d60bb7e4a86b14687b581b45efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.074482 751 tablet_service.cc:1511] Processing CreateTablet for tablet 15d6a025b9a248c5ab9422fe1c340f3e (DEFAULT_TABLE table=default.Table_e2695b46a446427381c2ea1d260bed78 [id=4f3dc165f3d84700856eebc8f3243acf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.078624 1033 tablet_service.cc:1511] Processing CreateTablet for tablet bfff9d60bb7e4a86b14687b581b45efe (DEFAULT_TABLE table=default.Table_969ffb30ff464eea9255cf085e7bf42d [id=a67306640a5b4c0a91a283892a3a8062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.079433 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfff9d60bb7e4a86b14687b581b45efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.079671 891 tablet_service.cc:1511] Processing CreateTablet for tablet 9c77fd138ce9463b8f2d6f4182a56559 (DEFAULT_TABLE table=default.Table_b34131cb606f45af969cab4e285a435c [id=f26741a3387e47f2905c06b1d7eecb17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.080016 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c77fd138ce9463b8f2d6f4182a56559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.078950 761 tablet_service.cc:1511] Processing CreateTablet for tablet 9c77fd138ce9463b8f2d6f4182a56559 (DEFAULT_TABLE table=default.Table_b34131cb606f45af969cab4e285a435c [id=f26741a3387e47f2905c06b1d7eecb17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.080713 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d6a025b9a248c5ab9422fe1c340f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.081997 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c77fd138ce9463b8f2d6f4182a56559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.086719 764 tablet_service.cc:1558] Processing DeleteTablet for tablet da51a682de41402cb537ab113f876a2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.087087 1190 ts_tablet_manager.cc:1929] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.087849 1190 log.cc:1199] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/154ca8a6bce84b4bab932e69ec7f1f8e
I20260616 19:51:54.088348 888 tablet_service.cc:1511] Processing CreateTablet for tablet 4ffce2dc22e24d1684e6eae92c487cea (DEFAULT_TABLE table=default.Table_0957b27c92aa48bdb6898b1cafddbf11 [id=a69482262948439783492742dcbf0b43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.089236 1245 raft_consensus.cc:493] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:54.089414 1245 raft_consensus.cc:515] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.090255 1245 leader_election.cc:290] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:54.090905 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ffce2dc22e24d1684e6eae92c487cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.091332 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56168eb4f5e449a8f9eed5c8cfad9df" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:54.091542 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet da51a682de41402cb537ab113f876a2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:54.092123 858 leader_election.cc:343] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:54.093425 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 9c77fd138ce9463b8f2d6f4182a56559 (DEFAULT_TABLE table=default.Table_b34131cb606f45af969cab4e285a435c [id=f26741a3387e47f2905c06b1d7eecb17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.093043 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56168eb4f5e449a8f9eed5c8cfad9df" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:54.093945 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c77fd138ce9463b8f2d6f4182a56559. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:54.094664 860 leader_election.cc:343] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:54.094810 860 leader_election.cc:304] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:54.095160 1193 ts_tablet_manager.cc:1929] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:54.095593 1245 raft_consensus.cc:2749] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:54.097306 1193 log.cc:1199] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/302997d0e3b247ebaceec9151f580c3a
I20260616 19:51:54.098276 1193 ts_tablet_manager.cc:1950] T 302997d0e3b247ebaceec9151f580c3a P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:54.099225 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 119) took 1408 ms. Trace:
I20260616 19:51:54.099326 1193 rpcz_store.cc:276] 0616 19:51:52.690840 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.690878 (+ 38us) service_pool.cc:224] Handling call
0616 19:51:53.748612 (+1057734us) ts_tablet_manager.cc:1151] Deleting tablet 302997d0e3b247ebaceec9151f580c3a
0616 19:51:53.748628 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:53.856032 (+107404us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.088446 (+232414us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.099162 (+ 10716us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1057533}
I20260616 19:51:54.099819 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 120) took 1386 ms. Trace:
I20260616 19:51:54.099895 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 302997d0e3b247ebaceec9151f580c3a (table default.Table_fca913263b4846dea884088bbe9d2529 [id=a67f3f850e8e4696ba2c178ad1de8360]) successfully deleted
I20260616 19:51:54.099911 1193 rpcz_store.cc:276] 0616 19:51:52.713377 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.714753 (+ 1376us) service_pool.cc:224] Handling call
0616 19:51:54.099648 (+1384895us) ts_tablet_manager.cc:1151] Deleting tablet dfee6a9e6d57487bb7d9482f7798e6b6
0616 19:51:54.099659 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.099767 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1384692}
I20260616 19:51:54.100234 1193 tablet_replica.cc:333] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:54.100232 1190 ts_tablet_manager.cc:1950] T 154ca8a6bce84b4bab932e69ec7f1f8e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
W20260616 19:51:54.100375 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet dfee6a9e6d57487bb7d9482f7798e6b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfee6a9e6d57487bb7d9482f7798e6b6 already in progress: creating tablet
I20260616 19:51:54.101543 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 154ca8a6bce84b4bab932e69ec7f1f8e (table default.Table_6db02b65da9f42279f9442335b438b91 [id=2c8430ecae1842458fb35770d90409f8]) successfully deleted
I20260616 19:51:54.101956 1191 ts_tablet_manager.cc:1929] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.102130 1191 log.cc:1199] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/c557049a020a4b318bb6e8a53710a6cc
I20260616 19:51:54.102579 1191 ts_tablet_manager.cc:1950] T c557049a020a4b318bb6e8a53710a6cc P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:54.103879 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet c557049a020a4b318bb6e8a53710a6cc (table default.Table_f29c0729614141a183a4aa7787c0a612 [id=7792ca664dbe4df5865c5a17ebd30d28]) successfully deleted
I20260616 19:51:54.104921 1190 tablet_replica.cc:333] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:54.105209 1190 raft_consensus.cc:2243] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.105405 1190 raft_consensus.cc:2272] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.100430 1193 raft_consensus.cc:2243] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.113193 1190 ts_tablet_manager.cc:1916] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:51:54.117118 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d61873c8aa094d7f899a61307a36f895 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d61873c8aa094d7f899a61307a36f895 already in progress: creating tablet
W20260616 19:51:54.118643 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet b99740ab59f947aabcac88dc2bf2de86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b99740ab59f947aabcac88dc2bf2de86 already in progress: creating tablet
W20260616 19:51:54.119565 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c44422ddb8ce45a48bb9aaeb6c209f21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c44422ddb8ce45a48bb9aaeb6c209f21 already in progress: creating tablet
W20260616 19:51:54.120645 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet da51a682de41402cb537ab113f876a2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da51a682de41402cb537ab113f876a2d already in progress: creating tablet
I20260616 19:51:54.138634 1208 raft_consensus.cc:493] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:54.138886 1208 raft_consensus.cc:515] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.139791 1208 leader_election.cc:290] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:54.140549 1193 raft_consensus.cc:2272] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.141011 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5657b6b56af4b8f8eff1fa18836df9b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:54.141247 923 raft_consensus.cc:2468] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:54.141645 1190 ts_tablet_manager.cc:1929] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.142441 993 leader_election.cc:304] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:54.142937 1208 raft_consensus.cc:2804] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:54.143100 1208 raft_consensus.cc:493] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:54.143209 1208 raft_consensus.cc:3060] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:54.143697 1190 log.cc:1199] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/fcfc9231ffeb487cb15ed2a3788730ba
I20260616 19:51:54.144116 1190 ts_tablet_manager.cc:1950] T fcfc9231ffeb487cb15ed2a3788730ba P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:54.144721 1193 ts_tablet_manager.cc:1916] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.145676 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet fcfc9231ffeb487cb15ed2a3788730ba (table default.Table_6a9c2eded2954f7282a8fa6d68278896 [id=54246691d67e4a68a4a9d955919d998c]) successfully deleted
I20260616 19:51:54.146780 1208 raft_consensus.cc:515] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.148336 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5657b6b56af4b8f8eff1fa18836df9b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:54.148456 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5657b6b56af4b8f8eff1fa18836df9b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:54.148722 923 raft_consensus.cc:3060] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:54.149850 1190 tablet_replica.cc:333] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:54.150077 1190 raft_consensus.cc:2243] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:54.150362 1190 pending_rounds.cc:70] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:51:54.150427 1190 pending_rounds.cc:77] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595447905439744 op_type: NO_OP noop_request { }
I20260616 19:51:54.150585 1190 raft_consensus.cc:2889] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260616 19:51:54.150614 996 leader_election.cc:343] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:54.150707 1190 raft_consensus.cc:2272] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.152767 923 raft_consensus.cc:2468] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:54.151772 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5657b6b56af4b8f8eff1fa18836df9b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:54.153304 993 leader_election.cc:304] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:51:54.153771 996 leader_election.cc:343] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:54.155658 1208 leader_election.cc:290] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:54.156052 1208 raft_consensus.cc:2804] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:54.156417 1208 raft_consensus.cc:697] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:54.156991 1208 consensus_queue.cc:237] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.157356 1190 ts_tablet_manager.cc:1916] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.177654 1190 ts_tablet_manager.cc:1929] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:54.177879 1190 log.cc:1199] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/6ddc4929e1dc4c9284cd78dfa6b6febd
I20260616 19:51:54.178413 1190 ts_tablet_manager.cc:1950] T 6ddc4929e1dc4c9284cd78dfa6b6febd P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:54.188194 1205 raft_consensus.cc:493] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:54.188508 1193 ts_tablet_manager.cc:1929] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.188380 1205 raft_consensus.cc:515] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.188685 1193 log.cc:1199] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/6d94eb734df94a309a7b171d907c81da
I20260616 19:51:54.189507 1205 leader_election.cc:290] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:54.191090 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 6ddc4929e1dc4c9284cd78dfa6b6febd (table default.Table_ae8591a97fd047dba2de2cdf593b8c17 [id=a7db76f5ed24476baf504282f03ed0c7]) successfully deleted
I20260616 19:51:54.192381 1190 tablet_replica.cc:333] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:54.192636 1190 raft_consensus.cc:2243] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.192852 1190 raft_consensus.cc:2272] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.193431 1190 ts_tablet_manager.cc:1916] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.196192 1196 tablet_bootstrap.cc:492] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:54.196219 1192 tablet_bootstrap.cc:492] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:54.196288 1198 tablet_bootstrap.cc:492] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:54.196342 1192 ts_tablet_manager.cc:1403] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.228s user 0.024s sys 0.068s
I20260616 19:51:54.196448 1198 ts_tablet_manager.cc:1403] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.225s user 0.003s sys 0.009s
I20260616 19:51:54.197685 1192 raft_consensus.cc:359] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.197878 1192 raft_consensus.cc:385] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.197960 1192 raft_consensus.cc:740] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.197947 1198 raft_consensus.cc:359] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.198115 1198 raft_consensus.cc:385] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.198192 1198 raft_consensus.cc:740] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.198239 1192 consensus_queue.cc:260] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.198390 1198 consensus_queue.cc:260] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.198899 1192 ts_tablet_manager.cc:1434] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260616 19:51:54.198895 1198 ts_tablet_manager.cc:1434] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:51:54.199386 1193 ts_tablet_manager.cc:1950] T 6d94eb734df94a309a7b171d907c81da P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:51:54.199566 719 leader_election.cc:343] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 154ca8a6bce84b4bab932e69ec7f1f8e
I20260616 19:51:54.199715 1192 tablet_bootstrap.cc:492] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:51:54.199764 718 leader_election.cc:343] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: 154ca8a6bce84b4bab932e69ec7f1f8e
I20260616 19:51:54.200027 718 leader_election.cc:304] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:54.201115 1205 raft_consensus.cc:2749] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:54.201701 1196 ts_tablet_manager.cc:1403] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.265s user 0.011s sys 0.032s
I20260616 19:51:54.202396 1192 tablet_bootstrap.cc:654] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.202767 1198 tablet_bootstrap.cc:492] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:54.202777 1196 raft_consensus.cc:359] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.202986 1196 raft_consensus.cc:385] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.203063 1196 raft_consensus.cc:740] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.203311 1196 consensus_queue.cc:260] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.203826 1196 ts_tablet_manager.cc:1434] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:51:54.204101 1196 tablet_bootstrap.cc:492] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:54.206511 1196 tablet_bootstrap.cc:654] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.212172 1198 tablet_bootstrap.cc:654] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.205025 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 121) took 1454 ms. Trace:
I20260616 19:51:54.218838 1193 rpcz_store.cc:276] 0616 19:51:52.750077 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.751313 (+ 1236us) service_pool.cc:224] Handling call
0616 19:51:54.100149 (+1348836us) ts_tablet_manager.cc:1151] Deleting tablet 6d94eb734df94a309a7b171d907c81da
0616 19:51:54.100158 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.184109 (+ 83951us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.188364 (+ 4255us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.204978 (+ 16614us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1348572}
I20260616 19:51:54.219496 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 6d94eb734df94a309a7b171d907c81da (table default.Table_0ed7b3aa00c145f49e22f9cbc892bc0c [id=6067524c64a14af0976b29a9776de33b]) successfully deleted
I20260616 19:51:54.220006 1193 tablet_replica.cc:333] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:54.220254 1193 raft_consensus.cc:2243] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.220513 1193 raft_consensus.cc:2272] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.221155 1193 ts_tablet_manager.cc:1916] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.222918 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_640a7f020c4044efad09aec2444b0b6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.223649 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_640a7f020c4044efad09aec2444b0b6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.228842 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_4a9b0e9a1c6648f8bb08c587a4750e4f [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 4 got 0
W20260616 19:51:54.229171 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 362e7ff9bea3459ca018d1a7febb2ce4 consensus state has no leader
I20260616 19:51:54.231319 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddc4929e1dc4c9284cd78dfa6b6febd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.231714 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 154ca8a6bce84b4bab932e69ec7f1f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.231776 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 387ba2086bca4a15b388700044e3c45d with delete_type TABLET_DATA_DELETED (replaced by tablet de0ea6ca79ff4ed09f63fc7bb98eaabd) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.231925 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 54ceb5a01be24dfb9c08001d662a9ac4 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:54.231760 454 catalog_manager.cc:5696] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131). New cstate: current_term: 1 leader_uuid: "61c874fef3684d10a272a9c7f280e0e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: HEALTHY } } }
I20260616 19:51:54.232059 888 tablet_service.cc:1558] Processing DeleteTablet for tablet bb2fdea2d4ab42708fcd3102ea54bdb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.232290 454 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet c5657b6b56af4b8f8eff1fa18836df9b (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]). Expected version 1 got 0
I20260616 19:51:54.232326 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d94eb734df94a309a7b171d907c81da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.232955 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 815d213bf1904353b4f0b2e2f8954db9
I20260616 19:51:54.233727 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3ebb67c879364b8eac6a40f80d97a6eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.234387 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ebb67c879364b8eac6a40f80d97a6eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.235047 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 815d213bf1904353b4f0b2e2f8954db9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.236593 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 39f52eebdc79460a9ff33191086e87c6
I20260616 19:51:54.236207 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f4b949adef834904a68e4b48dd6561cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:54.237586 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 39f52eebdc79460a9ff33191086e87c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e8160ad4cf74f16a586ae59291ce7d1) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.237192 460 catalog_manager.cc:6784] ReplaceTablet: tablet 39f52eebdc79460a9ff33191086e87c6 deleted and replaced by tablet 1e8160ad4cf74f16a586ae59291ce7d1
I20260616 19:51:54.238236 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0957b27c92aa48bdb6898b1cafddbf11" } new_table_name: "default.Table_ee130ae3817f41f8ac49a76361fd23ea" modify_external_catalogs: true
I20260616 19:51:54.238546 1190 ts_tablet_manager.cc:1929] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.238704 1190 log.cc:1199] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/4e37f42ce8ec47fca1cf8aa75bc0202d
I20260616 19:51:54.239156 1190 ts_tablet_manager.cc:1950] T 4e37f42ce8ec47fca1cf8aa75bc0202d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:54.239606 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_774101ee38e441449f023f43612d6621"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.240202 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_774101ee38e441449f023f43612d6621 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:54.240931 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4b949adef834904a68e4b48dd6561cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.242755 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 815d213bf1904353b4f0b2e2f8954db9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.242786 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 39f52eebdc79460a9ff33191086e87c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e8160ad4cf74f16a586ae59291ce7d1) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.244256 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 815d213bf1904353b4f0b2e2f8954db9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.244550 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 39f52eebdc79460a9ff33191086e87c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e8160ad4cf74f16a586ae59291ce7d1) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:54.245020 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 815d213bf1904353b4f0b2e2f8954db9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 815d213bf1904353b4f0b2e2f8954db9 already in progress: creating tablet
I20260616 19:51:54.245195 1196 tablet_bootstrap.cc:492] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
W20260616 19:51:54.245313 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 39f52eebdc79460a9ff33191086e87c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39f52eebdc79460a9ff33191086e87c6 already in progress: creating tablet
I20260616 19:51:54.245457 1196 ts_tablet_manager.cc:1403] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.007s
I20260616 19:51:54.246634 1196 raft_consensus.cc:359] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.246881 1196 raft_consensus.cc:385] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.246995 1196 raft_consensus.cc:740] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.247292 1196 consensus_queue.cc:260] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:51:54.253830 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 99551210f5974332bf6a16ee74b220f6 consensus state has no leader
I20260616 19:51:54.254489 1193 ts_tablet_manager.cc:1929] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.254674 1193 log.cc:1199] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/c789abf00da24981be5bb72c0b5752d1
I20260616 19:51:54.255081 1193 ts_tablet_manager.cc:1950] T c789abf00da24981be5bb72c0b5752d1 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:54.256060 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 122) took 1505 ms. Trace:
I20260616 19:51:54.256186 1193 rpcz_store.cc:276] 0616 19:51:52.750285 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.751617 (+ 1332us) service_pool.cc:224] Handling call
0616 19:51:54.219915 (+1468298us) ts_tablet_manager.cc:1151] Deleting tablet c789abf00da24981be5bb72c0b5752d1
0616 19:51:54.219929 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.227131 (+ 7202us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.254399 (+ 27268us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.255983 (+ 1584us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1468107}
I20260616 19:51:54.256925 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 4e37f42ce8ec47fca1cf8aa75bc0202d (table default.Table_6a6d8516df114593b27d86140407b724 [id=d104c5ac8acc4a6f9ed7cc87879d661b]) successfully deleted
I20260616 19:51:54.257364 1190 tablet_replica.cc:333] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:54.257701 1190 raft_consensus.cc:2243] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.258033 1190 raft_consensus.cc:2272] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.258952 1190 ts_tablet_manager.cc:1916] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.258965 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c74d12fe512847eb94953b8f78c6b753" } new_table_name: "default.Table_ebec5e10f80244469fca70fe48c270e8" modify_external_catalogs: true
I20260616 19:51:54.261970 1198 tablet_bootstrap.cc:492] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:54.261966 762 tablet_service.cc:1558] Processing DeleteTablet for tablet fcfc9231ffeb487cb15ed2a3788730ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.262156 1198 ts_tablet_manager.cc:1403] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.060s user 0.006s sys 0.001s
I20260616 19:51:54.262418 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet c789abf00da24981be5bb72c0b5752d1 (table default.Table_c654445815a9494491a390790185534e [id=2158cc9d64824b9b8836ff772169d936]) successfully deleted
I20260616 19:51:54.262928 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 123) took 1488 ms. Trace:
I20260616 19:51:54.263054 1198 raft_consensus.cc:359] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.263278 1198 raft_consensus.cc:385] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.263361 1198 raft_consensus.cc:740] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.263084 1193 rpcz_store.cc:276] 0616 19:51:52.774842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.774906 (+ 64us) service_pool.cc:224] Handling call
0616 19:51:54.262761 (+1487855us) ts_tablet_manager.cc:1151] Deleting tablet fd5a513aeb224609afaee1ded6ede5e6
0616 19:51:54.262771 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.262875 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1487666}
I20260616 19:51:54.263687 1198 consensus_queue.cc:260] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:51:54.264207 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet fd5a513aeb224609afaee1ded6ede5e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd5a513aeb224609afaee1ded6ede5e6 already in progress: creating tablet
I20260616 19:51:54.267685 1198 ts_tablet_manager.cc:1434] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260616 19:51:54.267905 1193 tablet_replica.cc:333] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:54.271009 1193 raft_consensus.cc:2243] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.271178 1198 tablet_bootstrap.cc:492] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:54.271504 1193 raft_consensus.cc:2272] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.272143 1193 ts_tablet_manager.cc:1916] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.273514 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 362e7ff9bea3459ca018d1a7febb2ce4
I20260616 19:51:54.274106 455 catalog_manager.cc:6784] ReplaceTablet: tablet 362e7ff9bea3459ca018d1a7febb2ce4 deleted and replaced by tablet ca5dc1e6cde347fc9a34e555385dc646
I20260616 19:51:54.274551 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 362e7ff9bea3459ca018d1a7febb2ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet ca5dc1e6cde347fc9a34e555385dc646) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.275243 1196 ts_tablet_manager.cc:1434] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.030s user 0.000s sys 0.002s
I20260616 19:51:54.279552 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 362e7ff9bea3459ca018d1a7febb2ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet ca5dc1e6cde347fc9a34e555385dc646) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.280133 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 362e7ff9bea3459ca018d1a7febb2ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet ca5dc1e6cde347fc9a34e555385dc646) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:54.280929 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 362e7ff9bea3459ca018d1a7febb2ce4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 362e7ff9bea3459ca018d1a7febb2ce4 already in progress: creating tablet
I20260616 19:51:54.276350 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dc293d30aea14e2385f75dbc8b66b349" } new_table_name: "default.Table_9e98175df9ce48a59cb42b1e48cd7fba" modify_external_catalogs: true
I20260616 19:51:54.283530 1198 tablet_bootstrap.cc:654] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.288551 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ae1d446a11f34a77bd9bcdafbef99127"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:54.288766 1192 tablet_bootstrap.cc:492] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:54.288933 1192 ts_tablet_manager.cc:1403] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.089s user 0.017s sys 0.048s
W20260616 19:51:54.289155 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae1d446a11f34a77bd9bcdafbef99127 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.289494 1190 ts_tablet_manager.cc:1929] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.289649 1190 log.cc:1199] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/e8351427cb34466f82ee74fb60b6798b
I20260616 19:51:54.289522 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_44015174890646ee876b8d08923fc342"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.290010 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44015174890646ee876b8d08923fc342 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.290030 1190 ts_tablet_manager.cc:1950] T e8351427cb34466f82ee74fb60b6798b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:54.290635 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0531204d83954cb3a55ad0f218d390a1" } modify_external_catalogs: true
I20260616 19:51:54.290813 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0531204d83954cb3a55ad0f218d390a1" } modify_external_catalogs: true
I20260616 19:51:54.291088 1190 tablet_replica.cc:333] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:54.291320 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8125dce4d32a416498b42a1b599355fd
I20260616 19:51:54.291718 1192 raft_consensus.cc:359] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.291874 457 catalog_manager.cc:6784] ReplaceTablet: tablet 8125dce4d32a416498b42a1b599355fd deleted and replaced by tablet 9060de590fa84ea08dc7d39765bc9308
I20260616 19:51:54.291916 1192 raft_consensus.cc:385] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.292002 1192 raft_consensus.cc:740] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.292178 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_83077797e50a4defa55132113e80d358" } modify_external_catalogs: true
I20260616 19:51:54.292325 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_83077797e50a4defa55132113e80d358" } modify_external_catalogs: true
I20260616 19:51:54.292268 1192 consensus_queue.cc:260] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.292791 1192 ts_tablet_manager.cc:1434] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260616 19:51:54.293627 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 8125dce4d32a416498b42a1b599355fd with delete_type TABLET_DATA_DELETED (replaced by tablet 9060de590fa84ea08dc7d39765bc9308) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.294508 1193 ts_tablet_manager.cc:1929] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.294644 1193 log.cc:1199] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/b657c023023d4070b3dfb16da1b35181
I20260616 19:51:54.294824 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 8125dce4d32a416498b42a1b599355fd with delete_type TABLET_DATA_DELETED (replaced by tablet 9060de590fa84ea08dc7d39765bc9308) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.294855 1198 tablet_bootstrap.cc:492] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:54.295032 1193 ts_tablet_manager.cc:1950] T b657c023023d4070b3dfb16da1b35181 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:54.295063 1198 ts_tablet_manager.cc:1403] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.002s
I20260616 19:51:54.295558 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet e8351427cb34466f82ee74fb60b6798b (table default.Table_cd728ab6319e49a395bee4e74aff4e22 [id=69f6da4c9974486e9b1b7d5a3d28b373]) successfully deleted
I20260616 19:51:54.295861 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 124) took 1517 ms. Trace:
I20260616 19:51:54.295922 1198 raft_consensus.cc:359] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:54.296074 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8125dce4d32a416498b42a1b599355fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8125dce4d32a416498b42a1b599355fd already in progress: creating tablet
I20260616 19:51:54.296115 1198 raft_consensus.cc:385] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.295984 1193 rpcz_store.cc:276] 0616 19:51:52.777895 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.777944 (+ 49us) service_pool.cc:224] Handling call
0616 19:51:54.264537 (+1486593us) ts_tablet_manager.cc:1151] Deleting tablet b657c023023d4070b3dfb16da1b35181
0616 19:51:54.267818 (+ 3281us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.282072 (+ 14254us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.294402 (+ 12330us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.295820 (+ 1418us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1486400}
I20260616 19:51:54.296203 1198 raft_consensus.cc:740] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.296453 1198 consensus_queue.cc:260] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.297056 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet b657c023023d4070b3dfb16da1b35181 (table default.Table_836a3f95e80c4694b0f23dc42274d582 [id=b92002b768ab4133b08391019758714a]) successfully deleted
I20260616 19:51:54.298166 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 125) took 1487 ms. Trace:
I20260616 19:51:54.298286 1193 rpcz_store.cc:276] 0616 19:51:52.811122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.811170 (+ 48us) service_pool.cc:224] Handling call
0616 19:51:54.297970 (+1486800us) ts_tablet_manager.cc:1151] Deleting tablet bb2fdea2d4ab42708fcd3102ea54bdb6
0616 19:51:54.297984 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.298130 (+ 146us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1486625}
W20260616 19:51:54.298781 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet bb2fdea2d4ab42708fcd3102ea54bdb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb2fdea2d4ab42708fcd3102ea54bdb6 already in progress: creating tablet
I20260616 19:51:54.299880 1196 tablet_bootstrap.cc:492] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:54.300971 1198 ts_tablet_manager.cc:1434] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260616 19:51:54.301658 1196 tablet_bootstrap.cc:654] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.301713 1193 tablet_replica.cc:333] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:54.302086 1193 raft_consensus.cc:2243] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.302166 1192 tablet_bootstrap.cc:492] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:54.302311 1193 raft_consensus.cc:2272] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.304742 1193 ts_tablet_manager.cc:1916] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.303944 1198 tablet_bootstrap.cc:492] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:54.309146 1190 raft_consensus.cc:2243] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.309406 1190 raft_consensus.cc:2272] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.310379 1190 ts_tablet_manager.cc:1916] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.310555 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 8125dce4d32a416498b42a1b599355fd with delete_type TABLET_DATA_DELETED (replaced by tablet 9060de590fa84ea08dc7d39765bc9308) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.312788 1192 tablet_bootstrap.cc:654] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:54.313598 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ffce2dc22e24d1684e6eae92c487cea consensus state has no leader
I20260616 19:51:54.318039 1198 tablet_bootstrap.cc:654] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:54.319310 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 776841d895d6431fbee76b7c4e28d973 consensus state has no leader
I20260616 19:51:54.319520 1190 ts_tablet_manager.cc:1929] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.319643 1190 log.cc:1199] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/a56168eb4f5e449a8f9eed5c8cfad9df
I20260616 19:51:54.319679 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 19832d0517524c0facf1f97486b1e58e from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:54.320060 1190 ts_tablet_manager.cc:1950] T a56168eb4f5e449a8f9eed5c8cfad9df P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
W20260616 19:51:54.320189 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2c31c8e977da4a70bca1beb00f364627 consensus state has no leader
I20260616 19:51:54.320608 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1b580eacc19b47f295938666dc9783fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:54.321301 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet a56168eb4f5e449a8f9eed5c8cfad9df (table default.Table_2bcad1cc946c4bea8e3eedee12ee1629 [id=9ec0598716a64236aaba17b464849f3f]) successfully deleted
W20260616 19:51:54.321378 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b580eacc19b47f295938666dc9783fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.324326 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_61b32c8d9ca6461c8f3edd6bf27c79bc" } modify_external_catalogs: true
I20260616 19:51:54.324591 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_61b32c8d9ca6461c8f3edd6bf27c79bc" } modify_external_catalogs: true
I20260616 19:51:54.327390 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ca73591123cf4e2982da39e8b7095cb0" } modify_external_catalogs: true
I20260616 19:51:54.327468 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 543ef0fcac3d47928c5dd1d13f9aba92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.332177 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet e4705cacd95a45888fac6a76745eae4e with delete_type TABLET_DATA_DELETED (replaced by tablet 0da93e4052094862a44812990df1136a) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.332552 1191 tablet_replica.cc:333] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:54.332814 1191 raft_consensus.cc:2243] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.333040 1191 raft_consensus.cc:2272] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.333921 1191 ts_tablet_manager.cc:1916] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.334692 1193 ts_tablet_manager.cc:1929] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.334847 1193 log.cc:1199] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/63a2448644894be186e2ab62f3d662be
I20260616 19:51:54.335228 1193 ts_tablet_manager.cc:1950] T 63a2448644894be186e2ab62f3d662be P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:54.336189 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 126) took 1416 ms. Trace:
I20260616 19:51:54.338589 1190 tablet_replica.cc:333] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:54.338830 1190 raft_consensus.cc:2243] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.339015 1190 raft_consensus.cc:2272] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.339133 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ca73591123cf4e2982da39e8b7095cb0" } modify_external_catalogs: true
I20260616 19:51:54.328624 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5a41286216274f998881eb155b57e7c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.337657 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet b99740ab59f947aabcac88dc2bf2de86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b99740ab59f947aabcac88dc2bf2de86 already in progress: creating tablet
W20260616 19:51:54.341315 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a41286216274f998881eb155b57e7c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:54.341354 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c44422ddb8ce45a48bb9aaeb6c209f21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c44422ddb8ce45a48bb9aaeb6c209f21 already in progress: creating tablet
I20260616 19:51:54.343169 1245 consensus_queue.cc:1048] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:51:54.343607 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet bb2fdea2d4ab42708fcd3102ea54bdb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.345458 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet a56168eb4f5e449a8f9eed5c8cfad9df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.353068 1190 ts_tablet_manager.cc:1916] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.353585 457 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet f2727cdad0dd4451a9c1c68067bc64e3
I20260616 19:51:54.353960 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f
I20260616 19:51:54.354214 454 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet fae6bae6395b47f597d325325a5b668e
I20260616 19:51:54.356652 1198 tablet_bootstrap.cc:492] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:54.356812 1198 ts_tablet_manager.cc:1403] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.010s
I20260616 19:51:54.357579 1198 raft_consensus.cc:359] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.357782 1198 raft_consensus.cc:385] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.357844 1198 raft_consensus.cc:740] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.358145 1198 consensus_queue.cc:260] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.360638 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.336294 1193 rpcz_store.cc:276] 0616 19:51:52.919546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.919598 (+ 52us) service_pool.cc:224] Handling call
0616 19:51:54.301629 (+1382031us) ts_tablet_manager.cc:1151] Deleting tablet 63a2448644894be186e2ab62f3d662be
0616 19:51:54.301640 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.308187 (+ 6547us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.334603 (+ 26416us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.336124 (+ 1521us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1381784}
I20260616 19:51:54.361485 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.361575 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 63a2448644894be186e2ab62f3d662be (table default.Table_de7cf8cf7c43409b9c41391ff6e8ba35 [id=122f88b500c0425e833926b349605d6f]) successfully deleted
I20260616 19:51:54.362246 1198 ts_tablet_manager.cc:1434] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260616 19:51:54.362771 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.363124 1208 raft_consensus.cc:493] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:54.363296 1208 raft_consensus.cc:515] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.363571 1193 tablet_replica.cc:333] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:54.363770 1193 raft_consensus.cc:2243] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.363960 1193 raft_consensus.cc:2272] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.363987 1208 leader_election.cc:290] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:54.365007 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d916b2f553ce41df8934e1190fa32120" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:51:54.365644 993 leader_election.cc:343] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:54.366466 1191 ts_tablet_manager.cc:1929] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.366469 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d916b2f553ce41df8934e1190fa32120" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:54.367085 1191 log.cc:1199] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/e4705cacd95a45888fac6a76745eae4e
I20260616 19:51:54.367453 1191 ts_tablet_manager.cc:1950] T e4705cacd95a45888fac6a76745eae4e P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
W20260616 19:51:54.369150 996 leader_election.cc:343] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:54.369277 996 leader_election.cc:304] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:54.370589 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet e4705cacd95a45888fac6a76745eae4e (table default.Table_fe763512a640490ebb25dca52b04788a [id=ad67f2c8f60f4c8c9b4ca2e57ffdb6f1]) successfully deleted
I20260616 19:51:54.371516 1192 tablet_bootstrap.cc:492] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:54.371665 1192 ts_tablet_manager.cc:1403] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.079s user 0.012s sys 0.019s
I20260616 19:51:54.371997 1208 raft_consensus.cc:2749] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:54.372483 1192 raft_consensus.cc:359] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.372678 1192 raft_consensus.cc:385] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.372783 1192 raft_consensus.cc:740] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.372900 1198 tablet_bootstrap.cc:492] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:54.373027 1192 consensus_queue.cc:260] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.374763 1193 ts_tablet_manager.cc:1916] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.375228 1192 ts_tablet_manager.cc:1434] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260616 19:51:54.375845 1192 tablet_bootstrap.cc:492] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:54.377388 454 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet d916b2f553ce41df8934e1190fa32120 (table default.Table_647cdefd19814321b51ee0898effc29c [id=7b17c97ad92b4ead8f60bf602853cd61]). Expected version 4 got 0
I20260616 19:51:54.379055 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet d916b2f553ce41df8934e1190fa32120 (table default.Table_647cdefd19814321b51ee0898effc29c [id=7b17c97ad92b4ead8f60bf602853cd61]). Expected version 4 got 0
I20260616 19:51:54.379421 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 10fc1d2ecaa746bab980a708dd8eb93a
I20260616 19:51:54.381004 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 10fc1d2ecaa746bab980a708dd8eb93a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.381356 1192 tablet_bootstrap.cc:654] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.381500 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 10fc1d2ecaa746bab980a708dd8eb93a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.382292 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 10fc1d2ecaa746bab980a708dd8eb93a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.382448 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet d916b2f553ce41df8934e1190fa32120 (table default.Table_647cdefd19814321b51ee0898effc29c [id=7b17c97ad92b4ead8f60bf602853cd61]). Expected version 4 got 0
I20260616 19:51:54.383131 1198 tablet_bootstrap.cc:654] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.385818 888 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4adff6e41148b8b54e969ea2eb7a91 (DEFAULT_TABLE table=default.Table_4df4f4584b034b46be562b220a3b256e [id=c8da781ace3a426c981725db208ba1c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.386339 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4adff6e41148b8b54e969ea2eb7a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.387267 1190 ts_tablet_manager.cc:1929] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.387773 1190 log.cc:1199] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/e4705cacd95a45888fac6a76745eae4e
I20260616 19:51:54.389544 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4adff6e41148b8b54e969ea2eb7a91 (DEFAULT_TABLE table=default.Table_4df4f4584b034b46be562b220a3b256e [id=c8da781ace3a426c981725db208ba1c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.389715 1190 ts_tablet_manager.cc:1950] T e4705cacd95a45888fac6a76745eae4e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:54.391006 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet e4705cacd95a45888fac6a76745eae4e (table default.Table_fe763512a640490ebb25dca52b04788a [id=ad67f2c8f60f4c8c9b4ca2e57ffdb6f1]) successfully deleted
I20260616 19:51:54.391016 762 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4adff6e41148b8b54e969ea2eb7a91 (DEFAULT_TABLE table=default.Table_4df4f4584b034b46be562b220a3b256e [id=c8da781ace3a426c981725db208ba1c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.391498 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4adff6e41148b8b54e969ea2eb7a91. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:54.397090 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d61873c8aa094d7f899a61307a36f895 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d61873c8aa094d7f899a61307a36f895 already in progress: creating tablet
W20260616 19:51:54.397924 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet da51a682de41402cb537ab113f876a2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da51a682de41402cb537ab113f876a2d already in progress: creating tablet
I20260616 19:51:54.398339 1190 tablet_replica.cc:333] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:54.398612 1190 raft_consensus.cc:2243] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.398861 1190 raft_consensus.cc:2272] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.400416 1193 ts_tablet_manager.cc:1929] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.400586 1193 log.cc:1199] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/cf89adf3cbe54beab939645f7ebbb616
I20260616 19:51:54.401049 1193 ts_tablet_manager.cc:1950] T cf89adf3cbe54beab939645f7ebbb616 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:54.402064 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 127) took 1471 ms. Trace:
I20260616 19:51:54.402251 1193 rpcz_store.cc:276] 0616 19:51:52.930962 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.931017 (+ 55us) service_pool.cc:224] Handling call
0616 19:51:54.363174 (+1432157us) ts_tablet_manager.cc:1151] Deleting tablet cf89adf3cbe54beab939645f7ebbb616
0616 19:51:54.363187 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.379243 (+ 16056us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.400302 (+ 21059us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.402014 (+ 1712us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1431926}
I20260616 19:51:54.402937 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet cf89adf3cbe54beab939645f7ebbb616 (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]) successfully deleted
I20260616 19:51:54.405332 888 tablet_service.cc:1511] Processing CreateTablet for tablet a170db3d27fd40c1b74deab29e9a033f (DEFAULT_TABLE table=default.Table_b03768997ca94dd897aed95bee7efc2b [id=6ab2bb094a714f089de17dd9c6742619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.405599 1033 tablet_service.cc:1511] Processing CreateTablet for tablet a170db3d27fd40c1b74deab29e9a033f (DEFAULT_TABLE table=default.Table_b03768997ca94dd897aed95bee7efc2b [id=6ab2bb094a714f089de17dd9c6742619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.407346 750 tablet_service.cc:1511] Processing CreateTablet for tablet a170db3d27fd40c1b74deab29e9a033f (DEFAULT_TABLE table=default.Table_b03768997ca94dd897aed95bee7efc2b [id=6ab2bb094a714f089de17dd9c6742619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.407555 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a170db3d27fd40c1b74deab29e9a033f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.407905 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a170db3d27fd40c1b74deab29e9a033f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.408710 1193 tablet_replica.cc:333] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:54.409040 1193 raft_consensus.cc:2243] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.409274 1193 raft_consensus.cc:2272] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.410064 1193 ts_tablet_manager.cc:1916] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.413441 903 tablet_service.cc:1511] Processing CreateTablet for tablet 1d62405248304339a03b01bc28238b8b (DEFAULT_TABLE table=default.Table_9dacb90aa08e434d99c33e3a4f49fbe3 [id=26e971fd00814ec89e4b45ad7544739b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.413940 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d62405248304339a03b01bc28238b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.424980 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 1d62405248304339a03b01bc28238b8b (DEFAULT_TABLE table=default.Table_9dacb90aa08e434d99c33e3a4f49fbe3 [id=26e971fd00814ec89e4b45ad7544739b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.426998 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 1bc181171b134de2b946376f468aec72 (DEFAULT_TABLE table=default.Table_daf95e025c454ee1b78a61861cc1a23d [id=625dfecea84f40369353e2b7a6408e01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.427179 751 tablet_service.cc:1511] Processing CreateTablet for tablet 1d62405248304339a03b01bc28238b8b (DEFAULT_TABLE table=default.Table_9dacb90aa08e434d99c33e3a4f49fbe3 [id=26e971fd00814ec89e4b45ad7544739b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.427563 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d62405248304339a03b01bc28238b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.429381 762 tablet_service.cc:1511] Processing CreateTablet for tablet 1bc181171b134de2b946376f468aec72 (DEFAULT_TABLE table=default.Table_daf95e025c454ee1b78a61861cc1a23d [id=625dfecea84f40369353e2b7a6408e01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.429912 891 tablet_service.cc:1511] Processing CreateTablet for tablet 13e4e52fae124d4085b15e143e98a7e4 (DEFAULT_TABLE table=default.Table_08665ae0b3d543ee85db56ca306c7f4b [id=ee62532e9e6148ac830ee9efe0a88a24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.430013 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bc181171b134de2b946376f468aec72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.430320 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e4e52fae124d4085b15e143e98a7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.434240 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5bfbe9967f534a958045a36d7e269580" } new_table_name: "default.Table_be8da347321a4279a4ad9123e4ea7b48" modify_external_catalogs: true
I20260616 19:51:54.438410 903 tablet_service.cc:1511] Processing CreateTablet for tablet 1bc181171b134de2b946376f468aec72 (DEFAULT_TABLE table=default.Table_daf95e025c454ee1b78a61861cc1a23d [id=625dfecea84f40369353e2b7a6408e01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.439126 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bc181171b134de2b946376f468aec72. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:54.441012 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d368ec65b624ea58f7b750097a78ede consensus state has no leader
I20260616 19:51:54.445528 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b03768997ca94dd897aed95bee7efc2b" } modify_external_catalogs: true
I20260616 19:51:54.445756 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b03768997ca94dd897aed95bee7efc2b" } modify_external_catalogs: true
I20260616 19:51:54.447404 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_08d577b7b19b4304839ef1e907e17551"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.448328 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08d577b7b19b4304839ef1e907e17551 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.451414 1191 tablet_replica.cc:333] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:54.451823 1191 raft_consensus.cc:2243] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.452030 1191 raft_consensus.cc:2272] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.452661 1190 ts_tablet_manager.cc:1916] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.452764 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4adff6e41148b8b54e969ea2eb7a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.456184 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a170db3d27fd40c1b74deab29e9a033f
I20260616 19:51:54.457057 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet a170db3d27fd40c1b74deab29e9a033f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.459257 891 tablet_service.cc:1558] Processing DeleteTablet for tablet a170db3d27fd40c1b74deab29e9a033f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.460628 750 tablet_service.cc:1558] Processing DeleteTablet for tablet a170db3d27fd40c1b74deab29e9a033f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.461870 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a170db3d27fd40c1b74deab29e9a033f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.462308 454 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet d916b2f553ce41df8934e1190fa32120 (table default.Table_647cdefd19814321b51ee0898effc29c [id=7b17c97ad92b4ead8f60bf602853cd61]). Expected version 4 got 0
I20260616 19:51:54.463076 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_969ffb30ff464eea9255cf085e7bf42d" } new_table_name: "default.Table_e572d7a091794957b3476b1afd6aae1c" modify_external_catalogs: true
I20260616 19:51:54.463805 1191 ts_tablet_manager.cc:1916] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.464727 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bc181171b134de2b946376f468aec72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.464779 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 13e4e52fae124d4085b15e143e98a7e4 (DEFAULT_TABLE table=default.Table_08665ae0b3d543ee85db56ca306c7f4b [id=ee62532e9e6148ac830ee9efe0a88a24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.465209 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e4e52fae124d4085b15e143e98a7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.466500 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 5b34d497f9334e94b06cc9245fca04ed (DEFAULT_TABLE table=default.Table_6425c298b87c4b6ba30e2944f06792d8 [id=6db44bdac0784e08b52a4db869edb3d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.466472 891 tablet_service.cc:1511] Processing CreateTablet for tablet 5b34d497f9334e94b06cc9245fca04ed (DEFAULT_TABLE table=default.Table_6425c298b87c4b6ba30e2944f06792d8 [id=6db44bdac0784e08b52a4db869edb3d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.466886 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b34d497f9334e94b06cc9245fca04ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.466909 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b34d497f9334e94b06cc9245fca04ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.468708 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d62405248304339a03b01bc28238b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.472885 1402 consensus_queue.cc:1048] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:51:54.476884 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 5af9bdceae184f8dbb9e5db67a11ee63 from {username='slave'} at 127.0.0.1:41696
W20260616 19:51:54.478641 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bfff9d60bb7e4a86b14687b581b45efe consensus state has no leader
I20260616 19:51:54.484932 750 tablet_service.cc:1511] Processing CreateTablet for tablet 13e4e52fae124d4085b15e143e98a7e4 (DEFAULT_TABLE table=default.Table_08665ae0b3d543ee85db56ca306c7f4b [id=ee62532e9e6148ac830ee9efe0a88a24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.485394 1191 ts_tablet_manager.cc:1929] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.485616 1191 log.cc:1199] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/bb2fdea2d4ab42708fcd3102ea54bdb6
I20260616 19:51:54.486124 1191 ts_tablet_manager.cc:1950] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:54.487161 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e4e52fae124d4085b15e143e98a7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.487186 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet bb2fdea2d4ab42708fcd3102ea54bdb6 (table default.Table_baf21e2369ea4aa6aa6cbf2370be11b9 [id=bb9e8ac09e824ad58ba1ce8f021968a1]) successfully deleted
I20260616 19:51:54.487514 1191 tablet_replica.cc:333] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:54.487778 1191 raft_consensus.cc:2243] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.488298 1191 raft_consensus.cc:2272] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.489141 1191 ts_tablet_manager.cc:1916] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.492296 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 99b211692aca478bb40f0f2c3f50ca44 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:54.499337 459 master_service.cc:960] ReplaceTablet: received request to replace tablet 8eab5bd3967c42e1b6b79558df742946 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:54.505964 923 raft_consensus.cc:1275] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Refusing update from remote peer 7245e7dab0ec474a876537be514c8767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:51:54.507131 1205 consensus_queue.cc:1048] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:51:54.507944 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_654e346141624d0d878221b2ef96cb83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.508549 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_654e346141624d0d878221b2ef96cb83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.510867 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7f7b6caef24d427986f0670e307a057a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.511359 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f7b6caef24d427986f0670e307a057a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.512667 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 99b211692aca478bb40f0f2c3f50ca44
I20260616 19:51:54.514698 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 4ffce2dc22e24d1684e6eae92c487cea from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:54.516319 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e572d7a091794957b3476b1afd6aae1c" } new_table_name: "default.Table_e45bf57dcf664129991297d4600d67d5" modify_external_catalogs: true
I20260616 19:51:54.520560 454 catalog_manager.cc:6784] ReplaceTablet: tablet 99b211692aca478bb40f0f2c3f50ca44 deleted and replaced by tablet 44493f0ffd064249a28628cf24895395
I20260616 19:51:54.521368 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 99b211692aca478bb40f0f2c3f50ca44 with delete_type TABLET_DATA_DELETED (replaced by tablet 44493f0ffd064249a28628cf24895395) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.522621 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_88815cb77f064a7d8c61564f6fe9458f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.523411 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88815cb77f064a7d8c61564f6fe9458f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.524127 1191 ts_tablet_manager.cc:1929] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.524298 1191 log.cc:1199] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/a56168eb4f5e449a8f9eed5c8cfad9df
I20260616 19:51:54.522769 1196 tablet_bootstrap.cc:492] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:54.524616 1196 ts_tablet_manager.cc:1403] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.225s user 0.005s sys 0.000s
I20260616 19:51:54.524729 1191 ts_tablet_manager.cc:1950] T a56168eb4f5e449a8f9eed5c8cfad9df P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:54.526197 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:54.526355 1196 raft_consensus.cc:359] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.526558 1196 raft_consensus.cc:385] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.526638 1196 raft_consensus.cc:740] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
W20260616 19:51:54.526826 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.527014 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4a9b0e9a1c6648f8bb08c587a4750e4f" } new_table_name: "default.Table_15c5a7f0c53c48069560560950206199" modify_external_catalogs: true
I20260616 19:51:54.527082 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0a2742804d7d48fcb8acc6f20ae3536b" } new_table_name: "default.Table_81d2820218034bf0a04d2480e6bd8b43" modify_external_catalogs: true
I20260616 19:51:54.527709 1193 ts_tablet_manager.cc:1929] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.529611 1205 raft_consensus.cc:493] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:54.529752 1205 raft_consensus.cc:515] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.529997 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8eab5bd3967c42e1b6b79558df742946
I20260616 19:51:54.530418 459 catalog_manager.cc:6784] ReplaceTablet: tablet 8eab5bd3967c42e1b6b79558df742946 deleted and replaced by tablet 65b0dc43b40649f29037f40d2ea9247e
I20260616 19:51:54.530411 1205 leader_election.cc:290] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:54.532015 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 99b211692aca478bb40f0f2c3f50ca44 with delete_type TABLET_DATA_DELETED (replaced by tablet 44493f0ffd064249a28628cf24895395) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.532212 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eab5bd3967c42e1b6b79558df742946 with delete_type TABLET_DATA_DELETED (replaced by tablet 65b0dc43b40649f29037f40d2ea9247e) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:54.533123 719 leader_election.cc:343] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 6ddc4929e1dc4c9284cd78dfa6b6febd
I20260616 19:51:54.527834 1193 log.cc:1199] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/51fa9bd399d54a86875db081081a8814
I20260616 19:51:54.534149 1193 ts_tablet_manager.cc:1950] T 51fa9bd399d54a86875db081081a8814 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:51:54.535593 718 leader_election.cc:343] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: 6ddc4929e1dc4c9284cd78dfa6b6febd
I20260616 19:51:54.535728 718 leader_election.cc:304] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:54.536757 1196 consensus_queue.cc:260] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.537523 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 129) took 1605 ms. Trace:
I20260616 19:51:54.537619 1193 rpcz_store.cc:276] 0616 19:51:52.931580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:52.938523 (+ 6943us) service_pool.cc:224] Handling call
0616 19:51:54.408609 (+1470086us) ts_tablet_manager.cc:1151] Deleting tablet 51fa9bd399d54a86875db081081a8814
0616 19:51:54.408623 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.508892 (+100269us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.527633 (+ 18741us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.537465 (+ 9832us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1469858}
I20260616 19:51:54.539278 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 141) took 1410 ms. Trace:
I20260616 19:51:54.539379 1193 rpcz_store.cc:276] 0616 19:51:53.128905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:53.129154 (+ 249us) service_pool.cc:224] Handling call
0616 19:51:54.539119 (+1409965us) ts_tablet_manager.cc:1151] Deleting tablet 7161894b9f9047fda9ed3f2180518a59
0616 19:51:54.539129 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.539226 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1409748}
W20260616 19:51:54.539805 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 7161894b9f9047fda9ed3f2180518a59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7161894b9f9047fda9ed3f2180518a59 already in progress: creating tablet
I20260616 19:51:54.541270 1193 tablet_replica.cc:333] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:54.541715 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 4ffce2dc22e24d1684e6eae92c487cea
I20260616 19:51:54.541756 1205 raft_consensus.cc:2749] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:54.542285 457 catalog_manager.cc:6784] ReplaceTablet: tablet 4ffce2dc22e24d1684e6eae92c487cea deleted and replaced by tablet 2374c740a25442debce55e9d5309f79e
W20260616 19:51:54.542701 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bfff9d60bb7e4a86b14687b581b45efe consensus state has no leader
I20260616 19:51:54.544544 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ffce2dc22e24d1684e6eae92c487cea with delete_type TABLET_DATA_DELETED (replaced by tablet 2374c740a25442debce55e9d5309f79e) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.544880 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ffce2dc22e24d1684e6eae92c487cea with delete_type TABLET_DATA_DELETED (replaced by tablet 2374c740a25442debce55e9d5309f79e) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.545202 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 99b211692aca478bb40f0f2c3f50ca44 with delete_type TABLET_DATA_DELETED (replaced by tablet 44493f0ffd064249a28628cf24895395) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.545517 1193 raft_consensus.cc:2243] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.545712 1060 raft_consensus.cc:1275] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Refusing update from remote peer 7245e7dab0ec474a876537be514c8767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:51:54.545895 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9eedef731fd84c70a73a66128d239708"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:54.545782 1196 ts_tablet_manager.cc:1434] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.021s user 0.002s sys 0.002s
W20260616 19:51:54.546494 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9eedef731fd84c70a73a66128d239708 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.546993 1196 tablet_bootstrap.cc:492] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:54.548794 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_216bb84e91f64d85be3ccce61831e74b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:54.547087 1193 raft_consensus.cc:2272] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.546329 1411 consensus_queue.cc:1048] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:51:54.549561 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_216bb84e91f64d85be3ccce61831e74b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.550474 1193 ts_tablet_manager.cc:1916] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.554152 1196 tablet_bootstrap.cc:654] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.554044 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_914e42d3110442b99b33a9a77c30dd49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.554648 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_914e42d3110442b99b33a9a77c30dd49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.558736 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ffce2dc22e24d1684e6eae92c487cea with delete_type TABLET_DATA_DELETED (replaced by tablet 2374c740a25442debce55e9d5309f79e) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.558846 1193 ts_tablet_manager.cc:1929] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.559005 1193 log.cc:1199] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/543ef0fcac3d47928c5dd1d13f9aba92
I20260616 19:51:54.559381 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 54ceb5a01be24dfb9c08001d662a9ac4 with delete_type TABLET_DATA_DELETED (replaced by tablet 122a8b15e62f4b23b465e2dbc816df62) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.560801 1196 tablet_bootstrap.cc:492] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:54.561465 1196 ts_tablet_manager.cc:1403] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.002s
I20260616 19:51:54.563134 751 tablet_service.cc:1511] Processing CreateTablet for tablet 5b34d497f9334e94b06cc9245fca04ed (DEFAULT_TABLE table=default.Table_6425c298b87c4b6ba30e2944f06792d8 [id=6db44bdac0784e08b52a4db869edb3d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.563807 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b34d497f9334e94b06cc9245fca04ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.565075 1196 raft_consensus.cc:359] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.565481 924 raft_consensus.cc:1275] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Refusing update from remote peer 61c874fef3684d10a272a9c7f280e0e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:51:54.566246 1208 consensus_queue.cc:1048] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:51:54.566659 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_11377e6262de467fbd54d3ab881b4362" } modify_external_catalogs: true
I20260616 19:51:54.566905 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_11377e6262de467fbd54d3ab881b4362" } modify_external_catalogs: true
I20260616 19:51:54.567201 1196 raft_consensus.cc:385] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260616 19:51:54.567826 996 consensus_peers.cc:597] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:51:54.568064 1196 raft_consensus.cc:740] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.559433 1193 ts_tablet_manager.cc:1950] T 543ef0fcac3d47928c5dd1d13f9aba92 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:54.568719 1196 consensus_queue.cc:260] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.569389 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ee130ae3817f41f8ac49a76361fd23ea" } modify_external_catalogs: true
I20260616 19:51:54.569587 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ee130ae3817f41f8ac49a76361fd23ea" } modify_external_catalogs: true
I20260616 19:51:54.572249 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_08665ae0b3d543ee85db56ca306c7f4b" } modify_external_catalogs: true
I20260616 19:51:54.572415 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_08665ae0b3d543ee85db56ca306c7f4b" } modify_external_catalogs: true
I20260616 19:51:54.576750 455 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_4a9b0e9a1c6648f8bb08c587a4750e4f [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 4 got 0
I20260616 19:51:54.577409 1192 tablet_bootstrap.cc:492] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:54.577590 1192 ts_tablet_manager.cc:1403] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.202s user 0.016s sys 0.030s
I20260616 19:51:54.578562 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eab5bd3967c42e1b6b79558df742946 with delete_type TABLET_DATA_DELETED (replaced by tablet 65b0dc43b40649f29037f40d2ea9247e) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.578553 1192 raft_consensus.cc:359] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.578742 1192 raft_consensus.cc:385] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.578833 1192 raft_consensus.cc:740] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.579089 1192 consensus_queue.cc:260] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.579798 1192 ts_tablet_manager.cc:1434] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260616 19:51:54.580109 1192 tablet_bootstrap.cc:492] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:51:54.581144 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59812b232848488b9894e8f8057e9def consensus state has no leader
I20260616 19:51:54.581676 1418 tablet.cc:1724] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:51:54.582705 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_dcc7f41280024bda90ded420734edd74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.583222 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcc7f41280024bda90ded420734edd74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.584681 1405 mvcc.cc:204] Tried to move back new op lower bound from 7297595451635408896 to 7297595449994428416. Current Snapshot: MvccSnapshot[applied={T|T < 7297595451635408896}]
I20260616 19:51:54.587810 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_25651fb93ba2434cb75171647df9d2ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.588300 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25651fb93ba2434cb75171647df9d2ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.589540 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet a56168eb4f5e449a8f9eed5c8cfad9df (table default.Table_2bcad1cc946c4bea8e3eedee12ee1629 [id=9ec0598716a64236aaba17b464849f3f]) successfully deleted
I20260616 19:51:54.589752 1196 ts_tablet_manager.cc:1434] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
W20260616 19:51:54.590554 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f already in progress: creating tablet
I20260616 19:51:54.590958 761 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3f47e767764032ae5a06e34e2de248 (DEFAULT_TABLE table=default.Table_1bfaf142b33c42df9480c0fd9ec9b5ea [id=af4aada43ecf46b8bacf0d9d1388e92e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.591351 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3f47e767764032ae5a06e34e2de248. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:54.591517 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 10fc1d2ecaa746bab980a708dd8eb93a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10fc1d2ecaa746bab980a708dd8eb93a already in progress: creating tablet
W20260616 19:51:54.593192 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a170db3d27fd40c1b74deab29e9a033f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a170db3d27fd40c1b74deab29e9a033f already in progress: creating tablet
W20260616 19:51:54.593930 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 99b211692aca478bb40f0f2c3f50ca44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99b211692aca478bb40f0f2c3f50ca44 already in progress: creating tablet
I20260616 19:51:54.570354 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 140) took 1441 ms. Trace:
W20260616 19:51:54.594677 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 4ffce2dc22e24d1684e6eae92c487cea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ffce2dc22e24d1684e6eae92c487cea already in progress: creating tablet
I20260616 19:51:54.594610 1193 rpcz_store.cc:276] 0616 19:51:53.128791 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:53.129386 (+ 595us) service_pool.cc:224] Handling call
0616 19:51:54.541182 (+1411796us) ts_tablet_manager.cc:1151] Deleting tablet 543ef0fcac3d47928c5dd1d13f9aba92
0616 19:51:54.541193 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.554365 (+ 13172us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.558744 (+ 4379us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.570307 (+ 11563us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1351334}
I20260616 19:51:54.595139 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 139) took 1480 ms. Trace:
I20260616 19:51:54.595247 1193 rpcz_store.cc:276] 0616 19:51:53.114408 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:53.115059 (+ 651us) service_pool.cc:224] Handling call
0616 19:51:54.594918 (+1479859us) ts_tablet_manager.cc:1151] Deleting tablet 21eb01a4b2424d63affa5d9d71e2fa64
0616 19:51:54.594930 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.595089 (+ 159us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1395904}
W20260616 19:51:54.595429 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8eab5bd3967c42e1b6b79558df742946 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8eab5bd3967c42e1b6b79558df742946 already in progress: creating tablet
I20260616 19:51:54.595649 1190 ts_tablet_manager.cc:1929] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.595640 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 143) took 1466 ms. Trace:
I20260616 19:51:54.595793 1190 log.cc:1199] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/bb2fdea2d4ab42708fcd3102ea54bdb6
I20260616 19:51:54.595777 1193 rpcz_store.cc:276] 0616 19:51:53.129179 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:53.129462 (+ 283us) service_pool.cc:224] Handling call
0616 19:51:54.595498 (+1466036us) ts_tablet_manager.cc:1151] Deleting tablet 5af9bdceae184f8dbb9e5db67a11ee63
0616 19:51:54.595506 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.595596 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1396313}
I20260616 19:51:54.596321 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 142) took 1467 ms. Trace:
I20260616 19:51:54.596454 1193 rpcz_store.cc:276] 0616 19:51:53.129056 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:53.129391 (+ 335us) service_pool.cc:224] Handling call
0616 19:51:54.596030 (+1466639us) ts_tablet_manager.cc:1151] Deleting tablet d3645fc39d974bffa8fe52c62e1c7eff
0616 19:51:54.596041 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.596275 (+ 234us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1337038}
I20260616 19:51:54.596778 763 tablet_service.cc:1511] Processing CreateTablet for tablet 31592a5ffb04429c9315a4fd72308f28 (DEFAULT_TABLE table=default.Table_6a6d8516df114593b27d86140407b724 [id=d104c5ac8acc4a6f9ed7cc87879d661b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.596870 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 144) took 1467 ms. Trace:
I20260616 19:51:54.597003 1193 rpcz_store.cc:276] 0616 19:51:53.129323 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:53.129486 (+ 163us) service_pool.cc:224] Handling call
0616 19:51:54.596724 (+1467238us) ts_tablet_manager.cc:1151] Deleting tablet 2cfb2238cbdb421a8f5001dc729e9bb5
0616 19:51:54.596735 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.596827 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1335469}
I20260616 19:51:54.597204 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31592a5ffb04429c9315a4fd72308f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.597270 1192 tablet_bootstrap.cc:654] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.597386 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 145) took 1408 ms. Trace:
I20260616 19:51:54.597486 1193 rpcz_store.cc:276] 0616 19:51:53.189450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:53.189515 (+ 65us) service_pool.cc:224] Handling call
0616 19:51:54.597249 (+1407734us) ts_tablet_manager.cc:1151] Deleting tablet eac603a84d3c4f96bd444c54f28d278d
0616 19:51:54.597257 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.597351 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1319872}
I20260616 19:51:54.597831 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 146) took 1337 ms. Trace:
I20260616 19:51:54.597673 1419 tablet.cc:1724] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:51:54.597927 1193 rpcz_store.cc:276] 0616 19:51:53.260209 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:53.260333 (+ 124us) service_pool.cc:224] Handling call
0616 19:51:54.597706 (+1337373us) ts_tablet_manager.cc:1151] Deleting tablet 0da93e4052094862a44812990df1136a
0616 19:51:54.597714 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.597794 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1314029}
I20260616 19:51:54.598287 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 147) took 1336 ms. Trace:
I20260616 19:51:54.598474 1190 ts_tablet_manager.cc:1950] T bb2fdea2d4ab42708fcd3102ea54bdb6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:54.598397 1193 rpcz_store.cc:276] 0616 19:51:53.261782 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:53.261858 (+ 76us) service_pool.cc:224] Handling call
0616 19:51:54.598135 (+1336277us) ts_tablet_manager.cc:1151] Deleting tablet 19832d0517524c0facf1f97486b1e58e
0616 19:51:54.598143 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.598250 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1314210}
I20260616 19:51:54.598728 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 151) took 1160 ms. Trace:
I20260616 19:51:54.598845 1193 rpcz_store.cc:276] 0616 19:51:53.438423 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:53.438684 (+ 261us) service_pool.cc:224] Handling call
0616 19:51:54.598609 (+1159925us) ts_tablet_manager.cc:1151] Deleting tablet c557049a020a4b318bb6e8a53710a6cc
0616 19:51:54.598617 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.598691 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159709}
I20260616 19:51:54.599201 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 158) took 1009 ms. Trace:
I20260616 19:51:54.599315 1193 rpcz_store.cc:276] 0616 19:51:53.590095 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:53.590145 (+ 50us) service_pool.cc:224] Handling call
0616 19:51:54.599041 (+1008896us) ts_tablet_manager.cc:1151] Deleting tablet a93dd295602840319f72e7021ddfd61a
0616 19:51:54.599049 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:54.599163 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1008703}
I20260616 19:51:54.599483 1190 tablet_replica.cc:333] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:54.599673 1190 raft_consensus.cc:2243] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.599815 1190 raft_consensus.cc:2272] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.600008 1193 tablet_replica.cc:333] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:54.600236 1193 raft_consensus.cc:2243] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:54.600755 1190 ts_tablet_manager.cc:1916] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.604104 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 543ef0fcac3d47928c5dd1d13f9aba92 (table default.Table_5ad3a183f911465da5f24ce69f9d6256 [id=91705098b83a4cbd80112158f1b82022]) successfully deleted
I20260616 19:51:54.582332 1417 tablet.cc:1724] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260616 19:51:54.604533 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 5af9bdceae184f8dbb9e5db67a11ee63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5af9bdceae184f8dbb9e5db67a11ee63 already in progress: creating tablet
I20260616 19:51:54.583043 1412 mvcc.cc:204] Tried to move back new op lower bound from 7297595451635408896 to 7297595449994428416. Current Snapshot: MvccSnapshot[applied={T|T < 7297595451635408896}]
I20260616 19:51:54.586361 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 73a754c728b5408eb47f91de93554ec5 (DEFAULT_TABLE table=default.Table_5f98dbc56e0e44ba93e5e67cb2a74652 [id=c6d68b5708374d73be79937542dc39a4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:54.604754 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d3645fc39d974bffa8fe52c62e1c7eff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3645fc39d974bffa8fe52c62e1c7eff already in progress: creating tablet
I20260616 19:51:54.604969 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a754c728b5408eb47f91de93554ec5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:54.604959 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2cfb2238cbdb421a8f5001dc729e9bb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cfb2238cbdb421a8f5001dc729e9bb5 already in progress: creating tablet
W20260616 19:51:54.605156 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet eac603a84d3c4f96bd444c54f28d278d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eac603a84d3c4f96bd444c54f28d278d already in progress: creating tablet
W20260616 19:51:54.605441 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 19832d0517524c0facf1f97486b1e58e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19832d0517524c0facf1f97486b1e58e already in progress: creating tablet
W20260616 19:51:54.605643 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c557049a020a4b318bb6e8a53710a6cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c557049a020a4b318bb6e8a53710a6cc already in progress: creating tablet
W20260616 19:51:54.605834 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a93dd295602840319f72e7021ddfd61a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a93dd295602840319f72e7021ddfd61a already in progress: creating tablet
W20260616 19:51:54.606007 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 350453721d13427a946ac5c5ee7c62a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 350453721d13427a946ac5c5ee7c62a0 already in progress: creating tablet
W20260616 19:51:54.606209 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet b99740ab59f947aabcac88dc2bf2de86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b99740ab59f947aabcac88dc2bf2de86 already in progress: creating tablet
I20260616 19:51:54.587981 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3f47e767764032ae5a06e34e2de248 (DEFAULT_TABLE table=default.Table_1bfaf142b33c42df9480c0fd9ec9b5ea [id=af4aada43ecf46b8bacf0d9d1388e92e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:54.606395 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c44422ddb8ce45a48bb9aaeb6c209f21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c44422ddb8ce45a48bb9aaeb6c209f21 already in progress: creating tablet
W20260616 19:51:54.606603 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d61873c8aa094d7f899a61307a36f895 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d61873c8aa094d7f899a61307a36f895 already in progress: creating tablet
I20260616 19:51:54.606688 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3f47e767764032ae5a06e34e2de248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.609575 891 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3f47e767764032ae5a06e34e2de248 (DEFAULT_TABLE table=default.Table_1bfaf142b33c42df9480c0fd9ec9b5ea [id=af4aada43ecf46b8bacf0d9d1388e92e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.588994 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 31592a5ffb04429c9315a4fd72308f28 (DEFAULT_TABLE table=default.Table_6a6d8516df114593b27d86140407b724 [id=d104c5ac8acc4a6f9ed7cc87879d661b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.610287 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31592a5ffb04429c9315a4fd72308f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.592669 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba2eefdfed14791b5a41decc34dce44 (DEFAULT_TABLE table=default.Table_1a330c132b3f4982b52e492c2ded8be7 [id=975461e7d8954e8fbe998142fb2783e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.610453 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet bb2fdea2d4ab42708fcd3102ea54bdb6 (table default.Table_baf21e2369ea4aa6aa6cbf2370be11b9 [id=bb9e8ac09e824ad58ba1ce8f021968a1]) successfully deleted
I20260616 19:51:54.610697 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba2eefdfed14791b5a41decc34dce44. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:54.610740 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 815d213bf1904353b4f0b2e2f8954db9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 815d213bf1904353b4f0b2e2f8954db9 already in progress: creating tablet
W20260616 19:51:54.610952 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 39f52eebdc79460a9ff33191086e87c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39f52eebdc79460a9ff33191086e87c6 already in progress: creating tablet
W20260616 19:51:54.611155 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 362e7ff9bea3459ca018d1a7febb2ce4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 362e7ff9bea3459ca018d1a7febb2ce4 already in progress: creating tablet
W20260616 19:51:54.611333 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 8125dce4d32a416498b42a1b599355fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8125dce4d32a416498b42a1b599355fd already in progress: creating tablet
I20260616 19:51:54.584522 1416 tablet.cc:1724] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:51:54.618417 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ce91ab4603cc400d94cf6e1fcfe99048" } modify_external_catalogs: true
I20260616 19:51:54.618620 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ce91ab4603cc400d94cf6e1fcfe99048" } modify_external_catalogs: true
I20260616 19:51:54.583525 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eab5bd3967c42e1b6b79558df742946 with delete_type TABLET_DATA_DELETED (replaced by tablet 65b0dc43b40649f29037f40d2ea9247e) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.619726 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 79250767a94141cd900a9715e86128b8 (DEFAULT_TABLE table=default.Table_cfe1476b261844838747bb5597d50449 [id=4fdd38d3f8d747b0b6181ee77db8e90a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.620213 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79250767a94141cd900a9715e86128b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.626878 1198 tablet_bootstrap.cc:492] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:54.627046 1198 ts_tablet_manager.cc:1403] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.254s user 0.032s sys 0.036s
I20260616 19:51:54.628414 1198 raft_consensus.cc:359] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.628638 1198 raft_consensus.cc:385] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.628748 1198 raft_consensus.cc:740] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.628984 1198 consensus_queue.cc:260] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.629300 454 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_15c5a7f0c53c48069560560950206199 [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 5 got 0
I20260616 19:51:54.630851 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3f47e767764032ae5a06e34e2de248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.631423 1198 ts_tablet_manager.cc:1434] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260616 19:51:54.607769 756 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba2eefdfed14791b5a41decc34dce44 (DEFAULT_TABLE table=default.Table_1a330c132b3f4982b52e492c2ded8be7 [id=975461e7d8954e8fbe998142fb2783e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.633826 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba2eefdfed14791b5a41decc34dce44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.635881 904 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba2eefdfed14791b5a41decc34dce44 (DEFAULT_TABLE table=default.Table_1a330c132b3f4982b52e492c2ded8be7 [id=975461e7d8954e8fbe998142fb2783e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.636286 889 tablet_service.cc:1511] Processing CreateTablet for tablet 79250767a94141cd900a9715e86128b8 (DEFAULT_TABLE table=default.Table_cfe1476b261844838747bb5597d50449 [id=4fdd38d3f8d747b0b6181ee77db8e90a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.637521 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 662e2d573bd7489a81697c17393ce088
I20260616 19:51:54.638304 459 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 2374c740a25442debce55e9d5309f79e
I20260616 19:51:54.615823 762 tablet_service.cc:1511] Processing CreateTablet for tablet 73a754c728b5408eb47f91de93554ec5 (DEFAULT_TABLE table=default.Table_5f98dbc56e0e44ba93e5e67cb2a74652 [id=c6d68b5708374d73be79937542dc39a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.640928 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a754c728b5408eb47f91de93554ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.641650 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 662e2d573bd7489a81697c17393ce088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.643425 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 13e4e52fae124d4085b15e143e98a7e4
I20260616 19:51:54.616775 1196 tablet_bootstrap.cc:492] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:54.644410 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 13e4e52fae124d4085b15e143e98a7e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:54.646593 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 13e4e52fae124d4085b15e143e98a7e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13e4e52fae124d4085b15e143e98a7e4 already in progress: creating tablet
I20260616 19:51:54.647270 1196 tablet_bootstrap.cc:654] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.647358 888 tablet_service.cc:1511] Processing CreateTablet for tablet 31592a5ffb04429c9315a4fd72308f28 (DEFAULT_TABLE table=default.Table_6a6d8516df114593b27d86140407b724 [id=d104c5ac8acc4a6f9ed7cc87879d661b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.647778 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba2eefdfed14791b5a41decc34dce44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.600457 1193 pending_rounds.cc:70] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:51:54.649469 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 13e4e52fae124d4085b15e143e98a7e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.649540 1193 pending_rounds.cc:77] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595447893184512 op_type: NO_OP noop_request { }
I20260616 19:51:54.649644 1193 raft_consensus.cc:2889] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:54.649753 1193 raft_consensus.cc:2272] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.652853 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31592a5ffb04429c9315a4fd72308f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.655792 1205 raft_consensus.cc:493] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:54.655942 1205 raft_consensus.cc:515] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.656641 1205 leader_election.cc:290] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:54.657135 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79250767a94141cd900a9715e86128b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.657759 1198 tablet_bootstrap.cc:492] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:54.657963 750 tablet_service.cc:1511] Processing CreateTablet for tablet 79250767a94141cd900a9715e86128b8 (DEFAULT_TABLE table=default.Table_cfe1476b261844838747bb5597d50449 [id=4fdd38d3f8d747b0b6181ee77db8e90a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.658416 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79250767a94141cd900a9715e86128b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.659418 1198 tablet_bootstrap.cc:654] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:54.662317 719 leader_election.cc:343] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: fcfc9231ffeb487cb15ed2a3788730ba
W20260616 19:51:54.663265 718 leader_election.cc:343] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: fcfc9231ffeb487cb15ed2a3788730ba
I20260616 19:51:54.663403 718 leader_election.cc:304] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:54.663791 1205 raft_consensus.cc:2749] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:54.671777 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 662e2d573bd7489a81697c17393ce088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.672065 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f2c392b2fecd483d9da12e30e37f27ad
I20260616 19:51:54.674679 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6cb59d68dcc344deae0b9679df0f26d9" } new_table_name: "default.Table_263c9f8e2f2d4434a68825691c83d219" modify_external_catalogs: true
I20260616 19:51:54.676491 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1a330c132b3f4982b52e492c2ded8be7" } modify_external_catalogs: true
I20260616 19:51:54.676673 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1a330c132b3f4982b52e492c2ded8be7" } modify_external_catalogs: true
I20260616 19:51:54.677053 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4635b5a6e60140b9acd169b569531ffd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:54.677235 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 13e4e52fae124d4085b15e143e98a7e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.674324 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 662e2d573bd7489a81697c17393ce088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.678052 901 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c392b2fecd483d9da12e30e37f27ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.678747 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c392b2fecd483d9da12e30e37f27ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.681798 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_216bb84e91f64d85be3ccce61831e74b" } new_table_name: "default.Table_4aa7825edd6a4e318e83e87f1fde10cb" modify_external_catalogs: true
W20260616 19:51:54.682472 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4635b5a6e60140b9acd169b569531ffd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:54.684551 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e8160ad4cf74f16a586ae59291ce7d1 has no consensus state
I20260616 19:51:54.685305 761 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c392b2fecd483d9da12e30e37f27ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:54.685750 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 662e2d573bd7489a81697c17393ce088 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 662e2d573bd7489a81697c17393ce088 already in progress: creating tablet
W20260616 19:51:54.686043 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet f2c392b2fecd483d9da12e30e37f27ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2c392b2fecd483d9da12e30e37f27ad already in progress: creating tablet
W20260616 19:51:54.688030 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 59812b232848488b9894e8f8057e9def (table default.Table_81d2820218034bf0a04d2480e6bd8b43 [id=1beb7d130df7492ab9b834d005eba63a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 59812b232848488b9894e8f8057e9def consensus state has no leader
I20260616 19:51:54.688207 903 tablet_service.cc:1511] Processing CreateTablet for tablet 73a754c728b5408eb47f91de93554ec5 (DEFAULT_TABLE table=default.Table_5f98dbc56e0e44ba93e5e67cb2a74652 [id=c6d68b5708374d73be79937542dc39a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.688194 1416 tablet.cc:1724] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260616 19:51:54.688670 1418 tablet.cc:1724] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260616 19:51:54.690840 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a754c728b5408eb47f91de93554ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.700068 1193 ts_tablet_manager.cc:1916] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.701776 1192 tablet_bootstrap.cc:492] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:54.702396 1192 ts_tablet_manager.cc:1403] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.122s user 0.006s sys 0.032s
I20260616 19:51:54.704811 1192 raft_consensus.cc:359] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.707053 1192 raft_consensus.cc:385] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.707208 1192 raft_consensus.cc:740] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
W20260616 19:51:54.707908 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 17029c1ba36644e9847200b54bf9094c has no consensus state
I20260616 19:51:54.707554 1192 consensus_queue.cc:260] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.708684 1192 ts_tablet_manager.cc:1434] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260616 19:51:54.717262 456 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet da380823d0ae437d9f1d9d0f633f74bb (table default.Table_fdb76eb70534433eae79f807fd35fb90 [id=46c822de2dc2471d847af2e018102efc]). Expected version 2 got 0
I20260616 19:51:54.717504 456 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_15c5a7f0c53c48069560560950206199 [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 5 got 4
I20260616 19:51:54.717554 1040 tablet_service.cc:1511] Processing CreateTablet for tablet d9c664f0386549d6867c407526ee45a0 (DEFAULT_TABLE table=default.Table_88815cb77f064a7d8c61564f6fe9458f [id=0cc25e520828404183490059b522eefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.718051 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c664f0386549d6867c407526ee45a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.718353 1036 tablet_service.cc:1511] Processing CreateTablet for tablet df036f9d31ca4770bb00bc9cece46953 (DEFAULT_TABLE table=default.Table_654e346141624d0d878221b2ef96cb83 [id=548cacd5de984fa89aa96b1c659f9e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.719216 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df036f9d31ca4770bb00bc9cece46953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.719205 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_15c5a7f0c53c48069560560950206199 [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 5 got 4
I20260616 19:51:54.720810 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 76d73be228664063822c41cbefafcab8 (DEFAULT_TABLE table=default.Table_5a41286216274f998881eb155b57e7c8 [id=946fd4fcf5f244acafa1e82743e70af2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.721125 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_15c5a7f0c53c48069560560950206199 [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 5 got 0
I20260616 19:51:54.721199 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d73be228664063822c41cbefafcab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.721472 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd6fa49eff4400ca40c722e18cea951 (DEFAULT_TABLE table=default.Table_ae1d446a11f34a77bd9bcdafbef99127 [id=b401e2a905f842579b3b60e5d20815aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.721860 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd6fa49eff4400ca40c722e18cea951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.721895 1192 tablet_bootstrap.cc:492] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:54.724256 1192 tablet_bootstrap.cc:654] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.724781 1030 tablet_service.cc:1511] Processing CreateTablet for tablet e91c377ae66441268351cd3592aa9dbc (DEFAULT_TABLE table=default.Table_44015174890646ee876b8d08923fc342 [id=0bc90fd55c8e4d5b8ac18717e00cea54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.725158 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91c377ae66441268351cd3592aa9dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.729077 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 1d80d9028184443da49623228259263d (DEFAULT_TABLE table=default.Table_774101ee38e441449f023f43612d6621 [id=cd27259f954043f8b50d2bb5788f1ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.729180 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 5029a79e046a489aa9976eff948a3c5b (DEFAULT_TABLE table=default.Table_f4b949adef834904a68e4b48dd6561cb [id=7f01acd67fa942bfb14744f0851047e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.729470 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d80d9028184443da49623228259263d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.732812 1032 tablet_service.cc:1511] Processing CreateTablet for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b (DEFAULT_TABLE table=default.Table_640a7f020c4044efad09aec2444b0b6e [id=f37d0e612ff74a31842cf47ec47beb3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.733214 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.733618 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5029a79e046a489aa9976eff948a3c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.736083 456 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44] alter complete (version 1)
I20260616 19:51:54.736147 1198 tablet_bootstrap.cc:492] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:54.736713 1198 ts_tablet_manager.cc:1403] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.079s user 0.002s sys 0.001s
I20260616 19:51:54.736970 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 5ba2eefdfed14791b5a41decc34dce44
I20260616 19:51:54.737253 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 9d800b4e2c2d42279c102e4e061f5530 (DEFAULT_TABLE table=default.Table_02b5fcd9202443e28e603c3a9998ff94 [id=444a660aa02c4f17a70407bd7d57b590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.737643 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d800b4e2c2d42279c102e4e061f5530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.738080 904 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd6fa49eff4400ca40c722e18cea951 (DEFAULT_TABLE table=default.Table_ae1d446a11f34a77bd9bcdafbef99127 [id=b401e2a905f842579b3b60e5d20815aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.738173 901 tablet_service.cc:1511] Processing CreateTablet for tablet 5029a79e046a489aa9976eff948a3c5b (DEFAULT_TABLE table=default.Table_f4b949adef834904a68e4b48dd6561cb [id=7f01acd67fa942bfb14744f0851047e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.738569 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd6fa49eff4400ca40c722e18cea951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.739121 888 tablet_service.cc:1511] Processing CreateTablet for tablet df036f9d31ca4770bb00bc9cece46953 (DEFAULT_TABLE table=default.Table_654e346141624d0d878221b2ef96cb83 [id=548cacd5de984fa89aa96b1c659f9e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.739488 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df036f9d31ca4770bb00bc9cece46953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.739789 900 tablet_service.cc:1511] Processing CreateTablet for tablet 1d80d9028184443da49623228259263d (DEFAULT_TABLE table=default.Table_774101ee38e441449f023f43612d6621 [id=cd27259f954043f8b50d2bb5788f1ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.740195 898 tablet_service.cc:1511] Processing CreateTablet for tablet 9d800b4e2c2d42279c102e4e061f5530 (DEFAULT_TABLE table=default.Table_02b5fcd9202443e28e603c3a9998ff94 [id=444a660aa02c4f17a70407bd7d57b590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.740217 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d80d9028184443da49623228259263d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.744830 453 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_15c5a7f0c53c48069560560950206199 [id=e75a6e5e4f0047d9b398ce230b170131] alter complete (version 5)
I20260616 19:51:54.750473 1198 raft_consensus.cc:359] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.751282 453 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet da380823d0ae437d9f1d9d0f633f74bb (table default.Table_fdb76eb70534433eae79f807fd35fb90 [id=46c822de2dc2471d847af2e018102efc]). Expected version 2 got 0
I20260616 19:51:54.753497 750 tablet_service.cc:1511] Processing CreateTablet for tablet df036f9d31ca4770bb00bc9cece46953 (DEFAULT_TABLE table=default.Table_654e346141624d0d878221b2ef96cb83 [id=548cacd5de984fa89aa96b1c659f9e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.753772 1193 ts_tablet_manager.cc:1929] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:54.753928 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df036f9d31ca4770bb00bc9cece46953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.754217 752 tablet_service.cc:1511] Processing CreateTablet for tablet 1d80d9028184443da49623228259263d (DEFAULT_TABLE table=default.Table_774101ee38e441449f023f43612d6621 [id=cd27259f954043f8b50d2bb5788f1ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.754598 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d80d9028184443da49623228259263d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.755505 751 tablet_service.cc:1511] Processing CreateTablet for tablet 76d73be228664063822c41cbefafcab8 (DEFAULT_TABLE table=default.Table_5a41286216274f998881eb155b57e7c8 [id=946fd4fcf5f244acafa1e82743e70af2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.755934 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d73be228664063822c41cbefafcab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.756417 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5029a79e046a489aa9976eff948a3c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.756659 891 tablet_service.cc:1511] Processing CreateTablet for tablet d9c664f0386549d6867c407526ee45a0 (DEFAULT_TABLE table=default.Table_88815cb77f064a7d8c61564f6fe9458f [id=0cc25e520828404183490059b522eefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.754216 756 tablet_service.cc:1511] Processing CreateTablet for tablet 5029a79e046a489aa9976eff948a3c5b (DEFAULT_TABLE table=default.Table_f4b949adef834904a68e4b48dd6561cb [id=7f01acd67fa942bfb14744f0851047e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.758991 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 44493f0ffd064249a28628cf24895395 (DEFAULT_TABLE table=default.Table_718b661372f441feb171907daff44e2d [id=a5404ca6c40f44b8b881ef582d703fd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.759047 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 543ef0fcac3d47928c5dd1d13f9aba92 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:54.759368 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44493f0ffd064249a28628cf24895395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.759305 763 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd6fa49eff4400ca40c722e18cea951 (DEFAULT_TABLE table=default.Table_ae1d446a11f34a77bd9bcdafbef99127 [id=b401e2a905f842579b3b60e5d20815aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.759644 1037 tablet_service.cc:1511] Processing CreateTablet for tablet d270afd0c0f3457aa6dd14721dca261d (DEFAULT_TABLE table=default.Table_1b580eacc19b47f295938666dc9783fb [id=014e024d22a94b42b4e61fac211f07e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.760697 453 master_service.cc:960] ReplaceTablet: received request to replace tablet eb024637294148c18b74bef47fb2fcce from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:54.763679 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d270afd0c0f3457aa6dd14721dca261d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.765630 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc988a195ec4bbf8691801421fed8bb (DEFAULT_TABLE table=default.Table_097cc1cefc2845c9811c04a380239f0d [id=94c69bbe02ab4591b12325de17d718be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.768806 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ba2eefdfed14791b5a41decc34dce44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.769101 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet eb024637294148c18b74bef47fb2fcce
I20260616 19:51:54.769796 453 catalog_manager.cc:6784] ReplaceTablet: tablet eb024637294148c18b74bef47fb2fcce deleted and replaced by tablet 64aa32856ca34743933931fb51f2bd7b
I20260616 19:51:54.770123 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 65b0dc43b40649f29037f40d2ea9247e (DEFAULT_TABLE table=default.Table_8fff86d5c2344e2fb59db9872ee90b74 [id=06f5d602dcec42a884b5eb53f9d0a27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.771413 890 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc988a195ec4bbf8691801421fed8bb (DEFAULT_TABLE table=default.Table_097cc1cefc2845c9811c04a380239f0d [id=94c69bbe02ab4591b12325de17d718be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.771615 892 tablet_service.cc:1511] Processing CreateTablet for tablet 44493f0ffd064249a28628cf24895395 (DEFAULT_TABLE table=default.Table_718b661372f441feb171907daff44e2d [id=a5404ca6c40f44b8b881ef582d703fd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.771667 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 4be902fe29bb46a4bf71ee6384e6722a (DEFAULT_TABLE table=default.Table_7f7b6caef24d427986f0670e307a057a [id=1da8c69819444e57b8c96d27abb2b4bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.771956 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 19b9248b88434a6e9ef7a3d602eee70c (DEFAULT_TABLE table=default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4 [id=7c1cbcd4d250459cba3590b94f9c8519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.757284 894 tablet_service.cc:1511] Processing CreateTablet for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b (DEFAULT_TABLE table=default.Table_640a7f020c4044efad09aec2444b0b6e [id=f37d0e612ff74a31842cf47ec47beb3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.753938 1193 log.cc:1199] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/4e37f42ce8ec47fca1cf8aa75bc0202d
I20260616 19:51:54.772876 889 tablet_service.cc:1511] Processing CreateTablet for tablet 76d73be228664063822c41cbefafcab8 (DEFAULT_TABLE table=default.Table_5a41286216274f998881eb155b57e7c8 [id=946fd4fcf5f244acafa1e82743e70af2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.773849 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c664f0386549d6867c407526ee45a0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:54.773849 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 5ba2eefdfed14791b5a41decc34dce44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ba2eefdfed14791b5a41decc34dce44 already in progress: creating tablet
I20260616 19:51:54.774470 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet eb024637294148c18b74bef47fb2fcce with delete_type TABLET_DATA_DELETED (replaced by tablet 64aa32856ca34743933931fb51f2bd7b) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.775012 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc988a195ec4bbf8691801421fed8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.775081 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44493f0ffd064249a28628cf24895395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.775451 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be902fe29bb46a4bf71ee6384e6722a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.775892 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.776520 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6813dd9e1dba43d2adf02fa586cb4c8f" } new_table_name: "default.Table_a5a8fee8fc214408ae98d4e88d6f66a5" modify_external_catalogs: true
I20260616 19:51:54.776947 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65b0dc43b40649f29037f40d2ea9247e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.778973 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b9248b88434a6e9ef7a3d602eee70c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:54.780642 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet eb024637294148c18b74bef47fb2fcce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb024637294148c18b74bef47fb2fcce already in progress: creating tablet
I20260616 19:51:54.781353 1027 tablet_service.cc:1511] Processing CreateTablet for tablet cf136fa86c264f69a1703596cfd0e77a (DEFAULT_TABLE table=default.Table_08d577b7b19b4304839ef1e907e17551 [id=6cd87cc1155f42719f9c324c487799ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.781565 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d800b4e2c2d42279c102e4e061f5530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.781836 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf136fa86c264f69a1703596cfd0e77a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:54.782974 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5741b92cafb4d53987dbeeef66ccd56 consensus state has no leader
I20260616 19:51:54.782965 1198 raft_consensus.cc:385] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.783185 1198 raft_consensus.cc:740] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.783973 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_689c1eb2c3714d7993014cee1e5c4258"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:54.784011 1198 consensus_queue.cc:260] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.786131 1198 ts_tablet_manager.cc:1434] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.049s user 0.002s sys 0.000s
I20260616 19:51:54.786523 1198 tablet_bootstrap.cc:492] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:51:54.788668 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_689c1eb2c3714d7993014cee1e5c4258 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.790126 1198 tablet_bootstrap.cc:654] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.791388 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:54.792104 1191 tablet_replica.cc:333] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:54.792282 1191 raft_consensus.cc:2243] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.792480 1191 raft_consensus.cc:2272] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.793162 1191 ts_tablet_manager.cc:1916] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.796659 902 tablet_service.cc:1511] Processing CreateTablet for tablet d270afd0c0f3457aa6dd14721dca261d (DEFAULT_TABLE table=default.Table_1b580eacc19b47f295938666dc9783fb [id=014e024d22a94b42b4e61fac211f07e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.796893 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d73be228664063822c41cbefafcab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.797703 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc988a195ec4bbf8691801421fed8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.799278 760 tablet_service.cc:1511] Processing CreateTablet for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b (DEFAULT_TABLE table=default.Table_640a7f020c4044efad09aec2444b0b6e [id=f37d0e612ff74a31842cf47ec47beb3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.799695 762 tablet_service.cc:1511] Processing CreateTablet for tablet d9c664f0386549d6867c407526ee45a0 (DEFAULT_TABLE table=default.Table_88815cb77f064a7d8c61564f6fe9458f [id=0cc25e520828404183490059b522eefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.800611 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_be8da347321a4279a4ad9123e4ea7b48" } new_table_name: "default.Table_e2ea805b6664428787f4a70953fd22ea" modify_external_catalogs: true
I20260616 19:51:54.801996 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_940a8144c5014fc9b2fcb74257f85d89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.802502 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_940a8144c5014fc9b2fcb74257f85d89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.803620 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_60ef6fc2bcf94a838594d3da8ec82c32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.804083 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60ef6fc2bcf94a838594d3da8ec82c32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.806416 895 tablet_service.cc:1511] Processing CreateTablet for tablet 65b0dc43b40649f29037f40d2ea9247e (DEFAULT_TABLE table=default.Table_8fff86d5c2344e2fb59db9872ee90b74 [id=06f5d602dcec42a884b5eb53f9d0a27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.806880 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65b0dc43b40649f29037f40d2ea9247e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.809235 761 tablet_service.cc:1511] Processing CreateTablet for tablet e91c377ae66441268351cd3592aa9dbc (DEFAULT_TABLE table=default.Table_44015174890646ee876b8d08923fc342 [id=0bc90fd55c8e4d5b8ac18717e00cea54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.810868 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5029a79e046a489aa9976eff948a3c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.814406 758 tablet_service.cc:1511] Processing CreateTablet for tablet 44493f0ffd064249a28628cf24895395 (DEFAULT_TABLE table=default.Table_718b661372f441feb171907daff44e2d [id=a5404ca6c40f44b8b881ef582d703fd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.814704 755 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc988a195ec4bbf8691801421fed8bb (DEFAULT_TABLE table=default.Table_097cc1cefc2845c9811c04a380239f0d [id=94c69bbe02ab4591b12325de17d718be]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:54.814954 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d368ec65b624ea58f7b750097a78ede consensus state has no leader
I20260616 19:51:54.815765 1035 tablet_service.cc:1511] Processing CreateTablet for tablet fbb308b05bb04bc18ccaa9550a73d3e7 (DEFAULT_TABLE table=default.Table_3ebb67c879364b8eac6a40f80d97a6eb [id=4ac9b907f9cf42478b9591bce31ccbcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.816097 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb308b05bb04bc18ccaa9550a73d3e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.816543 765 tablet_service.cc:1511] Processing CreateTablet for tablet 9d800b4e2c2d42279c102e4e061f5530 (DEFAULT_TABLE table=default.Table_02b5fcd9202443e28e603c3a9998ff94 [id=444a660aa02c4f17a70407bd7d57b590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.822050 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91c377ae66441268351cd3592aa9dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.823941 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44493f0ffd064249a28628cf24895395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.825670 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc988a195ec4bbf8691801421fed8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.826423 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d800b4e2c2d42279c102e4e061f5530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.827178 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd6fa49eff4400ca40c722e18cea951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.827818 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.828044 1205 raft_consensus.cc:493] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:54.828729 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c664f0386549d6867c407526ee45a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.830817 759 tablet_service.cc:1511] Processing CreateTablet for tablet d270afd0c0f3457aa6dd14721dca261d (DEFAULT_TABLE table=default.Table_1b580eacc19b47f295938666dc9783fb [id=014e024d22a94b42b4e61fac211f07e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.831221 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d270afd0c0f3457aa6dd14721dca261d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.834864 764 tablet_service.cc:1511] Processing CreateTablet for tablet 19b9248b88434a6e9ef7a3d602eee70c (DEFAULT_TABLE table=default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4 [id=7c1cbcd4d250459cba3590b94f9c8519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.835078 753 tablet_service.cc:1511] Processing CreateTablet for tablet 65b0dc43b40649f29037f40d2ea9247e (DEFAULT_TABLE table=default.Table_8fff86d5c2344e2fb59db9872ee90b74 [id=06f5d602dcec42a884b5eb53f9d0a27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.835270 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b9248b88434a6e9ef7a3d602eee70c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.835649 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65b0dc43b40649f29037f40d2ea9247e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.834570 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_190bf8f13ab249eabed966a7a32bc222"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.836342 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_190bf8f13ab249eabed966a7a32bc222 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.835242 757 tablet_service.cc:1558] Processing DeleteTablet for tablet eb024637294148c18b74bef47fb2fcce with delete_type TABLET_DATA_DELETED (replaced by tablet 64aa32856ca34743933931fb51f2bd7b) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.836828 757 tablet_service.cc:1511] Processing CreateTablet for tablet 9060de590fa84ea08dc7d39765bc9308 (DEFAULT_TABLE table=default.Table_7713a34d9f7e4031a42f66ee98382545 [id=6f77a88fd07a47cfbef0a061968dda5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.836967 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ba2eefdfed14791b5a41decc34dce44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:54.837349 754 tablet_service.cc:1511] Processing CreateTablet for tablet 1e8160ad4cf74f16a586ae59291ce7d1 (DEFAULT_TABLE table=default.Table_263c9f8e2f2d4434a68825691c83d219 [id=23f3d793560846b7a0701ec470588cbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.837927 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e8160ad4cf74f16a586ae59291ce7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.838716 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1b580eacc19b47f295938666dc9783fb" } new_table_name: "default.Table_ea860bf78ecb48ebb09d584767ab3f41" modify_external_catalogs: true
I20260616 19:51:54.845451 1193 ts_tablet_manager.cc:1950] T 4e37f42ce8ec47fca1cf8aa75bc0202d P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:54.846544 1193 tablet_replica.cc:333] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:54.846808 1193 raft_consensus.cc:2243] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:54.846915 1191 ts_tablet_manager.cc:1929] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:54.847082 1193 raft_consensus.cc:2272] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:54.847702 1193 ts_tablet_manager.cc:1916] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:54.848042 1191 log.cc:1199] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/de0ea6ca79ff4ed09f63fc7bb98eaabd
I20260616 19:51:54.848655 1191 ts_tablet_manager.cc:1950] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:54.848886 1402 raft_consensus.cc:493] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:54.849234 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 4e37f42ce8ec47fca1cf8aa75bc0202d (table default.Table_6a6d8516df114593b27d86140407b724 [id=d104c5ac8acc4a6f9ed7cc87879d661b]) successfully deleted
W20260616 19:51:54.855741 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d270afd0c0f3457aa6dd14721dca261d consensus state has no leader
I20260616 19:51:54.857411 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d270afd0c0f3457aa6dd14721dca261d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.858493 903 tablet_service.cc:1511] Processing CreateTablet for tablet e91c377ae66441268351cd3592aa9dbc (DEFAULT_TABLE table=default.Table_44015174890646ee876b8d08923fc342 [id=0bc90fd55c8e4d5b8ac18717e00cea54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.858966 1402 raft_consensus.cc:515] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.859776 1402 leader_election.cc:290] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:54.860711 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d916b2f553ce41df8934e1190fa32120" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:54.861325 860 leader_election.cc:343] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:54.862300 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ba2eefdfed14791b5a41decc34dce44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.864708 897 tablet_service.cc:1511] Processing CreateTablet for tablet 19b9248b88434a6e9ef7a3d602eee70c (DEFAULT_TABLE table=default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4 [id=7c1cbcd4d250459cba3590b94f9c8519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.828186 1205 raft_consensus.cc:515] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.866866 1205 leader_election.cc:290] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:54.871379 896 tablet_service.cc:1511] Processing CreateTablet for tablet 4be902fe29bb46a4bf71ee6384e6722a (DEFAULT_TABLE table=default.Table_7f7b6caef24d427986f0670e307a057a [id=1da8c69819444e57b8c96d27abb2b4bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.874471 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ea860bf78ecb48ebb09d584767ab3f41" } modify_external_catalogs: true
I20260616 19:51:54.875116 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_78964cf02d6e4b94be59a534e00ada50" } modify_external_catalogs: true
I20260616 19:51:54.875316 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_78964cf02d6e4b94be59a534e00ada50" } modify_external_catalogs: true
I20260616 19:51:54.874890 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ea860bf78ecb48ebb09d584767ab3f41" } modify_external_catalogs: true
I20260616 19:51:54.876458 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91c377ae66441268351cd3592aa9dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.878659 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9a89b6471d8c42e594c15f43327d9572"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:54.878700 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0af20b58e7f64f62b763c0f583c1d43e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.879287 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0af20b58e7f64f62b763c0f583c1d43e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.879513 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3fde6faf0f8549f69328d3129ad9f367"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.879978 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fde6faf0f8549f69328d3129ad9f367 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.880363 748 tablet_service.cc:1511] Processing CreateTablet for tablet cf136fa86c264f69a1703596cfd0e77a (DEFAULT_TABLE table=default.Table_08d577b7b19b4304839ef1e907e17551 [id=6cd87cc1155f42719f9c324c487799ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.880591 749 tablet_service.cc:1511] Processing CreateTablet for tablet 4be902fe29bb46a4bf71ee6384e6722a (DEFAULT_TABLE table=default.Table_7f7b6caef24d427986f0670e307a057a [id=1da8c69819444e57b8c96d27abb2b4bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.881053 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf136fa86c264f69a1703596cfd0e77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.881340 747 tablet_service.cc:1511] Processing CreateTablet for tablet fbb308b05bb04bc18ccaa9550a73d3e7 (DEFAULT_TABLE table=default.Table_3ebb67c879364b8eac6a40f80d97a6eb [id=4ac9b907f9cf42478b9591bce31ccbcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.881899 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb308b05bb04bc18ccaa9550a73d3e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.885239 746 tablet_service.cc:1511] Processing CreateTablet for tablet ca5dc1e6cde347fc9a34e555385dc646 (DEFAULT_TABLE table=default.Table_a8aa8e529ab0432d9abaf953a3aa73cf [id=d37e43e64c414245a12d2a86ebcbc24b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.885727 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca5dc1e6cde347fc9a34e555385dc646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.886571 899 tablet_service.cc:1558] Processing DeleteTablet for tablet eb024637294148c18b74bef47fb2fcce with delete_type TABLET_DATA_DELETED (replaced by tablet 64aa32856ca34743933931fb51f2bd7b) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:54.886737 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be902fe29bb46a4bf71ee6384e6722a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.887655 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_647cdefd19814321b51ee0898effc29c" } modify_external_catalogs: true
I20260616 19:51:54.887862 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_647cdefd19814321b51ee0898effc29c" } modify_external_catalogs: true
I20260616 19:51:54.888671 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_689c1eb2c3714d7993014cee1e5c4258" } new_table_name: "default.Table_2476a078d16f4862bceb42e0e78e1495" modify_external_catalogs: true
I20260616 19:51:54.889097 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e2ea805b6664428787f4a70953fd22ea" } modify_external_catalogs: true
I20260616 19:51:54.889250 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e2ea805b6664428787f4a70953fd22ea" } modify_external_catalogs: true
I20260616 19:51:54.889695 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8dbc007d3ffb483d8f4ca4fefdde8a2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.890187 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dbc007d3ffb483d8f4ca4fefdde8a2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.879324 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9e4be7ef0c8d47f18765df6682984b16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:54.891573 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e4be7ef0c8d47f18765df6682984b16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.893144 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be902fe29bb46a4bf71ee6384e6722a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.893472 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b9248b88434a6e9ef7a3d602eee70c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:54.879283 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a89b6471d8c42e594c15f43327d9572 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:54.901510 899 tablet_service.cc:1511] Processing CreateTablet for tablet cf136fa86c264f69a1703596cfd0e77a (DEFAULT_TABLE table=default.Table_08d577b7b19b4304839ef1e907e17551 [id=6cd87cc1155f42719f9c324c487799ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.901955 751 tablet_service.cc:1511] Processing CreateTablet for tablet cbd1070277a14fd98af5fa45925e4f0f (DEFAULT_TABLE table=default.Table_60ef6fc2bcf94a838594d3da8ec82c32 [id=72296d61a39e47389db261a68e679483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.902336 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd1070277a14fd98af5fa45925e4f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.902352 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf136fa86c264f69a1703596cfd0e77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.902529 1419 tablet.cc:1724] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:51:54.904733 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9060de590fa84ea08dc7d39765bc9308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.905081 750 tablet_service.cc:1511] Processing CreateTablet for tablet 17029c1ba36644e9847200b54bf9094c (DEFAULT_TABLE table=default.Table_4aa7825edd6a4e318e83e87f1fde10cb [id=1449ff28bd8546908359606f7272846f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.905414 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17029c1ba36644e9847200b54bf9094c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.905550 893 tablet_service.cc:1511] Processing CreateTablet for tablet fbb308b05bb04bc18ccaa9550a73d3e7 (DEFAULT_TABLE table=default.Table_3ebb67c879364b8eac6a40f80d97a6eb [id=4ac9b907f9cf42478b9591bce31ccbcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.905890 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb308b05bb04bc18ccaa9550a73d3e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.849505 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 9060de590fa84ea08dc7d39765bc9308 (DEFAULT_TABLE table=default.Table_7713a34d9f7e4031a42f66ee98382545 [id=6f77a88fd07a47cfbef0a061968dda5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.856904 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 1e8160ad4cf74f16a586ae59291ce7d1 (DEFAULT_TABLE table=default.Table_263c9f8e2f2d4434a68825691c83d219 [id=23f3d793560846b7a0701ec470588cbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.861917 1198 tablet_bootstrap.cc:492] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:54.909277 1198 ts_tablet_manager.cc:1403] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.123s user 0.004s sys 0.008s
I20260616 19:51:54.909396 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9060de590fa84ea08dc7d39765bc9308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.910158 1198 raft_consensus.cc:359] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.910339 1198 raft_consensus.cc:385] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.910425 1198 raft_consensus.cc:740] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.910701 1198 consensus_queue.cc:260] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:54.911229 1198 ts_tablet_manager.cc:1434] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:54.911526 1198 tablet_bootstrap.cc:492] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:54.912408 762 tablet_service.cc:1511] Processing CreateTablet for tablet 47b548b6b7f746fe9fd67c2e6563e961 (DEFAULT_TABLE table=default.Table_dcc7f41280024bda90ded420734edd74 [id=9c7b653f62ef4b74946cc87069f8df6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.861868 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d916b2f553ce41df8934e1190fa32120" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:54.912707 1060 raft_consensus.cc:2468] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:54.912849 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b548b6b7f746fe9fd67c2e6563e961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.897969 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 1c35e4c8e9304e798c9031469877b70e (DEFAULT_TABLE table=default.Table_940a8144c5014fc9b2fcb74257f85d89 [id=7278ea7c992e450d840d9174df3f1ca0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.898497 1029 tablet_service.cc:1511] Processing CreateTablet for tablet aa72e00b0a3a423f96bdd7abb6013810 (DEFAULT_TABLE table=default.Table_4635b5a6e60140b9acd169b569531ffd [id=13855ad4407546ea81ea615a1cdc0438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.914335 1198 tablet_bootstrap.cc:654] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:54.899008 1028 tablet_service.cc:1511] Processing CreateTablet for tablet f52b2c5ff6264ffe8d579cb3816fc253 (DEFAULT_TABLE table=default.Table_25651fb93ba2434cb75171647df9d2ec [id=3a6c9b0d46764e87832e82eabcdadc7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.899549 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f60e9778dd429c8bdbf96261901a56" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:54.916549 1059 raft_consensus.cc:2468] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:51:54.917379 858 leader_election.cc:304] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:51:54.918515 1402 raft_consensus.cc:2804] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:54.918622 1402 raft_consensus.cc:493] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:54.919063 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa72e00b0a3a423f96bdd7abb6013810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.921300 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c35e4c8e9304e798c9031469877b70e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.924561 887 tablet_service.cc:1511] Processing CreateTablet for tablet ca5dc1e6cde347fc9a34e555385dc646 (DEFAULT_TABLE table=default.Table_a8aa8e529ab0432d9abaf953a3aa73cf [id=d37e43e64c414245a12d2a86ebcbc24b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.925149 1402 raft_consensus.cc:3060] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:54.926365 719 leader_election.cc:304] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:51:54.926853 885 tablet_service.cc:1511] Processing CreateTablet for tablet 1e8160ad4cf74f16a586ae59291ce7d1 (DEFAULT_TABLE table=default.Table_263c9f8e2f2d4434a68825691c83d219 [id=23f3d793560846b7a0701ec470588cbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.929886 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e8160ad4cf74f16a586ae59291ce7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.930349 1205 raft_consensus.cc:2804] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:54.933041 886 tablet_service.cc:1511] Processing CreateTablet for tablet 9060de590fa84ea08dc7d39765bc9308 (DEFAULT_TABLE table=default.Table_7713a34d9f7e4031a42f66ee98382545 [id=6f77a88fd07a47cfbef0a061968dda5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.936051 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52b2c5ff6264ffe8d579cb3816fc253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.939395 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca5dc1e6cde347fc9a34e555385dc646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.940376 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9060de590fa84ea08dc7d39765bc9308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.899595 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 47b548b6b7f746fe9fd67c2e6563e961 (DEFAULT_TABLE table=default.Table_dcc7f41280024bda90ded420734edd74 [id=9c7b653f62ef4b74946cc87069f8df6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.899895 1033 tablet_service.cc:1511] Processing CreateTablet for tablet cbd1070277a14fd98af5fa45925e4f0f (DEFAULT_TABLE table=default.Table_60ef6fc2bcf94a838594d3da8ec82c32 [id=72296d61a39e47389db261a68e679483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.900381 1026 tablet_service.cc:1511] Processing CreateTablet for tablet f13d175adfe540b39fd55004a11c9aad (DEFAULT_TABLE table=default.Table_689c1eb2c3714d7993014cee1e5c4258 [id=f7089c8c9b504f13949fd8db2c11c45c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.901119 1032 tablet_service.cc:1511] Processing CreateTablet for tablet b718514e4fbd4601afeb021ed35643e6 (DEFAULT_TABLE table=default.Table_9eedef731fd84c70a73a66128d239708 [id=b4da8c337e114065ad1498aa33588d55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.946393 1205 raft_consensus.cc:493] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:54.946543 1205 raft_consensus.cc:3060] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:54.947062 752 tablet_service.cc:1511] Processing CreateTablet for tablet aabf57dd6d704645b6bf97b730dbe964 (DEFAULT_TABLE table=default.Table_914e42d3110442b99b33a9a77c30dd49 [id=8253e0421d10438cbb925f20579d9471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.947540 1196 tablet_bootstrap.cc:492] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:54.948926 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd1070277a14fd98af5fa45925e4f0f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:54.949469 447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.188:34219, user_credentials={real_user=slave}} blocked reactor thread for 93033.3us
I20260616 19:51:54.951674 1196 ts_tablet_manager.cc:1403] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.331s user 0.002s sys 0.002s
I20260616 19:51:54.952795 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13d175adfe540b39fd55004a11c9aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.954715 1196 raft_consensus.cc:359] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.954952 764 tablet_service.cc:1511] Processing CreateTablet for tablet 1c35e4c8e9304e798c9031469877b70e (DEFAULT_TABLE table=default.Table_940a8144c5014fc9b2fcb74257f85d89 [id=7278ea7c992e450d840d9174df3f1ca0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.956060 759 tablet_service.cc:1511] Processing CreateTablet for tablet f52b2c5ff6264ffe8d579cb3816fc253 (DEFAULT_TABLE table=default.Table_25651fb93ba2434cb75171647df9d2ec [id=3a6c9b0d46764e87832e82eabcdadc7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.956380 751 tablet_service.cc:1511] Processing CreateTablet for tablet aa72e00b0a3a423f96bdd7abb6013810 (DEFAULT_TABLE table=default.Table_4635b5a6e60140b9acd169b569531ffd [id=13855ad4407546ea81ea615a1cdc0438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.957125 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aabf57dd6d704645b6bf97b730dbe964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.959520 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52b2c5ff6264ffe8d579cb3816fc253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.960315 889 tablet_service.cc:1511] Processing CreateTablet for tablet cbd1070277a14fd98af5fa45925e4f0f (DEFAULT_TABLE table=default.Table_60ef6fc2bcf94a838594d3da8ec82c32 [id=72296d61a39e47389db261a68e679483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.960287 753 tablet_service.cc:1511] Processing CreateTablet for tablet b718514e4fbd4601afeb021ed35643e6 (DEFAULT_TABLE table=default.Table_9eedef731fd84c70a73a66128d239708 [id=b4da8c337e114065ad1498aa33588d55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.962050 761 tablet_service.cc:1511] Processing CreateTablet for tablet f13d175adfe540b39fd55004a11c9aad (DEFAULT_TABLE table=default.Table_689c1eb2c3714d7993014cee1e5c4258 [id=f7089c8c9b504f13949fd8db2c11c45c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.962692 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b718514e4fbd4601afeb021ed35643e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.964344 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b548b6b7f746fe9fd67c2e6563e961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.965085 748 tablet_service.cc:1511] Processing CreateTablet for tablet 64aa32856ca34743933931fb51f2bd7b (DEFAULT_TABLE table=default.Table_1dbd90a0e47a4f1eb2efa82ae31c9b74 [id=fb8670837a3f4c7086c4f112b7319a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.966997 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e8160ad4cf74f16a586ae59291ce7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.967206 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c35e4c8e9304e798c9031469877b70e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.967422 1196 raft_consensus.cc:385] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:54.972981 1196 raft_consensus.cc:740] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:54.974736 1196 consensus_queue.cc:260] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:54.975282 1196 ts_tablet_manager.cc:1434] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260616 19:51:54.982749 1196 tablet_bootstrap.cc:492] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:54.971791 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 64aa32856ca34743933931fb51f2bd7b (DEFAULT_TABLE table=default.Table_1dbd90a0e47a4f1eb2efa82ae31c9b74 [id=fb8670837a3f4c7086c4f112b7319a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.902303 1034 tablet_service.cc:1511] Processing CreateTablet for tablet aabf57dd6d704645b6bf97b730dbe964 (DEFAULT_TABLE table=default.Table_914e42d3110442b99b33a9a77c30dd49 [id=8253e0421d10438cbb925f20579d9471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:54.990887 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aabf57dd6d704645b6bf97b730dbe964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:54.993075 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64aa32856ca34743933931fb51f2bd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.000873 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 17029c1ba36644e9847200b54bf9094c (DEFAULT_TABLE table=default.Table_4aa7825edd6a4e318e83e87f1fde10cb [id=1449ff28bd8546908359606f7272846f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.006820 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet de0ea6ca79ff4ed09f63fc7bb98eaabd (table default.Table_6e469684e5b844a5b7f13a1047fd933a [id=7d5a7b1d32b147a3a8b5426c661dda2f]) successfully deleted
I20260616 19:51:55.007768 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17029c1ba36644e9847200b54bf9094c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.001997 1205 raft_consensus.cc:515] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.012328 1402 raft_consensus.cc:515] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:55.012450 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1d368ec65b624ea58f7b750097a78ede
I20260616 19:51:55.013065 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_31c35a01c5a3478992e6533efb32d555"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:55.013978 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31c35a01c5a3478992e6533efb32d555 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.014961 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b718514e4fbd4601afeb021ed35643e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:55.015077 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f13d175adfe540b39fd55004a11c9aad consensus state has no leader
I20260616 19:51:55.015079 1402 leader_election.cc:290] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:55.015705 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_774101ee38e441449f023f43612d6621" } new_table_name: "default.Table_9db63b29d7264d8da3cbda32ff0b3f02" modify_external_catalogs: true
I20260616 19:51:55.015936 459 master_service.cc:960] ReplaceTablet: received request to replace tablet fdc6222db09d4cd987cbdf70e4d40f70 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:55.017076 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13d175adfe540b39fd55004a11c9aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.017066 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ae1d446a11f34a77bd9bcdafbef99127" } modify_external_catalogs: true
I20260616 19:51:55.009101 1036 tablet_service.cc:1511] Processing CreateTablet for tablet ca5dc1e6cde347fc9a34e555385dc646 (DEFAULT_TABLE table=default.Table_a8aa8e529ab0432d9abaf953a3aa73cf [id=d37e43e64c414245a12d2a86ebcbc24b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.017645 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ae1d446a11f34a77bd9bcdafbef99127" } modify_external_catalogs: true
I20260616 19:51:55.019598 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 36ea9b8ba668410bae016a008cf37910
I20260616 19:51:55.014132 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d916b2f553ce41df8934e1190fa32120
I20260616 19:51:55.021247 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64aa32856ca34743933931fb51f2bd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.021286 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1663625bb19f4fcba05c5277abaf688f" } new_table_name: "default.Table_9858decdd2fb4e0cb9fdea7022f1962b" modify_external_catalogs: true
I20260616 19:51:55.022733 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d368ec65b624ea58f7b750097a78ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.023041 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa72e00b0a3a423f96bdd7abb6013810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.023406 1192 tablet_bootstrap.cc:492] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:55.024091 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d916b2f553ce41df8934e1190fa32120" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:51:55.024288 1059 raft_consensus.cc:3060] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:55.024708 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f60e9778dd429c8bdbf96261901a56" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:51:55.024896 1060 raft_consensus.cc:3060] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:55.024997 750 tablet_service.cc:1558] Processing DeleteTablet for tablet c557049a020a4b318bb6e8a53710a6cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.025417 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f60e9778dd429c8bdbf96261901a56" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:55.025748 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ea9b8ba668410bae016a008cf37910 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.027664 1205 leader_election.cc:290] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:51:55.029050 718 leader_election.cc:343] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:55.035076 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7cdef69863694f0ba023c214e42394e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:55.036999 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f60e9778dd429c8bdbf96261901a56" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:55.038524 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca5dc1e6cde347fc9a34e555385dc646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.038816 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d270afd0c0f3457aa6dd14721dca261d
I20260616 19:51:55.039423 1192 ts_tablet_manager.cc:1403] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.302s user 0.010s sys 0.011s
I20260616 19:51:55.044123 461 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_15c5a7f0c53c48069560560950206199 [id=e75a6e5e4f0047d9b398ce230b170131]). Expected version 5 got 0
I20260616 19:51:55.046868 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd1070277a14fd98af5fa45925e4f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.048226 1192 raft_consensus.cc:359] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.048768 1060 raft_consensus.cc:2468] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:51:55.051033 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_654e346141624d0d878221b2ef96cb83" } new_table_name: "default.Table_7617f8ff37a245578b7cdecd3c7fcd41" modify_external_catalogs: true
I20260616 19:51:55.051061 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_465ef4c1c4044473a6e721ae45cbd7a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:55.051602 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_465ef4c1c4044473a6e721ae45cbd7a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.054095 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d368ec65b624ea58f7b750097a78ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.056344 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 4bd6fa49eff4400ca40c722e18cea951
I20260616 19:51:55.056686 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fdc6222db09d4cd987cbdf70e4d40f70
W20260616 19:51:55.057117 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3587c1ab487a424eb82f378ae081f514 consensus state has no leader
I20260616 19:51:55.060061 459 catalog_manager.cc:6784] ReplaceTablet: tablet fdc6222db09d4cd987cbdf70e4d40f70 deleted and replaced by tablet d5c82b71969e4cbcb890d16e1cdd5348
I20260616 19:51:55.060112 1198 tablet_bootstrap.cc:492] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:55.060539 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ea9b8ba668410bae016a008cf37910 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.061120 1198 ts_tablet_manager.cc:1403] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.149s user 0.004s sys 0.000s
W20260616 19:51:55.060732 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cdef69863694f0ba023c214e42394e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.061903 1198 raft_consensus.cc:359] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.062089 1198 raft_consensus.cc:385] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.062155 1198 raft_consensus.cc:740] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.062374 1198 consensus_queue.cc:260] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.062781 1198 ts_tablet_manager.cc:1434] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:55.064694 894 tablet_service.cc:1511] Processing CreateTablet for tablet aabf57dd6d704645b6bf97b730dbe964 (DEFAULT_TABLE table=default.Table_914e42d3110442b99b33a9a77c30dd49 [id=8253e0421d10438cbb925f20579d9471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.065402 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet d916b2f553ce41df8934e1190fa32120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.061151 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_db902752da5f4f3ab65c0b21c57d34a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:55.066660 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db902752da5f4f3ab65c0b21c57d34a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.067798 896 tablet_service.cc:1511] Processing CreateTablet for tablet 17029c1ba36644e9847200b54bf9094c (DEFAULT_TABLE table=default.Table_4aa7825edd6a4e318e83e87f1fde10cb [id=1449ff28bd8546908359606f7272846f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.068194 888 tablet_service.cc:1511] Processing CreateTablet for tablet 47b548b6b7f746fe9fd67c2e6563e961 (DEFAULT_TABLE table=default.Table_dcc7f41280024bda90ded420734edd74 [id=9c7b653f62ef4b74946cc87069f8df6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.068416 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet d270afd0c0f3457aa6dd14721dca261d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.072686 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d916b2f553ce41df8934e1190fa32120" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:55.072834 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d22240d294454cbeb2ca5b07d45273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.073096 1191 tablet_replica.cc:333] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:51:55.073942 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 1d368ec65b624ea58f7b750097a78ede because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d368ec65b624ea58f7b750097a78ede already in progress: creating tablet
W20260616 19:51:55.074244 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 36ea9b8ba668410bae016a008cf37910 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ea9b8ba668410bae016a008cf37910 already in progress: creating tablet
I20260616 19:51:55.074290 895 tablet_service.cc:1511] Processing CreateTablet for tablet 1c35e4c8e9304e798c9031469877b70e (DEFAULT_TABLE table=default.Table_940a8144c5014fc9b2fcb74257f85d89 [id=7278ea7c992e450d840d9174df3f1ca0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.075069 892 tablet_service.cc:1511] Processing CreateTablet for tablet b718514e4fbd4601afeb021ed35643e6 (DEFAULT_TABLE table=default.Table_9eedef731fd84c70a73a66128d239708 [id=b4da8c337e114065ad1498aa33588d55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.075309 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet fdc6222db09d4cd987cbdf70e4d40f70 with delete_type TABLET_DATA_DELETED (replaced by tablet d5c82b71969e4cbcb890d16e1cdd5348) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.075536 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bd6fa49eff4400ca40c722e18cea951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.076277 1192 raft_consensus.cc:385] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.076382 1192 raft_consensus.cc:740] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
W20260616 19:51:55.076571 718 leader_election.cc:343] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:55.078094 1198 tablet_bootstrap.cc:492] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:55.078233 1192 consensus_queue.cc:260] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.078769 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d368ec65b624ea58f7b750097a78ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.078905 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aabf57dd6d704645b6bf97b730dbe964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.080307 1192 ts_tablet_manager.cc:1434] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.041s user 0.003s sys 0.000s
I20260616 19:51:55.081629 719 leader_election.cc:304] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:55.081979 1205 raft_consensus.cc:2804] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:55.082136 1205 raft_consensus.cc:697] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:51:55.082428 1205 consensus_queue.cc:237] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.085525 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17029c1ba36644e9847200b54bf9094c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.087877 886 tablet_service.cc:1511] Processing CreateTablet for tablet 64aa32856ca34743933931fb51f2bd7b (DEFAULT_TABLE table=default.Table_1dbd90a0e47a4f1eb2efa82ae31c9b74 [id=fb8670837a3f4c7086c4f112b7319a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.088296 900 tablet_service.cc:1511] Processing CreateTablet for tablet f13d175adfe540b39fd55004a11c9aad (DEFAULT_TABLE table=default.Table_689c1eb2c3714d7993014cee1e5c4258 [id=f7089c8c9b504f13949fd8db2c11c45c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.091059 1059 raft_consensus.cc:2468] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:55.092234 891 tablet_service.cc:1558] Processing DeleteTablet for tablet fdc6222db09d4cd987cbdf70e4d40f70 with delete_type TABLET_DATA_DELETED (replaced by tablet d5c82b71969e4cbcb890d16e1cdd5348) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.093009 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_00a384409532486b8ea5a32b1d61a7eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:55.093348 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7d684a6e485e4d9885757678979cb78f" } new_table_name: "default.Table_ab3032cb1f934fdc9bde24d4b3b1f5a3" modify_external_catalogs: true
W20260616 19:51:55.093602 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00a384409532486b8ea5a32b1d61a7eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.094740 1191 raft_consensus.cc:2243] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.095070 1191 raft_consensus.cc:2272] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.095638 1191 ts_tablet_manager.cc:1916] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.096889 902 tablet_service.cc:1511] Processing CreateTablet for tablet f52b2c5ff6264ffe8d579cb3816fc253 (DEFAULT_TABLE table=default.Table_25651fb93ba2434cb75171647df9d2ec [id=3a6c9b0d46764e87832e82eabcdadc7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.098618 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b548b6b7f746fe9fd67c2e6563e961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.100023 1196 tablet_bootstrap.cc:654] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.103166 890 tablet_service.cc:1511] Processing CreateTablet for tablet aa72e00b0a3a423f96bdd7abb6013810 (DEFAULT_TABLE table=default.Table_4635b5a6e60140b9acd169b569531ffd [id=13855ad4407546ea81ea615a1cdc0438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.103781 1190 ts_tablet_manager.cc:1929] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.104074 762 tablet_service.cc:1558] Processing DeleteTablet for tablet d270afd0c0f3457aa6dd14721dca261d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.104674 1198 tablet_bootstrap.cc:654] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.104844 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bd6fa49eff4400ca40c722e18cea951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.105561 904 tablet_service.cc:1558] Processing DeleteTablet for tablet d916b2f553ce41df8934e1190fa32120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.106302 749 tablet_service.cc:1558] Processing DeleteTablet for tablet d916b2f553ce41df8934e1190fa32120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.106415 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ea9b8ba668410bae016a008cf37910 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.106578 747 tablet_service.cc:1558] Processing DeleteTablet for tablet fdc6222db09d4cd987cbdf70e4d40f70 with delete_type TABLET_DATA_DELETED (replaced by tablet d5c82b71969e4cbcb890d16e1cdd5348) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.110123 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bd6fa49eff4400ca40c722e18cea951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.110543 901 tablet_service.cc:1558] Processing DeleteTablet for tablet d270afd0c0f3457aa6dd14721dca261d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.110911 1190 log.cc:1199] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/543ef0fcac3d47928c5dd1d13f9aba92
I20260616 19:51:55.111347 1190 ts_tablet_manager.cc:1950] T 543ef0fcac3d47928c5dd1d13f9aba92 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:55.113668 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52b2c5ff6264ffe8d579cb3816fc253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.114805 1192 tablet_bootstrap.cc:492] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:51:55.120150 860 leader_election.cc:343] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:55.121035 1191 ts_tablet_manager.cc:1929] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.121201 1191 log.cc:1199] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/d916b2f553ce41df8934e1190fa32120
I20260616 19:51:55.122018 1191 ts_tablet_manager.cc:1950] T d916b2f553ce41df8934e1190fa32120 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:55.123167 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet d916b2f553ce41df8934e1190fa32120 (table default.Table_647cdefd19814321b51ee0898effc29c [id=7b17c97ad92b4ead8f60bf602853cd61]) successfully deleted
I20260616 19:51:55.123365 1193 ts_tablet_manager.cc:1929] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.123733 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13d175adfe540b39fd55004a11c9aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.123708 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 543ef0fcac3d47928c5dd1d13f9aba92 (table default.Table_5ad3a183f911465da5f24ce69f9d6256 [id=91705098b83a4cbd80112158f1b82022]) successfully deleted
W20260616 19:51:55.123998 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f already in progress: creating tablet
W20260616 19:51:55.124234 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 10fc1d2ecaa746bab980a708dd8eb93a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10fc1d2ecaa746bab980a708dd8eb93a already in progress: creating tablet
W20260616 19:51:55.124428 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a170db3d27fd40c1b74deab29e9a033f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a170db3d27fd40c1b74deab29e9a033f already in progress: creating tablet
W20260616 19:51:55.124671 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 99b211692aca478bb40f0f2c3f50ca44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99b211692aca478bb40f0f2c3f50ca44 already in progress: creating tablet
I20260616 19:51:55.126760 1193 log.cc:1199] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/2808592f581e4605a814a2658401dfed
I20260616 19:51:55.127346 1193 ts_tablet_manager.cc:1950] T 2808592f581e4605a814a2658401dfed P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:55.128741 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 173) took 1083 ms. Trace:
I20260616 19:51:55.129105 1193 rpcz_store.cc:276] 0616 19:51:54.045175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.045250 (+ 75us) service_pool.cc:224] Handling call
0616 19:51:54.846479 (+801229us) ts_tablet_manager.cc:1151] Deleting tablet 2808592f581e4605a814a2658401dfed
0616 19:51:54.846489 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:55.034233 (+187744us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:55.123282 (+ 89049us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:55.128511 (+ 5229us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":781528}
I20260616 19:51:55.130301 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 2808592f581e4605a814a2658401dfed (table default.Table_c50bd97ac24a49f3a5b56d4f5731d562 [id=4e76c4bf11684b8094f076e37bb2be48]) successfully deleted
I20260616 19:51:55.133217 1419 tablet.cc:1724] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260616 19:51:55.134451 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d22240d294454cbeb2ca5b07d45273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.134835 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 54ceb5a01be24dfb9c08001d662a9ac4 with delete_type TABLET_DATA_DELETED (replaced by tablet 122a8b15e62f4b23b465e2dbc816df62) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.135123 858 leader_election.cc:304] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:51:55.135785 1402 raft_consensus.cc:2804] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
W20260616 19:51:55.135829 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df036f9d31ca4770bb00bc9cece46953 consensus state has no leader
W20260616 19:51:55.136759 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d80d9028184443da49623228259263d consensus state has no leader
W20260616 19:51:55.138360 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 99551210f5974332bf6a16ee74b220f6 consensus state has no leader
I20260616 19:51:55.141014 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64aa32856ca34743933931fb51f2bd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.141697 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa72e00b0a3a423f96bdd7abb6013810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.130746 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 176) took 1061 ms. Trace:
I20260616 19:51:55.144088 1193 rpcz_store.cc:276] 0616 19:51:54.068842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.086632 (+ 17790us) service_pool.cc:224] Handling call
0616 19:51:55.129756 (+1043124us) ts_tablet_manager.cc:1151] Deleting tablet da51a682de41402cb537ab113f876a2d
0616 19:51:55.129766 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:55.129952 (+ 186us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1042883}
I20260616 19:51:55.144600 1193 tablet_replica.cc:333] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:55.144840 1193 raft_consensus.cc:2243] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.145092 1193 raft_consensus.cc:2272] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.145644 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet eac603a84d3c4f96bd444c54f28d278d with delete_type TABLET_DATA_DELETED (replaced by tablet bfff9d60bb7e4a86b14687b581b45efe) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.146005 1193 ts_tablet_manager.cc:1916] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.146080 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 3b57bceabff64533ae3a49b8afda614d (DEFAULT_TABLE table=default.Table_190bf8f13ab249eabed966a7a32bc222 [id=e29060d6148a4e819d0e9c80cb32956b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.146481 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b57bceabff64533ae3a49b8afda614d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.152374 1193 ts_tablet_manager.cc:1929] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.152493 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c35e4c8e9304e798c9031469877b70e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:55.153035 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 8eab5bd3967c42e1b6b79558df742946 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8eab5bd3967c42e1b6b79558df742946 already in progress: creating tablet
W20260616 19:51:55.154961 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d270afd0c0f3457aa6dd14721dca261d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d270afd0c0f3457aa6dd14721dca261d already in progress: creating tablet
I20260616 19:51:55.156737 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b718514e4fbd4601afeb021ed35643e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:55.152766 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet da51a682de41402cb537ab113f876a2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da51a682de41402cb537ab113f876a2d already in progress: creating tablet
I20260616 19:51:55.175968 899 tablet_service.cc:1558] Processing DeleteTablet for tablet eac603a84d3c4f96bd444c54f28d278d with delete_type TABLET_DATA_DELETED (replaced by tablet bfff9d60bb7e4a86b14687b581b45efe) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.179405 898 tablet_service.cc:1511] Processing CreateTablet for tablet 3b57bceabff64533ae3a49b8afda614d (DEFAULT_TABLE table=default.Table_190bf8f13ab249eabed966a7a32bc222 [id=e29060d6148a4e819d0e9c80cb32956b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.180378 1191 tablet_replica.cc:333] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:55.180903 1191 raft_consensus.cc:2243] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.181514 1191 raft_consensus.cc:2272] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.188326 1191 ts_tablet_manager.cc:1916] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.190480 1192 tablet_bootstrap.cc:654] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.192766 1402 raft_consensus.cc:697] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:51:55.193176 1402 consensus_queue.cc:237] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:55.195538 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 662e2d573bd7489a81697c17393ce088 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 662e2d573bd7489a81697c17393ce088 already in progress: creating tablet
W20260616 19:51:55.196456 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 13e4e52fae124d4085b15e143e98a7e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13e4e52fae124d4085b15e143e98a7e4 already in progress: creating tablet
W20260616 19:51:55.197177 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet f2c392b2fecd483d9da12e30e37f27ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2c392b2fecd483d9da12e30e37f27ad already in progress: creating tablet
W20260616 19:51:55.197764 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 5ba2eefdfed14791b5a41decc34dce44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ba2eefdfed14791b5a41decc34dce44 already in progress: creating tablet
I20260616 19:51:55.198006 1190 tablet_replica.cc:333] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
W20260616 19:51:55.198215 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet eb024637294148c18b74bef47fb2fcce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb024637294148c18b74bef47fb2fcce already in progress: creating tablet
I20260616 19:51:55.198300 1198 tablet_bootstrap.cc:492] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:55.198331 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b57bceabff64533ae3a49b8afda614d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.198438 1198 ts_tablet_manager.cc:1403] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.126s user 0.023s sys 0.002s
I20260616 19:51:55.199216 1198 raft_consensus.cc:359] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.199427 1198 raft_consensus.cc:385] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.199559 1198 raft_consensus.cc:740] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
W20260616 19:51:55.199736 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 1d368ec65b624ea58f7b750097a78ede because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d368ec65b624ea58f7b750097a78ede already in progress: creating tablet
W20260616 19:51:55.199973 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet fdc6222db09d4cd987cbdf70e4d40f70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdc6222db09d4cd987cbdf70e4d40f70 already in progress: creating tablet
I20260616 19:51:55.199914 1198 consensus_queue.cc:260] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.159458 751 tablet_service.cc:1511] Processing CreateTablet for tablet 3b57bceabff64533ae3a49b8afda614d (DEFAULT_TABLE table=default.Table_190bf8f13ab249eabed966a7a32bc222 [id=e29060d6148a4e819d0e9c80cb32956b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.211562 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b57bceabff64533ae3a49b8afda614d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.211750 1028 tablet_service.cc:1511] Processing CreateTablet for tablet fb1c2030b3a14c6aafaa961869606f31 (DEFAULT_TABLE table=default.Table_7cdef69863694f0ba023c214e42394e8 [id=a7f1b3885b764715a88750ea3752dbdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.212154 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1c2030b3a14c6aafaa961869606f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.193230 1196 tablet_bootstrap.cc:492] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:55.214514 1196 ts_tablet_manager.cc:1403] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.239s user 0.000s sys 0.008s
I20260616 19:51:55.215292 1196 raft_consensus.cc:359] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.215505 1196 raft_consensus.cc:385] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.215596 1196 raft_consensus.cc:740] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.216070 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 102f322eb98f4224acb8637f8c29ac19 (DEFAULT_TABLE table=default.Table_9e4be7ef0c8d47f18765df6682984b16 [id=451f7d9acb9e4ec889906998eebae58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.216022 1196 consensus_queue.cc:260] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.216395 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102f322eb98f4224acb8637f8c29ac19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.216661 1196 ts_tablet_manager.cc:1434] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:51:55.216944 1196 tablet_bootstrap.cc:492] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:55.218708 1196 tablet_bootstrap.cc:654] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.220595 1036 tablet_service.cc:1511] Processing CreateTablet for tablet f1a09d62e68148349b337c5075763672 (DEFAULT_TABLE table=default.Table_9a89b6471d8c42e594c15f43327d9572 [id=e2e41de8962e4ce081aa7c1ac71f8064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.220964 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a09d62e68148349b337c5075763672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.223481 1193 log.cc:1199] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/6ddc4929e1dc4c9284cd78dfa6b6febd
I20260616 19:51:55.223881 1193 ts_tablet_manager.cc:1950] T 6ddc4929e1dc4c9284cd78dfa6b6febd P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:55.224757 1193 tablet_replica.cc:333] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:55.224746 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 2e316e44693d473dad901eeb95299988 (DEFAULT_TABLE table=default.Table_0af20b58e7f64f62b763c0f583c1d43e [id=5aaccdcce80844bbb73b04f81bde9373]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.224948 1193 raft_consensus.cc:2243] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.225119 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e316e44693d473dad901eeb95299988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.225104 1193 raft_consensus.cc:2272] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.225630 1193 ts_tablet_manager.cc:1916] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.226073 893 tablet_service.cc:1511] Processing CreateTablet for tablet fb1c2030b3a14c6aafaa961869606f31 (DEFAULT_TABLE table=default.Table_7cdef69863694f0ba023c214e42394e8 [id=a7f1b3885b764715a88750ea3752dbdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.227701 899 tablet_service.cc:1511] Processing CreateTablet for tablet 102f322eb98f4224acb8637f8c29ac19 (DEFAULT_TABLE table=default.Table_9e4be7ef0c8d47f18765df6682984b16 [id=451f7d9acb9e4ec889906998eebae58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.228871 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 90205213ba5f49a2931e68839cefb2d2 (DEFAULT_TABLE table=default.Table_3fde6faf0f8549f69328d3129ad9f367 [id=e43abc84d7e146e591d10768c8f146e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.229219 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90205213ba5f49a2931e68839cefb2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.231971 1193 ts_tablet_manager.cc:1929] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.232090 1193 log.cc:1199] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/154ca8a6bce84b4bab932e69ec7f1f8e
I20260616 19:51:55.232820 1031 tablet_service.cc:1511] Processing CreateTablet for tablet eed22bbef8ef479dad179b96ba850d26 (DEFAULT_TABLE table=default.Table_31c35a01c5a3478992e6533efb32d555 [id=51b9d37619484805a50cadd93ff7503a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.233147 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed22bbef8ef479dad179b96ba850d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.235517 901 tablet_service.cc:1511] Processing CreateTablet for tablet f1a09d62e68148349b337c5075763672 (DEFAULT_TABLE table=default.Table_9a89b6471d8c42e594c15f43327d9572 [id=e2e41de8962e4ce081aa7c1ac71f8064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.236718 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 731556662b62419dae76149b22469ebd (DEFAULT_TABLE table=default.Table_465ef4c1c4044473a6e721ae45cbd7a1 [id=c49098557d4b4b0d9a720713127e4b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.237051 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731556662b62419dae76149b22469ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.241410 1191 ts_tablet_manager.cc:1929] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.241549 1191 log.cc:1199] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/31d22240d294454cbeb2ca5b07d45273
I20260616 19:51:55.241498 460 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 21408288aae545cba9aa65afbc29a0e3 (table default.Table_e6fa01673a5f49c5b6198541d6d74674 [id=0342973a46bc4b93b84b0220163e9975]). Expected version 1 got 0
I20260616 19:51:55.241904 1191 ts_tablet_manager.cc:1950] T 31d22240d294454cbeb2ca5b07d45273 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:55.243093 1191 tablet_replica.cc:333] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:55.243287 1191 raft_consensus.cc:2243] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.243439 1191 raft_consensus.cc:2272] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.245468 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_827a69aca36a453db1e09ffa7d2b535c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:55.245687 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 3587c1ab487a424eb82f378ae081f514 from {username='slave'} at 127.0.0.1:41696
W20260616 19:51:55.246106 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_827a69aca36a453db1e09ffa7d2b535c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.246259 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3a297147806b42d2a05da3717d5f18d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:55.246330 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a4005930ba1a454cb63502a2ac17055b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:55.246706 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a297147806b42d2a05da3717d5f18d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:55.246838 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4005930ba1a454cb63502a2ac17055b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.248052 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_73d451214e35437c85c4e33d7cfbd65f" } new_table_name: "default.Table_dfb3308f15684b20b5d49353c0a255e7" modify_external_catalogs: true
I20260616 19:51:55.249162 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_52ebd4cc32a242b6af90514f289aaffd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:55.249557 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52ebd4cc32a242b6af90514f289aaffd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.249677 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1c2030b3a14c6aafaa961869606f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.250478 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9e4be7ef0c8d47f18765df6682984b16" } modify_external_catalogs: true
I20260616 19:51:55.250623 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9e4be7ef0c8d47f18765df6682984b16" } modify_external_catalogs: true
I20260616 19:51:55.251658 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7713a34d9f7e4031a42f66ee98382545" } modify_external_catalogs: true
I20260616 19:51:55.251793 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7713a34d9f7e4031a42f66ee98382545" } modify_external_catalogs: true
I20260616 19:51:55.256229 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 31d22240d294454cbeb2ca5b07d45273 (table default.Table_41371955e37644fda9a23d0fba091c86 [id=3f2766ea54a141eb84ccb6625a0d04b6]) successfully deleted
W20260616 19:51:55.256503 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet fdc6222db09d4cd987cbdf70e4d40f70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdc6222db09d4cd987cbdf70e4d40f70 already in progress: creating tablet
W20260616 19:51:55.256753 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 4bd6fa49eff4400ca40c722e18cea951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bd6fa49eff4400ca40c722e18cea951 already in progress: creating tablet
I20260616 19:51:55.259063 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 6ddc4929e1dc4c9284cd78dfa6b6febd (table default.Table_ae8591a97fd047dba2de2cdf593b8c17 [id=a7db76f5ed24476baf504282f03ed0c7]) successfully deleted
I20260616 19:51:55.260244 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 3587c1ab487a424eb82f378ae081f514
I20260616 19:51:55.260921 453 catalog_manager.cc:6784] ReplaceTablet: tablet 3587c1ab487a424eb82f378ae081f514 deleted and replaced by tablet 84ce7bf3e0004ffaa2c5e314fa69322c
I20260616 19:51:55.261668 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 3587c1ab487a424eb82f378ae081f514 with delete_type TABLET_DATA_DELETED (replaced by tablet 84ce7bf3e0004ffaa2c5e314fa69322c) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.266309 903 tablet_service.cc:1511] Processing CreateTablet for tablet 2e316e44693d473dad901eeb95299988 (DEFAULT_TABLE table=default.Table_0af20b58e7f64f62b763c0f583c1d43e [id=5aaccdcce80844bbb73b04f81bde9373]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.267242 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a09d62e68148349b337c5075763672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.268965 455 catalog_manager.cc:5696] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } }
I20260616 19:51:55.274139 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 49ab6193c479400da00e1fa80a5274a2 (DEFAULT_TABLE table=default.Table_00a384409532486b8ea5a32b1d61a7eb [id=1f077f42ac19492597ea7cd3027cae10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.274524 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ab6193c479400da00e1fa80a5274a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.276263 1198 ts_tablet_manager.cc:1434] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.078s user 0.001s sys 0.001s
I20260616 19:51:55.279240 1198 tablet_bootstrap.cc:492] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:55.281929 1198 tablet_bootstrap.cc:654] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.282025 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102f322eb98f4224acb8637f8c29ac19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.283269 1191 ts_tablet_manager.cc:1916] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.286866 1027 tablet_service.cc:1511] Processing CreateTablet for tablet c6939d108a7948bb9e56311a34d95486 (DEFAULT_TABLE table=default.Table_8dbc007d3ffb483d8f4ca4fefdde8a2b [id=794886751c914a4b9a139e477021e487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.287267 1036 tablet_service.cc:1511] Processing CreateTablet for tablet d5c82b71969e4cbcb890d16e1cdd5348 (DEFAULT_TABLE table=default.Table_92a53fd7dd1a4e9892c00c79c31c53f1 [id=d5fe1c6faa0d446ca84e71bbdfb4018d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.287962 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6939d108a7948bb9e56311a34d95486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.288355 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 3587c1ab487a424eb82f378ae081f514 with delete_type TABLET_DATA_DELETED (replaced by tablet 84ce7bf3e0004ffaa2c5e314fa69322c) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.244379 1196 tablet_bootstrap.cc:492] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:55.289345 1196 ts_tablet_manager.cc:1403] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.000s
I20260616 19:51:55.290108 1196 raft_consensus.cc:359] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.290307 1196 raft_consensus.cc:385] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.290374 1196 raft_consensus.cc:740] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.290637 1196 consensus_queue.cc:260] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.291069 1196 ts_tablet_manager.cc:1434] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:55.291379 1196 tablet_bootstrap.cc:492] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:55.291468 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c82b71969e4cbcb890d16e1cdd5348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.288326 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 8a718fefe07141119b7ef7edcbf61123 (DEFAULT_TABLE table=default.Table_db902752da5f4f3ab65c0b21c57d34a9 [id=347e25a5fa42418fa9952ed1e6bf9c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.255492 752 tablet_service.cc:1511] Processing CreateTablet for tablet f1a09d62e68148349b337c5075763672 (DEFAULT_TABLE table=default.Table_9a89b6471d8c42e594c15f43327d9572 [id=e2e41de8962e4ce081aa7c1ac71f8064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.292415 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a718fefe07141119b7ef7edcbf61123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.255730 761 tablet_service.cc:1511] Processing CreateTablet for tablet 2e316e44693d473dad901eeb95299988 (DEFAULT_TABLE table=default.Table_0af20b58e7f64f62b763c0f583c1d43e [id=5aaccdcce80844bbb73b04f81bde9373]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.255952 759 tablet_service.cc:1511] Processing CreateTablet for tablet 90205213ba5f49a2931e68839cefb2d2 (DEFAULT_TABLE table=default.Table_3fde6faf0f8549f69328d3129ad9f367 [id=e43abc84d7e146e591d10768c8f146e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.292946 889 tablet_service.cc:1511] Processing CreateTablet for tablet 731556662b62419dae76149b22469ebd (DEFAULT_TABLE table=default.Table_465ef4c1c4044473a6e721ae45cbd7a1 [id=c49098557d4b4b0d9a720713127e4b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.256187 748 tablet_service.cc:1511] Processing CreateTablet for tablet eed22bbef8ef479dad179b96ba850d26 (DEFAULT_TABLE table=default.Table_31c35a01c5a3478992e6533efb32d555 [id=51b9d37619484805a50cadd93ff7503a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.256556 753 tablet_service.cc:1511] Processing CreateTablet for tablet 102f322eb98f4224acb8637f8c29ac19 (DEFAULT_TABLE table=default.Table_9e4be7ef0c8d47f18765df6682984b16 [id=451f7d9acb9e4ec889906998eebae58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.294025 891 tablet_service.cc:1511] Processing CreateTablet for tablet d5c82b71969e4cbcb890d16e1cdd5348 (DEFAULT_TABLE table=default.Table_92a53fd7dd1a4e9892c00c79c31c53f1 [id=d5fe1c6faa0d446ca84e71bbdfb4018d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.267138 784 raft_consensus.cc:3060] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:55.297039 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a09d62e68148349b337c5075763672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.297153 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e316e44693d473dad901eeb95299988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.300804 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90205213ba5f49a2931e68839cefb2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.301291 888 tablet_service.cc:1511] Processing CreateTablet for tablet eed22bbef8ef479dad179b96ba850d26 (DEFAULT_TABLE table=default.Table_31c35a01c5a3478992e6533efb32d555 [id=51b9d37619484805a50cadd93ff7503a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.304638 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e316e44693d473dad901eeb95299988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.305359 1383 raft_consensus.cc:493] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:55.305703 1383 raft_consensus.cc:515] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:55.306109 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102f322eb98f4224acb8637f8c29ac19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.308653 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed22bbef8ef479dad179b96ba850d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.315117 1383 leader_election.cc:290] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:55.268026 751 tablet_service.cc:1511] Processing CreateTablet for tablet fb1c2030b3a14c6aafaa961869606f31 (DEFAULT_TABLE table=default.Table_7cdef69863694f0ba023c214e42394e8 [id=a7f1b3885b764715a88750ea3752dbdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.315727 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1c2030b3a14c6aafaa961869606f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.278343 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 3587c1ab487a424eb82f378ae081f514 with delete_type TABLET_DATA_DELETED (replaced by tablet 84ce7bf3e0004ffaa2c5e314fa69322c) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.279109 762 tablet_service.cc:1511] Processing CreateTablet for tablet d5c82b71969e4cbcb890d16e1cdd5348 (DEFAULT_TABLE table=default.Table_92a53fd7dd1a4e9892c00c79c31c53f1 [id=d5fe1c6faa0d446ca84e71bbdfb4018d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.317176 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c82b71969e4cbcb890d16e1cdd5348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.280000 764 tablet_service.cc:1511] Processing CreateTablet for tablet c6939d108a7948bb9e56311a34d95486 (DEFAULT_TABLE table=default.Table_8dbc007d3ffb483d8f4ca4fefdde8a2b [id=794886751c914a4b9a139e477021e487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.318138 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6939d108a7948bb9e56311a34d95486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.280062 754 tablet_service.cc:1511] Processing CreateTablet for tablet 8a718fefe07141119b7ef7edcbf61123 (DEFAULT_TABLE table=default.Table_db902752da5f4f3ab65c0b21c57d34a9 [id=347e25a5fa42418fa9952ed1e6bf9c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.323664 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a718fefe07141119b7ef7edcbf61123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.327155 1196 tablet_bootstrap.cc:654] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.285848 757 tablet_service.cc:1511] Processing CreateTablet for tablet 49ab6193c479400da00e1fa80a5274a2 (DEFAULT_TABLE table=default.Table_00a384409532486b8ea5a32b1d61a7eb [id=1f077f42ac19492597ea7cd3027cae10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.329423 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ab6193c479400da00e1fa80a5274a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.331653 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da380823d0ae437d9f1d9d0f633f74bb" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:55.332178 996 leader_election.cc:343] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:55.278647 749 tablet_service.cc:1511] Processing CreateTablet for tablet 731556662b62419dae76149b22469ebd (DEFAULT_TABLE table=default.Table_465ef4c1c4044473a6e721ae45cbd7a1 [id=c49098557d4b4b0d9a720713127e4b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.333092 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731556662b62419dae76149b22469ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.333462 1196 tablet_bootstrap.cc:492] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:55.333612 1196 ts_tablet_manager.cc:1403] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.002s
I20260616 19:51:55.334460 1196 raft_consensus.cc:359] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.334663 1196 raft_consensus.cc:385] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.334774 1196 raft_consensus.cc:740] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.335054 1196 consensus_queue.cc:260] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.335925 1196 ts_tablet_manager.cc:1434] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:55.336205 1196 tablet_bootstrap.cc:492] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:55.336223 1198 tablet_bootstrap.cc:492] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:55.336375 1198 ts_tablet_manager.cc:1403] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.057s user 0.001s sys 0.001s
I20260616 19:51:55.332648 1205 raft_consensus.cc:493] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:55.336783 1205 raft_consensus.cc:515] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:55.232409 1193 ts_tablet_manager.cc:1950] T 154ca8a6bce84b4bab932e69ec7f1f8e P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:55.337518 1205 leader_election.cc:290] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:55.338145 1196 tablet_bootstrap.cc:654] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:55.338548 719 leader_election.cc:343] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 54ceb5a01be24dfb9c08001d662a9ac4
I20260616 19:51:55.337853 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 183) took 1106 ms. Trace:
I20260616 19:51:55.342825 1193 rpcz_store.cc:276] 0616 19:51:54.231609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.231650 (+ 41us) service_pool.cc:224] Handling call
0616 19:51:55.224700 (+993050us) ts_tablet_manager.cc:1151] Deleting tablet 154ca8a6bce84b4bab932e69ec7f1f8e
0616 19:51:55.224708 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:55.228663 (+ 3955us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:55.231908 (+ 3245us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:55.337790 (+105882us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":992879}
I20260616 19:51:55.343178 1193 tablet_replica.cc:333] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:55.343374 1193 raft_consensus.cc:2243] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.343580 1193 raft_consensus.cc:2272] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.344120 1193 ts_tablet_manager.cc:1916] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.347038 1198 raft_consensus.cc:359] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.347237 1198 raft_consensus.cc:385] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.347311 1198 raft_consensus.cc:740] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.347561 1198 consensus_queue.cc:260] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.348058 1198 ts_tablet_manager.cc:1434] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260616 19:51:55.348349 1198 tablet_bootstrap.cc:492] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:55.351679 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c82b71969e4cbcb890d16e1cdd5348. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:55.355340 447 consensus_peers.cc:597] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 -> Peer c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219): Couldn't send request to peer c404c91cd2194cf6838fddd212f2f4ae. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260616 19:51:55.355978 1191 ts_tablet_manager.cc:1929] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.356123 1191 log.cc:1199] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/eac603a84d3c4f96bd444c54f28d278d
I20260616 19:51:55.359652 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 154ca8a6bce84b4bab932e69ec7f1f8e (table default.Table_6db02b65da9f42279f9442335b438b91 [id=2c8430ecae1842458fb35770d90409f8]) successfully deleted
I20260616 19:51:55.371196 894 tablet_service.cc:1511] Processing CreateTablet for tablet 90205213ba5f49a2931e68839cefb2d2 (DEFAULT_TABLE table=default.Table_3fde6faf0f8549f69328d3129ad9f367 [id=e43abc84d7e146e591d10768c8f146e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.374742 1198 tablet_bootstrap.cc:654] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.375226 1191 ts_tablet_manager.cc:1950] T eac603a84d3c4f96bd444c54f28d278d P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:55.378392 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet eac603a84d3c4f96bd444c54f28d278d (table default.Table_e45bf57dcf664129991297d4600d67d5 [id=a67306640a5b4c0a91a283892a3a8062]) successfully deleted
W20260616 19:51:55.379523 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 3587c1ab487a424eb82f378ae081f514 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3587c1ab487a424eb82f378ae081f514 already in progress: creating tablet
I20260616 19:51:55.380981 900 tablet_service.cc:1511] Processing CreateTablet for tablet 49ab6193c479400da00e1fa80a5274a2 (DEFAULT_TABLE table=default.Table_00a384409532486b8ea5a32b1d61a7eb [id=1f077f42ac19492597ea7cd3027cae10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.382192 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731556662b62419dae76149b22469ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.386087 1193 ts_tablet_manager.cc:1929] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.386222 1193 log.cc:1199] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/387ba2086bca4a15b388700044e3c45d
I20260616 19:51:55.386607 1193 ts_tablet_manager.cc:1950] T 387ba2086bca4a15b388700044e3c45d P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:55.387346 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 181) took 1156 ms. Trace:
I20260616 19:51:55.388686 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90205213ba5f49a2931e68839cefb2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.390226 886 tablet_service.cc:1511] Processing CreateTablet for tablet c6939d108a7948bb9e56311a34d95486 (DEFAULT_TABLE table=default.Table_8dbc007d3ffb483d8f4ca4fefdde8a2b [id=794886751c914a4b9a139e477021e487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.390782 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ab6193c479400da00e1fa80a5274a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.390723 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ceb5a01be24dfb9c08001d662a9ac4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:55.391002 924 raft_consensus.cc:2468] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:51:55.392244 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed22bbef8ef479dad179b96ba850d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.395246 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da380823d0ae437d9f1d9d0f633f74bb" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:51:55.395991 993 leader_election.cc:343] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:55.396162 993 leader_election.cc:304] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:55.396574 1383 raft_consensus.cc:2749] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:55.391664 718 leader_election.cc:304] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:55.397360 1193 rpcz_store.cc:276] 0616 19:51:54.231305 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.231673 (+ 368us) service_pool.cc:224] Handling call
0616 19:51:55.343090 (+1111417us) ts_tablet_manager.cc:1151] Deleting tablet 387ba2086bca4a15b388700044e3c45d
0616 19:51:55.343098 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:55.370720 (+ 27622us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:55.385979 (+ 15259us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:55.387303 (+ 1324us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1111200}
I20260616 19:51:55.397770 1205 raft_consensus.cc:2804] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:55.397876 1205 raft_consensus.cc:493] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:55.397924 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 387ba2086bca4a15b388700044e3c45d (table default.Table_6e469684e5b844a5b7f13a1047fd933a [id=7d5a7b1d32b147a3a8b5426c661dda2f]) successfully deleted
I20260616 19:51:55.398000 1205 raft_consensus.cc:3060] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:55.398502 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 182) took 1167 ms. Trace:
I20260616 19:51:55.398622 1193 rpcz_store.cc:276] 0616 19:51:54.231451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.232260 (+ 809us) service_pool.cc:224] Handling call
0616 19:51:55.398361 (+1166101us) ts_tablet_manager.cc:1151] Deleting tablet 6d94eb734df94a309a7b171d907c81da
0616 19:51:55.398372 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:55.398458 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1165932}
I20260616 19:51:55.398994 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 184) took 1154 ms. Trace:
W20260616 19:51:55.399078 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 6d94eb734df94a309a7b171d907c81da because the tablet was not found. No further retry: Not found: Tablet not found: 6d94eb734df94a309a7b171d907c81da
I20260616 19:51:55.399109 1193 rpcz_store.cc:276] 0616 19:51:54.244035 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.244114 (+ 79us) service_pool.cc:224] Handling call
0616 19:51:55.398850 (+1154736us) ts_tablet_manager.cc:1151] Deleting tablet 815d213bf1904353b4f0b2e2f8954db9
0616 19:51:55.398860 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:55.398950 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1154458}
W20260616 19:51:55.399549 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 815d213bf1904353b4f0b2e2f8954db9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 815d213bf1904353b4f0b2e2f8954db9 already in progress: creating tablet
I20260616 19:51:55.399483 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 185) took 1155 ms. Trace:
I20260616 19:51:55.399962 1193 rpcz_store.cc:276] 0616 19:51:54.244269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.244430 (+ 161us) service_pool.cc:224] Handling call
0616 19:51:55.399324 (+1154894us) ts_tablet_manager.cc:1151] Deleting tablet 39f52eebdc79460a9ff33191086e87c6
0616 19:51:55.399334 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:55.399446 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1154664}
I20260616 19:51:55.400246 1193 tablet_replica.cc:333] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:51:55.400446 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 39f52eebdc79460a9ff33191086e87c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39f52eebdc79460a9ff33191086e87c6 already in progress: creating tablet
I20260616 19:51:55.402165 1205 raft_consensus.cc:515] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:55.402732 1193 raft_consensus.cc:2243] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.402927 1193 raft_consensus.cc:2272] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.403344 1205 leader_election.cc:290] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:55.403507 1193 ts_tablet_manager.cc:1916] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.403911 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ceb5a01be24dfb9c08001d662a9ac4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:55.404152 923 raft_consensus.cc:3060] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:51:55.404934 719 leader_election.cc:343] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 54ceb5a01be24dfb9c08001d662a9ac4
I20260616 19:51:55.397274 896 tablet_service.cc:1511] Processing CreateTablet for tablet 8a718fefe07141119b7ef7edcbf61123 (DEFAULT_TABLE table=default.Table_db902752da5f4f3ab65c0b21c57d34a9 [id=347e25a5fa42418fa9952ed1e6bf9c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.406009 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6939d108a7948bb9e56311a34d95486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.421583 1193 ts_tablet_manager.cc:1929] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.423511 1193 log.cc:1199] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/fcfc9231ffeb487cb15ed2a3788730ba
I20260616 19:51:55.424160 1193 ts_tablet_manager.cc:1950] T fcfc9231ffeb487cb15ed2a3788730ba P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:55.429258 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 186) took 1167 ms. Trace:
I20260616 19:51:55.429502 1193 rpcz_store.cc:276] 0616 19:51:54.261790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.261858 (+ 68us) service_pool.cc:224] Handling call
0616 19:51:55.400179 (+1138321us) ts_tablet_manager.cc:1151] Deleting tablet fcfc9231ffeb487cb15ed2a3788730ba
0616 19:51:55.400189 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:55.414036 (+ 13847us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:55.421482 (+ 7446us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:55.429181 (+ 7699us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1138065}
I20260616 19:51:55.430510 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet fcfc9231ffeb487cb15ed2a3788730ba (table default.Table_6a9c2eded2954f7282a8fa6d68278896 [id=54246691d67e4a68a4a9d955919d998c]) successfully deleted
I20260616 19:51:55.431061 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 187) took 1151 ms. Trace:
I20260616 19:51:55.431273 1193 rpcz_store.cc:276] 0616 19:51:54.279373 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.279434 (+ 61us) service_pool.cc:224] Handling call
0616 19:51:55.430858 (+1151424us) ts_tablet_manager.cc:1151] Deleting tablet 362e7ff9bea3459ca018d1a7febb2ce4
0616 19:51:55.430869 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:55.431002 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1151156}
W20260616 19:51:55.431867 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 362e7ff9bea3459ca018d1a7febb2ce4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 362e7ff9bea3459ca018d1a7febb2ce4 already in progress: creating tablet
I20260616 19:51:55.432385 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 188) took 1139 ms. Trace:
I20260616 19:51:55.432672 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a718fefe07141119b7ef7edcbf61123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.432576 1193 rpcz_store.cc:276] 0616 19:51:54.293126 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.293187 (+ 61us) service_pool.cc:224] Handling call
0616 19:51:55.432216 (+1139029us) ts_tablet_manager.cc:1151] Deleting tablet 8125dce4d32a416498b42a1b599355fd
0616 19:51:55.432224 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:55.432314 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1138456}
W20260616 19:51:55.433091 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8125dce4d32a416498b42a1b599355fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8125dce4d32a416498b42a1b599355fd already in progress: creating tablet
I20260616 19:51:55.433570 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 189) took 1078 ms. Trace:
I20260616 19:51:55.434115 923 raft_consensus.cc:2468] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:51:55.433804 1193 rpcz_store.cc:276] 0616 19:51:54.354714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.360534 (+ 5820us) service_pool.cc:224] Handling call
0616 19:51:55.433377 (+1072843us) ts_tablet_manager.cc:1151] Deleting tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f
0616 19:51:55.433388 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:55.433505 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1072594}
I20260616 19:51:55.434921 718 leader_election.cc:304] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:55.435528 1411 raft_consensus.cc:2804] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
W20260616 19:51:55.435593 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f already in progress: creating tablet
I20260616 19:51:55.435835 1411 raft_consensus.cc:697] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:51:55.436060 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 190) took 1054 ms. Trace:
I20260616 19:51:55.436154 1193 rpcz_store.cc:276] 0616 19:51:54.381362 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.381417 (+ 55us) service_pool.cc:224] Handling call
0616 19:51:55.435860 (+1054443us) ts_tablet_manager.cc:1151] Deleting tablet 10fc1d2ecaa746bab980a708dd8eb93a
0616 19:51:55.435873 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:55.435989 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1054222}
W20260616 19:51:55.436592 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 10fc1d2ecaa746bab980a708dd8eb93a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10fc1d2ecaa746bab980a708dd8eb93a already in progress: creating tablet
I20260616 19:51:55.436568 1411 consensus_queue.cc:237] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:55.437387 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a170db3d27fd40c1b74deab29e9a033f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a170db3d27fd40c1b74deab29e9a033f already in progress: creating tablet
W20260616 19:51:55.439885 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 99b211692aca478bb40f0f2c3f50ca44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99b211692aca478bb40f0f2c3f50ca44 already in progress: creating tablet
I20260616 19:51:55.440284 1193 tablet_replica.cc:333] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:55.435184 1205 raft_consensus.cc:493] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:55.442397 1205 raft_consensus.cc:515] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.443403 1205 leader_election.cc:290] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:51:55.444478 719 leader_election.cc:343] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: c557049a020a4b318bb6e8a53710a6cc
I20260616 19:51:55.447860 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c557049a020a4b318bb6e8a53710a6cc" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:51:55.448493 718 leader_election.cc:343] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:55.448658 718 leader_election.cc:304] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:55.449175 1205 raft_consensus.cc:2749] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:55.454176 1193 raft_consensus.cc:2243] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:55.454826 1193 pending_rounds.cc:70] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:51:55.454893 1193 pending_rounds.cc:77] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595455231598592 op_type: NO_OP noop_request { }
I20260616 19:51:55.455018 1193 raft_consensus.cc:2889] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:55.455120 1193 raft_consensus.cc:2272] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.460613 1193 ts_tablet_manager.cc:1916] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.467269 1193 ts_tablet_manager.cc:1929] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:55.467514 1193 log.cc:1199] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/54ceb5a01be24dfb9c08001d662a9ac4
I20260616 19:51:55.468236 1193 ts_tablet_manager.cc:1950] T 54ceb5a01be24dfb9c08001d662a9ac4 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:55.469559 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 54ceb5a01be24dfb9c08001d662a9ac4 (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]) successfully deleted
I20260616 19:51:55.470470 1193 tablet_replica.cc:333] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:51:55.470611 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8eab5bd3967c42e1b6b79558df742946 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8eab5bd3967c42e1b6b79558df742946 already in progress: creating tablet
W20260616 19:51:55.470893 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 13e4e52fae124d4085b15e143e98a7e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13e4e52fae124d4085b15e143e98a7e4 already in progress: creating tablet
I20260616 19:51:55.470685 1193 raft_consensus.cc:2243] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260616 19:51:55.471140 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 662e2d573bd7489a81697c17393ce088 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 662e2d573bd7489a81697c17393ce088 already in progress: creating tablet
I20260616 19:51:55.471284 1193 raft_consensus.cc:2272] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:55.471339 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f2c392b2fecd483d9da12e30e37f27ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2c392b2fecd483d9da12e30e37f27ad already in progress: creating tablet
W20260616 19:51:55.471549 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet eb024637294148c18b74bef47fb2fcce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb024637294148c18b74bef47fb2fcce already in progress: creating tablet
W20260616 19:51:55.471746 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 5ba2eefdfed14791b5a41decc34dce44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ba2eefdfed14791b5a41decc34dce44 already in progress: creating tablet
I20260616 19:51:55.471824 1193 ts_tablet_manager.cc:1916] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:51:55.472018 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1d368ec65b624ea58f7b750097a78ede because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d368ec65b624ea58f7b750097a78ede already in progress: creating tablet
I20260616 19:51:55.503008 1193 ts_tablet_manager.cc:1929] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.511837 1193 log.cc:1199] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/c557049a020a4b318bb6e8a53710a6cc
I20260616 19:51:55.512928 1193 ts_tablet_manager.cc:1950] T c557049a020a4b318bb6e8a53710a6cc P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:55.515465 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet c557049a020a4b318bb6e8a53710a6cc (table default.Table_f29c0729614141a183a4aa7787c0a612 [id=7792ca664dbe4df5865c5a17ebd30d28]) successfully deleted
W20260616 19:51:55.518756 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 36ea9b8ba668410bae016a008cf37910 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ea9b8ba668410bae016a008cf37910 already in progress: creating tablet
I20260616 19:51:55.520780 1443 raft_consensus.cc:493] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:51:55.520963 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d270afd0c0f3457aa6dd14721dca261d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d270afd0c0f3457aa6dd14721dca261d already in progress: creating tablet
W20260616 19:51:55.522146 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 4bd6fa49eff4400ca40c722e18cea951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bd6fa49eff4400ca40c722e18cea951 already in progress: creating tablet
W20260616 19:51:55.523839 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d916b2f553ce41df8934e1190fa32120 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d916b2f553ce41df8934e1190fa32120 already in progress: creating tablet
W20260616 19:51:55.525290 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet fdc6222db09d4cd987cbdf70e4d40f70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdc6222db09d4cd987cbdf70e4d40f70 already in progress: creating tablet
W20260616 19:51:55.526743 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 3587c1ab487a424eb82f378ae081f514 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3587c1ab487a424eb82f378ae081f514 already in progress: creating tablet
I20260616 19:51:55.532153 1457 raft_consensus.cc:493] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:55.526214 1443 raft_consensus.cc:515] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.535751 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac603a84d3c4f96bd444c54f28d278d" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:55.537994 860 leader_election.cc:343] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:55.538265 1443 leader_election.cc:290] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:55.532418 1457 raft_consensus.cc:515] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:55.556052 1457 leader_election.cc:290] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:55.556218 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d22240d294454cbeb2ca5b07d45273" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:55.560876 1411 raft_consensus.cc:493] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:55.561123 1411 raft_consensus.cc:515] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.561923 1411 leader_election.cc:290] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:51:55.563143 719 leader_election.cc:343] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: a2b6158b31b34419aa3619f3ce8242b3
W20260616 19:51:55.563768 860 leader_election.cc:343] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:55.570155 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b6158b31b34419aa3619f3ce8242b3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:55.570693 1190 raft_consensus.cc:2243] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
W20260616 19:51:55.570917 718 leader_election.cc:343] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:55.571137 718 leader_election.cc:304] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:55.571674 1411 raft_consensus.cc:2749] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:51:55.568953 858 leader_election.cc:343] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: eac603a84d3c4f96bd444c54f28d278d
I20260616 19:51:55.573071 1190 pending_rounds.cc:70] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:51:55.573163 1190 pending_rounds.cc:77] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595454233923584 op_type: NO_OP noop_request { }
I20260616 19:51:55.574645 1190 raft_consensus.cc:2889] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:55.574785 1190 raft_consensus.cc:2272] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.577986 858 leader_election.cc:304] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
W20260616 19:51:55.584851 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 46943.4us
W20260616 19:51:55.587129 858 leader_election.cc:343] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 31d22240d294454cbeb2ca5b07d45273
I20260616 19:51:55.602648 1459 raft_consensus.cc:2749] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:55.602959 858 leader_election.cc:304] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:55.615918 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_120e5c908fe348a7ab3ff54504e841ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:55.617460 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_718b661372f441feb171907daff44e2d" } modify_external_catalogs: true
I20260616 19:51:55.617471 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3fde6faf0f8549f69328d3129ad9f367" } modify_external_catalogs: true
I20260616 19:51:55.617727 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3fde6faf0f8549f69328d3129ad9f367" } modify_external_catalogs: true
I20260616 19:51:55.617733 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_718b661372f441feb171907daff44e2d" } modify_external_catalogs: true
I20260616 19:51:55.620074 1198 tablet_bootstrap.cc:492] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:55.620245 1198 ts_tablet_manager.cc:1403] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.272s user 0.002s sys 0.003s
W20260616 19:51:55.621078 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_120e5c908fe348a7ab3ff54504e841ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.621241 1198 raft_consensus.cc:359] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.621459 1198 raft_consensus.cc:385] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.621551 1198 raft_consensus.cc:740] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.621857 1198 consensus_queue.cc:260] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.624555 1198 ts_tablet_manager.cc:1434] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260616 19:51:55.625447 1459 raft_consensus.cc:2749] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:51:55.641768 1445 consensus_queue.cc:1175] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260616 19:51:55.643100 1190 ts_tablet_manager.cc:1916] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.652866 1190 ts_tablet_manager.cc:1929] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:55.653227 1190 log.cc:1199] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/d916b2f553ce41df8934e1190fa32120
I20260616 19:51:55.653808 1190 ts_tablet_manager.cc:1950] T d916b2f553ce41df8934e1190fa32120 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:55.655238 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet d916b2f553ce41df8934e1190fa32120 (table default.Table_647cdefd19814321b51ee0898effc29c [id=7b17c97ad92b4ead8f60bf602853cd61]) successfully deleted
W20260616 19:51:55.656230 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 36ea9b8ba668410bae016a008cf37910 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ea9b8ba668410bae016a008cf37910 already in progress: creating tablet
W20260616 19:51:55.657042 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 4bd6fa49eff4400ca40c722e18cea951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bd6fa49eff4400ca40c722e18cea951 already in progress: creating tablet
W20260616 19:51:55.657729 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d270afd0c0f3457aa6dd14721dca261d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d270afd0c0f3457aa6dd14721dca261d already in progress: creating tablet
I20260616 19:51:55.658131 1190 tablet_replica.cc:333] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:55.658418 1190 raft_consensus.cc:2243] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.658701 1190 raft_consensus.cc:2272] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.659392 1190 ts_tablet_manager.cc:1916] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.660169 1452 mvcc.cc:204] Tried to move back new op lower bound from 7297595451635408896 to 7297595449994428416. Current Snapshot: MvccSnapshot[applied={T|T < 7297595451635408896}]
I20260616 19:51:55.670455 1196 tablet_bootstrap.cc:492] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:55.672297 1196 ts_tablet_manager.cc:1403] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.335s user 0.034s sys 0.065s
I20260616 19:51:55.673714 1196 raft_consensus.cc:359] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.674006 1196 raft_consensus.cc:385] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.674209 1196 raft_consensus.cc:740] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.674588 1196 consensus_queue.cc:260] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.674837 1198 tablet_bootstrap.cc:492] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:55.675135 1196 ts_tablet_manager.cc:1434] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:51:55.676740 1198 tablet_bootstrap.cc:654] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.676779 1196 tablet_bootstrap.cc:492] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:55.678673 1196 tablet_bootstrap.cc:654] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.679495 1210 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.188:34219
I20260616 19:51:55.679563 1464 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.188:34219 every 8 connection(s)
I20260616 19:51:55.679869 1192 tablet_bootstrap.cc:492] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:55.680037 1192 ts_tablet_manager.cc:1403] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.581s user 0.013s sys 0.003s
I20260616 19:51:55.681022 1192 raft_consensus.cc:359] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.681228 1192 raft_consensus.cc:385] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.681461 1192 raft_consensus.cc:740] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.681756 1192 consensus_queue.cc:260] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.681928 1210 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/info.pb
I20260616 19:51:55.682505 1192 ts_tablet_manager.cc:1434] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:55.683552 1192 tablet_bootstrap.cc:492] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:55.688728 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasknFdngH/build/asan/bin/kudu as pid 1210
I20260616 19:51:55.690048 1198 tablet_bootstrap.cc:492] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:55.690212 1198 ts_tablet_manager.cc:1403] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260616 19:51:55.691911 1196 tablet_bootstrap.cc:492] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:55.692126 1196 ts_tablet_manager.cc:1403] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.005s
I20260616 19:51:55.692982 1196 raft_consensus.cc:359] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.695330 461 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 21408288aae545cba9aa65afbc29a0e3 (table default.Table_e6fa01673a5f49c5b6198541d6d74674 [id=0342973a46bc4b93b84b0220163e9975]). Expected version 1 got 0
W20260616 19:51:55.696185 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet f13d175adfe540b39fd55004a11c9aad (table default.Table_2476a078d16f4862bceb42e0e78e1495 [id=f7089c8c9b504f13949fd8db2c11c45c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f13d175adfe540b39fd55004a11c9aad consensus state has no leader
I20260616 19:51:55.697244 1192 tablet_bootstrap.cc:654] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.699137 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 1d368ec65b624ea58f7b750097a78ede from {username='slave'} at 127.0.0.1:41696
W20260616 19:51:55.700562 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5f60e9778dd429c8bdbf96261901a56 consensus state has no leader
I20260616 19:51:55.702064 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 102f322eb98f4224acb8637f8c29ac19
I20260616 19:51:55.704903 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 102f322eb98f4224acb8637f8c29ac19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.706470 896 tablet_service.cc:1558] Processing DeleteTablet for tablet d916b2f553ce41df8934e1190fa32120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.710527 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 102f322eb98f4224acb8637f8c29ac19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.712679 1198 raft_consensus.cc:359] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:51:55.715477 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 102f322eb98f4224acb8637f8c29ac19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 102f322eb98f4224acb8637f8c29ac19 already in progress: creating tablet
I20260616 19:51:55.716382 1198 raft_consensus.cc:385] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.716569 1198 raft_consensus.cc:740] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.717970 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a438724efd6349269d52e1958ce629fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:55.718547 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_740f48968d6f4b38a0bd0dbcd42b9303" } new_table_name: "default.Table_6955250583bf4c3cbff20316dfa5d1a7" modify_external_catalogs: true
W20260616 19:51:55.718711 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a438724efd6349269d52e1958ce629fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.720002 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_263c9f8e2f2d4434a68825691c83d219" } new_table_name: "default.Table_2984957106b44cdc9ecd5a06e8edb7d3" modify_external_catalogs: true
I20260616 19:51:55.706825 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 102f322eb98f4224acb8637f8c29ac19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.721176 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_25651fb93ba2434cb75171647df9d2ec" } modify_external_catalogs: true
I20260616 19:51:55.721371 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_25651fb93ba2434cb75171647df9d2ec" } modify_external_catalogs: true
W20260616 19:51:55.721814 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 102f322eb98f4224acb8637f8c29ac19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 102f322eb98f4224acb8637f8c29ac19 already in progress: creating tablet
I20260616 19:51:55.722043 1196 raft_consensus.cc:385] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.722159 1196 raft_consensus.cc:740] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.722434 1196 consensus_queue.cc:260] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.724025 1196 ts_tablet_manager.cc:1434] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260616 19:51:55.724334 1196 tablet_bootstrap.cc:492] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:55.724682 1192 tablet_bootstrap.cc:492] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:55.724875 1192 ts_tablet_manager.cc:1403] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.000s
I20260616 19:51:55.725668 1192 raft_consensus.cc:359] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.725860 1192 raft_consensus.cc:385] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.725935 1192 raft_consensus.cc:740] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.726040 1196 tablet_bootstrap.cc:654] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.726244 1192 consensus_queue.cc:260] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.728056 1192 ts_tablet_manager.cc:1434] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:51:55.728366 1192 tablet_bootstrap.cc:492] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:55.730690 1192 tablet_bootstrap.cc:654] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.718664 1198 consensus_queue.cc:260] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.734848 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 776841d895d6431fbee76b7c4e28d973 (table default.Table_ebec5e10f80244469fca70fe48c270e8 [id=4d2238911f8d432095e4a20ee0dc6217]). Expected version 2 got 0
I20260616 19:51:55.735294 1198 ts_tablet_manager.cc:1434] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.045s user 0.003s sys 0.000s
I20260616 19:51:55.736425 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet fd5a513aeb224609afaee1ded6ede5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3de0e62cfd33410490a0b460fd5f69e9) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.736717 1198 tablet_bootstrap.cc:492] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:55.736724 1191 tablet_replica.cc:333] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:55.736984 1191 raft_consensus.cc:2243] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.737157 1196 tablet_bootstrap.cc:492] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:55.737176 1191 raft_consensus.cc:2272] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.737308 1196 ts_tablet_manager.cc:1403] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260616 19:51:55.738133 1191 ts_tablet_manager.cc:1916] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.738130 1196 raft_consensus.cc:359] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.738309 1196 raft_consensus.cc:385] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.738382 1196 raft_consensus.cc:740] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.738520 1198 tablet_bootstrap.cc:654] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.738688 1196 consensus_queue.cc:260] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.739341 1196 ts_tablet_manager.cc:1434] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:55.713286 1461 tablet.cc:1724] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:51:55.739630 1196 tablet_bootstrap.cc:492] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:55.740813 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 91336c7847ea4739a0be7fdd9d199cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.741714 1196 tablet_bootstrap.cc:654] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.744249 1190 ts_tablet_manager.cc:1929] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.744393 1190 log.cc:1199] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/31d22240d294454cbeb2ca5b07d45273
I20260616 19:51:55.744851 1190 ts_tablet_manager.cc:1950] T 31d22240d294454cbeb2ca5b07d45273 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:55.745517 1465 sys_catalog.cc:263] Verifying existing consensus state
I20260616 19:51:55.750047 1465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: Bootstrap starting.
I20260616 19:51:55.753182 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 31d22240d294454cbeb2ca5b07d45273 (table default.Table_41371955e37644fda9a23d0fba091c86 [id=3f2766ea54a141eb84ccb6625a0d04b6]) successfully deleted
I20260616 19:51:55.757475 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9060de590fa84ea08dc7d39765bc9308
I20260616 19:51:55.758271 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 9060de590fa84ea08dc7d39765bc9308 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.758338 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 9060de590fa84ea08dc7d39765bc9308 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.759347 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet ab33d99d857145dfbda54ff2f7464486 (table default.Table_de7cf8cf7c43409b9c41391ff6e8ba35 [id=122f88b500c0425e833926b349605d6f]). Expected version 3 got 0
W20260616 19:51:55.759480 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 9060de590fa84ea08dc7d39765bc9308 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9060de590fa84ea08dc7d39765bc9308 already in progress: creating tablet
I20260616 19:51:55.760164 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1bfaf142b33c42df9480c0fd9ec9b5ea" } new_table_name: "default.Table_1516f5dc3b2b4de48c2c4076d1cb1205" modify_external_catalogs: true
I20260616 19:51:55.760673 1190 tablet_replica.cc:333] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:55.761020 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 9060de590fa84ea08dc7d39765bc9308 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.761390 1190 raft_consensus.cc:2243] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.761662 1190 raft_consensus.cc:2272] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.762321 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_70f2f37a1352492e82eb6083bc7e0f53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:55.764686 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 90205213ba5f49a2931e68839cefb2d2
I20260616 19:51:55.765532 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 44493f0ffd064249a28628cf24895395
I20260616 19:51:55.765944 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 90205213ba5f49a2931e68839cefb2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.768566 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 44493f0ffd064249a28628cf24895395 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.768883 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 90205213ba5f49a2931e68839cefb2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:55.769018 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 90205213ba5f49a2931e68839cefb2d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90205213ba5f49a2931e68839cefb2d2 already in progress: creating tablet
I20260616 19:51:55.769760 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 44493f0ffd064249a28628cf24895395 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:55.770735 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 44493f0ffd064249a28628cf24895395 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44493f0ffd064249a28628cf24895395 already in progress: creating tablet
I20260616 19:51:55.771971 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 44493f0ffd064249a28628cf24895395 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.772215 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 90205213ba5f49a2931e68839cefb2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:55.775053 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70f2f37a1352492e82eb6083bc7e0f53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.777706 1196 tablet_bootstrap.cc:492] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:55.777971 1196 ts_tablet_manager.cc:1403] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.004s
I20260616 19:51:55.778578 1191 ts_tablet_manager.cc:1929] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.779078 1196 raft_consensus.cc:359] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:55.779413 1196 raft_consensus.cc:385] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.779559 1196 raft_consensus.cc:740] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.779902 1196 consensus_queue.cc:260] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:55.780725 1196 ts_tablet_manager.cc:1434] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:51:55.781263 1196 tablet_bootstrap.cc:492] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:55.786438 1192 tablet_bootstrap.cc:492] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:55.786437 1191 log.cc:1199] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/fd5a513aeb224609afaee1ded6ede5e6
I20260616 19:51:55.786700 1192 ts_tablet_manager.cc:1403] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.000s
I20260616 19:51:55.786839 1191 ts_tablet_manager.cc:1950] T fd5a513aeb224609afaee1ded6ede5e6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:55.791227 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_186eb03ebeeb4351b7cd0feeaebd1ef3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:55.791873 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7dc92bc15da14504a1ff5feda5aff7cf consensus state has no leader
W20260616 19:51:55.792002 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_186eb03ebeeb4351b7cd0feeaebd1ef3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.793991 1196 tablet_bootstrap.cc:654] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.795915 1190 ts_tablet_manager.cc:1916] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.795898 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c9853be5ddb04bc5b661d36f41042814"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:55.796787 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f52b2c5ff6264ffe8d579cb3816fc253
I20260616 19:51:55.797679 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b9effa349ec04a8989934380e9153218"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:55.798358 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9effa349ec04a8989934380e9153218 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.806600 1198 tablet_bootstrap.cc:492] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:55.806767 1198 ts_tablet_manager.cc:1403] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.070s user 0.004s sys 0.000s
I20260616 19:51:55.807686 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet f52b2c5ff6264ffe8d579cb3816fc253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.807773 1198 raft_consensus.cc:359] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.807986 1198 raft_consensus.cc:385] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.808080 1198 raft_consensus.cc:740] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.808338 1198 consensus_queue.cc:260] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.808949 1198 ts_tablet_manager.cc:1434] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:55.806047 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f4b949adef834904a68e4b48dd6561cb" } new_table_name: "default.Table_010bd6ff844d4227b21111bb4499d70b" modify_external_catalogs: true
I20260616 19:51:55.809166 749 tablet_service.cc:1558] Processing DeleteTablet for tablet f52b2c5ff6264ffe8d579cb3816fc253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.810828 1198 tablet_bootstrap.cc:492] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:55.812775 1198 tablet_bootstrap.cc:654] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.815043 1105 heartbeater.cc:344] Connected to a master server at 127.0.105.188:34219
I20260616 19:51:55.815224 1105 heartbeater.cc:499] Master 127.0.105.188:34219 was elected leader, sending a full tablet report...
I20260616 19:51:55.815277 1059 raft_consensus.cc:1275] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Refusing update from remote peer 7245e7dab0ec474a876537be514c8767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260616 19:51:55.816249 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e8160ad4cf74f16a586ae59291ce7d1 consensus state has no leader
I20260616 19:51:55.817615 830 heartbeater.cc:344] Connected to a master server at 127.0.105.188:34219
I20260616 19:51:55.819088 1411 consensus_queue.cc:1048] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:51:55.822355 1196 tablet_bootstrap.cc:492] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
W20260616 19:51:55.822424 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f52b2c5ff6264ffe8d579cb3816fc253 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f52b2c5ff6264ffe8d579cb3816fc253 already in progress: creating tablet
I20260616 19:51:55.822535 1196 ts_tablet_manager.cc:1403] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
W20260616 19:51:55.822742 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9853be5ddb04bc5b661d36f41042814 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.822979 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 7161894b9f9047fda9ed3f2180518a59 with delete_type TABLET_DATA_DELETED (replaced by tablet 4ffce2dc22e24d1684e6eae92c487cea) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.823544 455 master_service.cc:960] ReplaceTablet: received request to replace tablet eac603a84d3c4f96bd444c54f28d278d from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:55.823951 1196 raft_consensus.cc:359] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:55.824198 1196 raft_consensus.cc:385] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.824275 1196 raft_consensus.cc:740] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.824302 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 79efb1de93bc4c1e81f4b2e15f621417 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:55.824545 1196 consensus_queue.cc:260] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:55.825166 1196 ts_tablet_manager.cc:1434] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260616 19:51:55.826169 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d3f47e767764032ae5a06e34e2de248 consensus state has no leader
I20260616 19:51:55.826985 454 master_service.cc:960] ReplaceTablet: received request to replace tablet a170db3d27fd40c1b74deab29e9a033f from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:55.824067 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b887f50c6ede4a7285250a86ad6b5a87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:55.829195 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b887f50c6ede4a7285250a86ad6b5a87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.831629 1196 tablet_bootstrap.cc:492] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:55.832429 1105 heartbeater.cc:499] Master 127.0.105.188:34219 was elected leader, sending a full tablet report...
I20260616 19:51:55.833514 1196 tablet_bootstrap.cc:654] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.840229 1465 log.cc:826] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: Log is configured to *not* fsync() on all Append() calls
I20260616 19:51:55.842842 1196 tablet_bootstrap.cc:492] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:55.843134 1196 ts_tablet_manager.cc:1403] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.004s
W20260616 19:51:55.843977 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5029a79e046a489aa9976eff948a3c5b consensus state has no leader
I20260616 19:51:55.845647 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 79efb1de93bc4c1e81f4b2e15f621417 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:55.849836 1196 raft_consensus.cc:359] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.851382 1196 raft_consensus.cc:385] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.852659 1196 raft_consensus.cc:740] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.853199 1196 consensus_queue.cc:260] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.862329 1196 ts_tablet_manager.cc:1434] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.019s user 0.000s sys 0.002s
I20260616 19:51:55.865598 896 tablet_service.cc:1558] Processing DeleteTablet for tablet f52b2c5ff6264ffe8d579cb3816fc253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.866045 1192 raft_consensus.cc:359] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.866288 1192 raft_consensus.cc:385] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.866408 1192 raft_consensus.cc:740] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.866720 1192 consensus_queue.cc:260] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.867384 1192 ts_tablet_manager.cc:1434] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.081s user 0.001s sys 0.000s
W20260616 19:51:55.867977 718 consensus_peers.cc:597] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:51:55.868518 1192 tablet_bootstrap.cc:492] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:55.869685 1488 tablet.cc:1724] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:51:55.870584 1192 tablet_bootstrap.cc:654] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.876139 1190 ts_tablet_manager.cc:1929] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.879161 1190 log.cc:1199] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/54ceb5a01be24dfb9c08001d662a9ac4
I20260616 19:51:55.879799 1190 ts_tablet_manager.cc:1950] T 54ceb5a01be24dfb9c08001d662a9ac4 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:55.881246 969 heartbeater.cc:344] Connected to a master server at 127.0.105.188:34219
I20260616 19:51:55.883270 1198 tablet_bootstrap.cc:492] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:55.883472 1198 ts_tablet_manager.cc:1403] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.009s
I20260616 19:51:55.884262 1198 raft_consensus.cc:359] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.884517 1198 raft_consensus.cc:385] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.884590 1198 raft_consensus.cc:740] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.886797 1190 tablet_replica.cc:333] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:55.888124 1198 consensus_queue.cc:260] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.888569 1190 raft_consensus.cc:2243] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.888806 1190 raft_consensus.cc:2272] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.889170 1192 tablet_bootstrap.cc:492] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:55.889331 1192 ts_tablet_manager.cc:1403] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20260616 19:51:55.889496 1190 ts_tablet_manager.cc:1916] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.890174 1192 raft_consensus.cc:359] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.890381 1192 raft_consensus.cc:385] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.890580 1192 raft_consensus.cc:740] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.890810 1192 consensus_queue.cc:260] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.891314 1192 ts_tablet_manager.cc:1434] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:55.892055 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet fd5a513aeb224609afaee1ded6ede5e6 (table default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]) successfully deleted
I20260616 19:51:55.892562 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 54ceb5a01be24dfb9c08001d662a9ac4 (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]) successfully deleted
I20260616 19:51:55.894658 1196 tablet_bootstrap.cc:492] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:55.894958 1198 ts_tablet_manager.cc:1434] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
W20260616 19:51:55.895797 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 9060de590fa84ea08dc7d39765bc9308 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9060de590fa84ea08dc7d39765bc9308 already in progress: creating tablet
I20260616 19:51:55.896130 1192 tablet_bootstrap.cc:492] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:51:55.897271 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 44493f0ffd064249a28628cf24895395 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44493f0ffd064249a28628cf24895395 already in progress: creating tablet
W20260616 19:51:55.897506 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 90205213ba5f49a2931e68839cefb2d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90205213ba5f49a2931e68839cefb2d2 already in progress: creating tablet
W20260616 19:51:55.898720 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet f52b2c5ff6264ffe8d579cb3816fc253 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f52b2c5ff6264ffe8d579cb3816fc253 already in progress: creating tablet
I20260616 19:51:55.900315 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:55.901002 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet ab33d99d857145dfbda54ff2f7464486 (table default.Table_de7cf8cf7c43409b9c41391ff6e8ba35 [id=122f88b500c0425e833926b349605d6f]). Expected version 3 got 0
I20260616 19:51:55.901399 1196 tablet_bootstrap.cc:654] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.902235 1192 tablet_bootstrap.cc:654] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.905820 896 tablet_service.cc:1511] Processing CreateTablet for tablet e6530753b4184cfe972ae3a43f23d589 (DEFAULT_TABLE table=default.Table_827a69aca36a453db1e09ffa7d2b535c [id=99e870e6f821406bb65af1f96f5ad30f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.906350 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6530753b4184cfe972ae3a43f23d589. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:55.913273 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.915683 1192 tablet_bootstrap.cc:492] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:55.915845 1192 ts_tablet_manager.cc:1403] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.011s
I20260616 19:51:55.916734 1192 raft_consensus.cc:359] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.916944 1192 raft_consensus.cc:385] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.917052 1192 raft_consensus.cc:740] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.917348 1192 consensus_queue.cc:260] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.918123 1192 ts_tablet_manager.cc:1434] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260616 19:51:55.918541 1192 tablet_bootstrap.cc:492] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:55.920363 749 tablet_service.cc:1511] Processing CreateTablet for tablet e6530753b4184cfe972ae3a43f23d589 (DEFAULT_TABLE table=default.Table_827a69aca36a453db1e09ffa7d2b535c [id=99e870e6f821406bb65af1f96f5ad30f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.920837 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6530753b4184cfe972ae3a43f23d589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.920946 1192 tablet_bootstrap.cc:654] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.925884 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7b664bd6d3594152b56ffda505361969"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:55.926554 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b664bd6d3594152b56ffda505361969 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:55.928581 1028 tablet_service.cc:1511] Processing CreateTablet for tablet e6530753b4184cfe972ae3a43f23d589 (DEFAULT_TABLE table=default.Table_827a69aca36a453db1e09ffa7d2b535c [id=99e870e6f821406bb65af1f96f5ad30f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.932403 1192 tablet_bootstrap.cc:492] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:55.932597 1192 ts_tablet_manager.cc:1403] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.004s
I20260616 19:51:55.932776 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cfe1476b261844838747bb5597d50449" } new_table_name: "default.Table_8d5fed2f6cff49c4b8a9cd2c5a907fa9" modify_external_catalogs: true
I20260616 19:51:55.934538 1192 raft_consensus.cc:359] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:55.934839 1192 raft_consensus.cc:385] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.934940 1192 raft_consensus.cc:740] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.935292 1192 consensus_queue.cc:260] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:55.935952 1192 ts_tablet_manager.cc:1434] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:51:55.936328 1192 tablet_bootstrap.cc:492] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:55.936645 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5f98dbc56e0e44ba93e5e67cb2a74652" } modify_external_catalogs: true
I20260616 19:51:55.936861 456 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet b5f60e9778dd429c8bdbf96261901a56 (table default.Table_dfb3308f15684b20b5d49353c0a255e7 [id=91db6a529c234ab1b026fba00e18a7ef]). Expected version 1 got 0
I20260616 19:51:55.938325 751 tablet_service.cc:1511] Processing CreateTablet for tablet 84ce7bf3e0004ffaa2c5e314fa69322c (DEFAULT_TABLE table=default.Table_9858decdd2fb4e0cb9fdea7022f1962b [id=4f2b128cff5248f98e3506bb72a39391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.938476 1192 tablet_bootstrap.cc:654] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.938769 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ce7bf3e0004ffaa2c5e314fa69322c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.946712 1192 tablet_bootstrap.cc:492] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:55.946871 1192 ts_tablet_manager.cc:1403] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.002s
I20260616 19:51:55.948088 1192 raft_consensus.cc:359] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.948273 1192 raft_consensus.cc:385] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.948381 1192 raft_consensus.cc:740] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.948683 1192 consensus_queue.cc:260] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.948910 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5f98dbc56e0e44ba93e5e67cb2a74652" } modify_external_catalogs: true
I20260616 19:51:55.949247 1192 ts_tablet_manager.cc:1434] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:51:55.949550 1192 tablet_bootstrap.cc:492] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:55.952243 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 79efb1de93bc4c1e81f4b2e15f621417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:55.952979 1192 tablet_bootstrap.cc:654] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.958529 900 tablet_service.cc:1558] Processing DeleteTablet for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.961634 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet da380823d0ae437d9f1d9d0f633f74bb (table default.Table_fdb76eb70534433eae79f807fd35fb90 [id=46c822de2dc2471d847af2e018102efc]). Expected version 2 got 0
I20260616 19:51:55.961861 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet b5f60e9778dd429c8bdbf96261901a56 (table default.Table_dfb3308f15684b20b5d49353c0a255e7 [id=91db6a529c234ab1b026fba00e18a7ef]). Expected version 1 got 0
I20260616 19:51:55.963887 1192 tablet_bootstrap.cc:492] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:55.964097 1192 ts_tablet_manager.cc:1403] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.002s
I20260616 19:51:55.964272 757 tablet_service.cc:1558] Processing DeleteTablet for tablet a2b6158b31b34419aa3619f3ce8242b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.964639 1193 tablet_replica.cc:333] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:55.964869 1193 raft_consensus.cc:2243] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.964972 754 tablet_service.cc:1558] Processing DeleteTablet for tablet de0ea6ca79ff4ed09f63fc7bb98eaabd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.965102 1193 raft_consensus.cc:2272] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.965059 1192 raft_consensus.cc:359] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.965214 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 91336c7847ea4739a0be7fdd9d199cca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.965288 1192 raft_consensus.cc:385] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:55.965365 1192 raft_consensus.cc:740] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:55.965699 1193 ts_tablet_manager.cc:1916] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.965634 1192 consensus_queue.cc:260] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:55.966132 1192 ts_tablet_manager.cc:1434] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:51:55.966456 1192 tablet_bootstrap.cc:492] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:55.968348 1192 tablet_bootstrap.cc:654] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:55.972046 757 tablet_service.cc:1558] Processing DeleteTablet for tablet e8351427cb34466f82ee74fb60b6798b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:55.978869 1193 ts_tablet_manager.cc:1929] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.980791 1193 log.cc:1199] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/a2b6158b31b34419aa3619f3ce8242b3
I20260616 19:51:55.981258 1193 ts_tablet_manager.cc:1950] T a2b6158b31b34419aa3619f3ce8242b3 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:55.982352 1193 tablet_replica.cc:333] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:55.982592 1193 raft_consensus.cc:2243] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.982985 1193 raft_consensus.cc:2272] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.983906 1193 ts_tablet_manager.cc:1916] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:55.988106 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a4005930ba1a454cb63502a2ac17055b" } modify_external_catalogs: true
I20260616 19:51:55.989980 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_44015174890646ee876b8d08923fc342" } modify_external_catalogs: true
I20260616 19:51:55.990646 1193 ts_tablet_manager.cc:1929] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:55.990826 1193 log.cc:1199] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/de0ea6ca79ff4ed09f63fc7bb98eaabd
I20260616 19:51:55.990834 900 tablet_service.cc:1558] Processing DeleteTablet for tablet c557049a020a4b318bb6e8a53710a6cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:55.991308 1193 ts_tablet_manager.cc:1950] T de0ea6ca79ff4ed09f63fc7bb98eaabd P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:55.991883 900 tablet_service.cc:1511] Processing CreateTablet for tablet 84ce7bf3e0004ffaa2c5e314fa69322c (DEFAULT_TABLE table=default.Table_9858decdd2fb4e0cb9fdea7022f1962b [id=4f2b128cff5248f98e3506bb72a39391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:55.992409 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ce7bf3e0004ffaa2c5e314fa69322c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:55.992486 1193 tablet_replica.cc:333] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:55.992743 1193 raft_consensus.cc:2243] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:55.992911 1193 raft_consensus.cc:2272] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:55.993786 1193 ts_tablet_manager.cc:1916] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.000126 1193 ts_tablet_manager.cc:1929] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.000414 1193 log.cc:1199] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/91336c7847ea4739a0be7fdd9d199cca
I20260616 19:51:56.000720 1191 tablet_replica.cc:333] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:56.000837 1193 ts_tablet_manager.cc:1950] T 91336c7847ea4739a0be7fdd9d199cca P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:56.001024 1191 raft_consensus.cc:2243] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.001297 1191 raft_consensus.cc:2272] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.001814 1193 tablet_replica.cc:333] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:56.002048 1193 raft_consensus.cc:2243] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.002308 1193 raft_consensus.cc:2272] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.002851 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6530753b4184cfe972ae3a43f23d589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.002960 1193 ts_tablet_manager.cc:1916] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.005007 1198 tablet_bootstrap.cc:492] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:56.006819 1198 tablet_bootstrap.cc:654] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.010386 1193 ts_tablet_manager.cc:1929] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.010574 1193 log.cc:1199] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/e8351427cb34466f82ee74fb60b6798b
I20260616 19:51:56.010983 1193 ts_tablet_manager.cc:1950] T e8351427cb34466f82ee74fb60b6798b P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:56.011247 1105 heartbeater.cc:499] Master 127.0.105.188:34219 was elected leader, sending a full tablet report...
I20260616 19:51:56.016448 1191 ts_tablet_manager.cc:1916] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.020833 894 tablet_service.cc:1558] Processing DeleteTablet for tablet a2b6158b31b34419aa3619f3ce8242b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.028599 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_44015174890646ee876b8d08923fc342" } modify_external_catalogs: true
I20260616 19:51:56.029105 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a4005930ba1a454cb63502a2ac17055b" } modify_external_catalogs: true
I20260616 19:51:56.030220 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d19f51d7b61e47dea882c1fd07d9a122"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:56.031065 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet a2b6158b31b34419aa3619f3ce8242b3 (table default.Table_62044432f4a549d8846c6d9d17274c1a [id=48ebc382fbde40f8a05ccb60001efe00]) successfully deleted
I20260616 19:51:56.031401 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet de0ea6ca79ff4ed09f63fc7bb98eaabd (table default.Table_6e469684e5b844a5b7f13a1047fd933a [id=7d5a7b1d32b147a3a8b5426c661dda2f]) successfully deleted
I20260616 19:51:56.031894 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 91336c7847ea4739a0be7fdd9d199cca (table default.Table_e1afc98c2d9741a9a1b9196cec4c5390 [id=9f6df425186b463d830a66539d63bcdd]) successfully deleted
I20260616 19:51:56.032109 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet e8351427cb34466f82ee74fb60b6798b (table default.Table_cd728ab6319e49a395bee4e74aff4e22 [id=69f6da4c9974486e9b1b7d5a3d28b373]) successfully deleted
I20260616 19:51:56.032775 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 97afcb75fdc2440d913ad421534a4ef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.033835 1192 tablet_bootstrap.cc:492] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.033988 1192 ts_tablet_manager.cc:1403] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.068s user 0.005s sys 0.012s
I20260616 19:51:56.034763 1192 raft_consensus.cc:359] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.034929 1192 raft_consensus.cc:385] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.035028 1192 raft_consensus.cc:740] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.035246 1192 consensus_queue.cc:260] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.036167 458 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet da380823d0ae437d9f1d9d0f633f74bb (table default.Table_fdb76eb70534433eae79f807fd35fb90 [id=46c822de2dc2471d847af2e018102efc]). Expected version 2 got 0
I20260616 19:51:56.037153 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7ad7ef9c768d41edaa47c8cd68466731"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:56.037921 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_be0f2a85266c49789e5476fc2f376467" } modify_external_catalogs: true
I20260616 19:51:56.038111 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_be0f2a85266c49789e5476fc2f376467" } modify_external_catalogs: true
I20260616 19:51:56.040756 1192 ts_tablet_manager.cc:1434] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20260616 19:51:56.041894 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ad7ef9c768d41edaa47c8cd68466731 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.042412 1196 tablet_bootstrap.cc:492] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:56.042658 1196 ts_tablet_manager.cc:1403] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.148s user 0.030s sys 0.053s
I20260616 19:51:56.043643 1196 raft_consensus.cc:359] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.043974 1196 raft_consensus.cc:385] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.044126 1196 raft_consensus.cc:740] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.044492 1196 consensus_queue.cc:260] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.049549 1458 raft_consensus.cc:493] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.050544 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 0bf54b260fc941599cffb12581e8116a from {username='slave'} at 127.0.0.1:41696
W20260616 19:51:56.053939 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d19f51d7b61e47dea882c1fd07d9a122 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.060492 1458 raft_consensus.cc:515] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.061448 1192 tablet_bootstrap.cc:492] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.062047 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da380823d0ae437d9f1d9d0f633f74bb" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:56.062255 784 raft_consensus.cc:2468] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:56.062809 860 leader_election.cc:304] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:56.065503 1451 raft_consensus.cc:2804] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:56.065629 1451 raft_consensus.cc:493] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:56.066210 1451 raft_consensus.cc:3060] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.067729 1458 leader_election.cc:290] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:56.068849 1192 tablet_bootstrap.cc:654] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.069916 1465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=5 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260616 19:51:56.070609 1465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: Bootstrap complete.
I20260616 19:51:56.070622 1451 raft_consensus.cc:515] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.071331 1451 leader_election.cc:290] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:56.071905 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da380823d0ae437d9f1d9d0f633f74bb" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:56.072113 784 raft_consensus.cc:3060] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.075361 784 raft_consensus.cc:2468] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:56.075917 860 leader_election.cc:304] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:51:56.076359 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79250767a94141cd900a9715e86128b8 consensus state has no leader
I20260616 19:51:56.076654 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 73a754c728b5408eb47f91de93554ec5
I20260616 19:51:56.078163 1451 raft_consensus.cc:493] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.079185 1451 raft_consensus.cc:515] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.081815 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_99062c985ddb45478d3464befd327e07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:56.083563 1451 leader_election.cc:290] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.085285 1451 raft_consensus.cc:2804] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:56.085685 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_daf95e025c454ee1b78a61861cc1a23d" } modify_external_catalogs: true
I20260616 19:51:56.085844 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_daf95e025c454ee1b78a61861cc1a23d" } modify_external_catalogs: true
W20260616 19:51:56.086081 858 leader_election.cc:343] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 91336c7847ea4739a0be7fdd9d199cca
I20260616 19:51:56.086223 1451 raft_consensus.cc:697] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:51:56.080052 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7f7b6caef24d427986f0670e307a057a" } new_table_name: "default.Table_838a16aef68b412b852a100461184990" modify_external_catalogs: true
I20260616 19:51:56.087905 1451 consensus_queue.cc:237] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:56.088660 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99062c985ddb45478d3464befd327e07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:56.090696 860 leader_election.cc:343] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 91336c7847ea4739a0be7fdd9d199cca
I20260616 19:51:56.090852 860 leader_election.cc:304] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:56.091290 1458 raft_consensus.cc:2749] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:56.092303 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 73a754c728b5408eb47f91de93554ec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:56.093221 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 73a754c728b5408eb47f91de93554ec5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73a754c728b5408eb47f91de93554ec5 already in progress: creating tablet
I20260616 19:51:56.094379 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 73a754c728b5408eb47f91de93554ec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.095059 1465 raft_consensus.cc:359] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:56.096328 1465 raft_consensus.cc:740] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c404c91cd2194cf6838fddd212f2f4ae, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.097204 1465 consensus_queue.cc:260] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:56.100847 1196 ts_tablet_manager.cc:1434] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.058s user 0.000s sys 0.002s
I20260616 19:51:56.104173 1500 sys_catalog.cc:455] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:56.105836 1196 tablet_bootstrap.cc:492] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:56.106482 1500 sys_catalog.cc:458] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:51:56.106364 1465 sys_catalog.cc:565] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: configured and running, proceeding with master startup.
I20260616 19:51:56.113768 1196 tablet_bootstrap.cc:654] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.116140 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet db75a5169c0b4650a551b8a76a724469
I20260616 19:51:56.118158 454 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 142d629ce7834a2aa42d651a76cadaaa
I20260616 19:51:56.119406 896 tablet_service.cc:1558] Processing DeleteTablet for tablet db75a5169c0b4650a551b8a76a724469 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.119724 1196 tablet_bootstrap.cc:492] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:56.121069 1196 ts_tablet_manager.cc:1403] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.001s
I20260616 19:51:56.121390 1458 raft_consensus.cc:493] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.121572 1458 raft_consensus.cc:515] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.121721 1379 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [term 1 FOLLOWER]: Advancing to term 2
I20260616 19:51:56.122282 1458 leader_election.cc:290] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.123199 1196 raft_consensus.cc:359] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.124120 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0bf54b260fc941599cffb12581e8116a
I20260616 19:51:56.125315 458 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_dfb3308f15684b20b5d49353c0a255e7 [id=91db6a529c234ab1b026fba00e18a7ef] alter complete (version 1)
I20260616 19:51:56.125870 1192 tablet_bootstrap.cc:492] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.126045 1192 ts_tablet_manager.cc:1403] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.077s user 0.005s sys 0.005s
I20260616 19:51:56.126453 757 tablet_service.cc:1558] Processing DeleteTablet for tablet a56168eb4f5e449a8f9eed5c8cfad9df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.128212 1193 tablet_replica.cc:333] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:56.128433 1193 raft_consensus.cc:2243] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.128545 757 tablet_service.cc:1558] Processing DeleteTablet for tablet d916b2f553ce41df8934e1190fa32120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.128639 1193 raft_consensus.cc:2272] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.128947 1196 raft_consensus.cc:385] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.129238 1196 raft_consensus.cc:740] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.129460 749 tablet_service.cc:1558] Processing DeleteTablet for tablet db75a5169c0b4650a551b8a76a724469 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.129305 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bf54b260fc941599cffb12581e8116a with delete_type TABLET_DATA_DELETED (replaced by tablet 5c74b39e66d344b99f8fc75b855c0520) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.129069 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f60e9778dd429c8bdbf96261901a56" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:56.129675 1196 consensus_queue.cc:260] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.130873 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet e91c377ae66441268351cd3592aa9dbc
I20260616 19:51:56.131357 1196 ts_tablet_manager.cc:1434] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260616 19:51:56.131731 1193 ts_tablet_manager.cc:1916] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.137841 751 tablet_service.cc:1558] Processing DeleteTablet for tablet e91c377ae66441268351cd3592aa9dbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.138127 1193 ts_tablet_manager.cc:1929] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.138177 1192 raft_consensus.cc:359] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.138278 1193 log.cc:1199] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/a56168eb4f5e449a8f9eed5c8cfad9df
I20260616 19:51:56.138386 1192 raft_consensus.cc:385] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.138486 1192 raft_consensus.cc:740] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.138455 456 catalog_manager.cc:6784] ReplaceTablet: tablet 0bf54b260fc941599cffb12581e8116a deleted and replaced by tablet 5c74b39e66d344b99f8fc75b855c0520
I20260616 19:51:56.138652 1193 ts_tablet_manager.cc:1950] T a56168eb4f5e449a8f9eed5c8cfad9df P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:56.138754 1192 consensus_queue.cc:260] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.139515 1193 tablet_replica.cc:333] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:56.139695 1193 raft_consensus.cc:2243] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.139853 1193 raft_consensus.cc:2272] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.139940 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet a56168eb4f5e449a8f9eed5c8cfad9df (table default.Table_2bcad1cc946c4bea8e3eedee12ee1629 [id=9ec0598716a64236aaba17b464849f3f]) successfully deleted
I20260616 19:51:56.140232 1192 ts_tablet_manager.cc:1434] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.014s user 0.001s sys 0.002s
I20260616 19:51:56.140568 1192 tablet_bootstrap.cc:492] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.140568 1193 ts_tablet_manager.cc:1916] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.143217 1192 tablet_bootstrap.cc:654] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.144956 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bf54b260fc941599cffb12581e8116a with delete_type TABLET_DATA_DELETED (replaced by tablet 5c74b39e66d344b99f8fc75b855c0520) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.145063 1196 tablet_bootstrap.cc:492] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:56.146708 1196 tablet_bootstrap.cc:654] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.147281 896 tablet_service.cc:1558] Processing DeleteTablet for tablet e91c377ae66441268351cd3592aa9dbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.150764 1193 ts_tablet_manager.cc:1929] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.154095 1193 log.cc:1199] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/d916b2f553ce41df8934e1190fa32120
I20260616 19:51:56.155007 1193 ts_tablet_manager.cc:1950] T d916b2f553ce41df8934e1190fa32120 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:56.157577 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet d916b2f553ce41df8934e1190fa32120 (table default.Table_647cdefd19814321b51ee0898effc29c [id=7b17c97ad92b4ead8f60bf602853cd61]) successfully deleted
I20260616 19:51:56.156076 1196 tablet_bootstrap.cc:492] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:56.158267 1196 ts_tablet_manager.cc:1403] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260616 19:51:56.159296 1196 raft_consensus.cc:359] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:51:56.160485 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet db75a5169c0b4650a551b8a76a724469 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db75a5169c0b4650a551b8a76a724469 already in progress: creating tablet
W20260616 19:51:56.160851 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0bf54b260fc941599cffb12581e8116a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0bf54b260fc941599cffb12581e8116a already in progress: creating tablet
I20260616 19:51:56.027806 1198 tablet_bootstrap.cc:492] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:56.038516 1496 tablet.cc:1724] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:51:56.161567 1198 ts_tablet_manager.cc:1403] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.157s user 0.004s sys 0.002s
I20260616 19:51:56.162441 1198 raft_consensus.cc:359] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.162597 1198 raft_consensus.cc:385] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.059067 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 84ce7bf3e0004ffaa2c5e314fa69322c (DEFAULT_TABLE table=default.Table_9858decdd2fb4e0cb9fdea7022f1962b [id=4f2b128cff5248f98e3506bb72a39391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.162669 1198 raft_consensus.cc:740] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
W20260616 19:51:56.162688 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet e91c377ae66441268351cd3592aa9dbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e91c377ae66441268351cd3592aa9dbc already in progress: creating tablet
I20260616 19:51:56.162974 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ce7bf3e0004ffaa2c5e314fa69322c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.162871 1198 consensus_queue.cc:260] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.163133 1196 raft_consensus.cc:385] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.163208 1196 raft_consensus.cc:740] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.062250 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da380823d0ae437d9f1d9d0f633f74bb" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:56.163427 1060 raft_consensus.cc:2468] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:56.163669 1196 consensus_queue.cc:260] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.166291 1196 ts_tablet_manager.cc:1434] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260616 19:51:56.166626 1196 tablet_bootstrap.cc:492] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:56.079741 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da380823d0ae437d9f1d9d0f633f74bb" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:51:56.167088 1059 raft_consensus.cc:3060] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.168977 1196 tablet_bootstrap.cc:654] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.169896 1059 raft_consensus.cc:2468] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:56.170113 1105 heartbeater.cc:499] Master 127.0.105.188:34219 was elected leader, sending a full tablet report...
I20260616 19:51:56.085259 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 73a754c728b5408eb47f91de93554ec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.085259 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.113298 1383 raft_consensus.cc:493] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.118235 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet db75a5169c0b4650a551b8a76a724469 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.170619 1383 raft_consensus.cc:515] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.122776 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f60e9778dd429c8bdbf96261901a56" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:56.125070 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bf54b260fc941599cffb12581e8116a with delete_type TABLET_DATA_DELETED (replaced by tablet 5c74b39e66d344b99f8fc75b855c0520) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.131726 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet e91c377ae66441268351cd3592aa9dbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.171271 1383 leader_election.cc:290] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:56.172168 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21408288aae545cba9aa65afbc29a0e3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:56.172361 784 raft_consensus.cc:2468] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:56.172657 1192 tablet_bootstrap.cc:492] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.172830 1192 ts_tablet_manager.cc:1403] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260616 19:51:56.173817 1192 raft_consensus.cc:359] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.174017 1192 raft_consensus.cc:385] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.174114 1192 raft_consensus.cc:740] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.174503 1451 raft_consensus.cc:493] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.174655 1451 raft_consensus.cc:515] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.174787 858 leader_election.cc:304] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:56.174877 996 leader_election.cc:304] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:51:56.175108 1383 raft_consensus.cc:2804] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:56.175208 1383 raft_consensus.cc:493] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:56.175290 1383 raft_consensus.cc:3060] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.175381 1451 leader_election.cc:290] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.175592 1451 raft_consensus.cc:2749] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:56.176317 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab33d99d857145dfbda54ff2f7464486" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:56.176599 1058 raft_consensus.cc:2468] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:56.176668 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21408288aae545cba9aa65afbc29a0e3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:56.176860 924 raft_consensus.cc:2468] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:56.177081 858 leader_election.cc:304] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:56.177225 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab33d99d857145dfbda54ff2f7464486" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:56.177376 1451 raft_consensus.cc:2804] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:56.177409 785 raft_consensus.cc:2468] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:56.177508 1451 raft_consensus.cc:493] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:56.177627 1451 raft_consensus.cc:3060] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.178138 1383 raft_consensus.cc:515] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.180151 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21408288aae545cba9aa65afbc29a0e3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:56.180342 785 raft_consensus.cc:3060] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.180301 1383 leader_election.cc:290] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:56.181171 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21408288aae545cba9aa65afbc29a0e3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:56.181354 924 raft_consensus.cc:3060] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.181517 1451 raft_consensus.cc:515] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.182715 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab33d99d857145dfbda54ff2f7464486" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:51:56.182924 1058 raft_consensus.cc:3060] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.184412 924 raft_consensus.cc:2468] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:56.185405 993 leader_election.cc:304] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:56.186403 1058 raft_consensus.cc:2468] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:56.186872 1383 raft_consensus.cc:2804] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:56.187006 1383 raft_consensus.cc:697] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:56.187271 1383 consensus_queue.cc:237] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.187325 858 leader_election.cc:304] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:56.187690 1458 raft_consensus.cc:2804] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:56.187866 1458 raft_consensus.cc:697] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:51:56.188216 1458 consensus_queue.cc:237] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.189622 1451 leader_election.cc:290] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.174386 1192 consensus_queue.cc:260] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.191895 1192 ts_tablet_manager.cc:1434] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260616 19:51:56.192255 1192 tablet_bootstrap.cc:492] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.194515 1192 tablet_bootstrap.cc:654] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.194754 785 raft_consensus.cc:2468] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:56.195286 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab33d99d857145dfbda54ff2f7464486" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:56.195552 784 raft_consensus.cc:3060] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.195523 452 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet b5f60e9778dd429c8bdbf96261901a56 (table default.Table_dfb3308f15684b20b5d49353c0a255e7 [id=91db6a529c234ab1b026fba00e18a7ef]). Expected version 1 got 0
I20260616 19:51:56.198102 452 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 21408288aae545cba9aa65afbc29a0e3 (table default.Table_e6fa01673a5f49c5b6198541d6d74674 [id=0342973a46bc4b93b84b0220163e9975]). Expected version 1 got 0
I20260616 19:51:56.198987 784 raft_consensus.cc:2468] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:56.199659 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0af20b58e7f64f62b763c0f583c1d43e" } new_table_name: "default.Table_032fed7521604405ba49b2f399e0f628" modify_external_catalogs: true
I20260616 19:51:56.201974 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_68976277ccb342cb9c534c44fd200ace"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.203780 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68976277ccb342cb9c534c44fd200ace in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.205256 924 raft_consensus.cc:3060] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.207823 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_148c23f911c0426e857f5f3cd973d63e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.208550 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_148c23f911c0426e857f5f3cd973d63e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.210655 461 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 21408288aae545cba9aa65afbc29a0e3 (table default.Table_e6fa01673a5f49c5b6198541d6d74674 [id=0342973a46bc4b93b84b0220163e9975]). Expected version 1 got 0
I20260616 19:51:56.211887 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b28a102fcc514ff4ad1152a5fdf07cae" } new_table_name: "default.Table_730210c795214b2bb698287fcbd1bde3" modify_external_catalogs: true
I20260616 19:51:56.214092 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9858decdd2fb4e0cb9fdea7022f1962b" } new_table_name: "default.Table_9fe1afa2ee854800ab19aac1fb4c6048" modify_external_catalogs: true
I20260616 19:51:56.214776 1192 tablet_bootstrap.cc:492] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.214979 1192 ts_tablet_manager.cc:1403] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260616 19:51:56.216017 1192 raft_consensus.cc:359] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.216259 1192 raft_consensus.cc:385] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.216334 1192 raft_consensus.cc:740] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.216419 1198 ts_tablet_manager.cc:1434] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.055s user 0.002s sys 0.006s
I20260616 19:51:56.216629 1192 consensus_queue.cc:260] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.229200 749 tablet_service.cc:1558] Processing DeleteTablet for tablet e4705cacd95a45888fac6a76745eae4e with delete_type TABLET_DATA_DELETED (replaced by tablet 0da93e4052094862a44812990df1136a) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.229612 1193 tablet_replica.cc:333] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:56.229885 1193 raft_consensus.cc:2243] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.230088 1193 raft_consensus.cc:2272] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.230970 1193 ts_tablet_manager.cc:1916] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.232565 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1465eae9fad14db1b3cc0433cdfccf7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.233218 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1465eae9fad14db1b3cc0433cdfccf7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.233464 1192 ts_tablet_manager.cc:1434] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260616 19:51:56.233780 1192 tablet_bootstrap.cc:492] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.235399 1192 tablet_bootstrap.cc:654] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.238904 1193 ts_tablet_manager.cc:1929] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.239136 1193 log.cc:1199] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/e4705cacd95a45888fac6a76745eae4e
I20260616 19:51:56.239590 1193 ts_tablet_manager.cc:1950] T e4705cacd95a45888fac6a76745eae4e P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:56.241107 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet e4705cacd95a45888fac6a76745eae4e (table default.Table_fe763512a640490ebb25dca52b04788a [id=ad67f2c8f60f4c8c9b4ca2e57ffdb6f1]) successfully deleted
I20260616 19:51:56.248281 1518 tablet.cc:1724] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:51:56.253657 1192 tablet_bootstrap.cc:492] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.258319 1192 ts_tablet_manager.cc:1403] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260616 19:51:56.259400 1192 raft_consensus.cc:359] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.260070 1192 raft_consensus.cc:385] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.260231 1192 raft_consensus.cc:740] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.260586 1192 consensus_queue.cc:260] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.261283 1192 ts_tablet_manager.cc:1434] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:51:56.265590 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1bc181171b134de2b946376f468aec72
I20260616 19:51:56.266422 460 catalog_manager.cc:5696] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } }
I20260616 19:51:56.266848 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet ab33d99d857145dfbda54ff2f7464486 (table default.Table_de7cf8cf7c43409b9c41391ff6e8ba35 [id=122f88b500c0425e833926b349605d6f]). Expected version 3 got 0
I20260616 19:51:56.267132 460 catalog_manager.cc:5696] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260616 19:51:56.267537 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet da380823d0ae437d9f1d9d0f633f74bb (table default.Table_fdb76eb70534433eae79f807fd35fb90 [id=46c822de2dc2471d847af2e018102efc]). Expected version 2 got 0
I20260616 19:51:56.268872 457 catalog_manager.cc:5696] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131). New cstate: current_term: 1 leader_uuid: "61c874fef3684d10a272a9c7f280e0e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: HEALTHY } } }
I20260616 19:51:56.269186 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 21408288aae545cba9aa65afbc29a0e3 (table default.Table_e6fa01673a5f49c5b6198541d6d74674 [id=0342973a46bc4b93b84b0220163e9975]). Expected version 1 got 0
I20260616 19:51:56.271085 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc181171b134de2b946376f468aec72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.272030 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc181171b134de2b946376f468aec72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.272075 1192 tablet_bootstrap.cc:492] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.277894 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc181171b134de2b946376f468aec72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.278331 1192 tablet_bootstrap.cc:654] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:56.279054 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1bc181171b134de2b946376f468aec72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bc181171b134de2b946376f468aec72 already in progress: creating tablet
W20260616 19:51:56.287410 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2e316e44693d473dad901eeb95299988 consensus state has no leader
I20260616 19:51:56.287721 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 47b548b6b7f746fe9fd67c2e6563e961 from {username='slave'} at 127.0.0.1:41696
W20260616 19:51:56.290321 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4be902fe29bb46a4bf71ee6384e6722a consensus state has no leader
I20260616 19:51:56.290602 1192 tablet_bootstrap.cc:492] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.290762 1192 ts_tablet_manager.cc:1403] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260616 19:51:56.290948 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ac81df7bd9eb47678440fa3b7b932946"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:56.291451 1192 raft_consensus.cc:359] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.291662 1192 raft_consensus.cc:385] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260616 19:51:56.292078 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac81df7bd9eb47678440fa3b7b932946 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.292150 1192 raft_consensus.cc:740] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.292424 1192 consensus_queue.cc:260] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.293049 1192 ts_tablet_manager.cc:1434] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:56.293560 1192 tablet_bootstrap.cc:492] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:51:56.293583 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2b7f591d97bc4571b294b06d990d4065 consensus state has no leader
I20260616 19:51:56.293846 461 master_service.cc:960] ReplaceTablet: received request to replace tablet 15d6a025b9a248c5ab9422fe1c340f3e from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:56.295112 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c63ea4e62e3e433b86b05b9a80a2fd49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.295794 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c63ea4e62e3e433b86b05b9a80a2fd49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.298082 1411 raft_consensus.cc:493] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.298269 1411 raft_consensus.cc:515] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.298768 1192 tablet_bootstrap.cc:654] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.298903 1411 leader_election.cc:290] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.300019 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf87ea2e8604f35bc57b6d2b8b9c61f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:56.300252 924 raft_consensus.cc:2468] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:51:56.300689 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf87ea2e8604f35bc57b6d2b8b9c61f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:56.300900 1058 raft_consensus.cc:2468] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:51:56.300999 718 leader_election.cc:304] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:56.301280 1411 raft_consensus.cc:2804] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:56.301369 1411 raft_consensus.cc:493] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:56.301468 1411 raft_consensus.cc:3060] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.304215 1411 raft_consensus.cc:515] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.306147 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf87ea2e8604f35bc57b6d2b8b9c61f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:56.306317 1411 leader_election.cc:290] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.306376 924 raft_consensus.cc:3060] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:51:56.307410 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84ce7bf3e0004ffaa2c5e314fa69322c consensus state has no leader
I20260616 19:51:56.307773 1192 tablet_bootstrap.cc:492] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.307922 1192 ts_tablet_manager.cc:1403] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260616 19:51:56.308686 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf87ea2e8604f35bc57b6d2b8b9c61f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:51:56.308881 1058 raft_consensus.cc:3060] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.308847 1192 raft_consensus.cc:359] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.309039 1192 raft_consensus.cc:385] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.309134 1192 raft_consensus.cc:740] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.309348 1192 consensus_queue.cc:260] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.309887 1192 ts_tablet_manager.cc:1434] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:51:56.310146 1192 tablet_bootstrap.cc:492] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.312325 1192 tablet_bootstrap.cc:654] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.313709 924 raft_consensus.cc:2468] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:51:56.314565 1058 raft_consensus.cc:2468] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:51:56.314896 718 leader_election.cc:304] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:56.317361 1411 raft_consensus.cc:2804] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:56.317716 1411 raft_consensus.cc:697] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:51:56.318120 1411 consensus_queue.cc:237] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.319633 452 master_service.cc:960] ReplaceTablet: received request to replace tablet fb1c2030b3a14c6aafaa961869606f31 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:56.321962 458 master_service.cc:960] ReplaceTablet: received request to replace tablet 1bc181171b134de2b946376f468aec72 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:56.332859 1192 tablet_bootstrap.cc:492] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.333089 1192 ts_tablet_manager.cc:1403] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.005s
I20260616 19:51:56.334682 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f059ca67519042369942560b08e0d06c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:56.336601 1192 raft_consensus.cc:359] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.336882 1192 raft_consensus.cc:385] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.336962 1192 raft_consensus.cc:740] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.337282 1192 consensus_queue.cc:260] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.337973 1192 ts_tablet_manager.cc:1434] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260616 19:51:56.340847 1192 tablet_bootstrap.cc:492] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.360438 1383 raft_consensus.cc:493] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.360800 1383 raft_consensus.cc:515] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.361790 1192 tablet_bootstrap.cc:654] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.362560 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776841d895d6431fbee76b7c4e28d973" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:56.362776 924 raft_consensus.cc:2468] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:56.363539 993 leader_election.cc:304] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:56.363806 1508 raft_consensus.cc:2804] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:56.363900 1508 raft_consensus.cc:493] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:56.364030 1508 raft_consensus.cc:3060] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.364182 1383 leader_election.cc:290] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:56.364933 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776841d895d6431fbee76b7c4e28d973" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:56.365655 996 leader_election.cc:343] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:56.366685 1508 raft_consensus.cc:515] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.367322 1508 leader_election.cc:290] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:56.368108 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776841d895d6431fbee76b7c4e28d973" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:56.368296 924 raft_consensus.cc:3060] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.369071 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776841d895d6431fbee76b7c4e28d973" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:51:56.369709 996 leader_election.cc:343] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:51:56.370235 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f059ca67519042369942560b08e0d06c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.370936 924 raft_consensus.cc:2468] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:56.371510 993 leader_election.cc:304] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:51:56.371950 1508 raft_consensus.cc:2804] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:56.372179 1508 raft_consensus.cc:697] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:56.372512 1508 consensus_queue.cc:237] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.381140 1192 tablet_bootstrap.cc:492] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.381341 1192 ts_tablet_manager.cc:1403] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.004s
I20260616 19:51:56.382493 1192 raft_consensus.cc:359] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.382740 1192 raft_consensus.cc:385] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.382836 1192 raft_consensus.cc:740] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.383074 1192 consensus_queue.cc:260] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.383795 1192 ts_tablet_manager.cc:1434] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:51:56.389460 1192 tablet_bootstrap.cc:492] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.391896 1192 tablet_bootstrap.cc:654] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.395979 1105 heartbeater.cc:499] Master 127.0.105.188:34219 was elected leader, sending a full tablet report...
I20260616 19:51:56.407610 1190 ts_tablet_manager.cc:1929] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.408248 1198 tablet_bootstrap.cc:492] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:56.409972 1198 tablet_bootstrap.cc:654] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.409930 1192 tablet_bootstrap.cc:492] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.418362 1458 raft_consensus.cc:493] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.421424 1458 raft_consensus.cc:515] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.421507 1192 ts_tablet_manager.cc:1403] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.032s user 0.008s sys 0.000s
I20260616 19:51:56.422164 1458 leader_election.cc:290] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.422639 1190 log.cc:1199] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/eac603a84d3c4f96bd444c54f28d278d
I20260616 19:51:56.422647 1192 raft_consensus.cc:359] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.423071 1192 raft_consensus.cc:385] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.423159 1192 raft_consensus.cc:740] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.423475 1192 consensus_queue.cc:260] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:56.423623 860 leader_election.cc:343] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: de0ea6ca79ff4ed09f63fc7bb98eaabd
I20260616 19:51:56.424142 1192 ts_tablet_manager.cc:1434] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260616 19:51:56.424324 858 leader_election.cc:343] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: de0ea6ca79ff4ed09f63fc7bb98eaabd
I20260616 19:51:56.424507 858 leader_election.cc:304] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:56.424896 1192 tablet_bootstrap.cc:492] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.424949 1458 raft_consensus.cc:2749] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:56.430716 1192 tablet_bootstrap.cc:654] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.432060 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 79efb1de93bc4c1e81f4b2e15f621417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.432240 1458 raft_consensus.cc:493] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.432386 1458 raft_consensus.cc:515] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.432700 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.433132 1458 leader_election.cc:290] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.434545 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97afcb75fdc2440d913ad421534a4ef3" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:56.434628 1190 ts_tablet_manager.cc:1950] T eac603a84d3c4f96bd444c54f28d278d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:56.435041 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.435316 1193 tablet_replica.cc:333] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:56.435518 1193 raft_consensus.cc:2243] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:56.435616 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 252) took 1274 ms. Trace:
I20260616 19:51:56.435770 1193 pending_rounds.cc:70] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:51:56.435834 1193 pending_rounds.cc:77] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595458842624000 op_type: NO_OP noop_request { }
I20260616 19:51:56.435961 1193 raft_consensus.cc:2889] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260616 19:51:56.435972 858 leader_election.cc:343] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 97afcb75fdc2440d913ad421534a4ef3
I20260616 19:51:56.436069 1193 raft_consensus.cc:2272] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:56.436378 860 leader_election.cc:343] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:56.436522 860 leader_election.cc:304] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:56.436877 1458 raft_consensus.cc:2749] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:56.437373 1193 ts_tablet_manager.cc:1916] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.437570 1198 tablet_bootstrap.cc:492] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:56.437760 1198 ts_tablet_manager.cc:1403] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.006s
I20260616 19:51:56.438565 1198 raft_consensus.cc:359] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.438822 1198 raft_consensus.cc:385] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.438930 1198 raft_consensus.cc:740] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.439244 1198 consensus_queue.cc:260] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.440013 1198 ts_tablet_manager.cc:1434] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:56.440346 1198 tablet_bootstrap.cc:492] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:56.441027 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b887f50c6ede4a7285250a86ad6b5a87" } modify_external_catalogs: true
I20260616 19:51:56.441267 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b887f50c6ede4a7285250a86ad6b5a87" } modify_external_catalogs: true
I20260616 19:51:56.442801 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_49f2a480dfe747e1b60b94db3199fe38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.443372 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49f2a480dfe747e1b60b94db3199fe38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.444053 1192 tablet_bootstrap.cc:492] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.444216 1192 ts_tablet_manager.cc:1403] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260616 19:51:56.446643 1192 raft_consensus.cc:359] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.446890 1192 raft_consensus.cc:385] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.447006 1192 raft_consensus.cc:740] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.447134 1198 tablet_bootstrap.cc:654] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.449185 1193 ts_tablet_manager.cc:1929] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:56.449508 1192 consensus_queue.cc:260] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.450266 1192 ts_tablet_manager.cc:1434] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260616 19:51:56.450536 1193 log.cc:1199] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/8bf87ea2e8604f35bc57b6d2b8b9c61f
I20260616 19:51:56.451694 1458 raft_consensus.cc:493] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.451861 1458 raft_consensus.cc:515] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.452919 1193 ts_tablet_manager.cc:1950] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:56.453835 1458 leader_election.cc:290] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.454272 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f (table default.Table_0531204d83954cb3a55ad0f218d390a1 [id=f99403687f45449d84c7ad8b490f6c2a]) successfully deleted
I20260616 19:51:56.435781 1190 rpcz_store.cc:276] 0616 19:51:55.161099 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:55.161304 (+ 205us) service_pool.cc:224] Handling call
0616 19:51:55.886713 (+725409us) ts_tablet_manager.cc:1151] Deleting tablet eac603a84d3c4f96bd444c54f28d278d
0616 19:51:55.886722 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:56.018701 (+131979us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:56.407483 (+388782us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:56.435569 (+ 28086us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":710586}
I20260616 19:51:56.456010 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet eac603a84d3c4f96bd444c54f28d278d (table default.Table_e45bf57dcf664129991297d4600d67d5 [id=a67306640a5b4c0a91a283892a3a8062]) successfully deleted
W20260616 19:51:56.455139 860 leader_election.cc:343] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: c557049a020a4b318bb6e8a53710a6cc
W20260616 19:51:56.460914 858 leader_election.cc:343] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: c557049a020a4b318bb6e8a53710a6cc
I20260616 19:51:56.461050 858 leader_election.cc:304] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:56.461470 1458 raft_consensus.cc:2749] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:56.473785 1191 ts_tablet_manager.cc:1929] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.473951 1191 log.cc:1199] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/7161894b9f9047fda9ed3f2180518a59
I20260616 19:51:56.474339 1191 ts_tablet_manager.cc:1950] T 7161894b9f9047fda9ed3f2180518a59 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:56.474896 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 7161894b9f9047fda9ed3f2180518a59 (table default.Table_ee130ae3817f41f8ac49a76361fd23ea [id=a69482262948439783492742dcbf0b43]) successfully deleted
I20260616 19:51:56.474995 1191 tablet_replica.cc:333] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:56.475190 1191 raft_consensus.cc:2243] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.475387 1191 raft_consensus.cc:2272] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.476104 1191 ts_tablet_manager.cc:1916] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.481364 1196 tablet_bootstrap.cc:492] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:56.481564 1196 ts_tablet_manager.cc:1403] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.315s user 0.066s sys 0.129s
I20260616 19:51:56.482810 1196 raft_consensus.cc:359] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.483080 1196 raft_consensus.cc:385] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.483197 1196 raft_consensus.cc:740] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.483485 1196 consensus_queue.cc:260] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.486361 1196 ts_tablet_manager.cc:1434] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:51:56.487305 1196 tablet_bootstrap.cc:492] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:56.491348 457 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 776841d895d6431fbee76b7c4e28d973 (table default.Table_ebec5e10f80244469fca70fe48c270e8 [id=4d2238911f8d432095e4a20ee0dc6217]). Expected version 2 got 0
I20260616 19:51:56.497002 896 tablet_service.cc:1558] Processing DeleteTablet for tablet d61873c8aa094d7f899a61307a36f895 with delete_type TABLET_DATA_DELETED (replaced by tablet 31592a5ffb04429c9315a4fd72308f28) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.497541 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c90188c0181467ea3deee14fa5568b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.497821 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.498323 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 21eb01a4b2424d63affa5d9d71e2fa64 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e7e298c8e374f46aecbb0711760c06c) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:56.498716 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f because the tablet was not found. No further retry: Not found: Tablet not found: 8bf87ea2e8604f35bc57b6d2b8b9c61f
I20260616 19:51:56.498809 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 7161894b9f9047fda9ed3f2180518a59 with delete_type TABLET_DATA_DELETED (replaced by tablet 4ffce2dc22e24d1684e6eae92c487cea) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.499249 896 tablet_service.cc:1558] Processing DeleteTablet for tablet dfee6a9e6d57487bb7d9482f7798e6b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.496376 457 catalog_manager.cc:5696] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131). New cstate: current_term: 1 leader_uuid: "61c874fef3684d10a272a9c7f280e0e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: HEALTHY } } }
I20260616 19:51:56.501437 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 776841d895d6431fbee76b7c4e28d973 (table default.Table_ebec5e10f80244469fca70fe48c270e8 [id=4d2238911f8d432095e4a20ee0dc6217]). Expected version 2 got 0
I20260616 19:51:56.503428 1192 tablet_bootstrap.cc:492] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.506291 1192 tablet_bootstrap.cc:654] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.507498 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 261) took 1236 ms. Trace:
I20260616 19:51:56.507576 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 47b548b6b7f746fe9fd67c2e6563e961
I20260616 19:51:56.507619 1190 rpcz_store.cc:276] 0616 19:51:55.271295 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:55.271595 (+ 300us) service_pool.cc:224] Handling call
0616 19:51:56.455667 (+1184072us) ts_tablet_manager.cc:1151] Deleting tablet 3587c1ab487a424eb82f378ae081f514
0616 19:51:56.507299 (+ 51632us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:56.507457 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1167135}
I20260616 19:51:56.508383 1190 tablet_replica.cc:333] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:56.508720 1190 raft_consensus.cc:2243] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.508927 1190 raft_consensus.cc:2272] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.509027 454 catalog_manager.cc:6784] ReplaceTablet: tablet 47b548b6b7f746fe9fd67c2e6563e961 deleted and replaced by tablet bcc5116ef5df4140a96f03c003337c68
I20260616 19:51:56.509632 1190 ts_tablet_manager.cc:1916] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.509917 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 47b548b6b7f746fe9fd67c2e6563e961 with delete_type TABLET_DATA_DELETED (replaced by tablet bcc5116ef5df4140a96f03c003337c68) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.510627 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 47b548b6b7f746fe9fd67c2e6563e961 with delete_type TABLET_DATA_DELETED (replaced by tablet bcc5116ef5df4140a96f03c003337c68) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:56.510685 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 47b548b6b7f746fe9fd67c2e6563e961 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b548b6b7f746fe9fd67c2e6563e961 already in progress: creating tablet
I20260616 19:51:56.511663 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 47b548b6b7f746fe9fd67c2e6563e961 with delete_type TABLET_DATA_DELETED (replaced by tablet bcc5116ef5df4140a96f03c003337c68) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:56.513583 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 3587c1ab487a424eb82f378ae081f514 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3587c1ab487a424eb82f378ae081f514 already in progress: creating tablet
W20260616 19:51:56.513873 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d916b2f553ce41df8934e1190fa32120 because the tablet was not found. No further retry: Not found: Tablet not found: d916b2f553ce41df8934e1190fa32120
W20260616 19:51:56.514154 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 102f322eb98f4224acb8637f8c29ac19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 102f322eb98f4224acb8637f8c29ac19 already in progress: creating tablet
I20260616 19:51:56.518229 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2476a078d16f4862bceb42e0e78e1495" } new_table_name: "default.Table_2cdc89bc850c41539c75340c7bf74a30" modify_external_catalogs: true
I20260616 19:51:56.519827 896 tablet_service.cc:1558] Processing DeleteTablet for tablet fd5a513aeb224609afaee1ded6ede5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3de0e62cfd33410490a0b460fd5f69e9) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.520059 749 tablet_service.cc:1558] Processing DeleteTablet for tablet fd5a513aeb224609afaee1ded6ede5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3de0e62cfd33410490a0b460fd5f69e9) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.520336 1193 tablet_replica.cc:333] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:56.520532 1193 raft_consensus.cc:2243] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.520715 1193 raft_consensus.cc:2272] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.521381 1193 ts_tablet_manager.cc:1916] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.527861 1193 ts_tablet_manager.cc:1929] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.528043 1193 log.cc:1199] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/fd5a513aeb224609afaee1ded6ede5e6
I20260616 19:51:56.528363 1192 tablet_bootstrap.cc:492] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.528561 1192 ts_tablet_manager.cc:1403] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.004s
I20260616 19:51:56.528795 1193 ts_tablet_manager.cc:1950] T fd5a513aeb224609afaee1ded6ede5e6 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:56.529381 1192 raft_consensus.cc:359] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.529577 1192 raft_consensus.cc:385] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.529659 1192 raft_consensus.cc:740] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.529942 1192 consensus_queue.cc:260] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.530148 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet fd5a513aeb224609afaee1ded6ede5e6 (table default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]) successfully deleted
I20260616 19:51:56.530894 1192 ts_tablet_manager.cc:1434] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:56.531538 1192 tablet_bootstrap.cc:492] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.532750 1190 ts_tablet_manager.cc:1929] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.532920 1190 log.cc:1199] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/91336c7847ea4739a0be7fdd9d199cca
I20260616 19:51:56.533358 1190 ts_tablet_manager.cc:1950] T 91336c7847ea4739a0be7fdd9d199cca P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:56.537637 1192 tablet_bootstrap.cc:654] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.540248 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8d5fed2f6cff49c4b8a9cd2c5a907fa9" } modify_external_catalogs: true
I20260616 19:51:56.540424 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8d5fed2f6cff49c4b8a9cd2c5a907fa9" } modify_external_catalogs: true
I20260616 19:51:56.542004 1196 tablet_bootstrap.cc:654] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.547396 1198 tablet_bootstrap.cc:492] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:56.547549 1198 ts_tablet_manager.cc:1403] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.107s user 0.026s sys 0.026s
I20260616 19:51:56.548219 1198 raft_consensus.cc:359] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.548379 1198 raft_consensus.cc:385] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.548458 1198 raft_consensus.cc:740] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.548672 1198 consensus_queue.cc:260] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.549144 1198 ts_tablet_manager.cc:1434] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260616 19:51:56.550225 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_697a7231aefa42178532aaa38eb61439"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.550791 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_697a7231aefa42178532aaa38eb61439 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.552289 1191 ts_tablet_manager.cc:1929] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.552397 1191 log.cc:1199] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/79efb1de93bc4c1e81f4b2e15f621417
I20260616 19:51:56.552754 1191 ts_tablet_manager.cc:1950] T 79efb1de93bc4c1e81f4b2e15f621417 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:56.553170 1198 tablet_bootstrap.cc:492] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:56.554718 1198 tablet_bootstrap.cc:654] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.556581 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 91336c7847ea4739a0be7fdd9d199cca (table default.Table_e1afc98c2d9741a9a1b9196cec4c5390 [id=9f6df425186b463d830a66539d63bcdd]) successfully deleted
I20260616 19:51:56.556825 1105 heartbeater.cc:499] Master 127.0.105.188:34219 was elected leader, sending a full tablet report...
I20260616 19:51:56.558279 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 79efb1de93bc4c1e81f4b2e15f621417 (table default.Table_bd62e9b749144fb28a1f58d92574d60a [id=3624f762ccce461390df6f711254aa05]) successfully deleted
I20260616 19:51:56.559809 1500 sys_catalog.cc:455] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85d6b13547f2413c86ee07194ca74704. Latest consensus state: current_term: 2 leader_uuid: "85d6b13547f2413c86ee07194ca74704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:56.560057 1500 sys_catalog.cc:458] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:51:56.560431 1448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "85d6b13547f2413c86ee07194ca74704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:56.560441 1530 sys_catalog.cc:455] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "85d6b13547f2413c86ee07194ca74704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:51:56.560664 1448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: This master's current role is: LEADER
I20260616 19:51:56.560683 1530 sys_catalog.cc:458] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae [sys.catalog]: This master's current role is: FOLLOWER
W20260616 19:51:56.572221 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 9060de590fa84ea08dc7d39765bc9308 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9060de590fa84ea08dc7d39765bc9308 already in progress: creating tablet
W20260616 19:51:56.572978 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 44493f0ffd064249a28628cf24895395 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44493f0ffd064249a28628cf24895395 already in progress: creating tablet
W20260616 19:51:56.574409 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 90205213ba5f49a2931e68839cefb2d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90205213ba5f49a2931e68839cefb2d2 already in progress: creating tablet
W20260616 19:51:56.575641 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet f52b2c5ff6264ffe8d579cb3816fc253 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f52b2c5ff6264ffe8d579cb3816fc253 already in progress: creating tablet
I20260616 19:51:56.577078 1545 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260616 19:51:56.590374 1458 raft_consensus.cc:493] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.590551 1458 raft_consensus.cc:515] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.591255 1458 leader_election.cc:290] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.592628 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fb1c2030b3a14c6aafaa961869606f31
I20260616 19:51:56.593181 452 catalog_manager.cc:6784] ReplaceTablet: tablet fb1c2030b3a14c6aafaa961869606f31 deleted and replaced by tablet c7f724dc23024a7297cfb8689f199600
I20260616 19:51:56.595512 749 tablet_service.cc:1558] Processing DeleteTablet for tablet fb1c2030b3a14c6aafaa961869606f31 with delete_type TABLET_DATA_DELETED (replaced by tablet c7f724dc23024a7297cfb8689f199600) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:56.596197 860 leader_election.cc:343] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: a2b6158b31b34419aa3619f3ce8242b3
I20260616 19:51:56.597319 1192 tablet_bootstrap.cc:492] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.597462 1192 ts_tablet_manager.cc:1403] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.066s user 0.000s sys 0.005s
I20260616 19:51:56.598237 1192 raft_consensus.cc:359] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.598414 1192 raft_consensus.cc:385] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.598488 1192 raft_consensus.cc:740] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.598697 1192 consensus_queue.cc:260] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.599258 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet fb1c2030b3a14c6aafaa961869606f31 with delete_type TABLET_DATA_DELETED (replaced by tablet c7f724dc23024a7297cfb8689f199600) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.599977 896 tablet_service.cc:1558] Processing DeleteTablet for tablet fb1c2030b3a14c6aafaa961869606f31 with delete_type TABLET_DATA_DELETED (replaced by tablet c7f724dc23024a7297cfb8689f199600) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:56.600744 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet fb1c2030b3a14c6aafaa961869606f31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb1c2030b3a14c6aafaa961869606f31 already in progress: creating tablet
I20260616 19:51:56.604192 1192 ts_tablet_manager.cc:1434] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20260616 19:51:56.604430 969 heartbeater.cc:344] Connected to a master server at 127.0.105.188:34219
I20260616 19:51:56.608055 1192 tablet_bootstrap.cc:492] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.609210 1348 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" instance_seqno: 1781639509283738) as {username='slave'} at 127.0.105.130:47051; Asking this server to re-register.
I20260616 19:51:56.610255 1192 tablet_bootstrap.cc:654] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.612270 969 heartbeater.cc:461] Registering TS with master...
W20260616 19:51:56.613916 858 leader_election.cc:343] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: a2b6158b31b34419aa3619f3ce8242b3
I20260616 19:51:56.614070 858 leader_election.cc:304] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:56.614333 1458 raft_consensus.cc:2749] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:51:56.614507 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 73a754c728b5408eb47f91de93554ec5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73a754c728b5408eb47f91de93554ec5 already in progress: creating tablet
I20260616 19:51:56.614888 1196 tablet_bootstrap.cc:492] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:56.614960 1198 tablet_bootstrap.cc:492] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:56.614946 1348 ts_manager.cc:194] Registered new tserver with Master: ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:56.615118 1198 ts_tablet_manager.cc:1403] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.062s user 0.009s sys 0.015s
I20260616 19:51:56.615862 1191 tablet_replica.cc:333] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:56.616091 1191 raft_consensus.cc:2243] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.616256 1191 raft_consensus.cc:2272] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.616684 460 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet e04d700da18b417788240b67a03f63e2
I20260616 19:51:56.616928 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 17029c1ba36644e9847200b54bf9094c from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:56.617534 1190 tablet_replica.cc:333] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:56.617487 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_db902752da5f4f3ab65c0b21c57d34a9" } modify_external_catalogs: true
W20260616 19:51:56.617595 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f13d175adfe540b39fd55004a11c9aad consensus state has no leader
I20260616 19:51:56.617703 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_db902752da5f4f3ab65c0b21c57d34a9" } modify_external_catalogs: true
I20260616 19:51:56.617969 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_46f9f0dfd80649ce93583c93a95c2e02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.618631 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46f9f0dfd80649ce93583c93a95c2e02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.622144 1458 raft_consensus.cc:493] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.622733 1458 raft_consensus.cc:515] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.622908 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c90188c0181467ea3deee14fa5568b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.623346 1458 leader_election.cc:290] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:56.623469 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_52a0c9cc9c054a069c0a208d7dd79fd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.623979 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52a0c9cc9c054a069c0a208d7dd79fd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.624280 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f061d4bc90f42409eb99987059e6656" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:56.625241 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_097cc1cefc2845c9811c04a380239f0d" } modify_external_catalogs: true
W20260616 19:51:56.625315 860 leader_election.cc:343] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:56.625417 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_097cc1cefc2845c9811c04a380239f0d" } modify_external_catalogs: true
I20260616 19:51:56.625936 1191 ts_tablet_manager.cc:1916] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.625905 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f061d4bc90f42409eb99987059e6656" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:56.625922 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a438724efd6349269d52e1958ce629fc" } modify_external_catalogs: true
I20260616 19:51:56.626093 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a438724efd6349269d52e1958ce629fc" } modify_external_catalogs: true
W20260616 19:51:56.626514 858 leader_election.cc:343] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:56.626629 858 leader_election.cc:304] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:56.626911 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 362e7ff9bea3459ca018d1a7febb2ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet ca5dc1e6cde347fc9a34e555385dc646) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.627053 1458 raft_consensus.cc:2749] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:56.627156 1196 ts_tablet_manager.cc:1403] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.140s user 0.010s sys 0.016s
I20260616 19:51:56.627959 1196 raft_consensus.cc:359] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.628173 1196 raft_consensus.cc:385] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.628239 1196 raft_consensus.cc:740] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.629468 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 79250767a94141cd900a9715e86128b8
I20260616 19:51:56.630590 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 79250767a94141cd900a9715e86128b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.630837 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 79250767a94141cd900a9715e86128b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.631163 1190 raft_consensus.cc:2243] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.631372 1190 raft_consensus.cc:2272] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.631453 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 79250767a94141cd900a9715e86128b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.631902 1190 ts_tablet_manager.cc:1916] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:51:56.631949 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 79250767a94141cd900a9715e86128b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79250767a94141cd900a9715e86128b8 already in progress: creating tablet
I20260616 19:51:56.632143 1196 consensus_queue.cc:260] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.634943 1196 ts_tablet_manager.cc:1434] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260616 19:51:56.635280 1196 tablet_bootstrap.cc:492] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:56.638197 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8a718fefe07141119b7ef7edcbf61123
I20260616 19:51:56.638748 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_640a7f020c4044efad09aec2444b0b6e" } new_table_name: "default.Table_2349f63e2a7e4af4ae0a80e8ed86c6a9" modify_external_catalogs: true
I20260616 19:51:56.640301 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e6fa01673a5f49c5b6198541d6d74674" } new_table_name: "default.Table_081048b59d4d45719878e3c76725c5e7" modify_external_catalogs: true
I20260616 19:51:56.640583 830 heartbeater.cc:344] Connected to a master server at 127.0.105.188:34219
I20260616 19:51:56.642371 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_81d2820218034bf0a04d2480e6bd8b43" } new_table_name: "default.Table_191f8acd55ae4da9982a9fb3ec2d51cd" modify_external_catalogs: true
I20260616 19:51:56.642968 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a718fefe07141119b7ef7edcbf61123 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.643994 1348 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "7245e7dab0ec474a876537be514c8767" instance_seqno: 1781639508785759) as {username='slave'} at 127.0.105.129:50141; Asking this server to re-register.
I20260616 19:51:56.644917 830 heartbeater.cc:461] Registering TS with master...
I20260616 19:51:56.645568 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a718fefe07141119b7ef7edcbf61123 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.645826 1196 tablet_bootstrap.cc:654] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.646517 1348 ts_manager.cc:194] Registered new tserver with Master: 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:51:56.647704 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8a718fefe07141119b7ef7edcbf61123 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a718fefe07141119b7ef7edcbf61123 already in progress: creating tablet
I20260616 19:51:56.647959 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a718fefe07141119b7ef7edcbf61123 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.648605 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f061d4bc90f42409eb99987059e6656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.648944 1192 tablet_bootstrap.cc:492] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.648895 1198 raft_consensus.cc:359] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.649115 1192 ts_tablet_manager.cc:1403] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.000s
I20260616 19:51:56.649115 1198 raft_consensus.cc:385] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.649195 1198 raft_consensus.cc:740] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.649463 1198 consensus_queue.cc:260] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.652642 1198 ts_tablet_manager.cc:1434] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.037s user 0.000s sys 0.002s
I20260616 19:51:56.655157 1348 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" instance_seqno: 1781639509785789) as {username='slave'} at 127.0.105.131:40883; Asking this server to re-register.
I20260616 19:51:56.657015 1105 heartbeater.cc:461] Registering TS with master...
I20260616 19:51:56.657472 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet dfee6a9e6d57487bb7d9482f7798e6b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.658006 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a84e0dab565b459c96cdce84214af742"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.658838 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a84e0dab565b459c96cdce84214af742 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.660272 1198 tablet_bootstrap.cc:492] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:56.652945 1191 ts_tablet_manager.cc:1929] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.661132 1191 log.cc:1199] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/8bf87ea2e8604f35bc57b6d2b8b9c61f
I20260616 19:51:56.661273 1192 raft_consensus.cc:359] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.661507 1192 raft_consensus.cc:385] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.661604 1192 raft_consensus.cc:740] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.661952 1191 ts_tablet_manager.cc:1950] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:56.663280 1348 ts_manager.cc:194] Registered new tserver with Master: 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.664428 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f (table default.Table_0531204d83954cb3a55ad0f218d390a1 [id=f99403687f45449d84c7ad8b490f6c2a]) successfully deleted
W20260616 19:51:56.665669 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59812b232848488b9894e8f8057e9def consensus state has no leader
W20260616 19:51:56.665778 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b consensus state has no leader
I20260616 19:51:56.666193 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_68976277ccb342cb9c534c44fd200ace" } new_table_name: "default.Table_d2ddb45a3fbb446689cb737dcb4fbc12" modify_external_catalogs: true
I20260616 19:51:56.667517 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_657c910adb4d432296fa32c1bb06a3a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.668058 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_657c910adb4d432296fa32c1bb06a3a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.668609 455 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 776841d895d6431fbee76b7c4e28d973 (table default.Table_ebec5e10f80244469fca70fe48c270e8 [id=4d2238911f8d432095e4a20ee0dc6217]). Expected version 2 got 0
I20260616 19:51:56.669327 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_46b6e5faa0a34a3cbf1391d58cb61798"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.670293 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46b6e5faa0a34a3cbf1391d58cb61798 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.672870 1192 consensus_queue.cc:260] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.673784 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 21eb01a4b2424d63affa5d9d71e2fa64 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e7e298c8e374f46aecbb0711760c06c) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.674261 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 802d30c340494490896c8da33d110708 (DEFAULT_TABLE table=default.Table_c9853be5ddb04bc5b661d36f41042814 [id=cb3eb4838e8a48108a44c7940a73765e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.674350 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 9d9c89216995430188b1eed4c6b26d1e (DEFAULT_TABLE table=default.Table_52ebd4cc32a242b6af90514f289aaffd [id=a02891a271e04ca084884abd17c9bee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.674706 1040 tablet_service.cc:1511] Processing CreateTablet for tablet c239a24dbdc047f9beb2ed7e1492acfe (DEFAULT_TABLE table=default.Table_b9effa349ec04a8989934380e9153218 [id=bb33691603dd4d118134ed79f128e4d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.674782 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 67ac2e31a1ba40b39145c26a1e4e0884 (DEFAULT_TABLE table=default.Table_a438724efd6349269d52e1958ce629fc [id=979c551af45f4055ac350d0db71fa793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.675094 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1696a3c9f24001a4aaf99725f73f62 (DEFAULT_TABLE table=default.Table_186eb03ebeeb4351b7cd0feeaebd1ef3 [id=9f49b3a822224b5082a631394c44a5b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.675693 749 tablet_service.cc:1511] Processing CreateTablet for tablet 802d30c340494490896c8da33d110708 (DEFAULT_TABLE table=default.Table_c9853be5ddb04bc5b661d36f41042814 [id=cb3eb4838e8a48108a44c7940a73765e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.676151 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802d30c340494490896c8da33d110708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.677466 1034 tablet_service.cc:1511] Processing CreateTablet for tablet d4a2855b7dec4244a3fc52bdca7e7eb3 (DEFAULT_TABLE table=default.Table_70f2f37a1352492e82eb6083bc7e0f53 [id=29105635fc2f455a8b53ed105028ac13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.677824 1036 tablet_service.cc:1511] Processing CreateTablet for tablet dbe373c3bb094972b0e17fcb1587987a (DEFAULT_TABLE table=default.Table_3a297147806b42d2a05da3717d5f18d3 [id=fdd0430505e44bbabac45088b8930d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.678179 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 269c1dea941c481fb6fd2e4d59c877c0 (DEFAULT_TABLE table=default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb [id=2c7a8a72acf5496eaebb585c459112fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.678795 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 647b1abeb3c14b11b9a5c62b67e83cf8 (DEFAULT_TABLE table=default.Table_120e5c908fe348a7ab3ff54504e841ec [id=508154cdccf0482b890ef231e6fac070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.679809 751 tablet_service.cc:1511] Processing CreateTablet for tablet c239a24dbdc047f9beb2ed7e1492acfe (DEFAULT_TABLE table=default.Table_b9effa349ec04a8989934380e9153218 [id=bb33691603dd4d118134ed79f128e4d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.680333 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c239a24dbdc047f9beb2ed7e1492acfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.681818 1190 ts_tablet_manager.cc:1929] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.681977 1190 log.cc:1199] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/de0ea6ca79ff4ed09f63fc7bb98eaabd
I20260616 19:51:56.682355 1190 ts_tablet_manager.cc:1950] T de0ea6ca79ff4ed09f63fc7bb98eaabd P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:56.685271 1190 tablet_replica.cc:333] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:56.685933 1190 raft_consensus.cc:2243] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.686187 1458 raft_consensus.cc:493] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.686210 1196 tablet_bootstrap.cc:492] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:56.686350 1196 ts_tablet_manager.cc:1403] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.002s
I20260616 19:51:56.686316 1458 raft_consensus.cc:515] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.686964 1458 leader_election.cc:290] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.687176 1196 raft_consensus.cc:359] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.687342 1196 raft_consensus.cc:385] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.687439 1196 raft_consensus.cc:740] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.687602 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61873c8aa094d7f899a61307a36f895" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:56.687661 1196 consensus_queue.cc:260] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.688086 1459 raft_consensus.cc:493] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.688218 1459 raft_consensus.cc:515] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:56.688491 858 leader_election.cc:343] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:56.689016 1459 leader_election.cc:290] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:56.689116 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61873c8aa094d7f899a61307a36f895" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:56.689188 757 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1696a3c9f24001a4aaf99725f73f62 (DEFAULT_TABLE table=default.Table_186eb03ebeeb4351b7cd0feeaebd1ef3 [id=9f49b3a822224b5082a631394c44a5b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.689620 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1696a3c9f24001a4aaf99725f73f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.689810 1192 ts_tablet_manager.cc:1434] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.041s user 0.002s sys 0.000s
I20260616 19:51:56.690265 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21eb01a4b2424d63affa5d9d71e2fa64" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:56.690536 1058 raft_consensus.cc:2468] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
W20260616 19:51:56.691459 860 leader_election.cc:343] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:56.691653 860 leader_election.cc:304] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:56.692260 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21eb01a4b2424d63affa5d9d71e2fa64" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:56.692734 762 tablet_service.cc:1511] Processing CreateTablet for tablet 67ac2e31a1ba40b39145c26a1e4e0884 (DEFAULT_TABLE table=default.Table_a438724efd6349269d52e1958ce629fc [id=979c551af45f4055ac350d0db71fa793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.692762 858 leader_election.cc:304] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:56.693147 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ac2e31a1ba40b39145c26a1e4e0884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.693236 1459 raft_consensus.cc:2749] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:56.693492 1459 raft_consensus.cc:2804] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:56.693589 1459 raft_consensus.cc:493] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:56.693709 1459 raft_consensus.cc:3060] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.694087 1192 tablet_bootstrap.cc:492] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.696847 754 tablet_service.cc:1511] Processing CreateTablet for tablet 9d9c89216995430188b1eed4c6b26d1e (DEFAULT_TABLE table=default.Table_52ebd4cc32a242b6af90514f289aaffd [id=a02891a271e04ca084884abd17c9bee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.697054 1196 ts_tablet_manager.cc:1434] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
W20260616 19:51:56.697146 860 leader_election.cc:343] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:56.697259 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d9c89216995430188b1eed4c6b26d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.698558 1459 raft_consensus.cc:515] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.698915 1192 tablet_bootstrap.cc:654] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.699668 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21eb01a4b2424d63affa5d9d71e2fa64" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:51:56.700285 1058 raft_consensus.cc:3060] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.700922 764 tablet_service.cc:1511] Processing CreateTablet for tablet dbe373c3bb094972b0e17fcb1587987a (DEFAULT_TABLE table=default.Table_3a297147806b42d2a05da3717d5f18d3 [id=fdd0430505e44bbabac45088b8930d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.701431 759 tablet_service.cc:1511] Processing CreateTablet for tablet d4a2855b7dec4244a3fc52bdca7e7eb3 (DEFAULT_TABLE table=default.Table_70f2f37a1352492e82eb6083bc7e0f53 [id=29105635fc2f455a8b53ed105028ac13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.701889 752 tablet_service.cc:1511] Processing CreateTablet for tablet 269c1dea941c481fb6fd2e4d59c877c0 (DEFAULT_TABLE table=default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb [id=2c7a8a72acf5496eaebb585c459112fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.702363 761 tablet_service.cc:1511] Processing CreateTablet for tablet 647b1abeb3c14b11b9a5c62b67e83cf8 (DEFAULT_TABLE table=default.Table_120e5c908fe348a7ab3ff54504e841ec [id=508154cdccf0482b890ef231e6fac070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.702975 1196 tablet_bootstrap.cc:492] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:56.703205 1058 raft_consensus.cc:2468] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:56.703673 858 leader_election.cc:304] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:56.704023 1458 raft_consensus.cc:2804] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:56.704720 1196 tablet_bootstrap.cc:654] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.705948 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21eb01a4b2424d63affa5d9d71e2fa64" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:51:56.706516 860 leader_election.cc:343] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:56.706880 1459 leader_election.cc:290] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:56.708117 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe373c3bb094972b0e17fcb1587987a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.708691 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a2855b7dec4244a3fc52bdca7e7eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.710327 924 raft_consensus.cc:1275] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Refusing update from remote peer 61c874fef3684d10a272a9c7f280e0e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:51:56.710968 1508 consensus_queue.cc:1048] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:51:56.712710 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269c1dea941c481fb6fd2e4d59c877c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.714004 1190 raft_consensus.cc:2272] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.715341 1190 ts_tablet_manager.cc:1916] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.716719 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647b1abeb3c14b11b9a5c62b67e83cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.718684 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 99551210f5974332bf6a16ee74b220f6 (table default.Table_ab3032cb1f934fdc9bde24d4b3b1f5a3 [id=4fbf7d11df5448f4b249f9c831241f38]). Expected version 2 got 0
W20260616 19:51:56.727090 446 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b (table default.Table_2349f63e2a7e4af4ae0a80e8ed86c6a9 [id=f37d0e612ff74a31842cf47ec47beb3f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b consensus state has no leader
I20260616 19:51:56.729194 1458 raft_consensus.cc:697] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:51:56.729692 1458 consensus_queue.cc:237] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.730018 784 raft_consensus.cc:1275] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Refusing update from remote peer 61c874fef3684d10a272a9c7f280e0e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:51:56.731617 1508 consensus_queue.cc:1048] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:51:56.736977 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 40bdb01a15254c329d82f0d40919b880 has no consensus state
I20260616 19:51:56.737010 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 6cc988a195ec4bbf8691801421fed8bb
I20260616 19:51:56.737679 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 17029c1ba36644e9847200b54bf9094c
I20260616 19:51:56.738268 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 15d6a025b9a248c5ab9422fe1c340f3e
I20260616 19:51:56.738539 460 catalog_manager.cc:6784] ReplaceTablet: tablet 17029c1ba36644e9847200b54bf9094c deleted and replaced by tablet 29df38f273494a079bdc76a915d43dab
I20260616 19:51:56.738752 461 catalog_manager.cc:6784] ReplaceTablet: tablet 15d6a025b9a248c5ab9422fe1c340f3e deleted and replaced by tablet db750fc9641f492494fdb167de86f6df
I20260616 19:51:56.738754 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cc988a195ec4bbf8691801421fed8bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.738807 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 17029c1ba36644e9847200b54bf9094c with delete_type TABLET_DATA_DELETED (replaced by tablet 29df38f273494a079bdc76a915d43dab) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.740782 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a4a6f573af0d49d58db91ad41beb2ac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.741483 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4a6f573af0d49d58db91ad41beb2ac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.743523 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 17029c1ba36644e9847200b54bf9094c with delete_type TABLET_DATA_DELETED (replaced by tablet 29df38f273494a079bdc76a915d43dab) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.743847 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 15d6a025b9a248c5ab9422fe1c340f3e with delete_type TABLET_DATA_DELETED (replaced by tablet db750fc9641f492494fdb167de86f6df) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:56.745023 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 17029c1ba36644e9847200b54bf9094c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17029c1ba36644e9847200b54bf9094c already in progress: creating tablet
W20260616 19:51:56.745312 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 15d6a025b9a248c5ab9422fe1c340f3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15d6a025b9a248c5ab9422fe1c340f3e already in progress: creating tablet
I20260616 19:51:56.745780 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cc988a195ec4bbf8691801421fed8bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:56.746832 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 6cc988a195ec4bbf8691801421fed8bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cc988a195ec4bbf8691801421fed8bb already in progress: creating tablet
I20260616 19:51:56.747416 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 15d6a025b9a248c5ab9422fe1c340f3e with delete_type TABLET_DATA_DELETED (replaced by tablet db750fc9641f492494fdb167de86f6df) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.748040 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_788c444456b04560873e5d7d2429251e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:56.748797 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 67ac2e31a1ba40b39145c26a1e4e0884
W20260616 19:51:56.748842 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_788c444456b04560873e5d7d2429251e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.749840 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 67ac2e31a1ba40b39145c26a1e4e0884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.752549 896 tablet_service.cc:1511] Processing CreateTablet for tablet 802d30c340494490896c8da33d110708 (DEFAULT_TABLE table=default.Table_c9853be5ddb04bc5b661d36f41042814 [id=cb3eb4838e8a48108a44c7940a73765e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.752977 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802d30c340494490896c8da33d110708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.759677 1563 tablet.cc:1724] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:51:56.762053 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet de0ea6ca79ff4ed09f63fc7bb98eaabd (table default.Table_6e469684e5b844a5b7f13a1047fd933a [id=7d5a7b1d32b147a3a8b5426c661dda2f]) successfully deleted
I20260616 19:51:56.765589 900 tablet_service.cc:1511] Processing CreateTablet for tablet c239a24dbdc047f9beb2ed7e1492acfe (DEFAULT_TABLE table=default.Table_b9effa349ec04a8989934380e9153218 [id=bb33691603dd4d118134ed79f128e4d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.769825 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 67ac2e31a1ba40b39145c26a1e4e0884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:56.770562 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 67ac2e31a1ba40b39145c26a1e4e0884 because the tablet was not found. No further retry: Not found: Tablet not found: 67ac2e31a1ba40b39145c26a1e4e0884
I20260616 19:51:56.771189 894 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1696a3c9f24001a4aaf99725f73f62 (DEFAULT_TABLE table=default.Table_186eb03ebeeb4351b7cd0feeaebd1ef3 [id=9f49b3a822224b5082a631394c44a5b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.771775 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c239a24dbdc047f9beb2ed7e1492acfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.772874 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1696a3c9f24001a4aaf99725f73f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.774047 1459 raft_consensus.cc:493] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.774196 1518 tablet.cc:1724] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:51:56.775352 1459 raft_consensus.cc:515] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.776101 1459 leader_election.cc:290] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.777115 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efb1de93bc4c1e81f4b2e15f621417" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:56.777315 785 raft_consensus.cc:2468] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:56.781711 903 tablet_service.cc:1511] Processing CreateTablet for tablet 67ac2e31a1ba40b39145c26a1e4e0884 (DEFAULT_TABLE table=default.Table_a438724efd6349269d52e1958ce629fc [id=979c551af45f4055ac350d0db71fa793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.782122 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ac2e31a1ba40b39145c26a1e4e0884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.791055 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cc988a195ec4bbf8691801421fed8bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.791281 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 17029c1ba36644e9847200b54bf9094c with delete_type TABLET_DATA_DELETED (replaced by tablet 29df38f273494a079bdc76a915d43dab) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.665081 1191 tablet_replica.cc:333] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:56.793207 1191 raft_consensus.cc:2243] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.793428 1191 raft_consensus.cc:2272] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.794036 1191 ts_tablet_manager.cc:1916] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.795545 860 leader_election.cc:304] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:56.795748 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802d30c340494490896c8da33d110708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.797115 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d9c89216995430188b1eed4c6b26d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.800989 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c239a24dbdc047f9beb2ed7e1492acfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.804766 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ac2e31a1ba40b39145c26a1e4e0884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.805044 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269c1dea941c481fb6fd2e4d59c877c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.807548 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647b1abeb3c14b11b9a5c62b67e83cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.808733 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe373c3bb094972b0e17fcb1587987a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.812597 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a2855b7dec4244a3fc52bdca7e7eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.814937 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1696a3c9f24001a4aaf99725f73f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.816751 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7dfd07f94bbe49879183a4f48fff3f4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.817271 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7dfd07f94bbe49879183a4f48fff3f4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.822991 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4946f8b82570430db08700b53f259d84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.823529 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4946f8b82570430db08700b53f259d84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.824007 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_15c5a7f0c53c48069560560950206199" } new_table_name: "default.Table_b1e42d7ed6304430a453bb9184363f77" modify_external_catalogs: true
I20260616 19:51:56.824846 893 tablet_service.cc:1511] Processing CreateTablet for tablet dbe373c3bb094972b0e17fcb1587987a (DEFAULT_TABLE table=default.Table_3a297147806b42d2a05da3717d5f18d3 [id=fdd0430505e44bbabac45088b8930d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.825300 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe373c3bb094972b0e17fcb1587987a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.825831 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4635b5a6e60140b9acd169b569531ffd" } modify_external_catalogs: true
I20260616 19:51:56.826047 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4635b5a6e60140b9acd169b569531ffd" } modify_external_catalogs: true
I20260616 19:51:56.828840 752 tablet_service.cc:1511] Processing CreateTablet for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 (DEFAULT_TABLE table=default.Table_52a0c9cc9c054a069c0a208d7dd79fd8 [id=2f996fd8aa154e608653b56bc8d01990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.829289 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.831883 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_914e42d3110442b99b33a9a77c30dd49" } modify_external_catalogs: true
I20260616 19:51:56.831884 886 tablet_service.cc:1511] Processing CreateTablet for tablet 9d9c89216995430188b1eed4c6b26d1e (DEFAULT_TABLE table=default.Table_52ebd4cc32a242b6af90514f289aaffd [id=a02891a271e04ca084884abd17c9bee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.832049 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_914e42d3110442b99b33a9a77c30dd49" } modify_external_catalogs: true
W20260616 19:51:56.831770 858 leader_election.cc:343] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 79efb1de93bc4c1e81f4b2e15f621417
I20260616 19:51:56.834479 901 tablet_service.cc:1511] Processing CreateTablet for tablet 269c1dea941c481fb6fd2e4d59c877c0 (DEFAULT_TABLE table=default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb [id=2c7a8a72acf5496eaebb585c459112fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.834797 454 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_081048b59d4d45719878e3c76725c5e7 [id=0342973a46bc4b93b84b0220163e9975] alter complete (version 2)
I20260616 19:51:56.834832 899 tablet_service.cc:1511] Processing CreateTablet for tablet 647b1abeb3c14b11b9a5c62b67e83cf8 (DEFAULT_TABLE table=default.Table_120e5c908fe348a7ab3ff54504e841ec [id=508154cdccf0482b890ef231e6fac070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.835194 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 15d6a025b9a248c5ab9422fe1c340f3e with delete_type TABLET_DATA_DELETED (replaced by tablet db750fc9641f492494fdb167de86f6df) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.835381 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 67ac2e31a1ba40b39145c26a1e4e0884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.835548 1459 raft_consensus.cc:2804] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:56.835634 1459 raft_consensus.cc:493] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:56.835732 1459 raft_consensus.cc:3060] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:56.837071 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d9c89216995430188b1eed4c6b26d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.842960 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2984957106b44cdc9ecd5a06e8edb7d3" } modify_external_catalogs: true
I20260616 19:51:56.843156 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2984957106b44cdc9ecd5a06e8edb7d3" } modify_external_catalogs: true
I20260616 19:51:56.846127 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7454297805304a68987f421ea266723e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.846688 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7454297805304a68987f421ea266723e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.852372 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet aabf57dd6d704645b6bf97b730dbe964
I20260616 19:51:56.852494 1198 tablet_bootstrap.cc:654] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:56.853468 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet aabf57dd6d704645b6bf97b730dbe964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.855000 764 tablet_service.cc:1558] Processing DeleteTablet for tablet aabf57dd6d704645b6bf97b730dbe964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.856419 891 tablet_service.cc:1558] Processing DeleteTablet for tablet aabf57dd6d704645b6bf97b730dbe964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:56.858304 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet aabf57dd6d704645b6bf97b730dbe964 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aabf57dd6d704645b6bf97b730dbe964 already in progress: creating tablet
I20260616 19:51:56.858749 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1b0deebdd1844949b9064d3e3ab11920"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.859324 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b0deebdd1844949b9064d3e3ab11920 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.859359 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6028f4beaf354f9db81ae938006efd35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:56.859869 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6028f4beaf354f9db81ae938006efd35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.862576 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1e8160ad4cf74f16a586ae59291ce7d1
I20260616 19:51:56.863848 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e8160ad4cf74f16a586ae59291ce7d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.864199 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e8160ad4cf74f16a586ae59291ce7d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:56.865047 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1e8160ad4cf74f16a586ae59291ce7d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e8160ad4cf74f16a586ae59291ce7d1 already in progress: creating tablet
I20260616 19:51:56.873328 1191 ts_tablet_manager.cc:1929] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.873452 1191 log.cc:1199] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/db75a5169c0b4650a551b8a76a724469
I20260616 19:51:56.873859 1191 ts_tablet_manager.cc:1950] T db75a5169c0b4650a551b8a76a724469 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:56.874837 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet db75a5169c0b4650a551b8a76a724469 (table default.Table_be0f2a85266c49789e5476fc2f376467 [id=7a7fd9801283464ea1f9ac454219c3d4]) successfully deleted
I20260616 19:51:56.875552 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9db63b29d7264d8da3cbda32ff0b3f02" } new_table_name: "default.Table_4fa069920cee4fbaba6994b164f57509" modify_external_catalogs: true
I20260616 19:51:56.876133 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4946f8b82570430db08700b53f259d84" } new_table_name: "default.Table_4244ccf1f4524ab093b318fa861cf4b6" modify_external_catalogs: true
I20260616 19:51:56.879323 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 776841d895d6431fbee76b7c4e28d973 (table default.Table_ebec5e10f80244469fca70fe48c270e8 [id=4d2238911f8d432095e4a20ee0dc6217]). Expected version 2 got 0
W20260616 19:51:56.879741 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0bf54b260fc941599cffb12581e8116a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0bf54b260fc941599cffb12581e8116a already in progress: creating tablet
W20260616 19:51:56.883145 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet e91c377ae66441268351cd3592aa9dbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e91c377ae66441268351cd3592aa9dbc already in progress: creating tablet
I20260616 19:51:56.883376 1191 tablet_replica.cc:333] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:51:56.883363 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 1bc181171b134de2b946376f468aec72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bc181171b134de2b946376f468aec72 already in progress: creating tablet
W20260616 19:51:56.883571 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 47b548b6b7f746fe9fd67c2e6563e961 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b548b6b7f746fe9fd67c2e6563e961 already in progress: creating tablet
I20260616 19:51:56.883579 1191 raft_consensus.cc:2243] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.883741 1191 raft_consensus.cc:2272] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:56.883773 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet fb1c2030b3a14c6aafaa961869606f31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb1c2030b3a14c6aafaa961869606f31 already in progress: creating tablet
I20260616 19:51:56.884723 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 21408288aae545cba9aa65afbc29a0e3 (table default.Table_081048b59d4d45719878e3c76725c5e7 [id=0342973a46bc4b93b84b0220163e9975]). Expected version 2 got 0
I20260616 19:51:56.885807 888 tablet_service.cc:1511] Processing CreateTablet for tablet d4a2855b7dec4244a3fc52bdca7e7eb3 (DEFAULT_TABLE table=default.Table_70f2f37a1352492e82eb6083bc7e0f53 [id=29105635fc2f455a8b53ed105028ac13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.887918 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647b1abeb3c14b11b9a5c62b67e83cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.889353 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7617f8ff37a245578b7cdecd3c7fcd41" } new_table_name: "default.Table_cb218be8407c4256b227a291d63e7ea5" modify_external_catalogs: true
I20260616 19:51:56.890935 1508 raft_consensus.cc:493] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.891022 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 79efb1de93bc4c1e81f4b2e15f621417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.891091 1508 raft_consensus.cc:515] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.891263 1193 tablet_replica.cc:333] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:56.891451 1193 raft_consensus.cc:2243] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.890956 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet aa72e00b0a3a423f96bdd7abb6013810
I20260616 19:51:56.891613 1193 raft_consensus.cc:2272] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.891824 1508 leader_election.cc:290] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:56.892688 1193 ts_tablet_manager.cc:1916] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.892621 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee6a9e6d57487bb7d9482f7798e6b6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:56.893150 996 leader_election.cc:343] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:56.898248 1196 tablet_bootstrap.cc:492] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:56.898403 1196 ts_tablet_manager.cc:1403] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.195s user 0.001s sys 0.018s
I20260616 19:51:56.899204 1196 raft_consensus.cc:359] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.899422 1196 raft_consensus.cc:385] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.899495 1196 raft_consensus.cc:740] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.899760 1196 consensus_queue.cc:260] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.900300 1040 tablet_service.cc:1511] Processing CreateTablet for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 (DEFAULT_TABLE table=default.Table_52a0c9cc9c054a069c0a208d7dd79fd8 [id=2f996fd8aa154e608653b56bc8d01990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.900707 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.901552 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet aa72e00b0a3a423f96bdd7abb6013810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:56.901830 764 tablet_service.cc:1558] Processing DeleteTablet for tablet aa72e00b0a3a423f96bdd7abb6013810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:56.902644 749 tablet_service.cc:1511] Processing CreateTablet for tablet afc58b2bda2a43f18f157469b591854b (DEFAULT_TABLE table=default.Table_697a7231aefa42178532aaa38eb61439 [id=9c655609a0ef47a2b4fb050ad8dab9d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.903033 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc58b2bda2a43f18f157469b591854b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:56.905403 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aa59388f91ee4901b10c9273db4884b2 has no consensus state
I20260616 19:51:56.906190 1190 ts_tablet_manager.cc:1929] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260616 19:51:56.907003 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d80d9028184443da49623228259263d consensus state has no leader
I20260616 19:51:56.907970 1040 tablet_service.cc:1511] Processing CreateTablet for tablet afc58b2bda2a43f18f157469b591854b (DEFAULT_TABLE table=default.Table_697a7231aefa42178532aaa38eb61439 [id=9c655609a0ef47a2b4fb050ad8dab9d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.908531 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc58b2bda2a43f18f157469b591854b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.908955 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a2855b7dec4244a3fc52bdca7e7eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.909956 1557 raft_consensus.cc:493] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:51:56.912894 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 62628.1us
I20260616 19:51:56.916905 1190 log.cc:1199] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/c557049a020a4b318bb6e8a53710a6cc
I20260616 19:51:56.917124 1458 raft_consensus.cc:493] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.917285 1458 raft_consensus.cc:515] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.917572 1190 ts_tablet_manager.cc:1950] T c557049a020a4b318bb6e8a53710a6cc P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:56.917887 749 tablet_service.cc:1511] Processing CreateTablet for tablet e896d5aa87f14e5593d01085bb6d434f (DEFAULT_TABLE table=default.Table_49f2a480dfe747e1b60b94db3199fe38 [id=a2abe0bca3fa4d35b86a23f91f6973b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.918154 1190 tablet_replica.cc:333] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:56.918349 1458 leader_election.cc:290] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:56.918423 1190 raft_consensus.cc:2243] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:56.918633 1190 raft_consensus.cc:2272] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:56.919230 1190 ts_tablet_manager.cc:1916] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.919530 1033 tablet_service.cc:1511] Processing CreateTablet for tablet e896d5aa87f14e5593d01085bb6d434f (DEFAULT_TABLE table=default.Table_49f2a480dfe747e1b60b94db3199fe38 [id=a2abe0bca3fa4d35b86a23f91f6973b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.920024 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e896d5aa87f14e5593d01085bb6d434f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.920171 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269c1dea941c481fb6fd2e4d59c877c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.920845 895 tablet_service.cc:1558] Processing DeleteTablet for tablet aa72e00b0a3a423f96bdd7abb6013810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.922310 902 tablet_service.cc:1511] Processing CreateTablet for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 (DEFAULT_TABLE table=default.Table_52a0c9cc9c054a069c0a208d7dd79fd8 [id=2f996fd8aa154e608653b56bc8d01990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.923804 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e8160ad4cf74f16a586ae59291ce7d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:56.924891 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c90188c0181467ea3deee14fa5568b3" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:51:56.930088 858 leader_election.cc:343] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:56.930294 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e896d5aa87f14e5593d01085bb6d434f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.931886 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.926046 1557 raft_consensus.cc:515] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.933126 1192 tablet_bootstrap.cc:492] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:56.933202 1557 leader_election.cc:290] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.933286 1192 ts_tablet_manager.cc:1403] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.239s user 0.005s sys 0.016s
I20260616 19:51:56.934170 1192 raft_consensus.cc:359] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.934350 1192 raft_consensus.cc:385] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:56.934441 1192 raft_consensus.cc:740] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:56.934656 1192 consensus_queue.cc:260] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:56.935633 1192 ts_tablet_manager.cc:1434] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:56.935911 1192 tablet_bootstrap.cc:492] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:56.936769 891 tablet_service.cc:1511] Processing CreateTablet for tablet afc58b2bda2a43f18f157469b591854b (DEFAULT_TABLE table=default.Table_697a7231aefa42178532aaa38eb61439 [id=9c655609a0ef47a2b4fb050ad8dab9d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.937815 1191 ts_tablet_manager.cc:1916] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:56.938230 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc58b2bda2a43f18f157469b591854b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:56.938268 858 leader_election.cc:343] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: fd5a513aeb224609afaee1ded6ede5e6
I20260616 19:51:56.941504 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 31db3862f78943519bcd9531c5530048 (DEFAULT_TABLE table=default.Table_1465eae9fad14db1b3cc0433cdfccf7b [id=c72157c1e0f943e4af149e7f692209ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.941884 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31db3862f78943519bcd9531c5530048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.942669 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4fa069920cee4fbaba6994b164f57509" } new_table_name: "default.Table_97db7730461e4d00ab3bc527573cde94" modify_external_catalogs: true
I20260616 19:51:56.942744 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_861e66e4d4424b7d91d0a3a5d3519db8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:56.942859 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_46b6e5faa0a34a3cbf1391d58cb61798" } modify_external_catalogs: true
I20260616 19:51:56.942991 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_46b6e5faa0a34a3cbf1391d58cb61798" } modify_external_catalogs: true
W20260616 19:51:56.943368 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_861e66e4d4424b7d91d0a3a5d3519db8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.943966 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 1d825bcf365f424fb99a10afe3e96501 (DEFAULT_TABLE table=default.Table_ac81df7bd9eb47678440fa3b7b932946 [id=d3197da9180e47e18f4e1573504ae8c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.944325 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d825bcf365f424fb99a10afe3e96501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.952567 757 tablet_service.cc:1511] Processing CreateTablet for tablet a817b1d4c7b640db8894bc801878caae (DEFAULT_TABLE table=default.Table_99062c985ddb45478d3464befd327e07 [id=f212bb8d2d614707bc55ef08138d29d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.952632 761 tablet_service.cc:1511] Processing CreateTablet for tablet e6f309caaa9042f99432a61fd2ebb089 (DEFAULT_TABLE table=default.Table_148c23f911c0426e857f5f3cd973d63e [id=fa08d08f5e8a4f9d8616afb37792fbeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.952737 1026 tablet_service.cc:1511] Processing CreateTablet for tablet e6f309caaa9042f99432a61fd2ebb089 (DEFAULT_TABLE table=default.Table_148c23f911c0426e857f5f3cd973d63e [id=fa08d08f5e8a4f9d8616afb37792fbeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.953271 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a817b1d4c7b640db8894bc801878caae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.953406 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f309caaa9042f99432a61fd2ebb089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.955483 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 99551210f5974332bf6a16ee74b220f6 (table default.Table_ab3032cb1f934fdc9bde24d4b3b1f5a3 [id=4fbf7d11df5448f4b249f9c831241f38]). Expected version 2 got 0
I20260616 19:51:56.955673 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 21408288aae545cba9aa65afbc29a0e3 (table default.Table_081048b59d4d45719878e3c76725c5e7 [id=0342973a46bc4b93b84b0220163e9975]). Expected version 2 got 0
I20260616 19:51:56.957559 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f309caaa9042f99432a61fd2ebb089. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:56.958002 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df036f9d31ca4770bb00bc9cece46953 consensus state has no leader
I20260616 19:51:56.958475 764 tablet_service.cc:1511] Processing CreateTablet for tablet 31db3862f78943519bcd9531c5530048 (DEFAULT_TABLE table=default.Table_1465eae9fad14db1b3cc0433cdfccf7b [id=c72157c1e0f943e4af149e7f692209ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.958796 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31db3862f78943519bcd9531c5530048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.959995 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet c557049a020a4b318bb6e8a53710a6cc (table default.Table_f29c0729614141a183a4aa7787c0a612 [id=7792ca664dbe4df5865c5a17ebd30d28]) successfully deleted
I20260616 19:51:56.960793 1569 tablet.cc:1724] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:51:56.961323 749 tablet_service.cc:1511] Processing CreateTablet for tablet 1d825bcf365f424fb99a10afe3e96501 (DEFAULT_TABLE table=default.Table_ac81df7bd9eb47678440fa3b7b932946 [id=d3197da9180e47e18f4e1573504ae8c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.961355 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d2ddb45a3fbb446689cb737dcb4fbc12" } modify_external_catalogs: true
I20260616 19:51:56.961544 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d2ddb45a3fbb446689cb737dcb4fbc12" } modify_external_catalogs: true
I20260616 19:51:56.961709 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d825bcf365f424fb99a10afe3e96501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.962284 1036 tablet_service.cc:1511] Processing CreateTablet for tablet a817b1d4c7b640db8894bc801878caae (DEFAULT_TABLE table=default.Table_99062c985ddb45478d3464befd327e07 [id=f212bb8d2d614707bc55ef08138d29d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.964236 892 tablet_service.cc:1511] Processing CreateTablet for tablet e6f309caaa9042f99432a61fd2ebb089 (DEFAULT_TABLE table=default.Table_148c23f911c0426e857f5f3cd973d63e [id=fa08d08f5e8a4f9d8616afb37792fbeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.964697 895 tablet_service.cc:1511] Processing CreateTablet for tablet 31db3862f78943519bcd9531c5530048 (DEFAULT_TABLE table=default.Table_1465eae9fad14db1b3cc0433cdfccf7b [id=c72157c1e0f943e4af149e7f692209ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.965183 1557 consensus_queue.cc:1048] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:51:56.968681 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a817b1d4c7b640db8894bc801878caae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.972381 1459 raft_consensus.cc:515] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.972458 757 tablet_service.cc:1511] Processing CreateTablet for tablet fbe784716b3c4293bd4eddf57f6c9048 (DEFAULT_TABLE table=default.Table_46f9f0dfd80649ce93583c93a95c2e02 [id=16e9ecefa14243e9988253004dcd756b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.974120 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6623943c0e0c496583317884ef6790ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:56.974376 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbe784716b3c4293bd4eddf57f6c9048. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:56.974680 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6623943c0e0c496583317884ef6790ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:56.979017 1557 raft_consensus.cc:493] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:56.979090 1459 leader_election.cc:290] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:56.979199 1557 raft_consensus.cc:515] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:56.979772 903 tablet_service.cc:1511] Processing CreateTablet for tablet 1d825bcf365f424fb99a10afe3e96501 (DEFAULT_TABLE table=default.Table_ac81df7bd9eb47678440fa3b7b932946 [id=d3197da9180e47e18f4e1573504ae8c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.979852 1557 leader_election.cc:290] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:51:56.981001 858 leader_election.cc:343] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 79efb1de93bc4c1e81f4b2e15f621417
I20260616 19:51:56.981360 889 tablet_service.cc:1511] Processing CreateTablet for tablet a817b1d4c7b640db8894bc801878caae (DEFAULT_TABLE table=default.Table_99062c985ddb45478d3464befd327e07 [id=f212bb8d2d614707bc55ef08138d29d3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:56.981832 858 leader_election.cc:343] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 7161894b9f9047fda9ed3f2180518a59
I20260616 19:51:56.985533 1036 tablet_service.cc:1511] Processing CreateTablet for tablet fbe784716b3c4293bd4eddf57f6c9048 (DEFAULT_TABLE table=default.Table_46f9f0dfd80649ce93583c93a95c2e02 [id=16e9ecefa14243e9988253004dcd756b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.985973 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbe784716b3c4293bd4eddf57f6c9048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:56.990700 1193 ts_tablet_manager.cc:1929] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:56.990860 1193 log.cc:1199] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/79efb1de93bc4c1e81f4b2e15f621417
I20260616 19:51:56.991266 1193 ts_tablet_manager.cc:1950] T 79efb1de93bc4c1e81f4b2e15f621417 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:56.994532 759 tablet_service.cc:1511] Processing CreateTablet for tablet c7f724dc23024a7297cfb8689f199600 (DEFAULT_TABLE table=default.Table_7cdef69863694f0ba023c214e42394e8 [id=a7f1b3885b764715a88750ea3752dbdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:56.994910 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f724dc23024a7297cfb8689f199600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.001726 890 tablet_service.cc:1511] Processing CreateTablet for tablet fbe784716b3c4293bd4eddf57f6c9048 (DEFAULT_TABLE table=default.Table_46f9f0dfd80649ce93583c93a95c2e02 [id=16e9ecefa14243e9988253004dcd756b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.002256 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3fc9d9c9f0844372a2c28932bf508e6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:57.002409 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_59682c99c0fb454897cb23774423a837"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.002900 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59682c99c0fb454897cb23774423a837 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.003105 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_667b7f908e7349bcb46f2df575854ac2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.003582 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_667b7f908e7349bcb46f2df575854ac2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:57.002902 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fc9d9c9f0844372a2c28932bf508e6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.005302 891 tablet_service.cc:1511] Processing CreateTablet for tablet e896d5aa87f14e5593d01085bb6d434f (DEFAULT_TABLE table=default.Table_49f2a480dfe747e1b60b94db3199fe38 [id=a2abe0bca3fa4d35b86a23f91f6973b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.007748 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f309caaa9042f99432a61fd2ebb089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.010115 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31db3862f78943519bcd9531c5530048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.011279 460 master_service.cc:960] ReplaceTablet: received request to replace tablet bfff9d60bb7e4a86b14687b581b45efe from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:57.015339 1026 tablet_service.cc:1511] Processing CreateTablet for tablet c7f724dc23024a7297cfb8689f199600 (DEFAULT_TABLE table=default.Table_7cdef69863694f0ba023c214e42394e8 [id=a7f1b3885b764715a88750ea3752dbdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.017544 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a817b1d4c7b640db8894bc801878caae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.025856 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbe784716b3c4293bd4eddf57f6c9048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.026504 757 tablet_service.cc:1511] Processing CreateTablet for tablet bcc5116ef5df4140a96f03c003337c68 (DEFAULT_TABLE table=default.Table_dcc7f41280024bda90ded420734edd74 [id=9c7b653f62ef4b74946cc87069f8df6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.026988 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcc5116ef5df4140a96f03c003337c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.030591 896 tablet_service.cc:1511] Processing CreateTablet for tablet c7f724dc23024a7297cfb8689f199600 (DEFAULT_TABLE table=default.Table_7cdef69863694f0ba023c214e42394e8 [id=a7f1b3885b764715a88750ea3752dbdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.031301 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d825bcf365f424fb99a10afe3e96501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.031482 1192 tablet_bootstrap.cc:654] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:57.036186 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d80d9028184443da49623228259263d consensus state has no leader
I20260616 19:51:57.036653 457 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 1203f60173754fd2948c1b8a35695173
I20260616 19:51:57.037524 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f724dc23024a7297cfb8689f199600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.045058 1059 raft_consensus.cc:1275] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Refusing update from remote peer ae28da1c4102450ab76eb2946a5cbf2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:51:57.050825 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c9853be5ddb04bc5b661d36f41042814" } new_table_name: "default.Table_bae68fd4354043c283c58e7a0ecea689" modify_external_catalogs: true
I20260616 19:51:57.050966 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f708aab917b844abbd6f94d1e60d14b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.051611 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f708aab917b844abbd6f94d1e60d14b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.053223 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_452005efb2c6487fad171dc5d5197ce5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.053725 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_452005efb2c6487fad171dc5d5197ce5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.057688 461 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet ab33d99d857145dfbda54ff2f7464486 (table default.Table_de7cf8cf7c43409b9c41391ff6e8ba35 [id=122f88b500c0425e833926b349605d6f]). Expected version 3 got 0
I20260616 19:51:57.058043 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_186eb03ebeeb4351b7cd0feeaebd1ef3" } modify_external_catalogs: true
I20260616 19:51:57.058328 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_186eb03ebeeb4351b7cd0feeaebd1ef3" } modify_external_catalogs: true
I20260616 19:51:57.058670 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 40bdb01a15254c329d82f0d40919b880
I20260616 19:51:57.059530 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 40bdb01a15254c329d82f0d40919b880 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.062558 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet bfff9d60bb7e4a86b14687b581b45efe
I20260616 19:51:57.063253 460 catalog_manager.cc:6784] ReplaceTablet: tablet bfff9d60bb7e4a86b14687b581b45efe deleted and replaced by tablet 0b362fa598a54632880faa42a9224ffd
I20260616 19:51:57.063704 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet bfff9d60bb7e4a86b14687b581b45efe with delete_type TABLET_DATA_DELETED (replaced by tablet 0b362fa598a54632880faa42a9224ffd) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.065033 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4244ccf1f4524ab093b318fa861cf4b6" } modify_external_catalogs: true
I20260616 19:51:57.065285 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4244ccf1f4524ab093b318fa861cf4b6" } modify_external_catalogs: true
W20260616 19:51:57.066588 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 802d30c340494490896c8da33d110708 consensus state has no leader
I20260616 19:51:57.067780 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 40bdb01a15254c329d82f0d40919b880 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.069357 759 tablet_service.cc:1558] Processing DeleteTablet for tablet bfff9d60bb7e4a86b14687b581b45efe with delete_type TABLET_DATA_DELETED (replaced by tablet 0b362fa598a54632880faa42a9224ffd) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.069794 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9b154e7b9f584385866a56cfaa2bbd49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.070284 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b154e7b9f584385866a56cfaa2bbd49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.074661 1557 consensus_queue.cc:1048] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260616 19:51:57.077076 1191 ts_tablet_manager.cc:1929] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:57.077303 1191 log.cc:1199] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/5c90188c0181467ea3deee14fa5568b3
I20260616 19:51:57.077884 1191 ts_tablet_manager.cc:1950] T 5c90188c0181467ea3deee14fa5568b3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:57.079047 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 5c90188c0181467ea3deee14fa5568b3 (table default.Table_fce6c0a420e74d889b4665e221e3c559 [id=0d6caa2121db47609b15d8b087a3752a]) successfully deleted
W20260616 19:51:57.079820 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 79250767a94141cd900a9715e86128b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79250767a94141cd900a9715e86128b8 already in progress: creating tablet
W20260616 19:51:57.080505 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8a718fefe07141119b7ef7edcbf61123 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a718fefe07141119b7ef7edcbf61123 already in progress: creating tablet
I20260616 19:51:57.080643 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e896d5aa87f14e5593d01085bb6d434f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.080886 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f724dc23024a7297cfb8689f199600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.081064 1191 tablet_replica.cc:333] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:57.081249 1191 raft_consensus.cc:2243] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:57.081408 1191 raft_consensus.cc:2272] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:57.082834 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_68091f2e6a6a42c3802c8e2d425729bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:57.083346 1038 tablet_service.cc:1511] Processing CreateTablet for tablet bcc5116ef5df4140a96f03c003337c68 (DEFAULT_TABLE table=default.Table_dcc7f41280024bda90ded420734edd74 [id=9c7b653f62ef4b74946cc87069f8df6e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:57.083439 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68091f2e6a6a42c3802c8e2d425729bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.083763 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcc5116ef5df4140a96f03c003337c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.086658 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2e1696a3c9f24001a4aaf99725f73f62
I20260616 19:51:57.087841 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 19832d0517524c0facf1f97486b1e58e with delete_type TABLET_DATA_DELETED (replaced by tablet 9c77fd138ce9463b8f2d6f4182a56559) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.095602 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_60ef6fc2bcf94a838594d3da8ec82c32" } modify_external_catalogs: true
I20260616 19:51:57.095809 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_60ef6fc2bcf94a838594d3da8ec82c32" } modify_external_catalogs: true
I20260616 19:51:57.101331 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1696a3c9f24001a4aaf99725f73f62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.101827 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet cbd1070277a14fd98af5fa45925e4f0f
I20260616 19:51:57.102638 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet cbd1070277a14fd98af5fa45925e4f0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.104290 759 tablet_service.cc:1558] Processing DeleteTablet for tablet cbd1070277a14fd98af5fa45925e4f0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.105306 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 40bdb01a15254c329d82f0d40919b880 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.105626 898 tablet_service.cc:1558] Processing DeleteTablet for tablet bfff9d60bb7e4a86b14687b581b45efe with delete_type TABLET_DATA_DELETED (replaced by tablet 0b362fa598a54632880faa42a9224ffd) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.107070 454 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet aa59388f91ee4901b10c9273db4884b2
I20260616 19:51:57.107167 1563 tablet.cc:1724] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:51:57.107149 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dcc7f41280024bda90ded420734edd74" } new_table_name: "default.Table_6678ca70f63c4fd389c950e0023a5d07" modify_external_catalogs: true
I20260616 19:51:57.107887 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1054530674ec44d19e673765aefe6cdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.108528 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1054530674ec44d19e673765aefe6cdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.112046 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a8aa8e529ab0432d9abaf953a3aa73cf" } new_table_name: "default.Table_f33b8daab78a4f08bd8f0090c7e0bb32" modify_external_catalogs: true
I20260616 19:51:57.116448 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 43b4c3bd370749b18fb86f7a0aae2c50 (DEFAULT_TABLE table=default.Table_7ad7ef9c768d41edaa47c8cd68466731 [id=217c0ab9c81b4dae8666abc02dfeb60b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.116528 759 tablet_service.cc:1511] Processing CreateTablet for tablet 40bdb01a15254c329d82f0d40919b880 (DEFAULT_TABLE table=default.Table_d2ddb45a3fbb446689cb737dcb4fbc12 [id=ccddc1e63f194e539a50d511f05eff8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.116920 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b4c3bd370749b18fb86f7a0aae2c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.118793 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40bdb01a15254c329d82f0d40919b880. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:57.122778 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bcc5116ef5df4140a96f03c003337c68 consensus state has no leader
I20260616 19:51:57.123952 892 tablet_service.cc:1511] Processing CreateTablet for tablet bcc5116ef5df4140a96f03c003337c68 (DEFAULT_TABLE table=default.Table_dcc7f41280024bda90ded420734edd74 [id=9c7b653f62ef4b74946cc87069f8df6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.124387 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 40bdb01a15254c329d82f0d40919b880 (DEFAULT_TABLE table=default.Table_d2ddb45a3fbb446689cb737dcb4fbc12 [id=ccddc1e63f194e539a50d511f05eff8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.124356 752 tablet_service.cc:1511] Processing CreateTablet for tablet 43b4c3bd370749b18fb86f7a0aae2c50 (DEFAULT_TABLE table=default.Table_7ad7ef9c768d41edaa47c8cd68466731 [id=217c0ab9c81b4dae8666abc02dfeb60b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.124742 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b4c3bd370749b18fb86f7a0aae2c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.124764 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40bdb01a15254c329d82f0d40919b880. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:57.125734 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca5dc1e6cde347fc9a34e555385dc646 consensus state has no leader
I20260616 19:51:57.134835 1518 tablet.cc:1724] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260616 19:51:57.141515 445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:43055, user_credentials={real_user=slave}} blocked reactor thread for 76704us
I20260616 19:51:57.144062 1563 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:51:57.146628 452 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet ab33d99d857145dfbda54ff2f7464486 (table default.Table_de7cf8cf7c43409b9c41391ff6e8ba35 [id=122f88b500c0425e833926b349605d6f]). Expected version 3 got 0
I20260616 19:51:57.159551 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_788c444456b04560873e5d7d2429251e" } new_table_name: "default.Table_5993624d9698498986c80f02a4c7260b" modify_external_catalogs: true
W20260616 19:51:57.165156 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 272838af35d840faa7b11217456533c2 has no consensus state
I20260616 19:51:57.173115 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcc5116ef5df4140a96f03c003337c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.178951 1198 tablet_bootstrap.cc:492] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:57.179297 1198 ts_tablet_manager.cc:1403] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.519s user 0.005s sys 0.011s
I20260616 19:51:57.179562 1038 tablet_service.cc:1511] Processing CreateTablet for tablet af5e277102b8480db44e5ffe88267808 (DEFAULT_TABLE table=default.Table_d19f51d7b61e47dea882c1fd07d9a122 [id=00510df65be542a98fec0f25a07d1542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.180100 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5e277102b8480db44e5ffe88267808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.180684 1198 raft_consensus.cc:359] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:57.180966 1198 raft_consensus.cc:385] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.181315 1459 raft_consensus.cc:493] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:57.182935 1191 ts_tablet_manager.cc:1916] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:57.190618 1198 raft_consensus.cc:740] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.190891 1198 consensus_queue.cc:260] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:57.191785 1198 ts_tablet_manager.cc:1434] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260616 19:51:57.192165 1198 tablet_bootstrap.cc:492] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:57.198338 1198 tablet_bootstrap.cc:654] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:57.202913 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1696a3c9f24001a4aaf99725f73f62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.199853 1564 raft_consensus.cc:493] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:57.206272 899 tablet_service.cc:1558] Processing DeleteTablet for tablet cbd1070277a14fd98af5fa45925e4f0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.206910 1557 raft_consensus.cc:493] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:57.208918 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 79efb1de93bc4c1e81f4b2e15f621417 (table default.Table_bd62e9b749144fb28a1f58d92574d60a [id=3624f762ccce461390df6f711254aa05]) successfully deleted
W20260616 19:51:57.209225 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet aa72e00b0a3a423f96bdd7abb6013810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa72e00b0a3a423f96bdd7abb6013810 already in progress: creating tablet
W20260616 19:51:57.209511 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 40bdb01a15254c329d82f0d40919b880 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40bdb01a15254c329d82f0d40919b880 already in progress: creating tablet
I20260616 19:51:57.210425 452 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet ab33d99d857145dfbda54ff2f7464486 (table default.Table_de7cf8cf7c43409b9c41391ff6e8ba35 [id=122f88b500c0425e833926b349605d6f]). Expected version 3 got 0
I20260616 19:51:57.208226 1459 raft_consensus.cc:515] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.216174 759 tablet_service.cc:1511] Processing CreateTablet for tablet af5e277102b8480db44e5ffe88267808 (DEFAULT_TABLE table=default.Table_d19f51d7b61e47dea882c1fd07d9a122 [id=00510df65be542a98fec0f25a07d1542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.216535 1569 tablet.cc:1724] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260616 19:51:57.216636 1557 raft_consensus.cc:515] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:57.216982 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 287537us
I20260616 19:51:57.219120 1198 tablet_bootstrap.cc:492] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:57.219341 1198 ts_tablet_manager.cc:1403] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.000s
I20260616 19:51:57.219270 1563 tablet.cc:1724] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260616 19:51:57.220163 1198 raft_consensus.cc:359] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.220387 1198 raft_consensus.cc:385] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.220494 1198 raft_consensus.cc:740] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.220844 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee6a9e6d57487bb7d9482f7798e6b6" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:57.220901 1198 consensus_queue.cc:260] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.223296 1198 ts_tablet_manager.cc:1434] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260616 19:51:57.223645 1198 tablet_bootstrap.cc:492] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:57.223807 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee6a9e6d57487bb7d9482f7798e6b6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:57.224871 1459 leader_election.cc:290] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:57.225160 1557 leader_election.cc:290] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:57.217275 1564 raft_consensus.cc:515] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:57.225447 858 leader_election.cc:343] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: db75a5169c0b4650a551b8a76a724469
I20260616 19:51:57.225950 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1696a3c9f24001a4aaf99725f73f62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.226184 1196 ts_tablet_manager.cc:1434] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.309s user 0.001s sys 0.002s
I20260616 19:51:57.226162 924 raft_consensus.cc:2468] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:57.226634 1411 raft_consensus.cc:493] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:57.226648 993 leader_election.cc:304] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:51:57.226784 1411 raft_consensus.cc:515] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:51:57.226922 858 leader_election.cc:343] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: Tablet not RUNNING: STOPPED
W20260616 19:51:57.227986 993 raft_consensus.cc:2686] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:51:57.228034 1198 tablet_bootstrap.cc:654] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:57.228313 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776841d895d6431fbee76b7c4e28d973" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:57.229058 1411 leader_election.cc:290] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:57.230186 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5e277102b8480db44e5ffe88267808. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:57.231156 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet bfff9d60bb7e4a86b14687b581b45efe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfff9d60bb7e4a86b14687b581b45efe already in progress: creating tablet
W20260616 19:51:57.231792 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet cbd1070277a14fd98af5fa45925e4f0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbd1070277a14fd98af5fa45925e4f0f already in progress: creating tablet
I20260616 19:51:57.233467 1564 leader_election.cc:290] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:57.236881 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 2f1e12555be64192860eab59b3aeb562 (DEFAULT_TABLE table=default.Table_f059ca67519042369942560b08e0d06c [id=91826dbfc6aa417cba9e7f3cc5fb8dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.237294 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1e12555be64192860eab59b3aeb562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.239403 894 tablet_service.cc:1511] Processing CreateTablet for tablet 40bdb01a15254c329d82f0d40919b880 (DEFAULT_TABLE table=default.Table_d2ddb45a3fbb446689cb737dcb4fbc12 [id=ccddc1e63f194e539a50d511f05eff8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.239794 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40bdb01a15254c329d82f0d40919b880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.240159 889 tablet_service.cc:1511] Processing CreateTablet for tablet af5e277102b8480db44e5ffe88267808 (DEFAULT_TABLE table=default.Table_d19f51d7b61e47dea882c1fd07d9a122 [id=00510df65be542a98fec0f25a07d1542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.240510 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5e277102b8480db44e5ffe88267808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.243271 899 tablet_service.cc:1511] Processing CreateTablet for tablet 43b4c3bd370749b18fb86f7a0aae2c50 (DEFAULT_TABLE table=default.Table_7ad7ef9c768d41edaa47c8cd68466731 [id=217c0ab9c81b4dae8666abc02dfeb60b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.243690 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b4c3bd370749b18fb86f7a0aae2c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.245765 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 21408288aae545cba9aa65afbc29a0e3 (table default.Table_081048b59d4d45719878e3c76725c5e7 [id=0342973a46bc4b93b84b0220163e9975]). Expected version 2 got 0
I20260616 19:51:57.250124 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1dbd90a0e47a4f1eb2efa82ae31c9b74" } new_table_name: "default.Table_9d7e4f47840e4f26bc2ee3c1ae553a0c" modify_external_catalogs: true
I20260616 19:51:57.251448 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2e6556b04f044419a12f88274c124086"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.251946 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e6556b04f044419a12f88274c124086 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.253363 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362e7ff9bea3459ca018d1a7febb2ce4" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:57.253351 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c99b06b04b8743d5ab70f7e50b641736"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.253880 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c99b06b04b8743d5ab70f7e50b641736 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:57.254127 858 leader_election.cc:343] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:57.254428 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dfb3308f15684b20b5d49353c0a255e7" } modify_external_catalogs: true
I20260616 19:51:57.254608 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dfb3308f15684b20b5d49353c0a255e7" } modify_external_catalogs: true
I20260616 19:51:57.254954 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_014502e208f04aa69b455d4a2fea43e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.255406 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_014502e208f04aa69b455d4a2fea43e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:57.258045 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 64aa32856ca34743933931fb51f2bd7b consensus state has no leader
I20260616 19:51:57.257938 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ee70960f9236404aad2ea35b57c6cde2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.258447 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee70960f9236404aad2ea35b57c6cde2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.261798 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7af2cb04d4654ceabe58936f5a687406" } modify_external_catalogs: true
I20260616 19:51:57.261958 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7af2cb04d4654ceabe58936f5a687406" } modify_external_catalogs: true
I20260616 19:51:57.262456 1190 ts_tablet_manager.cc:1929] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:57.262571 1190 log.cc:1199] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/a2b6158b31b34419aa3619f3ce8242b3
I20260616 19:51:57.262957 1190 ts_tablet_manager.cc:1950] T a2b6158b31b34419aa3619f3ce8242b3 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:57.263276 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 278) took 1242 ms. Trace:
I20260616 19:51:57.263388 1190 rpcz_store.cc:276] 0616 19:51:56.020630 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.020726 (+ 96us) service_pool.cc:224] Handling call
0616 19:51:56.918050 (+897324us) ts_tablet_manager.cc:1151] Deleting tablet a2b6158b31b34419aa3619f3ce8242b3
0616 19:51:56.918060 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:57.200966 (+282906us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:57.262373 (+ 61407us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:57.263244 (+ 871us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":897072}
I20260616 19:51:57.263835 1190 tablet_replica.cc:333] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:57.264086 1190 raft_consensus.cc:2243] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:57.264276 1190 raft_consensus.cc:2272] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:57.265928 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet b5f60e9778dd429c8bdbf96261901a56
I20260616 19:51:57.267211 1518 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:51:57.267882 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3e975395a7f54cc6bda4ad65f522a3c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.268385 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e975395a7f54cc6bda4ad65f522a3c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.268718 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 5c74b39e66d344b99f8fc75b855c0520
I20260616 19:51:57.272974 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3ebb67c879364b8eac6a40f80d97a6eb" } new_table_name: "default.Table_fae6d52794914f15a61ce5057c2d51b5" modify_external_catalogs: true
I20260616 19:51:57.273089 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_aee030c17ec146b0b77a8cfc6e4af008"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.273615 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aee030c17ec146b0b77a8cfc6e4af008 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.276554 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c74b39e66d344b99f8fc75b855c0520 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.276831 452 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_de7cf8cf7c43409b9c41391ff6e8ba35 [id=122f88b500c0425e833926b349605d6f] alter complete (version 3)
I20260616 19:51:57.277772 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7a338ffcf4ad4ca8a9b87644da4aec3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.278241 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a338ffcf4ad4ca8a9b87644da4aec3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.284173 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f60e9778dd429c8bdbf96261901a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.284636 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 (DEFAULT_TABLE table=default.Table_7b664bd6d3594152b56ffda505361969 [id=a4744c9d6db148a095891784f8e9bab6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.285044 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.288282 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 5c74b39e66d344b99f8fc75b855c0520 (DEFAULT_TABLE table=default.Table_7af2cb04d4654ceabe58936f5a687406 [id=7f7faf7145fd4ea5babd783d76d44821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.288885 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c74b39e66d344b99f8fc75b855c0520. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:57.290295 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fbb308b05bb04bc18ccaa9550a73d3e7 consensus state has no leader
I20260616 19:51:57.290944 452 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_fdb76eb70534433eae79f807fd35fb90 [id=46c822de2dc2471d847af2e018102efc] alter complete (version 2)
I20260616 19:51:57.291582 1026 tablet_service.cc:1511] Processing CreateTablet for tablet a8708321fb0f4c409a66df75da4c6c0e (DEFAULT_TABLE table=default.Table_c63ea4e62e3e433b86b05b9a80a2fd49 [id=c29388becc784f90b536d84c8548774e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.292047 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8708321fb0f4c409a66df75da4c6c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.294987 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8fff86d5c2344e2fb59db9872ee90b74" } modify_external_catalogs: true
I20260616 19:51:57.295308 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8fff86d5c2344e2fb59db9872ee90b74" } modify_external_catalogs: true
I20260616 19:51:57.296208 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f1ca20a6b9e04c2cb89432166b05988d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.296770 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1ca20a6b9e04c2cb89432166b05988d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.297273 1191 ts_tablet_manager.cc:1929] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:57.297399 1191 log.cc:1199] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/dfee6a9e6d57487bb7d9482f7798e6b6
I20260616 19:51:57.297760 1191 ts_tablet_manager.cc:1950] T dfee6a9e6d57487bb7d9482f7798e6b6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:57.298171 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f325b72bd9214978b04a89c26e52749d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.298744 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f325b72bd9214978b04a89c26e52749d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.298803 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet dfee6a9e6d57487bb7d9482f7798e6b6 (table default.Table_81e67ee241e34396b9e1c159338b192a [id=074446fd6e71497cb644841e5bbd0510]) successfully deleted
I20260616 19:51:57.301015 1564 raft_consensus.cc:493] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:57.301187 1564 raft_consensus.cc:515] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.301801 1564 leader_election.cc:290] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:57.303853 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 65b0dc43b40649f29037f40d2ea9247e
I20260616 19:51:57.303833 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99551210f5974332bf6a16ee74b220f6" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:51:57.304812 858 leader_election.cc:343] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:57.305325 890 tablet_service.cc:1511] Processing CreateTablet for tablet 5c74b39e66d344b99f8fc75b855c0520 (DEFAULT_TABLE table=default.Table_7af2cb04d4654ceabe58936f5a687406 [id=7f7faf7145fd4ea5babd783d76d44821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.305814 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c74b39e66d344b99f8fc75b855c0520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.306782 761 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f60e9778dd429c8bdbf96261901a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.307080 749 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 (DEFAULT_TABLE table=default.Table_7b664bd6d3594152b56ffda505361969 [id=a4744c9d6db148a095891784f8e9bab6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.307206 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 65b0dc43b40649f29037f40d2ea9247e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.307528 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c74b39e66d344b99f8fc75b855c0520 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.308020 1191 tablet_replica.cc:333] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:57.308568 1191 raft_consensus.cc:2243] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:57.309106 1191 raft_consensus.cc:2272] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:57.309507 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2e1696a3c9f24001a4aaf99725f73f62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e1696a3c9f24001a4aaf99725f73f62 already in progress: creating tablet
I20260616 19:51:57.309702 895 tablet_service.cc:1511] Processing CreateTablet for tablet 2f1e12555be64192860eab59b3aeb562 (DEFAULT_TABLE table=default.Table_f059ca67519042369942560b08e0d06c [id=91826dbfc6aa417cba9e7f3cc5fb8dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.310062 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1e12555be64192860eab59b3aeb562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.312310 1191 ts_tablet_manager.cc:1916] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:57.317698 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776841d895d6431fbee76b7c4e28d973" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:57.318393 922 raft_consensus.cc:2393] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
I20260616 19:51:57.319903 1196 tablet_bootstrap.cc:492] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:57.319953 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362e7ff9bea3459ca018d1a7febb2ce4" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:57.320057 752 tablet_service.cc:1511] Processing CreateTablet for tablet 2f1e12555be64192860eab59b3aeb562 (DEFAULT_TABLE table=default.Table_f059ca67519042369942560b08e0d06c [id=91826dbfc6aa417cba9e7f3cc5fb8dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.320163 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 65b0dc43b40649f29037f40d2ea9247e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.320365 764 tablet_service.cc:1511] Processing CreateTablet for tablet 5c74b39e66d344b99f8fc75b855c0520 (DEFAULT_TABLE table=default.Table_7af2cb04d4654ceabe58936f5a687406 [id=7f7faf7145fd4ea5babd783d76d44821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.320585 1193 tablet_replica.cc:333] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:57.320693 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99551210f5974332bf6a16ee74b220f6" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:57.320765 1193 raft_consensus.cc:2243] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:57.321141 1193 raft_consensus.cc:2272] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:57.321154 860 leader_election.cc:343] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: fd5a513aeb224609afaee1ded6ede5e6
I20260616 19:51:57.321309 860 leader_election.cc:304] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:57.321694 1193 ts_tablet_manager.cc:1916] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:57.321779 1564 raft_consensus.cc:2749] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:57.322145 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:57.322309 860 leader_election.cc:343] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 79efb1de93bc4c1e81f4b2e15f621417
I20260616 19:51:57.322439 860 leader_election.cc:304] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:57.322824 1564 raft_consensus.cc:2749] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260616 19:51:57.323738 860 leader_election.cc:343] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:57.323858 860 leader_election.cc:304] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:57.324203 1564 raft_consensus.cc:2749] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:51:57.324608 860 leader_election.cc:343] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:57.324735 860 leader_election.cc:304] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:57.325176 1564 raft_consensus.cc:2749] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:57.325819 718 leader_election.cc:304] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:57.326325 1579 raft_consensus.cc:3060] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:57.326792 1196 tablet_bootstrap.cc:654] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:57.328289 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_667b7f908e7349bcb46f2df575854ac2" } modify_external_catalogs: true
I20260616 19:51:57.328536 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_667b7f908e7349bcb46f2df575854ac2" } modify_external_catalogs: true
I20260616 19:51:57.330006 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b30d3eb9400f41859828b301e68cfec4" } modify_external_catalogs: true
I20260616 19:51:57.330230 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b30d3eb9400f41859828b301e68cfec4" } modify_external_catalogs: true
I20260616 19:51:57.331080 1579 raft_consensus.cc:2749] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:57.336825 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_52a0c9cc9c054a069c0a208d7dd79fd8" } new_table_name: "default.Table_08419ba303bb445eac997664503a70a7" modify_external_catalogs: true
I20260616 19:51:57.338424 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_29d4c487ede340ee9de12af6c3092aec" } new_table_name: "default.Table_62b93909f63642cda25a0d17ce9b567c" modify_external_catalogs: true
I20260616 19:51:57.338621 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c74b39e66d344b99f8fc75b855c0520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.340699 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cd11291643eb41f4bb804b58effb7904"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:57.342398 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1e12555be64192860eab59b3aeb562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.345710 892 tablet_service.cc:1511] Processing CreateTablet for tablet a8708321fb0f4c409a66df75da4c6c0e (DEFAULT_TABLE table=default.Table_c63ea4e62e3e433b86b05b9a80a2fd49 [id=c29388becc784f90b536d84c8548774e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.346136 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8708321fb0f4c409a66df75da4c6c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.353719 1190 ts_tablet_manager.cc:1916] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:57.358515 1193 ts_tablet_manager.cc:1929] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260616 19:51:57.359486 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 consensus state has no leader
W20260616 19:51:57.359524 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb04ccc26e64484a9a29c515d4b954fe consensus state has no leader
I20260616 19:51:57.362342 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c74b39e66d344b99f8fc75b855c0520 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.365886 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 65b0dc43b40649f29037f40d2ea9247e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.366360 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet a2b6158b31b34419aa3619f3ce8242b3 (table default.Table_62044432f4a549d8846c6d9d17274c1a [id=48ebc382fbde40f8a05ccb60001efe00]) successfully deleted
I20260616 19:51:57.367007 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f33b8daab78a4f08bd8f0090c7e0bb32" } new_table_name: "default.Table_ee076c723b314968b2d9f7de0e0947c3" modify_external_catalogs: true
I20260616 19:51:57.368716 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 (DEFAULT_TABLE table=default.Table_7b664bd6d3594152b56ffda505361969 [id=a4744c9d6db148a095891784f8e9bab6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.369189 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:57.370882 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd11291643eb41f4bb804b58effb7904 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:57.377465 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca5dc1e6cde347fc9a34e555385dc646 consensus state has no leader
I20260616 19:51:57.378849 889 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f60e9778dd429c8bdbf96261901a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.379730 780 raft_consensus.cc:1275] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Refusing update from remote peer ae28da1c4102450ab76eb2946a5cbf2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:51:57.379159 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c90188c0181467ea3deee14fa5568b3" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:57.379879 1193 log.cc:1199] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/b5f60e9778dd429c8bdbf96261901a56
I20260616 19:51:57.379200 784 raft_consensus.cc:1275] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Refusing update from remote peer ae28da1c4102450ab76eb2946a5cbf2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:51:57.379328 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7161894b9f9047fda9ed3f2180518a59" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:57.380076 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee6a9e6d57487bb7d9482f7798e6b6" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:57.380298 781 raft_consensus.cc:2468] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:57.379561 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75a5169c0b4650a551b8a76a724469" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:57.380986 860 leader_election.cc:343] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:57.381035 1193 ts_tablet_manager.cc:1950] T b5f60e9778dd429c8bdbf96261901a56 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:57.381117 860 leader_election.cc:304] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:57.381480 1564 consensus_queue.cc:1048] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:51:57.381898 1564 raft_consensus.cc:2749] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:57.382048 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet b5f60e9778dd429c8bdbf96261901a56 (table default.Table_dfb3308f15684b20b5d49353c0a255e7 [id=91db6a529c234ab1b026fba00e18a7ef]) successfully deleted
I20260616 19:51:57.382560 1564 consensus_queue.cc:1048] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:51:57.383378 860 leader_election.cc:343] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:57.383505 860 leader_election.cc:304] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:57.383879 1564 raft_consensus.cc:2749] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:57.384268 860 leader_election.cc:304] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:57.384646 1564 raft_consensus.cc:2804] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:57.384644 453 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_b1e42d7ed6304430a453bb9184363f77 [id=e75a6e5e4f0047d9b398ce230b170131] alter complete (version 6)
I20260616 19:51:57.384739 1564 raft_consensus.cc:493] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:57.384842 1564 raft_consensus.cc:3060] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:57.387835 749 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f60e9778dd429c8bdbf96261901a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.387856 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 7161894b9f9047fda9ed3f2180518a59 with delete_type TABLET_DATA_DELETED (replaced by tablet 4ffce2dc22e24d1684e6eae92c487cea) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.388010 1564 raft_consensus.cc:515] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:57.388130 1191 ts_tablet_manager.cc:1929] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:57.388171 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 19832d0517524c0facf1f97486b1e58e with delete_type TABLET_DATA_DELETED (replaced by tablet 9c77fd138ce9463b8f2d6f4182a56559) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.388281 1191 log.cc:1199] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/21eb01a4b2424d63affa5d9d71e2fa64
I20260616 19:51:57.388664 1191 ts_tablet_manager.cc:1950] T 21eb01a4b2424d63affa5d9d71e2fa64 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
W20260616 19:51:57.389467 860 leader_election.cc:343] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:57.389600 860 leader_election.cc:304] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:57.391840 1458 raft_consensus.cc:2749] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:57.392490 1383 consensus_queue.cc:1048] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:51:57.393198 1564 leader_election.cc:290] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:57.396103 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet d61873c8aa094d7f899a61307a36f895 with delete_type TABLET_DATA_DELETED (replaced by tablet 31592a5ffb04429c9315a4fd72308f28) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.397406 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7161894b9f9047fda9ed3f2180518a59" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:57.397670 779 raft_consensus.cc:3060] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:57.402017 779 raft_consensus.cc:2468] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
W20260616 19:51:57.393707 858 leader_election.cc:343] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 7161894b9f9047fda9ed3f2180518a59
W20260616 19:51:57.410162 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 5c74b39e66d344b99f8fc75b855c0520 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c74b39e66d344b99f8fc75b855c0520 already in progress: creating tablet
W20260616 19:51:57.410864 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 65b0dc43b40649f29037f40d2ea9247e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65b0dc43b40649f29037f40d2ea9247e already in progress: creating tablet
I20260616 19:51:57.379117 757 tablet_service.cc:1511] Processing CreateTablet for tablet a8708321fb0f4c409a66df75da4c6c0e (DEFAULT_TABLE table=default.Table_c63ea4e62e3e433b86b05b9a80a2fd49 [id=c29388becc784f90b536d84c8548774e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.412406 860 leader_election.cc:304] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:57.413031 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8708321fb0f4c409a66df75da4c6c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.414559 1564 raft_consensus.cc:2804] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:57.415297 1190 ts_tablet_manager.cc:1929] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:57.415462 1190 log.cc:1199] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/97afcb75fdc2440d913ad421534a4ef3
I20260616 19:51:57.415457 1564 raft_consensus.cc:697] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:51:57.415824 1190 ts_tablet_manager.cc:1950] T 97afcb75fdc2440d913ad421534a4ef3 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:57.416143 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 275) took 1426 ms. Trace:
I20260616 19:51:57.416234 1190 rpcz_store.cc:276] 0616 19:51:55.989634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.032651 (+ 43017us) service_pool.cc:224] Handling call
0616 19:51:57.263761 (+1231110us) ts_tablet_manager.cc:1151] Deleting tablet 97afcb75fdc2440d913ad421534a4ef3
0616 19:51:57.263771 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:57.411365 (+147594us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:57.415229 (+ 3864us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:57.416094 (+ 865us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1230797}
I20260616 19:51:57.416183 1564 consensus_queue.cc:237] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:51:57.417243 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet b5f60e9778dd429c8bdbf96261901a56 because the tablet was not found. No further retry: Not found: Tablet not found: b5f60e9778dd429c8bdbf96261901a56
I20260616 19:51:57.417836 1193 tablet_replica.cc:333] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:57.418254 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 21eb01a4b2424d63affa5d9d71e2fa64 (table default.Table_873136a2abfb41018a2cec78a9f5fbc9 [id=1938e4f4794c4c3ebd2ea294477e38cd]) successfully deleted
W20260616 19:51:57.418960 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 6cc988a195ec4bbf8691801421fed8bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cc988a195ec4bbf8691801421fed8bb already in progress: creating tablet
I20260616 19:51:57.419239 1192 tablet_bootstrap.cc:492] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:57.419422 1192 ts_tablet_manager.cc:1403] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.484s user 0.005s sys 0.000s
W20260616 19:51:57.419725 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 17029c1ba36644e9847200b54bf9094c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17029c1ba36644e9847200b54bf9094c already in progress: creating tablet
W20260616 19:51:57.420313 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 15d6a025b9a248c5ab9422fe1c340f3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15d6a025b9a248c5ab9422fe1c340f3e already in progress: creating tablet
W20260616 19:51:57.421068 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 67ac2e31a1ba40b39145c26a1e4e0884 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67ac2e31a1ba40b39145c26a1e4e0884 already in progress: creating tablet
I20260616 19:51:57.421032 1192 raft_consensus.cc:359] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:57.421288 1192 raft_consensus.cc:385] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.421381 1192 raft_consensus.cc:740] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.421643 1192 consensus_queue.cc:260] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:51:57.422019 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet aabf57dd6d704645b6bf97b730dbe964 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aabf57dd6d704645b6bf97b730dbe964 already in progress: creating tablet
I20260616 19:51:57.422269 1192 ts_tablet_manager.cc:1434] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:51:57.422634 1192 tablet_bootstrap.cc:492] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:51:57.422780 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 1e8160ad4cf74f16a586ae59291ce7d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e8160ad4cf74f16a586ae59291ce7d1 already in progress: creating tablet
W20260616 19:51:57.423646 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet aa72e00b0a3a423f96bdd7abb6013810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa72e00b0a3a423f96bdd7abb6013810 already in progress: creating tablet
W20260616 19:51:57.424268 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 40bdb01a15254c329d82f0d40919b880 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40bdb01a15254c329d82f0d40919b880 already in progress: creating tablet
I20260616 19:51:57.425076 1192 tablet_bootstrap.cc:654] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:57.425709 1198 tablet_bootstrap.cc:492] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
W20260616 19:51:57.425745 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet bfff9d60bb7e4a86b14687b581b45efe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfff9d60bb7e4a86b14687b581b45efe already in progress: creating tablet
I20260616 19:51:57.425925 1198 ts_tablet_manager.cc:1403] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.202s user 0.014s sys 0.020s
W20260616 19:51:57.426869 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2e1696a3c9f24001a4aaf99725f73f62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e1696a3c9f24001a4aaf99725f73f62 already in progress: creating tablet
I20260616 19:51:57.427183 1198 raft_consensus.cc:359] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.427492 1198 raft_consensus.cc:385] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.427630 1198 raft_consensus.cc:740] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.427994 1198 consensus_queue.cc:260] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:57.428102 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet cbd1070277a14fd98af5fa45925e4f0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbd1070277a14fd98af5fa45925e4f0f already in progress: creating tablet
I20260616 19:51:57.433276 1198 ts_tablet_manager.cc:1434] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:51:57.434039 1198 tablet_bootstrap.cc:492] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:57.434173 1193 raft_consensus.cc:2243] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:57.434437 1193 raft_consensus.cc:2272] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:57.435199 1193 ts_tablet_manager.cc:1916] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:57.437873 1198 tablet_bootstrap.cc:654] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:57.438941 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 776841d895d6431fbee76b7c4e28d973 (table default.Table_ebec5e10f80244469fca70fe48c270e8 [id=4d2238911f8d432095e4a20ee0dc6217]). Expected version 2 got 0
I20260616 19:51:57.441704 1508 raft_consensus.cc:493] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:57.441905 1508 raft_consensus.cc:515] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.442689 1508 leader_election.cc:290] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:57.443779 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19832d0517524c0facf1f97486b1e58e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:57.444432 996 leader_election.cc:343] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:57.445395 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19832d0517524c0facf1f97486b1e58e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:57.445710 922 raft_consensus.cc:2468] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:57.446218 993 leader_election.cc:304] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:51:57.446787 1508 raft_consensus.cc:2804] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:57.446892 1508 raft_consensus.cc:493] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:57.447008 1508 raft_consensus.cc:3060] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:57.449070 1198 tablet_bootstrap.cc:492] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:57.449232 1198 ts_tablet_manager.cc:1403] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260616 19:51:57.450449 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 362e7ff9bea3459ca018d1a7febb2ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet ca5dc1e6cde347fc9a34e555385dc646) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.450553 1508 raft_consensus.cc:515] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.450790 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 97afcb75fdc2440d913ad421534a4ef3 (table default.Table_2d821dc335024cba9f1635d15a76a3b9 [id=475a74cfa2ba41998c3ba29ce388cdc8]) successfully deleted
I20260616 19:51:57.452137 1198 raft_consensus.cc:359] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.452986 1198 raft_consensus.cc:385] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.453284 1198 raft_consensus.cc:740] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.453728 1198 consensus_queue.cc:260] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.453999 1508 leader_election.cc:290] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:51:57.454605 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 5c74b39e66d344b99f8fc75b855c0520 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c74b39e66d344b99f8fc75b855c0520 already in progress: creating tablet
I20260616 19:51:57.454704 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19832d0517524c0facf1f97486b1e58e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:57.454916 924 raft_consensus.cc:3060] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:57.454994 1191 tablet_replica.cc:333] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:57.455265 1198 ts_tablet_manager.cc:1434] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260616 19:51:57.455570 1198 tablet_bootstrap.cc:492] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:57.457366 1198 tablet_bootstrap.cc:654] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:57.461500 1191 raft_consensus.cc:2243] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:57.461727 1191 raft_consensus.cc:2272] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:57.462268 1191 ts_tablet_manager.cc:1916] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:57.462579 924 raft_consensus.cc:2468] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:57.463117 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_02b5fcd9202443e28e603c3a9998ff94" } new_table_name: "default.Table_fab39b1a6f2940f4955f9d3b9dd78a79" modify_external_catalogs: true
I20260616 19:51:57.465252 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cef1d0acd28d4153a1b73c10bc977ebd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.465890 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cef1d0acd28d4153a1b73c10bc977ebd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.467764 1518 tablet.cc:1724] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260616 19:51:57.468143 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_63633f90e6cf41e680de39872cf046f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.468740 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63633f90e6cf41e680de39872cf046f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.472157 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_64de4a339ae243949520501b01d8c41a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.472764 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64de4a339ae243949520501b01d8c41a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.474574 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ab3032cb1f934fdc9bde24d4b3b1f5a3" } modify_external_catalogs: true
I20260616 19:51:57.474787 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ab3032cb1f934fdc9bde24d4b3b1f5a3" } modify_external_catalogs: true
I20260616 19:51:57.475880 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fae6d52794914f15a61ce5057c2d51b5" } modify_external_catalogs: true
I20260616 19:51:57.476063 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fae6d52794914f15a61ce5057c2d51b5" } modify_external_catalogs: true
I20260616 19:51:57.479301 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bf54b260fc941599cffb12581e8116a with delete_type TABLET_DATA_DELETED (replaced by tablet 5c74b39e66d344b99f8fc75b855c0520) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:57.485574 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9d800b4e2c2d42279c102e4e061f5530 consensus state has no leader
I20260616 19:51:57.490736 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 99551210f5974332bf6a16ee74b220f6
I20260616 19:51:57.491184 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d45e81dae12b4aa1a924643a7e38a177"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:57.491981 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 99551210f5974332bf6a16ee74b220f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:57.492549 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d45e81dae12b4aa1a924643a7e38a177 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.494017 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a0cb7a1acf35403192254bf5cd1170a2
I20260616 19:51:57.494776 993 leader_election.cc:304] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:57.495097 1508 raft_consensus.cc:2804] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:57.495040 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7dfd07f94bbe49879183a4f48fff3f4f" } new_table_name: "default.Table_3a7e97060a4b49078e3a1d6d87337196" modify_external_catalogs: true
I20260616 19:51:57.495272 1508 raft_consensus.cc:697] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:57.495532 1508 consensus_queue.cc:237] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.495674 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet a0cb7a1acf35403192254bf5cd1170a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.497406 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6c1f3c5fbc404e8bbdc316236d207917"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.498409 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c1f3c5fbc404e8bbdc316236d207917 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.499922 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 (DEFAULT_TABLE table=default.Table_1054530674ec44d19e673765aefe6cdf [id=1366cc6d014c4092a6ad2086b9f137e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.500344 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.500415 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_03a8cf81701e4e65808bb7336defaf27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.501001 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03a8cf81701e4e65808bb7336defaf27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.503130 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7b912aaf74bb4b23a2cd06c0e5a64873"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.503664 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b912aaf74bb4b23a2cd06c0e5a64873 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.504606 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c6d6071d862241e196a83a23bc939af4
I20260616 19:51:57.505671 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet c6d6071d862241e196a83a23bc939af4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.505779 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fbb308b05bb04bc18ccaa9550a73d3e7
I20260616 19:51:57.506174 903 tablet_service.cc:1558] Processing DeleteTablet for tablet c6d6071d862241e196a83a23bc939af4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.506625 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet fbb308b05bb04bc18ccaa9550a73d3e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.506740 903 tablet_service.cc:1558] Processing DeleteTablet for tablet fbb308b05bb04bc18ccaa9550a73d3e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.507997 891 tablet_service.cc:1558] Processing DeleteTablet for tablet a0cb7a1acf35403192254bf5cd1170a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.508217 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 99551210f5974332bf6a16ee74b220f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.510520 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_148c23f911c0426e857f5f3cd973d63e" } modify_external_catalogs: true
I20260616 19:51:57.510715 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_148c23f911c0426e857f5f3cd973d63e" } modify_external_catalogs: true
I20260616 19:51:57.511490 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7b177800174706a985c11e5876b9d3 (DEFAULT_TABLE table=default.Table_9b154e7b9f584385866a56cfaa2bbd49 [id=0f612612c8124e4a91a05c3e23a9d693]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.511934 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7b177800174706a985c11e5876b9d3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:57.512081 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet efd5fecc6d444e5fba9103287c09542e consensus state has no leader
I20260616 19:51:57.519881 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 279) took 1425 ms. Trace:
I20260616 19:51:57.521673 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet e6f309caaa9042f99432a61fd2ebb089
I20260616 19:51:57.522776 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet e6f309caaa9042f99432a61fd2ebb089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.529565 1190 rpcz_store.cc:276] 0616 19:51:56.094184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.094257 (+ 73us) service_pool.cc:224] Handling call
0616 19:51:57.519652 (+1425395us) ts_tablet_manager.cc:1151] Deleting tablet 73a754c728b5408eb47f91de93554ec5
0616 19:51:57.519668 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:57.519815 (+ 147us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1425098}
I20260616 19:51:57.530503 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 2141b6c7013648a4b716642ccb4eccd6 (DEFAULT_TABLE table=default.Table_452005efb2c6487fad171dc5d5197ce5 [id=bc83d5c728054794b2c3cc0f9b90e202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.530925 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2141b6c7013648a4b716642ccb4eccd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.531383 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 41f2d259a31c4f4eaeceaba57fb978b2 (DEFAULT_TABLE table=default.Table_f708aab917b844abbd6f94d1e60d14b3 [id=d49c093f51b04c2fa1b1f5daadd802cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.531723 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f2d259a31c4f4eaeceaba57fb978b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:57.532336 860 consensus_peers.cc:597] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:51:57.535456 1190 tablet_replica.cc:333] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:57.536298 1190 raft_consensus.cc:2243] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:57.538322 1190 raft_consensus.cc:2272] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:57.540330 1190 ts_tablet_manager.cc:1916] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:57.552506 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19832d0517524c0facf1f97486b1e58e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:57.554558 903 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7b177800174706a985c11e5876b9d3 (DEFAULT_TABLE table=default.Table_9b154e7b9f584385866a56cfaa2bbd49 [id=0f612612c8124e4a91a05c3e23a9d693]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:57.554868 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 73a754c728b5408eb47f91de93554ec5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73a754c728b5408eb47f91de93554ec5 already in progress: creating tablet
I20260616 19:51:57.555006 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7b177800174706a985c11e5876b9d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.560909 890 tablet_service.cc:1511] Processing CreateTablet for tablet 2141b6c7013648a4b716642ccb4eccd6 (DEFAULT_TABLE table=default.Table_452005efb2c6487fad171dc5d5197ce5 [id=bc83d5c728054794b2c3cc0f9b90e202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.561347 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2141b6c7013648a4b716642ccb4eccd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.562381 1036 tablet_service.cc:1511] Processing CreateTablet for tablet b5587d5aa8584cf49ef3cb113a1b64ca (DEFAULT_TABLE table=default.Table_59682c99c0fb454897cb23774423a837 [id=1105333647e747a39fc06efbcc95fa0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.562793 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5587d5aa8584cf49ef3cb113a1b64ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.563902 1040 tablet_service.cc:1511] Processing CreateTablet for tablet a95c684f5fe54f7dad6300efb0c18780 (DEFAULT_TABLE table=default.Table_6623943c0e0c496583317884ef6790ed [id=02d0cb31737b4289988e982dd24ae298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.564240 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95c684f5fe54f7dad6300efb0c18780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.565747 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 99551210f5974332bf6a16ee74b220f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.566084 764 tablet_service.cc:1558] Processing DeleteTablet for tablet a0cb7a1acf35403192254bf5cd1170a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:57.567222 996 leader_election.cc:343] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:57.567435 749 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7b177800174706a985c11e5876b9d3 (DEFAULT_TABLE table=default.Table_9b154e7b9f584385866a56cfaa2bbd49 [id=0f612612c8124e4a91a05c3e23a9d693]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.567813 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7b177800174706a985c11e5876b9d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.569342 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6f119e40509a4d48ae68ebe6eec35784"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:57.569479 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4aa7825edd6a4e318e83e87f1fde10cb" } new_table_name: "default.Table_bfda4071639c49399f2f5bf499be37e9" modify_external_catalogs: true
W20260616 19:51:57.569913 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f119e40509a4d48ae68ebe6eec35784 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.571103 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7bcf075ada124095b23b2fb0b84099ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:57.571542 759 tablet_service.cc:1558] Processing DeleteTablet for tablet e6f309caaa9042f99432a61fd2ebb089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:57.571578 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bcf075ada124095b23b2fb0b84099ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.571911 751 tablet_service.cc:1511] Processing CreateTablet for tablet 2141b6c7013648a4b716642ccb4eccd6 (DEFAULT_TABLE table=default.Table_452005efb2c6487fad171dc5d5197ce5 [id=bc83d5c728054794b2c3cc0f9b90e202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.572288 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2141b6c7013648a4b716642ccb4eccd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.573300 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e45bf57dcf664129991297d4600d67d5" } new_table_name: "default.Table_74f3d2b26e0d4319b73c964c2eaf9204" modify_external_catalogs: true
I20260616 19:51:57.576773 762 tablet_service.cc:1511] Processing CreateTablet for tablet 41f2d259a31c4f4eaeceaba57fb978b2 (DEFAULT_TABLE table=default.Table_f708aab917b844abbd6f94d1e60d14b3 [id=d49c093f51b04c2fa1b1f5daadd802cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.577186 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f2d259a31c4f4eaeceaba57fb978b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.581096 752 tablet_service.cc:1558] Processing DeleteTablet for tablet fbb308b05bb04bc18ccaa9550a73d3e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.581946 764 tablet_service.cc:1558] Processing DeleteTablet for tablet c6d6071d862241e196a83a23bc939af4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.582921 1190 ts_tablet_manager.cc:1929] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:57.583163 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_68091f2e6a6a42c3802c8e2d425729bc" } new_table_name: "default.Table_fb0eda926e1d438baa52295e10f25508" modify_external_catalogs: true
I20260616 19:51:57.583945 752 tablet_service.cc:1511] Processing CreateTablet for tablet a95c684f5fe54f7dad6300efb0c18780 (DEFAULT_TABLE table=default.Table_6623943c0e0c496583317884ef6790ed [id=02d0cb31737b4289988e982dd24ae298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.584302 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95c684f5fe54f7dad6300efb0c18780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.586414 764 tablet_service.cc:1511] Processing CreateTablet for tablet b5587d5aa8584cf49ef3cb113a1b64ca (DEFAULT_TABLE table=default.Table_59682c99c0fb454897cb23774423a837 [id=1105333647e747a39fc06efbcc95fa0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.586833 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5587d5aa8584cf49ef3cb113a1b64ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.588629 1383 consensus_queue.cc:1048] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:51:57.595974 1569 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:51:57.586547 895 tablet_service.cc:1511] Processing CreateTablet for tablet 41f2d259a31c4f4eaeceaba57fb978b2 (DEFAULT_TABLE table=default.Table_f708aab917b844abbd6f94d1e60d14b3 [id=d49c093f51b04c2fa1b1f5daadd802cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.598212 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f2d259a31c4f4eaeceaba57fb978b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.598346 1191 ts_tablet_manager.cc:1929] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:51:57.598467 1191 log.cc:1199] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/b5f60e9778dd429c8bdbf96261901a56
I20260616 19:51:57.598909 1191 ts_tablet_manager.cc:1950] T b5f60e9778dd429c8bdbf96261901a56 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:57.599941 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet b5f60e9778dd429c8bdbf96261901a56 (table default.Table_dfb3308f15684b20b5d49353c0a255e7 [id=91db6a529c234ab1b026fba00e18a7ef]) successfully deleted
I20260616 19:51:57.587131 894 tablet_service.cc:1511] Processing CreateTablet for tablet b5587d5aa8584cf49ef3cb113a1b64ca (DEFAULT_TABLE table=default.Table_59682c99c0fb454897cb23774423a837 [id=1105333647e747a39fc06efbcc95fa0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.600863 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5587d5aa8584cf49ef3cb113a1b64ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.601270 892 tablet_service.cc:1511] Processing CreateTablet for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 (DEFAULT_TABLE table=default.Table_1054530674ec44d19e673765aefe6cdf [id=1366cc6d014c4092a6ad2086b9f137e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.602185 759 tablet_service.cc:1511] Processing CreateTablet for tablet c48314f8e45d4b198306f0ae6e40def7 (DEFAULT_TABLE table=default.Table_3fc9d9c9f0844372a2c28932bf508e6d [id=a1533cc8be3c405b9474aa29dc71aa5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.602545 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48314f8e45d4b198306f0ae6e40def7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.605125 889 tablet_service.cc:1511] Processing CreateTablet for tablet a95c684f5fe54f7dad6300efb0c18780 (DEFAULT_TABLE table=default.Table_6623943c0e0c496583317884ef6790ed [id=02d0cb31737b4289988e982dd24ae298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.608505 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95c684f5fe54f7dad6300efb0c18780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.600870 891 tablet_service.cc:1558] Processing DeleteTablet for tablet e6f309caaa9042f99432a61fd2ebb089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.615583 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.616796 1040 tablet_service.cc:1511] Processing CreateTablet for tablet c48314f8e45d4b198306f0ae6e40def7 (DEFAULT_TABLE table=default.Table_3fc9d9c9f0844372a2c28932bf508e6d [id=a1533cc8be3c405b9474aa29dc71aa5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.617312 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48314f8e45d4b198306f0ae6e40def7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.620306 1190 log.cc:1199] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/db75a5169c0b4650a551b8a76a724469
I20260616 19:51:57.620839 1190 ts_tablet_manager.cc:1950] T db75a5169c0b4650a551b8a76a724469 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:57.621249 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 280) took 1502 ms. Trace:
I20260616 19:51:57.621403 1190 rpcz_store.cc:276] 0616 19:51:56.119224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.119278 (+ 54us) service_pool.cc:224] Handling call
0616 19:51:57.535352 (+1416074us) ts_tablet_manager.cc:1151] Deleting tablet db75a5169c0b4650a551b8a76a724469
0616 19:51:57.535366 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:57.558864 (+ 23498us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:57.582804 (+ 23940us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:57.621202 (+ 38398us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1415760}
I20260616 19:51:57.624570 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5376eb58bd584cce9ea6b9260d89a57c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:57.625839 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 281) took 1481 ms. Trace:
I20260616 19:51:57.626012 1190 rpcz_store.cc:276] 0616 19:51:56.144832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.144888 (+ 56us) service_pool.cc:224] Handling call
0616 19:51:57.625612 (+1480724us) ts_tablet_manager.cc:1151] Deleting tablet 0bf54b260fc941599cffb12581e8116a
0616 19:51:57.625625 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:57.625790 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1480522}
I20260616 19:51:57.632164 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 282) took 1485 ms. Trace:
I20260616 19:51:57.632331 1190 rpcz_store.cc:276] 0616 19:51:56.147148 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.147201 (+ 53us) service_pool.cc:224] Handling call
0616 19:51:57.631918 (+1484717us) ts_tablet_manager.cc:1151] Deleting tablet e91c377ae66441268351cd3592aa9dbc
0616 19:51:57.631943 (+ 25us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:57.632109 (+ 166us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1484505}
W20260616 19:51:57.633091 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5376eb58bd584cce9ea6b9260d89a57c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.633255 1191 tablet_replica.cc:333] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:51:57.639520 858 consensus_peers.cc:597] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21eb01a4b2424d63affa5d9d71e2fa64. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:51:57.639832 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 65b0dc43b40649f29037f40d2ea9247e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65b0dc43b40649f29037f40d2ea9247e already in progress: creating tablet
W20260616 19:51:57.640192 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29df38f273494a079bdc76a915d43dab consensus state has no leader
W20260616 19:51:57.640403 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0b362fa598a54632880faa42a9224ffd consensus state has no leader
I20260616 19:51:57.640533 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet db75a5169c0b4650a551b8a76a724469 (table default.Table_be0f2a85266c49789e5476fc2f376467 [id=7a7fd9801283464ea1f9ac454219c3d4]) successfully deleted
W20260616 19:51:57.641111 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf consensus state has no leader
I20260616 19:51:57.641286 895 tablet_service.cc:1511] Processing CreateTablet for tablet c48314f8e45d4b198306f0ae6e40def7 (DEFAULT_TABLE table=default.Table_3fc9d9c9f0844372a2c28932bf508e6d [id=a1533cc8be3c405b9474aa29dc71aa5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.641692 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48314f8e45d4b198306f0ae6e40def7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:57.648949 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet e91c377ae66441268351cd3592aa9dbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e91c377ae66441268351cd3592aa9dbc already in progress: creating tablet
I20260616 19:51:57.649252 1545 catalog_manager.cc:1294] Loaded cluster ID: d3d9ed8a8f984d7f816cb660c217abc3
I20260616 19:51:57.653316 757 tablet_service.cc:1511] Processing CreateTablet for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 (DEFAULT_TABLE table=default.Table_1054530674ec44d19e673765aefe6cdf [id=1366cc6d014c4092a6ad2086b9f137e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.653772 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.655369 1545 catalog_manager.cc:1587] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: loading cluster ID for follower catalog manager: success
I20260616 19:51:57.656232 1196 tablet_bootstrap.cc:492] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:57.656383 1196 ts_tablet_manager.cc:1403] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.430s user 0.019s sys 0.018s
I20260616 19:51:57.656482 903 tablet_service.cc:1511] Processing CreateTablet for tablet a0cb7a1acf35403192254bf5cd1170a2 (DEFAULT_TABLE table=default.Table_667b7f908e7349bcb46f2df575854ac2 [id=278c6728a83248e9aaf08c4c18bba31f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.656683 1036 tablet_service.cc:1511] Processing CreateTablet for tablet a0cb7a1acf35403192254bf5cd1170a2 (DEFAULT_TABLE table=default.Table_667b7f908e7349bcb46f2df575854ac2 [id=278c6728a83248e9aaf08c4c18bba31f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.656824 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0cb7a1acf35403192254bf5cd1170a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.657106 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0cb7a1acf35403192254bf5cd1170a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.657219 1191 raft_consensus.cc:2243] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:57.657195 1196 raft_consensus.cc:359] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:57.657368 1196 raft_consensus.cc:385] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.657464 1196 raft_consensus.cc:740] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.657598 1191 pending_rounds.cc:70] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2: Trying to abort 1 pending ops.
I20260616 19:51:57.657682 1191 pending_rounds.cc:77] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595463664291840 op_type: NO_OP noop_request { }
I20260616 19:51:57.657677 1196 consensus_queue.cc:260] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:57.657785 1191 raft_consensus.cc:2889] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:57.657904 1191 raft_consensus.cc:2272] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:57.658169 1196 ts_tablet_manager.cc:1434] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:51:57.658461 1196 tablet_bootstrap.cc:492] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:57.660851 1458 raft_consensus.cc:493] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:57.660954 1196 tablet_bootstrap.cc:654] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:57.661037 1458 raft_consensus.cc:515] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:57.661648 1458 leader_election.cc:290] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:57.662225 762 tablet_service.cc:1511] Processing CreateTablet for tablet a0cb7a1acf35403192254bf5cd1170a2 (DEFAULT_TABLE table=default.Table_667b7f908e7349bcb46f2df575854ac2 [id=278c6728a83248e9aaf08c4c18bba31f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.662647 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0cb7a1acf35403192254bf5cd1170a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.664788 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cfb2238cbdb421a8f5001dc729e9bb5" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:51:57.665671 858 leader_election.cc:343] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:57.666319 751 tablet_service.cc:1511] Processing CreateTablet for tablet 482411d57f24459d8e7ed0eeb573234d (DEFAULT_TABLE table=default.Table_861e66e4d4424b7d91d0a3a5d3519db8 [id=1712ccef85b8436986d12a371de3a4eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.666714 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482411d57f24459d8e7ed0eeb573234d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.666656 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 482411d57f24459d8e7ed0eeb573234d (DEFAULT_TABLE table=default.Table_861e66e4d4424b7d91d0a3a5d3519db8 [id=1712ccef85b8436986d12a371de3a4eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.667143 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482411d57f24459d8e7ed0eeb573234d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.671756 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cfb2238cbdb421a8f5001dc729e9bb5" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:57.672307 860 leader_election.cc:343] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:57.672451 860 leader_election.cc:304] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:57.673031 1458 raft_consensus.cc:2749] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:57.673424 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 776841d895d6431fbee76b7c4e28d973 (table default.Table_ebec5e10f80244469fca70fe48c270e8 [id=4d2238911f8d432095e4a20ee0dc6217]). Expected version 2 got 0
I20260616 19:51:57.675076 892 tablet_service.cc:1511] Processing CreateTablet for tablet 482411d57f24459d8e7ed0eeb573234d (DEFAULT_TABLE table=default.Table_861e66e4d4424b7d91d0a3a5d3519db8 [id=1712ccef85b8436986d12a371de3a4eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.675559 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482411d57f24459d8e7ed0eeb573234d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.675915 1569 tablet.cc:1724] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:51:57.680750 457 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet ab33d99d857145dfbda54ff2f7464486 (table default.Table_de7cf8cf7c43409b9c41391ff6e8ba35 [id=122f88b500c0425e833926b349605d6f]). Expected version 3 got 0
I20260616 19:51:57.680979 457 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet da380823d0ae437d9f1d9d0f633f74bb (table default.Table_fdb76eb70534433eae79f807fd35fb90 [id=46c822de2dc2471d847af2e018102efc]). Expected version 2 got 0
I20260616 19:51:57.685743 457 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 776841d895d6431fbee76b7c4e28d973 (table default.Table_ebec5e10f80244469fca70fe48c270e8 [id=4d2238911f8d432095e4a20ee0dc6217]). Expected version 2 got 0
I20260616 19:51:57.687994 759 tablet_service.cc:1558] Processing DeleteTablet for tablet eac603a84d3c4f96bd444c54f28d278d with delete_type TABLET_DATA_DELETED (replaced by tablet bfff9d60bb7e4a86b14687b581b45efe) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.689056 1196 tablet_bootstrap.cc:492] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:57.688959 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a04ece9647b14e4d9cb0d5f5557cc8b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:57.689276 1196 ts_tablet_manager.cc:1403] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.007s
I20260616 19:51:57.689014 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_45887a2d367d4294bce394b38dbe33ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:57.689580 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7b40c6fbe572449e9bf54bdd4a500c41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.690117 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45887a2d367d4294bce394b38dbe33ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:57.690277 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b40c6fbe572449e9bf54bdd4a500c41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.690239 1196 raft_consensus.cc:359] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:57.690457 1196 raft_consensus.cc:385] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.690527 1196 raft_consensus.cc:740] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.690804 1196 consensus_queue.cc:260] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:57.691555 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fb0eda926e1d438baa52295e10f25508" } new_table_name: "default.Table_ab8c15658e304438854ef13e1ce2274b" modify_external_catalogs: true
I20260616 19:51:57.693156 1196 ts_tablet_manager.cc:1434] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
W20260616 19:51:57.689590 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a04ece9647b14e4d9cb0d5f5557cc8b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.693655 1196 tablet_bootstrap.cc:492] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:57.695990 1196 tablet_bootstrap.cc:654] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:57.703202 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 283) took 1431 ms. Trace:
I20260616 19:51:57.703367 1190 rpcz_store.cc:276] 0616 19:51:56.271870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.271933 (+ 63us) service_pool.cc:224] Handling call
0616 19:51:57.702641 (+1430708us) ts_tablet_manager.cc:1151] Deleting tablet 1bc181171b134de2b946376f468aec72
0616 19:51:57.702655 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:57.703145 (+ 490us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1430471}
I20260616 19:51:57.703725 1190 tablet_replica.cc:333] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:57.703987 1190 raft_consensus.cc:2243] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:57.704192 1190 raft_consensus.cc:2272] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:57.704865 1190 ts_tablet_manager.cc:1916] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:51:57.705768 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 1bc181171b134de2b946376f468aec72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bc181171b134de2b946376f468aec72 already in progress: creating tablet
I20260616 19:51:57.707449 1196 tablet_bootstrap.cc:492] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:57.709270 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd289d39eaf4471b754dae9433a5474 (DEFAULT_TABLE table=default.Table_6028f4beaf354f9db81ae938006efd35 [id=13d99b2022554ceba95801c0da5bb100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.709673 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 08db2c1398b946c180d81b88504c1d9c (DEFAULT_TABLE table=default.Table_1b0deebdd1844949b9064d3e3ab11920 [id=70f7e3e96e524037a13e7c49678a3a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.709750 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd289d39eaf4471b754dae9433a5474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.710357 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08db2c1398b946c180d81b88504c1d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.708793 1196 ts_tablet_manager.cc:1403] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.004s
I20260616 19:51:57.711846 1196 raft_consensus.cc:359] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.718179 1196 raft_consensus.cc:385] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.720333 1196 raft_consensus.cc:740] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.720649 1196 consensus_queue.cc:260] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:57.723120 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf consensus state has no leader
I20260616 19:51:57.723182 1196 ts_tablet_manager.cc:1434] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260616 19:51:57.723520 1196 tablet_bootstrap.cc:492] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:57.729139 1196 tablet_bootstrap.cc:654] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:57.733741 895 tablet_service.cc:1511] Processing CreateTablet for tablet 2d05c86bca9343a2bc8c5709e1c49647 (DEFAULT_TABLE table=default.Table_7454297805304a68987f421ea266723e [id=d93c65e8731244c4b0df941577a30010]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:57.737701 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 29df38f273494a079bdc76a915d43dab (table default.Table_bfda4071639c49399f2f5bf499be37e9 [id=1449ff28bd8546908359606f7272846f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 29df38f273494a079bdc76a915d43dab consensus state has no leader
I20260616 19:51:57.740281 894 tablet_service.cc:1511] Processing CreateTablet for tablet 3f96ef25396a4092bc475f4aab269bc7 (DEFAULT_TABLE table=default.Table_2e6556b04f044419a12f88274c124086 [id=85bdc981552e4f50a725c53285275af3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.739571 890 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd289d39eaf4471b754dae9433a5474 (DEFAULT_TABLE table=default.Table_6028f4beaf354f9db81ae938006efd35 [id=13d99b2022554ceba95801c0da5bb100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.741427 891 tablet_service.cc:1511] Processing CreateTablet for tablet 272838af35d840faa7b11217456533c2 (DEFAULT_TABLE table=default.Table_5993624d9698498986c80f02a4c7260b [id=9a09704d792a45f6a5fd8a90e5158110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.741817 1196 tablet_bootstrap.cc:492] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:57.741842 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 2d05c86bca9343a2bc8c5709e1c49647 (DEFAULT_TABLE table=default.Table_7454297805304a68987f421ea266723e [id=d93c65e8731244c4b0df941577a30010]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.741990 1196 ts_tablet_manager.cc:1403] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.001s
I20260616 19:51:57.742256 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d05c86bca9343a2bc8c5709e1c49647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.742358 903 tablet_service.cc:1511] Processing CreateTablet for tablet 08db2c1398b946c180d81b88504c1d9c (DEFAULT_TABLE table=default.Table_1b0deebdd1844949b9064d3e3ab11920 [id=70f7e3e96e524037a13e7c49678a3a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.742771 1196 raft_consensus.cc:359] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.742998 1196 raft_consensus.cc:385] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.743081 1196 raft_consensus.cc:740] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.743399 762 tablet_service.cc:1558] Processing DeleteTablet for tablet d61873c8aa094d7f899a61307a36f895 with delete_type TABLET_DATA_DELETED (replaced by tablet 31592a5ffb04429c9315a4fd72308f28) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.743360 1196 consensus_queue.cc:260] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.744036 762 tablet_service.cc:1511] Processing CreateTablet for tablet 08db2c1398b946c180d81b88504c1d9c (DEFAULT_TABLE table=default.Table_1b0deebdd1844949b9064d3e3ab11920 [id=70f7e3e96e524037a13e7c49678a3a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.745608 751 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd289d39eaf4471b754dae9433a5474 (DEFAULT_TABLE table=default.Table_6028f4beaf354f9db81ae938006efd35 [id=13d99b2022554ceba95801c0da5bb100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.747098 757 tablet_service.cc:1511] Processing CreateTablet for tablet 2d05c86bca9343a2bc8c5709e1c49647 (DEFAULT_TABLE table=default.Table_7454297805304a68987f421ea266723e [id=d93c65e8731244c4b0df941577a30010]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.747888 889 tablet_service.cc:1511] Processing CreateTablet for tablet 90bc7409e31043bd9f47d3628278a2fa (DEFAULT_TABLE table=default.Table_a4a6f573af0d49d58db91ad41beb2ac1 [id=f120198cf70040b982289f0a239f2e5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.748651 899 tablet_service.cc:1511] Processing CreateTablet for tablet 0b362fa598a54632880faa42a9224ffd (DEFAULT_TABLE table=default.Table_74f3d2b26e0d4319b73c964c2eaf9204 [id=a67306640a5b4c0a91a283892a3a8062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.748425 759 tablet_service.cc:1511] Processing CreateTablet for tablet 3f96ef25396a4092bc475f4aab269bc7 (DEFAULT_TABLE table=default.Table_2e6556b04f044419a12f88274c124086 [id=85bdc981552e4f50a725c53285275af3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.749205 1196 ts_tablet_manager.cc:1434] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20260616 19:51:57.751446 1192 tablet_bootstrap.cc:492] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:57.751636 1192 ts_tablet_manager.cc:1403] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.329s user 0.005s sys 0.014s
I20260616 19:51:57.749780 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c90188c0181467ea3deee14fa5568b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.750597 761 tablet_service.cc:1511] Processing CreateTablet for tablet 272838af35d840faa7b11217456533c2 (DEFAULT_TABLE table=default.Table_5993624d9698498986c80f02a4c7260b [id=9a09704d792a45f6a5fd8a90e5158110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.751931 754 tablet_service.cc:1511] Processing CreateTablet for tablet 90bc7409e31043bd9f47d3628278a2fa (DEFAULT_TABLE table=default.Table_a4a6f573af0d49d58db91ad41beb2ac1 [id=f120198cf70040b982289f0a239f2e5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.752511 1192 raft_consensus.cc:359] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.752727 1192 raft_consensus.cc:385] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.752846 1192 raft_consensus.cc:740] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.753103 1192 consensus_queue.cc:260] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.753643 1192 ts_tablet_manager.cc:1434] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:51:57.753923 1192 tablet_bootstrap.cc:492] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:57.754223 1196 tablet_bootstrap.cc:492] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:57.756116 1196 tablet_bootstrap.cc:654] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:57.764760 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272838af35d840faa7b11217456533c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.765026 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d05c86bca9343a2bc8c5709e1c49647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.765138 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ee076c723b314968b2d9f7de0e0947c3" } modify_external_catalogs: true
I20260616 19:51:57.765350 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ee076c723b314968b2d9f7de0e0947c3" } modify_external_catalogs: true
I20260616 19:51:57.765569 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bc7409e31043bd9f47d3628278a2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.766053 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08db2c1398b946c180d81b88504c1d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.766620 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f96ef25396a4092bc475f4aab269bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.772109 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_97db7730461e4d00ab3bc527573cde94" } modify_external_catalogs: true
I20260616 19:51:57.772296 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_97db7730461e4d00ab3bc527573cde94" } modify_external_catalogs: true
I20260616 19:51:57.778699 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 776841d895d6431fbee76b7c4e28d973 (table default.Table_ebec5e10f80244469fca70fe48c270e8 [id=4d2238911f8d432095e4a20ee0dc6217]). Expected version 2 got 0
I20260616 19:51:57.784649 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd289d39eaf4471b754dae9433a5474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.790213 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ca5dc1e6cde347fc9a34e555385dc646
I20260616 19:51:57.792512 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1d80d9028184443da49623228259263d
I20260616 19:51:57.794756 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8dbc007d3ffb483d8f4ca4fefdde8a2b" } modify_external_catalogs: true
I20260616 19:51:57.795084 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8dbc007d3ffb483d8f4ca4fefdde8a2b" } modify_external_catalogs: true
I20260616 19:51:57.801018 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c6939d108a7948bb9e56311a34d95486
I20260616 19:51:57.803572 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6f119e40509a4d48ae68ebe6eec35784" } modify_external_catalogs: true
I20260616 19:51:57.803814 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6f119e40509a4d48ae68ebe6eec35784" } modify_external_catalogs: true
I20260616 19:51:57.732419 1545 catalog_manager.cc:1609] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: acquiring CA information for follower catalog manager: success
I20260616 19:51:57.810714 1545 catalog_manager.cc:1637] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260616 19:51:57.812451 452 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 0bfc551920104096b48ab2463686f4dd
I20260616 19:51:57.813328 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6678ca70f63c4fd389c950e0023a5d07" } new_table_name: "default.Table_60ba0f6f88634456a3d4afc9f759c4a7" modify_external_catalogs: true
I20260616 19:51:57.814998 1192 tablet_bootstrap.cc:654] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:57.819636 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bcc5116ef5df4140a96f03c003337c68 consensus state has no leader
I20260616 19:51:57.820077 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_98561738ee7d4ad8bf14170c99d01b96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.820755 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98561738ee7d4ad8bf14170c99d01b96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.827905 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cfb2238cbdb421a8f5001dc729e9bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.827991 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1d16dde2c5a74de4a602f6be2aa95a23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:57.828519 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 5af9bdceae184f8dbb9e5db67a11ee63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:57.828709 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d16dde2c5a74de4a602f6be2aa95a23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.829550 902 tablet_service.cc:1558] Processing DeleteTablet for tablet ca5dc1e6cde347fc9a34e555385dc646 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.830150 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d80d9028184443da49623228259263d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.830715 902 tablet_service.cc:1558] Processing DeleteTablet for tablet c6939d108a7948bb9e56311a34d95486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.833035 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_550c0ce5672e4d06a8224cafdc7d1479"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.833814 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_550c0ce5672e4d06a8224cafdc7d1479 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.834434 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f96ef25396a4092bc475f4aab269bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.835182 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b362fa598a54632880faa42a9224ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.835773 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272838af35d840faa7b11217456533c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.837093 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d05c86bca9343a2bc8c5709e1c49647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.837658 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bc7409e31043bd9f47d3628278a2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.838157 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd289d39eaf4471b754dae9433a5474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.838330 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f4fa0f49dd9849f18e8d221a29eb24c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:57.838727 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08db2c1398b946c180d81b88504c1d9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:57.838948 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4fa0f49dd9849f18e8d221a29eb24c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.842556 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fab39b1a6f2940f4955f9d3b9dd78a79" } modify_external_catalogs: true
I20260616 19:51:57.842788 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fab39b1a6f2940f4955f9d3b9dd78a79" } modify_external_catalogs: true
I20260616 19:51:57.845335 460 master_service.cc:960] ReplaceTablet: received request to replace tablet db75a5169c0b4650a551b8a76a724469 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:57.848308 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 4bd6fa49eff4400ca40c722e18cea951 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:57.852685 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_425ca87bdf224de58078e9b95a26897e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.853394 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_425ca87bdf224de58078e9b95a26897e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.855696 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ade11253e88d413db148bcee7283260d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.856112 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ade11253e88d413db148bcee7283260d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.859467 1193 ts_tablet_manager.cc:1929] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:57.859632 1193 log.cc:1199] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/7161894b9f9047fda9ed3f2180518a59
I20260616 19:51:57.860019 1193 ts_tablet_manager.cc:1950] T 7161894b9f9047fda9ed3f2180518a59 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:57.863983 1193 tablet_replica.cc:333] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:57.864162 1193 raft_consensus.cc:2243] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:57.864348 1193 raft_consensus.cc:2272] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:57.865916 1193 ts_tablet_manager.cc:1916] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:57.873442 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_03a8cf81701e4e65808bb7336defaf27" } new_table_name: "default.Table_52d50dabb1b2498f88d5a07f62f7d058" modify_external_catalogs: true
I20260616 19:51:57.876747 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_70f2f37a1352492e82eb6083bc7e0f53" } new_table_name: "default.Table_2b005a492d164f608d275c8e23da534a" modify_external_catalogs: true
I20260616 19:51:57.880082 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7b664bd6d3594152b56ffda505361969" } new_table_name: "default.Table_d82de7981eb34e10866c36d2414328af" modify_external_catalogs: true
I20260616 19:51:57.886950 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9d800b4e2c2d42279c102e4e061f5530
W20260616 19:51:57.889642 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 67957.8us
I20260616 19:51:57.890367 1191 ts_tablet_manager.cc:1916] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:57.892614 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 3f96ef25396a4092bc475f4aab269bc7 (DEFAULT_TABLE table=default.Table_2e6556b04f044419a12f88274c124086 [id=85bdc981552e4f50a725c53285275af3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.893155 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f96ef25396a4092bc475f4aab269bc7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:57.890363 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d686190fb6a34ab18cc4799197765f1b has no consensus state
I20260616 19:51:57.898801 751 tablet_service.cc:1511] Processing CreateTablet for tablet 0b362fa598a54632880faa42a9224ffd (DEFAULT_TABLE table=default.Table_74f3d2b26e0d4319b73c964c2eaf9204 [id=a67306640a5b4c0a91a283892a3a8062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.899773 759 tablet_service.cc:1558] Processing DeleteTablet for tablet dfee6a9e6d57487bb7d9482f7798e6b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.900447 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ca5dc1e6cde347fc9a34e555385dc646 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.901600 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d80d9028184443da49623228259263d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.902922 1196 tablet_bootstrap.cc:492] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:57.903117 1196 ts_tablet_manager.cc:1403] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.149s user 0.005s sys 0.042s
I20260616 19:51:57.903748 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 0b362fa598a54632880faa42a9224ffd (DEFAULT_TABLE table=default.Table_74f3d2b26e0d4319b73c964c2eaf9204 [id=a67306640a5b4c0a91a283892a3a8062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.904182 1196 raft_consensus.cc:359] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:57.904409 1196 raft_consensus.cc:385] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.904542 1196 raft_consensus.cc:740] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.904865 1196 consensus_queue.cc:260] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:57.905551 1196 ts_tablet_manager.cc:1434] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:57.905630 759 tablet_service.cc:1558] Processing DeleteTablet for tablet c6939d108a7948bb9e56311a34d95486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.910948 759 tablet_service.cc:1511] Processing CreateTablet for tablet db750fc9641f492494fdb167de86f6df (DEFAULT_TABLE table=default.Table_e2695b46a446427381c2ea1d260bed78 [id=4f3dc165f3d84700856eebc8f3243acf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.912022 1196 tablet_bootstrap.cc:492] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:57.913219 762 tablet_service.cc:1511] Processing CreateTablet for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd (DEFAULT_TABLE table=default.Table_c99b06b04b8743d5ab70f7e50b641736 [id=e7d3c7f7cee242c6b5f66df9ec3d2dff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.913702 1029 tablet_service.cc:1511] Processing CreateTablet for tablet c1203a4e952a42369d5c03ff4a4c59ec (DEFAULT_TABLE table=default.Table_657c910adb4d432296fa32c1bb06a3a6 [id=f4cf481e37b84114b98f1caeb5098fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.913781 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 76c48e233d184487b7651e9cb105c2cc (DEFAULT_TABLE table=default.Table_014502e208f04aa69b455d4a2fea43e4 [id=d24b6a6d28c949b2880a34bfa227c585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.913990 1196 tablet_bootstrap.cc:654] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:57.914247 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 335f7411fda84fada762345010a4339c (DEFAULT_TABLE table=default.Table_a84e0dab565b459c96cdce84214af742 [id=be40d7e74be1474c98f06b62d98de5db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.916383 761 tablet_service.cc:1511] Processing CreateTablet for tablet c1203a4e952a42369d5c03ff4a4c59ec (DEFAULT_TABLE table=default.Table_657c910adb4d432296fa32c1bb06a3a6 [id=f4cf481e37b84114b98f1caeb5098fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.916781 757 tablet_service.cc:1511] Processing CreateTablet for tablet efd5fecc6d444e5fba9103287c09542e (DEFAULT_TABLE table=default.Table_3a7e97060a4b49078e3a1d6d87337196 [id=c44c8263ef0247ffabb1e337409d1aad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.917241 754 tablet_service.cc:1511] Processing CreateTablet for tablet 76c48e233d184487b7651e9cb105c2cc (DEFAULT_TABLE table=default.Table_014502e208f04aa69b455d4a2fea43e4 [id=d24b6a6d28c949b2880a34bfa227c585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.917820 752 tablet_service.cc:1511] Processing CreateTablet for tablet 335f7411fda84fada762345010a4339c (DEFAULT_TABLE table=default.Table_a84e0dab565b459c96cdce84214af742 [id=be40d7e74be1474c98f06b62d98de5db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.918234 764 tablet_service.cc:1511] Processing CreateTablet for tablet 29df38f273494a079bdc76a915d43dab (DEFAULT_TABLE table=default.Table_bfda4071639c49399f2f5bf499be37e9 [id=1449ff28bd8546908359606f7272846f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.922029 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d800b4e2c2d42279c102e4e061f5530 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.923599 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet ca5dc1e6cde347fc9a34e555385dc646 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:57.923830 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4a2855b7dec4244a3fc52bdca7e7eb3 consensus state has no leader
I20260616 19:51:57.923880 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d80d9028184443da49623228259263d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.923931 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet c6939d108a7948bb9e56311a34d95486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.924062 1030 tablet_service.cc:1511] Processing CreateTablet for tablet db750fc9641f492494fdb167de86f6df (DEFAULT_TABLE table=default.Table_e2695b46a446427381c2ea1d260bed78 [id=4f3dc165f3d84700856eebc8f3243acf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:57.924331 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 consensus state has no leader
I20260616 19:51:57.925371 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c4f4a13f09cb47da8cb7a526f431e3c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:57.925822 1196 tablet_bootstrap.cc:492] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
W20260616 19:51:57.925930 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4f4a13f09cb47da8cb7a526f431e3c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.926040 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b362fa598a54632880faa42a9224ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.926080 1196 ts_tablet_manager.cc:1403] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.003s
I20260616 19:51:57.926326 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c48e233d184487b7651e9cb105c2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.926414 1035 tablet_service.cc:1511] Processing CreateTablet for tablet efd5fecc6d444e5fba9103287c09542e (DEFAULT_TABLE table=default.Table_3a7e97060a4b49078e3a1d6d87337196 [id=c44c8263ef0247ffabb1e337409d1aad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.926782 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd5fecc6d444e5fba9103287c09542e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.929209 1196 raft_consensus.cc:359] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.932525 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d800b4e2c2d42279c102e4e061f5530 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:57.933136 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 90bc7409e31043bd9f47d3628278a2fa (DEFAULT_TABLE table=default.Table_a4a6f573af0d49d58db91ad41beb2ac1 [id=f120198cf70040b982289f0a239f2e5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.933683 1196 raft_consensus.cc:385] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.933828 1196 raft_consensus.cc:740] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.934139 1196 consensus_queue.cc:260] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.934742 1196 ts_tablet_manager.cc:1434] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260616 19:51:57.936393 1196 tablet_bootstrap.cc:492] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:57.937096 1032 tablet_service.cc:1511] Processing CreateTablet for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd (DEFAULT_TABLE table=default.Table_c99b06b04b8743d5ab70f7e50b641736 [id=e7d3c7f7cee242c6b5f66df9ec3d2dff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.938555 1196 tablet_bootstrap.cc:654] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:57.938720 893 tablet_service.cc:1511] Processing CreateTablet for tablet 29df38f273494a079bdc76a915d43dab (DEFAULT_TABLE table=default.Table_bfda4071639c49399f2f5bf499be37e9 [id=1449ff28bd8546908359606f7272846f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.939173 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29df38f273494a079bdc76a915d43dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.942505 891 tablet_service.cc:1511] Processing CreateTablet for tablet db750fc9641f492494fdb167de86f6df (DEFAULT_TABLE table=default.Table_e2695b46a446427381c2ea1d260bed78 [id=4f3dc165f3d84700856eebc8f3243acf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.942904 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db750fc9641f492494fdb167de86f6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.944288 901 tablet_service.cc:1511] Processing CreateTablet for tablet c1203a4e952a42369d5c03ff4a4c59ec (DEFAULT_TABLE table=default.Table_657c910adb4d432296fa32c1bb06a3a6 [id=f4cf481e37b84114b98f1caeb5098fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.948714 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 7161894b9f9047fda9ed3f2180518a59 (table default.Table_ee130ae3817f41f8ac49a76361fd23ea [id=a69482262948439783492742dcbf0b43]) successfully deleted
W20260616 19:51:57.948992 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 99551210f5974332bf6a16ee74b220f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99551210f5974332bf6a16ee74b220f6 already in progress: creating tablet
W20260616 19:51:57.949237 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a0cb7a1acf35403192254bf5cd1170a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0cb7a1acf35403192254bf5cd1170a2 already in progress: creating tablet
W20260616 19:51:57.949472 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet e6f309caaa9042f99432a61fd2ebb089 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6f309caaa9042f99432a61fd2ebb089 already in progress: creating tablet
W20260616 19:51:57.949659 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet fbb308b05bb04bc18ccaa9550a73d3e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbb308b05bb04bc18ccaa9550a73d3e7 already in progress: creating tablet
I20260616 19:51:57.949674 902 tablet_service.cc:1511] Processing CreateTablet for tablet efd5fecc6d444e5fba9103287c09542e (DEFAULT_TABLE table=default.Table_3a7e97060a4b49078e3a1d6d87337196 [id=c44c8263ef0247ffabb1e337409d1aad]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:57.949857 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c6d6071d862241e196a83a23bc939af4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6d6071d862241e196a83a23bc939af4 already in progress: creating tablet
I20260616 19:51:57.951380 894 tablet_service.cc:1511] Processing CreateTablet for tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf (DEFAULT_TABLE table=default.Table_ab8c15658e304438854ef13e1ce2274b [id=b7d5c502d76f428683cb0830f0819011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.952116 896 tablet_service.cc:1511] Processing CreateTablet for tablet 76c48e233d184487b7651e9cb105c2cc (DEFAULT_TABLE table=default.Table_014502e208f04aa69b455d4a2fea43e4 [id=d24b6a6d28c949b2880a34bfa227c585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.952392 749 tablet_service.cc:1511] Processing CreateTablet for tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf (DEFAULT_TABLE table=default.Table_ab8c15658e304438854ef13e1ce2274b [id=b7d5c502d76f428683cb0830f0819011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.952770 898 tablet_service.cc:1511] Processing CreateTablet for tablet 335f7411fda84fada762345010a4339c (DEFAULT_TABLE table=default.Table_a84e0dab565b459c96cdce84214af742 [id=be40d7e74be1474c98f06b62d98de5db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.952939 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 97afcb75fdc2440d913ad421534a4ef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:51 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.953333 748 tablet_service.cc:1558] Processing DeleteTablet for tablet bb2fdea2d4ab42708fcd3102ea54bdb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:57.955224 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b362fa598a54632880faa42a9224ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.955806 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29df38f273494a079bdc76a915d43dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.956278 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd5fecc6d444e5fba9103287c09542e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.956584 455 master_service.cc:960] ReplaceTablet: received request to replace tablet d9c664f0386549d6867c407526ee45a0 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:57.956845 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335f7411fda84fada762345010a4339c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.957037 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 2e316e44693d473dad901eeb95299988 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:57.957340 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c48e233d184487b7651e9cb105c2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.957412 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 102f322eb98f4224acb8637f8c29ac19 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:57.957832 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.958077 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_98dfc128f98d405bb94b36098e43025f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.958595 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98dfc128f98d405bb94b36098e43025f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.959296 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.961508 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_de7cf8cf7c43409b9c41391ff6e8ba35" } new_table_name: "default.Table_805133e8e07b40a8a2e8a326ac7991ab" modify_external_catalogs: true
I20260616 19:51:57.962110 899 tablet_service.cc:1511] Processing CreateTablet for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd (DEFAULT_TABLE table=default.Table_c99b06b04b8743d5ab70f7e50b641736 [id=e7d3c7f7cee242c6b5f66df9ec3d2dff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:57.962301 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1203a4e952a42369d5c03ff4a4c59ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.962556 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db750fc9641f492494fdb167de86f6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.962841 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c3ed767db6964beebf754607830e97d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.963325 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3ed767db6964beebf754607830e97d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.963634 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d800b4e2c2d42279c102e4e061f5530 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:57.964143 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd5fecc6d444e5fba9103287c09542e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.967649 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d9b6ea5cbcd347058c16f26573990825"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:57.968873 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9b6ea5cbcd347058c16f26573990825 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:57.972213 1192 tablet_bootstrap.cc:492] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:57.972972 1192 ts_tablet_manager.cc:1403] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.219s user 0.001s sys 0.003s
I20260616 19:51:57.973841 1192 raft_consensus.cc:359] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.974113 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.974789 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335f7411fda84fada762345010a4339c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:57.974829 1192 raft_consensus.cc:385] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:57.974939 1192 raft_consensus.cc:740] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:57.985086 1192 consensus_queue.cc:260] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:57.985819 1192 ts_tablet_manager.cc:1434] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260616 19:51:57.986752 1192 tablet_bootstrap.cc:492] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:57.997615 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.003269 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c48e233d184487b7651e9cb105c2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.016037 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1203a4e952a42369d5c03ff4a4c59ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.029481 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db750fc9641f492494fdb167de86f6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.032181 1569 tablet.cc:1724] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:51:58.035739 1196 tablet_bootstrap.cc:492] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:58.036176 1458 raft_consensus.cc:493] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:58.036351 1458 raft_consensus.cc:515] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.037058 1458 leader_election.cc:290] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:58.036968 1196 ts_tablet_manager.cc:1403] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.101s user 0.014s sys 0.044s
I20260616 19:51:58.038228 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51a6fb4c49e461583a5aba1813b2a3e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:58.038951 860 leader_election.cc:343] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:58.039891 1196 raft_consensus.cc:359] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.040853 1196 raft_consensus.cc:385] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:58.041124 1196 raft_consensus.cc:740] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:58.041679 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 272838af35d840faa7b11217456533c2 (DEFAULT_TABLE table=default.Table_5993624d9698498986c80f02a4c7260b [id=9a09704d792a45f6a5fd8a90e5158110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.041838 1196 consensus_queue.cc:260] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.043339 1196 ts_tablet_manager.cc:1434] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260616 19:51:58.045243 1196 tablet_bootstrap.cc:492] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:58.049958 1192 tablet_bootstrap.cc:654] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:58.052364 1196 tablet_bootstrap.cc:654] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:58.054427 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d22240d294454cbeb2ca5b07d45273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:58.058943 1193 ts_tablet_manager.cc:1929] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:58.059059 1193 log.cc:1199] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/eac603a84d3c4f96bd444c54f28d278d
I20260616 19:51:58.059392 1193 ts_tablet_manager.cc:1950] T eac603a84d3c4f96bd444c54f28d278d P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:58.059427 1190 ts_tablet_manager.cc:1929] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:58.059568 1190 log.cc:1199] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/79efb1de93bc4c1e81f4b2e15f621417
I20260616 19:51:58.059938 1190 ts_tablet_manager.cc:1950] T 79efb1de93bc4c1e81f4b2e15f621417 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:58.065582 1193 tablet_replica.cc:333] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:58.065809 1193 raft_consensus.cc:2243] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:58.065974 1193 raft_consensus.cc:2272] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:58.066514 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet eac603a84d3c4f96bd444c54f28d278d (table default.Table_74f3d2b26e0d4319b73c964c2eaf9204 [id=a67306640a5b4c0a91a283892a3a8062]) successfully deleted
I20260616 19:51:58.066989 1193 ts_tablet_manager.cc:1916] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:58.070844 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 284) took 1638 ms. Trace:
I20260616 19:51:58.070982 1190 rpcz_store.cc:276] 0616 19:51:56.431895 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.431955 (+ 60us) service_pool.cc:224] Handling call
0616 19:51:57.703657 (+1271702us) ts_tablet_manager.cc:1151] Deleting tablet 79efb1de93bc4c1e81f4b2e15f621417
0616 19:51:57.703669 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:57.879279 (+175610us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:58.059351 (+180072us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:58.070783 (+ 11432us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1271464}
I20260616 19:51:58.071357 1190 tablet_replica.cc:333] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:58.071538 1190 raft_consensus.cc:2243] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:58.071719 1190 raft_consensus.cc:2272] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:58.072233 1190 ts_tablet_manager.cc:1916] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:58.076056 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet d51a6fb4c49e461583a5aba1813b2a3e (table default.Table_b3d1ae6133974de8942b6f6a2ae9f310 [id=2d4376cceca648ef87dcf561d1e9e701]). Expected version 1 got 0
I20260616 19:51:58.091073 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet ab33d99d857145dfbda54ff2f7464486 (table default.Table_805133e8e07b40a8a2e8a326ac7991ab [id=122f88b500c0425e833926b349605d6f]). Expected version 4 got 3
I20260616 19:51:58.091161 764 tablet_service.cc:1511] Processing CreateTablet for tablet 61189a715da140a6833801681bbd5ef4 (DEFAULT_TABLE table=default.Table_425ca87bdf224de58078e9b95a26897e [id=45b3473eea3f4c6cba1561fee495371a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.091291 752 tablet_service.cc:1511] Processing CreateTablet for tablet 4fc0c02ef58d4e429855e5bbaa4752ad (DEFAULT_TABLE table=default.Table_98561738ee7d4ad8bf14170c99d01b96 [id=601faf6d488e40c584a3537834653ae9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.091606 761 tablet_service.cc:1511] Processing CreateTablet for tablet e03e6a2614564eeeb8ec382b16f0ece1 (DEFAULT_TABLE table=default.Table_7b40c6fbe572449e9bf54bdd4a500c41 [id=911a55a5f54547a88ed431bb85f18351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.091694 754 tablet_service.cc:1511] Processing CreateTablet for tablet e85e2861c41f402d88cafe64a6871429 (DEFAULT_TABLE table=default.Table_550c0ce5672e4d06a8224cafdc7d1479 [id=02a85fe82ed24f6b949c0ded2d9a7d5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.094029 749 tablet_service.cc:1511] Processing CreateTablet for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b (DEFAULT_TABLE table=default.Table_5376eb58bd584cce9ea6b9260d89a57c [id=33517e3e567c4b59be27cc606c6c905c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.094867 762 tablet_service.cc:1511] Processing CreateTablet for tablet dd52351082274a4aa12cac468d9a512d (DEFAULT_TABLE table=default.Table_d45e81dae12b4aa1a924643a7e38a177 [id=ae7663c7da4444f1a6ef328ba7bd3494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.096993 757 tablet_service.cc:1511] Processing CreateTablet for tablet 61132c1c9cd24b7d923f1d65ad04c340 (DEFAULT_TABLE table=default.Table_63633f90e6cf41e680de39872cf046f0 [id=e8db7417fd294af4b160a434625e9fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.099025 751 tablet_service.cc:1511] Processing CreateTablet for tablet 8b7e2d8c25b8464b94ca386566abc2cc (DEFAULT_TABLE table=default.Table_cd11291643eb41f4bb804b58effb7904 [id=a12694adb1ba4cfabe42db00e13b002b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.100872 759 tablet_service.cc:1511] Processing CreateTablet for tablet be6dc34b00414a0d94b01f579994eb4c (DEFAULT_TABLE table=default.Table_7a338ffcf4ad4ca8a9b87644da4aec3a [id=6c63e96ce8304f33b1d44e6689561337]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.102154 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d19f51d7b61e47dea882c1fd07d9a122" } modify_external_catalogs: true
I20260616 19:51:58.102391 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d19f51d7b61e47dea882c1fd07d9a122" } modify_external_catalogs: true
I20260616 19:51:58.103065 748 tablet_service.cc:1511] Processing CreateTablet for tablet 352ca272888f4dd2ab1a8127bb8c2b6e (DEFAULT_TABLE table=default.Table_3e975395a7f54cc6bda4ad65f522a3c2 [id=55ebc40e7e83434fadff7113c194e90d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.104665 747 tablet_service.cc:1511] Processing CreateTablet for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 (DEFAULT_TABLE table=default.Table_f325b72bd9214978b04a89c26e52749d [id=e5b4b3a687134ad3ad6c299441012753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.106899 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ebec5e10f80244469fca70fe48c270e8" } modify_external_catalogs: true
I20260616 19:51:58.107110 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ebec5e10f80244469fca70fe48c270e8" } modify_external_catalogs: true
I20260616 19:51:58.107791 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3fc9d9c9f0844372a2c28932bf508e6d" } modify_external_catalogs: true
I20260616 19:51:58.108018 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3fc9d9c9f0844372a2c28932bf508e6d" } modify_external_catalogs: true
I20260616 19:51:58.114241 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_63633f90e6cf41e680de39872cf046f0" } new_table_name: "default.Table_00198787acf34996be2d5ee946f8b6ae" modify_external_catalogs: true
I20260616 19:51:58.114591 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f1ca20a6b9e04c2cb89432166b05988d" } modify_external_catalogs: true
I20260616 19:51:58.114774 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f1ca20a6b9e04c2cb89432166b05988d" } modify_external_catalogs: true
I20260616 19:51:58.115649 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_156e92a12c2d49dda4e54f4f3681abb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:58.116344 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_156e92a12c2d49dda4e54f4f3681abb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:58.117249 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9a33444036b544e8a6d5d5c743ebc5a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:58.117785 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a33444036b544e8a6d5d5c743ebc5a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:58.118172 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 79efb1de93bc4c1e81f4b2e15f621417 (table default.Table_bd62e9b749144fb28a1f58d92574d60a [id=3624f762ccce461390df6f711254aa05]) successfully deleted
I20260616 19:51:58.119161 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_32f046307a634164a6087e004a8a9494"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:58.119701 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32f046307a634164a6087e004a8a9494 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:58.123669 901 tablet_service.cc:1511] Processing CreateTablet for tablet e85e2861c41f402d88cafe64a6871429 (DEFAULT_TABLE table=default.Table_550c0ce5672e4d06a8224cafdc7d1479 [id=02a85fe82ed24f6b949c0ded2d9a7d5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.125639 899 tablet_service.cc:1511] Processing CreateTablet for tablet 61189a715da140a6833801681bbd5ef4 (DEFAULT_TABLE table=default.Table_425ca87bdf224de58078e9b95a26897e [id=45b3473eea3f4c6cba1561fee495371a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.126844 894 tablet_service.cc:1511] Processing CreateTablet for tablet 4fc0c02ef58d4e429855e5bbaa4752ad (DEFAULT_TABLE table=default.Table_98561738ee7d4ad8bf14170c99d01b96 [id=601faf6d488e40c584a3537834653ae9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.128135 902 tablet_service.cc:1511] Processing CreateTablet for tablet e03e6a2614564eeeb8ec382b16f0ece1 (DEFAULT_TABLE table=default.Table_7b40c6fbe572449e9bf54bdd4a500c41 [id=911a55a5f54547a88ed431bb85f18351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.129390 898 tablet_service.cc:1511] Processing CreateTablet for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b (DEFAULT_TABLE table=default.Table_5376eb58bd584cce9ea6b9260d89a57c [id=33517e3e567c4b59be27cc606c6c905c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.130399 891 tablet_service.cc:1511] Processing CreateTablet for tablet dd52351082274a4aa12cac468d9a512d (DEFAULT_TABLE table=default.Table_d45e81dae12b4aa1a924643a7e38a177 [id=ae7663c7da4444f1a6ef328ba7bd3494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.131548 893 tablet_service.cc:1511] Processing CreateTablet for tablet 61132c1c9cd24b7d923f1d65ad04c340 (DEFAULT_TABLE table=default.Table_63633f90e6cf41e680de39872cf046f0 [id=e8db7417fd294af4b160a434625e9fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.134406 890 tablet_service.cc:1511] Processing CreateTablet for tablet 8b7e2d8c25b8464b94ca386566abc2cc (DEFAULT_TABLE table=default.Table_cd11291643eb41f4bb804b58effb7904 [id=a12694adb1ba4cfabe42db00e13b002b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.134734 889 tablet_service.cc:1511] Processing CreateTablet for tablet be6dc34b00414a0d94b01f579994eb4c (DEFAULT_TABLE table=default.Table_7a338ffcf4ad4ca8a9b87644da4aec3a [id=6c63e96ce8304f33b1d44e6689561337]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.136489 1508 raft_consensus.cc:493] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:58.136723 1508 raft_consensus.cc:515] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:58.137620 1508 leader_election.cc:290] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:58.137789 1508 raft_consensus.cc:493] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:58.137971 1508 raft_consensus.cc:515] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.138609 1508 leader_election.cc:290] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:58.138908 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335f7411fda84fada762345010a4339c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.139277 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1203a4e952a42369d5c03ff4a4c59ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.142373 1612 tablet.cc:1724] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:51:58.142433 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 29df38f273494a079bdc76a915d43dab (DEFAULT_TABLE table=default.Table_bfda4071639c49399f2f5bf499be37e9 [id=1449ff28bd8546908359606f7272846f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.144062 1613 tablet.cc:1724] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:51:58.150869 1567 raft_consensus.cc:493] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:58.151192 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bc7409e31043bd9f47d3628278a2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.151823 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf (DEFAULT_TABLE table=default.Table_ab8c15658e304438854ef13e1ce2274b [id=b7d5c502d76f428683cb0830f0819011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.155767 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272838af35d840faa7b11217456533c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.164585 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 61189a715da140a6833801681bbd5ef4 (DEFAULT_TABLE table=default.Table_425ca87bdf224de58078e9b95a26897e [id=45b3473eea3f4c6cba1561fee495371a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.151051 1567 raft_consensus.cc:515] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.168071 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 4fc0c02ef58d4e429855e5bbaa4752ad (DEFAULT_TABLE table=default.Table_98561738ee7d4ad8bf14170c99d01b96 [id=601faf6d488e40c584a3537834653ae9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.171496 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.171941 1035 tablet_service.cc:1511] Processing CreateTablet for tablet e85e2861c41f402d88cafe64a6871429 (DEFAULT_TABLE table=default.Table_550c0ce5672e4d06a8224cafdc7d1479 [id=02a85fe82ed24f6b949c0ded2d9a7d5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.172642 1567 leader_election.cc:290] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:58.173024 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61189a715da140a6833801681bbd5ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.175042 1027 tablet_service.cc:1511] Processing CreateTablet for tablet e03e6a2614564eeeb8ec382b16f0ece1 (DEFAULT_TABLE table=default.Table_7b40c6fbe572449e9bf54bdd4a500c41 [id=911a55a5f54547a88ed431bb85f18351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.175340 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b (DEFAULT_TABLE table=default.Table_5376eb58bd584cce9ea6b9260d89a57c [id=33517e3e567c4b59be27cc606c6c905c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.178097 1198 tablet_bootstrap.cc:492] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:58.182447 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d9c664f0386549d6867c407526ee45a0
I20260616 19:51:58.182749 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2e316e44693d473dad901eeb95299988
I20260616 19:51:58.182997 455 catalog_manager.cc:6784] ReplaceTablet: tablet d9c664f0386549d6867c407526ee45a0 deleted and replaced by tablet 3c90eb04585c4fa992435d11015ffec7
I20260616 19:51:58.183226 457 catalog_manager.cc:6784] ReplaceTablet: tablet 2e316e44693d473dad901eeb95299988 deleted and replaced by tablet 93c940bd14a040ddba5ea058e732bf0c
I20260616 19:51:58.183424 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_91f98e62a1f54c249e7932f0f5f259eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:58.183581 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_29a007aa6e0a4f58a0c38a06900abdd4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:58.183974 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91f98e62a1f54c249e7932f0f5f259eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:58.184118 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29a007aa6e0a4f58a0c38a06900abdd4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:58.185549 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet af5e277102b8480db44e5ffe88267808
I20260616 19:51:58.186151 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3b8f449c385948bcb34abccbf9add4a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:58.152426 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd52351082274a4aa12cac468d9a512d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:58.186596 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b8f449c385948bcb34abccbf9add4a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:58.186766 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61132c1c9cd24b7d923f1d65ad04c340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.187954 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 776841d895d6431fbee76b7c4e28d973
I20260616 19:51:58.188588 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2cdc89bc850c41539c75340c7bf74a30" } new_table_name: "default.Table_630c32eab3fb4372a3a7de16f0f7916c" modify_external_catalogs: true
I20260616 19:51:58.188777 1024 tablet_service.cc:1511] Processing CreateTablet for tablet dd52351082274a4aa12cac468d9a512d (DEFAULT_TABLE table=default.Table_d45e81dae12b4aa1a924643a7e38a177 [id=ae7663c7da4444f1a6ef328ba7bd3494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.190063 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c48314f8e45d4b198306f0ae6e40def7
I20260616 19:51:58.190785 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1d16dde2c5a74de4a602f6be2aa95a23" } modify_external_catalogs: true
I20260616 19:51:58.190939 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1d16dde2c5a74de4a602f6be2aa95a23" } modify_external_catalogs: true
I20260616 19:51:58.193852 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85e2861c41f402d88cafe64a6871429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.195362 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.197175 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352ca272888f4dd2ab1a8127bb8c2b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.199322 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.200647 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7e2d8c25b8464b94ca386566abc2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.203792 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03e6a2614564eeeb8ec382b16f0ece1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.204245 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 776841d895d6431fbee76b7c4e28d973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:58.204305 750 tablet_service.cc:1558] Processing DeleteTablet for tablet c48314f8e45d4b198306f0ae6e40def7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:58.204545 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc0c02ef58d4e429855e5bbaa4752ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.205035 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61189a715da140a6833801681bbd5ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.205215 750 tablet_service.cc:1511] Processing CreateTablet for tablet 8c19c2e43a944893b86982bee1eb2f30 (DEFAULT_TABLE table=default.Table_7bcf075ada124095b23b2fb0b84099ca [id=12dff8f6fa4d45d3999ba67bf5584c29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.205453 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6dc34b00414a0d94b01f579994eb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.143124 888 tablet_service.cc:1511] Processing CreateTablet for tablet 352ca272888f4dd2ab1a8127bb8c2b6e (DEFAULT_TABLE table=default.Table_3e975395a7f54cc6bda4ad65f522a3c2 [id=55ebc40e7e83434fadff7113c194e90d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.144906 895 tablet_service.cc:1511] Processing CreateTablet for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 (DEFAULT_TABLE table=default.Table_f325b72bd9214978b04a89c26e52749d [id=e5b4b3a687134ad3ad6c299441012753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.166677 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7e2d8c25b8464b94ca386566abc2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.206714 1192 tablet_bootstrap.cc:492] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:58.207158 1192 ts_tablet_manager.cc:1403] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.221s user 0.001s sys 0.006s
I20260616 19:51:58.208320 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.208214 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e316e44693d473dad901eeb95299988 with delete_type TABLET_DATA_DELETED (replaced by tablet 93c940bd14a040ddba5ea058e732bf0c) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:58.209187 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352ca272888f4dd2ab1a8127bb8c2b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.211447 762 tablet_service.cc:1558] Processing DeleteTablet for tablet af5e277102b8480db44e5ffe88267808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:58.216838 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c19c2e43a944893b86982bee1eb2f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.221269 749 tablet_service.cc:1558] Processing DeleteTablet for tablet d9c664f0386549d6867c407526ee45a0 with delete_type TABLET_DATA_DELETED (replaced by tablet 3c90eb04585c4fa992435d11015ffec7) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:58.222831 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03e6a2614564eeeb8ec382b16f0ece1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.226958 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6dc34b00414a0d94b01f579994eb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.237514 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61132c1c9cd24b7d923f1d65ad04c340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.240775 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61189a715da140a6833801681bbd5ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.249919 749 tablet_service.cc:1511] Processing CreateTablet for tablet fab8282287434bf8b7e37f008a1b0166 (DEFAULT_TABLE table=default.Table_ee70960f9236404aad2ea35b57c6cde2 [id=aa090475f13b49ba964ec317aff450c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.250954 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab8282287434bf8b7e37f008a1b0166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.255146 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc0c02ef58d4e429855e5bbaa4752ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.259177 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85e2861c41f402d88cafe64a6871429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.259696 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd52351082274a4aa12cac468d9a512d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.261119 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.259928 1504 mvcc.cc:204] Tried to move back new op lower bound from 7297595456480854016 to 7297595435339984896. Current Snapshot: MvccSnapshot[applied={T|T < 7297595456480854016 or (T in {7297595456480854016})}]
I20260616 19:51:58.266968 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.267251 1198 ts_tablet_manager.cc:1403] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.723s user 0.074s sys 0.148s
I20260616 19:51:58.273540 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 61132c1c9cd24b7d923f1d65ad04c340 (DEFAULT_TABLE table=default.Table_63633f90e6cf41e680de39872cf046f0 [id=e8db7417fd294af4b160a434625e9fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.271554 754 tablet_service.cc:1511] Processing CreateTablet for tablet 75c08452aeec471f8480a489620cca28 (DEFAULT_TABLE table=default.Table_45887a2d367d4294bce394b38dbe33ac [id=10ba0af63bcc4e46a6053933ffd539db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.275373 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 8b7e2d8c25b8464b94ca386566abc2cc (DEFAULT_TABLE table=default.Table_cd11291643eb41f4bb804b58effb7904 [id=a12694adb1ba4cfabe42db00e13b002b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.276125 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 23f280b9ea1147799635f8a6199f17c0
I20260616 19:51:58.276794 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_452005efb2c6487fad171dc5d5197ce5" } new_table_name: "default.Table_5047c84664124989b931ee92afc5b463" modify_external_catalogs: true
I20260616 19:51:58.277040 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_838a16aef68b412b852a100461184990" } new_table_name: "default.Table_6084b95509cf42a180b1753a884ecf4e" modify_external_catalogs: true
W20260616 19:51:58.278409 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61132c1c9cd24b7d923f1d65ad04c340 consensus state has no leader
I20260616 19:51:58.278988 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_04e2e7eefe2d42298ac7914ba1fba70c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:58.279211 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_96a5b2a9fdda4f5b82a47ae1dc7b190c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:58.279521 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04e2e7eefe2d42298ac7914ba1fba70c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:58.279659 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96a5b2a9fdda4f5b82a47ae1dc7b190c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:58.282595 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 23f280b9ea1147799635f8a6199f17c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:58.288125 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_de10497bdced446781f27d9eb54717be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:58.288584 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_fb391d8a718646b0b47d996c2f98f46f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:58.288700 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de10497bdced446781f27d9eb54717be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:58.289042 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb391d8a718646b0b47d996c2f98f46f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:58.290081 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f13d175adfe540b39fd55004a11c9aad consensus state has no leader
I20260616 19:51:58.290262 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_08d577b7b19b4304839ef1e907e17551" } new_table_name: "default.Table_10d86a39b61c40c496871f63597d86ed" modify_external_catalogs: true
I20260616 19:51:58.290592 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 610d6197e35e447ea25cdba2cc454b8d
I20260616 19:51:58.293042 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03e6a2614564eeeb8ec382b16f0ece1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.294497 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61132c1c9cd24b7d923f1d65ad04c340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.294430 1605 tablet.cc:1724] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:51:58.295099 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61873c8aa094d7f899a61307a36f895" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:58.295341 922 raft_consensus.cc:2468] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:58.203526 1193 ts_tablet_manager.cc:1929] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:58.295646 1579 raft_consensus.cc:493] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:58.298686 1579 raft_consensus.cc:515] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:58.293902 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 610d6197e35e447ea25cdba2cc454b8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:58.299377 1579 leader_election.cc:290] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:58.292222 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c08452aeec471f8480a489620cca28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.300745 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7e2d8c25b8464b94ca386566abc2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.297138 1193 log.cc:1199] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/d61873c8aa094d7f899a61307a36f895
I20260616 19:51:58.306924 1193 ts_tablet_manager.cc:1950] T d61873c8aa094d7f899a61307a36f895 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:58.318500 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 352ca272888f4dd2ab1a8127bb8c2b6e (DEFAULT_TABLE table=default.Table_3e975395a7f54cc6bda4ad65f522a3c2 [id=55ebc40e7e83434fadff7113c194e90d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.320551 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc0c02ef58d4e429855e5bbaa4752ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.320856 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85e2861c41f402d88cafe64a6871429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.321085 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29df38f273494a079bdc76a915d43dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.322381 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.322630 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd52351082274a4aa12cac468d9a512d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.323390 761 tablet_service.cc:1511] Processing CreateTablet for tablet 7a2e5bc2c47746e88e95634fb073273e (DEFAULT_TABLE table=default.Table_6c1f3c5fbc404e8bbdc316236d207917 [id=5ca7057e8a4642dbaa33fb2260f10f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.323824 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 (DEFAULT_TABLE table=default.Table_f325b72bd9214978b04a89c26e52749d [id=e5b4b3a687134ad3ad6c299441012753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.324245 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:58.326668 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2141b6c7013648a4b716642ccb4eccd6 consensus state has no leader
W20260616 19:51:58.327591 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4be902fe29bb46a4bf71ee6384e6722a consensus state has no leader
I20260616 19:51:58.328794 747 tablet_service.cc:1511] Processing CreateTablet for tablet 1a95eafa064b4b95b5281915ea5bd9f7 (DEFAULT_TABLE table=default.Table_c4f4a13f09cb47da8cb7a526f431e3c5 [id=973ba262057d42418fc1e3b6e2145eb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.330874 759 tablet_service.cc:1511] Processing CreateTablet for tablet e3c4e584fad94633ae49332872de0fc3 (DEFAULT_TABLE table=default.Table_cef1d0acd28d4153a1b73c10bc977ebd [id=a74530aa94504004bbea04f61cd3377a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.331993 748 tablet_service.cc:1511] Processing CreateTablet for tablet 23f280b9ea1147799635f8a6199f17c0 (DEFAULT_TABLE table=default.Table_f1ca20a6b9e04c2cb89432166b05988d [id=b19d846b7871403993c07b3a5be54ada]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.309129 1021 tablet_service.cc:1511] Processing CreateTablet for tablet be6dc34b00414a0d94b01f579994eb4c (DEFAULT_TABLE table=default.Table_7a338ffcf4ad4ca8a9b87644da4aec3a [id=6c63e96ce8304f33b1d44e6689561337]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.333002 764 tablet_service.cc:1511] Processing CreateTablet for tablet 610d6197e35e447ea25cdba2cc454b8d (DEFAULT_TABLE table=default.Table_1d16dde2c5a74de4a602f6be2aa95a23 [id=4f8f3f33093b4dc2b3a073756ad29f56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.334254 752 tablet_service.cc:1511] Processing CreateTablet for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c (DEFAULT_TABLE table=default.Table_ade11253e88d413db148bcee7283260d [id=79346acffcf0424489622058f891d392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.339565 1198 raft_consensus.cc:359] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.339916 993 leader_election.cc:304] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:58.340515 750 tablet_service.cc:1511] Processing CreateTablet for tablet 4faa62f03c2a4588a776883dc54d0426 (DEFAULT_TABLE table=default.Table_7b912aaf74bb4b23a2cd06c0e5a64873 [id=9d94425680c44e4f99c13f70357d7c43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.343370 762 tablet_service.cc:1511] Processing CreateTablet for tablet d686190fb6a34ab18cc4799197765f1b (DEFAULT_TABLE table=default.Table_52d50dabb1b2498f88d5a07f62f7d058 [id=e6bef21f2f3644859d5d44ef5d5b5b3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.346797 751 tablet_service.cc:1511] Processing CreateTablet for tablet 54eb61046c954a36a036b24e9e16b5c4 (DEFAULT_TABLE table=default.Table_a04ece9647b14e4d9cb0d5f5557cc8b4 [id=e89b92f225554748812dc4f9a09e0dc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.348308 1192 raft_consensus.cc:359] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.348563 1192 raft_consensus.cc:385] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:58.348680 1192 raft_consensus.cc:740] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:58.348904 1192 consensus_queue.cc:260] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:58.349484 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf136fa86c264f69a1703596cfd0e77a consensus state has no leader
I20260616 19:51:58.349504 1192 ts_tablet_manager.cc:1434] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.142s user 0.002s sys 0.000s
I20260616 19:51:58.349793 893 tablet_service.cc:1558] Processing DeleteTablet for tablet d9c664f0386549d6867c407526ee45a0 with delete_type TABLET_DATA_DELETED (replaced by tablet 3c90eb04585c4fa992435d11015ffec7) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:58.352214 757 tablet_service.cc:1511] Processing CreateTablet for tablet 1142b61e40e6499e8244d71f2ad39b1e (DEFAULT_TABLE table=default.Table_f4fa0f49dd9849f18e8d221a29eb24c5 [id=2dcde1c167ce4d8c8f7aab84e86f47d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.355204 753 tablet_service.cc:1511] Processing CreateTablet for tablet daf86e5d5f2341c78705f78c02695c17 (DEFAULT_TABLE table=default.Table_64de4a339ae243949520501b01d8c41a [id=9982394d897b411c84d41343bb031bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.357272 760 tablet_service.cc:1511] Processing CreateTablet for tablet d1e3778611a24397a1a776be2cc76284 (DEFAULT_TABLE table=default.Table_aee030c17ec146b0b77a8cfc6e4af008 [id=d1dbf5b9407644a48893bad8d11b16e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.357991 1198 raft_consensus.cc:385] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260616 19:51:58.361961 858 consensus_peers.cc:597] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7161894b9f9047fda9ed3f2180518a59. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:51:58.362183 895 tablet_service.cc:1558] Processing DeleteTablet for tablet af5e277102b8480db44e5ffe88267808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:58.362497 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 776841d895d6431fbee76b7c4e28d973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:58.367008 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf54b260fc941599cffb12581e8116a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:58.367203 922 raft_consensus.cc:2468] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:58.367976 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 4bd6fa49eff4400ca40c722e18cea951 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:58.368865 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352ca272888f4dd2ab1a8127bb8c2b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.369694 892 tablet_service.cc:1511] Processing CreateTablet for tablet fab8282287434bf8b7e37f008a1b0166 (DEFAULT_TABLE table=default.Table_ee70960f9236404aad2ea35b57c6cde2 [id=aa090475f13b49ba964ec317aff450c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.372493 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51a6fb4c49e461583a5aba1813b2a3e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:58.373095 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet d9c664f0386549d6867c407526ee45a0 with delete_type TABLET_DATA_DELETED (replaced by tablet 3c90eb04585c4fa992435d11015ffec7) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:58.373320 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e316e44693d473dad901eeb95299988 with delete_type TABLET_DATA_DELETED (replaced by tablet 93c940bd14a040ddba5ea058e732bf0c) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:58.373478 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet af5e277102b8480db44e5ffe88267808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:58.373610 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 776841d895d6431fbee76b7c4e28d973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:58.373777 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet c48314f8e45d4b198306f0ae6e40def7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:58.374310 1198 raft_consensus.cc:740] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:58.374552 1198 consensus_queue.cc:260] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.377480 895 tablet_service.cc:1511] Processing CreateTablet for tablet 8c19c2e43a944893b86982bee1eb2f30 (DEFAULT_TABLE table=default.Table_7bcf075ada124095b23b2fb0b84099ca [id=12dff8f6fa4d45d3999ba67bf5584c29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.377832 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 23f280b9ea1147799635f8a6199f17c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:58.377902 1608 raft_consensus.cc:2804] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:58.378221 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6dc34b00414a0d94b01f579994eb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.356196 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362e7ff9bea3459ca018d1a7febb2ce4" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:58.380636 1192 tablet_bootstrap.cc:492] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:58.381474 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab8282287434bf8b7e37f008a1b0166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.382616 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 8c19c2e43a944893b86982bee1eb2f30 (DEFAULT_TABLE table=default.Table_7bcf075ada124095b23b2fb0b84099ca [id=12dff8f6fa4d45d3999ba67bf5584c29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.384292 1608 raft_consensus.cc:493] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:58.388234 900 tablet_service.cc:1511] Processing CreateTablet for tablet 7a2e5bc2c47746e88e95634fb073273e (DEFAULT_TABLE table=default.Table_6c1f3c5fbc404e8bbdc316236d207917 [id=5ca7057e8a4642dbaa33fb2260f10f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.388684 887 tablet_service.cc:1511] Processing CreateTablet for tablet e3c4e584fad94633ae49332872de0fc3 (DEFAULT_TABLE table=default.Table_cef1d0acd28d4153a1b73c10bc977ebd [id=a74530aa94504004bbea04f61cd3377a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.388846 903 tablet_service.cc:1511] Processing CreateTablet for tablet 75c08452aeec471f8480a489620cca28 (DEFAULT_TABLE table=default.Table_45887a2d367d4294bce394b38dbe33ac [id=10ba0af63bcc4e46a6053933ffd539db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.392295 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c19c2e43a944893b86982bee1eb2f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.392231 993 leader_election.cc:304] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:58.392776 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 610d6197e35e447ea25cdba2cc454b8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:58.393657 923 raft_consensus.cc:2468] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:58.395629 1608 raft_consensus.cc:3060] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:58.396598 1609 raft_consensus.cc:2804] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:58.396694 1609 raft_consensus.cc:493] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:58.396797 1609 raft_consensus.cc:3060] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:58.396983 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7cdef69863694f0ba023c214e42394e8" } modify_external_catalogs: true
I20260616 19:51:58.397168 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7cdef69863694f0ba023c214e42394e8" } modify_external_catalogs: true
I20260616 19:51:58.397675 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7ad7ef9c768d41edaa47c8cd68466731" } modify_external_catalogs: true
I20260616 19:51:58.397855 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7ad7ef9c768d41edaa47c8cd68466731" } modify_external_catalogs: true
I20260616 19:51:58.398007 1036 tablet_service.cc:1511] Processing CreateTablet for tablet fab8282287434bf8b7e37f008a1b0166 (DEFAULT_TABLE table=default.Table_ee70960f9236404aad2ea35b57c6cde2 [id=aa090475f13b49ba964ec317aff450c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.398388 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cef1d0acd28d4153a1b73c10bc977ebd" } modify_external_catalogs: true
I20260616 19:51:58.398592 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cef1d0acd28d4153a1b73c10bc977ebd" } modify_external_catalogs: true
I20260616 19:51:58.400297 890 tablet_service.cc:1511] Processing CreateTablet for tablet 1a95eafa064b4b95b5281915ea5bd9f7 (DEFAULT_TABLE table=default.Table_c4f4a13f09cb47da8cb7a526f431e3c5 [id=973ba262057d42418fc1e3b6e2145eb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.401350 1579 raft_consensus.cc:493] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:58.401525 1579 raft_consensus.cc:515] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.402144 1579 leader_election.cc:290] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:58.403906 888 tablet_service.cc:1558] Processing DeleteTablet for tablet c48314f8e45d4b198306f0ae6e40def7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:58.404253 886 tablet_service.cc:1511] Processing CreateTablet for tablet 23f280b9ea1147799635f8a6199f17c0 (DEFAULT_TABLE table=default.Table_f1ca20a6b9e04c2cb89432166b05988d [id=b19d846b7871403993c07b3a5be54ada]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.404925 1198 ts_tablet_manager.cc:1434] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.127s user 0.002s sys 0.000s
W20260616 19:51:58.410162 718 leader_election.cc:343] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: 97afcb75fdc2440d913ad421534a4ef3
I20260616 19:51:58.410760 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab8282287434bf8b7e37f008a1b0166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.410933 1198 tablet_bootstrap.cc:492] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:58.410727 993 leader_election.cc:304] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:58.411092 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 75c08452aeec471f8480a489620cca28 (DEFAULT_TABLE table=default.Table_45887a2d367d4294bce394b38dbe33ac [id=10ba0af63bcc4e46a6053933ffd539db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.413367 1383 raft_consensus.cc:2804] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260616 19:51:58.414927 858 leader_election.cc:343] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:58.415295 1383 raft_consensus.cc:493] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:58.415376 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c08452aeec471f8480a489620cca28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.416137 888 tablet_service.cc:1511] Processing CreateTablet for tablet 610d6197e35e447ea25cdba2cc454b8d (DEFAULT_TABLE table=default.Table_1d16dde2c5a74de4a602f6be2aa95a23 [id=4f8f3f33093b4dc2b3a073756ad29f56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.417785 1383 raft_consensus.cc:3060] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:58.421619 858 leader_election.cc:304] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:58.422175 1458 raft_consensus.cc:2749] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:58.424587 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c19c2e43a944893b86982bee1eb2f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.429037 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f280b9ea1147799635f8a6199f17c0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:58.432987 719 leader_election.cc:343] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 31d22240d294454cbeb2ca5b07d45273
W20260616 19:51:58.433224 719 leader_election.cc:343] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 97afcb75fdc2440d913ad421534a4ef3
I20260616 19:51:58.433351 719 leader_election.cc:304] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:58.433637 1579 raft_consensus.cc:2749] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:51:58.441967 718 leader_election.cc:343] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: 31d22240d294454cbeb2ca5b07d45273
I20260616 19:51:58.442121 718 leader_election.cc:304] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:58.442811 1579 raft_consensus.cc:2749] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:58.444540 746 tablet_service.cc:1511] Processing CreateTablet for tablet 9800df09eecb4a299a6facf8b85a93e4 (DEFAULT_TABLE table=default.Table_de10497bdced446781f27d9eb54717be [id=b9e3ddc46058486aaef9d221832c636d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.444766 763 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc (DEFAULT_TABLE table=default.Table_fb391d8a718646b0b47d996c2f98f46f [id=548db2885e3f4ad19e6c310f67ad116e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.445186 765 tablet_service.cc:1511] Processing CreateTablet for tablet 0a406124a8d34e578ba94fab2a873a55 (DEFAULT_TABLE table=default.Table_9a33444036b544e8a6d5d5c743ebc5a7 [id=f53951a5b5094a1a8ef37cdba97f251d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.445597 756 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9befb557d84f3bb7781664cbf2f28f (DEFAULT_TABLE table=default.Table_156e92a12c2d49dda4e54f4f3681abb8 [id=fea2a89e41c24f248c1e291f2ad3093b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.443346 1608 raft_consensus.cc:515] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:58.448432 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c08452aeec471f8480a489620cca28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.449230 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 7a2e5bc2c47746e88e95634fb073273e (DEFAULT_TABLE table=default.Table_6c1f3c5fbc404e8bbdc316236d207917 [id=5ca7057e8a4642dbaa33fb2260f10f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.452996 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 23f280b9ea1147799635f8a6199f17c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:58.454849 1608 leader_election.cc:290] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:58.455101 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 43b4c3bd370749b18fb86f7a0aae2c50
I20260616 19:51:58.455525 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c7f724dc23024a7297cfb8689f199600
I20260616 19:51:58.456878 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet e3c4e584fad94633ae49332872de0fc3
I20260616 19:51:58.456903 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 43b4c3bd370749b18fb86f7a0aae2c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:58.457137 758 tablet_service.cc:1558] Processing DeleteTablet for tablet c7f724dc23024a7297cfb8689f199600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:58.457765 758 tablet_service.cc:1511] Processing CreateTablet for tablet 5462af2002f9406b85ee20660e001a95 (DEFAULT_TABLE table=default.Table_d9b6ea5cbcd347058c16f26573990825 [id=d2574a03769945e99b662ed1015b2703]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.458783 755 tablet_service.cc:1511] Processing CreateTablet for tablet 26503d1293be438dae39fa1e1ea1885b (DEFAULT_TABLE table=default.Table_c3ed767db6964beebf754607830e97d2 [id=467b42cd85544c589d2cf3f9eaf21754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.461993 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 610d6197e35e447ea25cdba2cc454b8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:58.462415 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 1a95eafa064b4b95b5281915ea5bd9f7 (DEFAULT_TABLE table=default.Table_c4f4a13f09cb47da8cb7a526f431e3c5 [id=973ba262057d42418fc1e3b6e2145eb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.470335 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a2e5bc2c47746e88e95634fb073273e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.472594 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61873c8aa094d7f899a61307a36f895" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:58.472805 922 raft_consensus.cc:3060] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:58.474833 1383 raft_consensus.cc:515] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.476496 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c4e584fad94633ae49332872de0fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.477357 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362e7ff9bea3459ca018d1a7febb2ce4" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:58.480134 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bfaf83b26abe4e78813fd297b564ba57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:58.480695 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfaf83b26abe4e78813fd297b564ba57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:58.481540 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ee70960f9236404aad2ea35b57c6cde2" } modify_external_catalogs: true
I20260616 19:51:58.481698 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ee70960f9236404aad2ea35b57c6cde2" } modify_external_catalogs: true
I20260616 19:51:58.483393 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_46f9f0dfd80649ce93583c93a95c2e02" } new_table_name: "default.Table_dc19f0ab5b6c47ea854f9d8bfdf6f905" modify_external_catalogs: true
I20260616 19:51:58.485890 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_dd8ccdd722484ba5b6d855c64e825279"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:58.489915 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_61d46cd30fe14d8d9e6e45f4a242e6fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:58.491035 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a2e5bc2c47746e88e95634fb073273e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.491490 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c82451507e00496a8d501a63dddeeec8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:58.493438 924 raft_consensus.cc:3060] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:58.494165 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d45e81dae12b4aa1a924643a7e38a177" } new_table_name: "default.Table_cbfdcfcea0e346d18b7a18e411c66dc1" modify_external_catalogs: true
I20260616 19:51:58.500883 1383 leader_election.cc:290] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:58.500916 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_333a3cd8e7d247e7b113f715a2f14955"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:58.500955 1033 tablet_service.cc:1511] Processing CreateTablet for tablet e3c4e584fad94633ae49332872de0fc3 (DEFAULT_TABLE table=default.Table_cef1d0acd28d4153a1b73c10bc977ebd [id=a74530aa94504004bbea04f61cd3377a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.501647 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a95eafa064b4b95b5281915ea5bd9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.502275 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610d6197e35e447ea25cdba2cc454b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.502725 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a95eafa064b4b95b5281915ea5bd9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.506430 924 raft_consensus.cc:2468] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:58.506660 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c4e584fad94633ae49332872de0fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.512634 1026 tablet_service.cc:1511] Processing CreateTablet for tablet d686190fb6a34ab18cc4799197765f1b (DEFAULT_TABLE table=default.Table_52d50dabb1b2498f88d5a07f62f7d058 [id=e6bef21f2f3644859d5d44ef5d5b5b3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.512742 1192 tablet_bootstrap.cc:654] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:58.513331 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 23f280b9ea1147799635f8a6199f17c0 (DEFAULT_TABLE table=default.Table_f1ca20a6b9e04c2cb89432166b05988d [id=b19d846b7871403993c07b3a5be54ada]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.509999 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c (DEFAULT_TABLE table=default.Table_ade11253e88d413db148bcee7283260d [id=79346acffcf0424489622058f891d392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.517017 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 610d6197e35e447ea25cdba2cc454b8d (DEFAULT_TABLE table=default.Table_1d16dde2c5a74de4a602f6be2aa95a23 [id=4f8f3f33093b4dc2b3a073756ad29f56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.517647 1191 ts_tablet_manager.cc:1929] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:58.518689 922 raft_consensus.cc:2468] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:58.518548 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 4faa62f03c2a4588a776883dc54d0426 (DEFAULT_TABLE table=default.Table_7b912aaf74bb4b23a2cd06c0e5a64873 [id=9d94425680c44e4f99c13f70357d7c43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.537038 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 54eb61046c954a36a036b24e9e16b5c4 (DEFAULT_TABLE table=default.Table_a04ece9647b14e4d9cb0d5f5557cc8b4 [id=e89b92f225554748812dc4f9a09e0dc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.537393 1198 tablet_bootstrap.cc:654] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:58.537451 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d686190fb6a34ab18cc4799197765f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.539800 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610d6197e35e447ea25cdba2cc454b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.542239 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4faa62f03c2a4588a776883dc54d0426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.542696 993 leader_election.cc:304] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:58.542989 1383 raft_consensus.cc:2804] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:58.540534 1191 log.cc:1199] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/19832d0517524c0facf1f97486b1e58e
I20260616 19:51:58.543092 993 leader_election.cc:304] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:58.544373 1383 raft_consensus.cc:697] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:58.544697 1383 consensus_queue.cc:237] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.547375 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 1142b61e40e6499e8244d71f2ad39b1e (DEFAULT_TABLE table=default.Table_f4fa0f49dd9849f18e8d221a29eb24c5 [id=2dcde1c167ce4d8c8f7aab84e86f47d5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:58.550949 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61d46cd30fe14d8d9e6e45f4a242e6fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:58.552570 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a4a6f573af0d49d58db91ad41beb2ac1" } modify_external_catalogs: true
I20260616 19:51:58.552783 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a4a6f573af0d49d58db91ad41beb2ac1" } modify_external_catalogs: true
I20260616 19:51:58.553220 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_87572bccfe72485c994560d15596febe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:58.553785 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87572bccfe72485c994560d15596febe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:58.552429 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c82451507e00496a8d501a63dddeeec8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:58.555994 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd8ccdd722484ba5b6d855c64e825279 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:58.556975 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_333a3cd8e7d247e7b113f715a2f14955 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:58.556945 1038 tablet_service.cc:1511] Processing CreateTablet for tablet daf86e5d5f2341c78705f78c02695c17 (DEFAULT_TABLE table=default.Table_64de4a339ae243949520501b01d8c41a [id=9982394d897b411c84d41343bb031bf9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:58.557911 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fbe784716b3c4293bd4eddf57f6c9048 consensus state has no leader
W20260616 19:51:58.558125 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd52351082274a4aa12cac468d9a512d consensus state has no leader
I20260616 19:51:58.558300 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cd11291643eb41f4bb804b58effb7904" } new_table_name: "default.Table_9c19749d8e8a4eaeaa2294ca29ea85dc" modify_external_catalogs: true
I20260616 19:51:58.558425 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7454297805304a68987f421ea266723e" } new_table_name: "default.Table_4f13e0ca57ec46899092c426fb249611" modify_external_catalogs: true
I20260616 19:51:58.559377 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_86e549fb88f34f51a867554c129f5d7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:58.559870 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86e549fb88f34f51a867554c129f5d7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:58.560815 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fab8282287434bf8b7e37f008a1b0166
I20260616 19:51:58.561506 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c7617de287ff4770bb063b7ee633a61a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:58.561868 1579 raft_consensus.cc:493] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:51:58.561918 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7617de287ff4770bb063b7ee633a61a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:58.562040 1579 raft_consensus.cc:515] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.562804 1579 leader_election.cc:290] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:58.564935 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c90188c0181467ea3deee14fa5568b3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:58.565629 922 raft_consensus.cc:2468] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:51:58.566049 718 leader_election.cc:304] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:58.557376 1608 raft_consensus.cc:2804] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:58.566480 1579 raft_consensus.cc:2804] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:58.566586 1579 raft_consensus.cc:493] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:58.566656 1579 raft_consensus.cc:3060] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:58.567098 1608 raft_consensus.cc:697] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:58.567723 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.569391 1579 raft_consensus.cc:515] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.570328 1579 leader_election.cc:290] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:58.574681 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f280b9ea1147799635f8a6199f17c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.576066 1609 raft_consensus.cc:515] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.567358 1608 consensus_queue.cc:237] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:58.577286 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf54b260fc941599cffb12581e8116a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:58.577507 924 raft_consensus.cc:3060] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:58.579489 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 0a406124a8d34e578ba94fab2a873a55 (DEFAULT_TABLE table=default.Table_9a33444036b544e8a6d5d5c743ebc5a7 [id=f53951a5b5094a1a8ef37cdba97f251d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.579756 1191 ts_tablet_manager.cc:1950] T 19832d0517524c0facf1f97486b1e58e P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:58.580331 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf86e5d5f2341c78705f78c02695c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.580636 924 raft_consensus.cc:2468] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
W20260616 19:51:58.581979 719 leader_election.cc:343] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 5c90188c0181467ea3deee14fa5568b3
I20260616 19:51:58.583537 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c90188c0181467ea3deee14fa5568b3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:58.583814 922 raft_consensus.cc:3060] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:51:58.584272 719 leader_election.cc:343] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 5c90188c0181467ea3deee14fa5568b3
I20260616 19:51:58.587796 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9befb557d84f3bb7781664cbf2f28f (DEFAULT_TABLE table=default.Table_156e92a12c2d49dda4e54f4f3681abb8 [id=fea2a89e41c24f248c1e291f2ad3093b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.589568 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 5462af2002f9406b85ee20660e001a95 (DEFAULT_TABLE table=default.Table_d9b6ea5cbcd347058c16f26573990825 [id=d2574a03769945e99b662ed1015b2703]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.589884 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 339) took 1194 ms. Trace:
I20260616 19:51:58.591090 1040 tablet_service.cc:1511] Processing CreateTablet for tablet d1e3778611a24397a1a776be2cc76284 (DEFAULT_TABLE table=default.Table_aee030c17ec146b0b77a8cfc6e4af008 [id=d1dbf5b9407644a48893bad8d11b16e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.594733 1609 leader_election.cc:290] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:58.595376 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc (DEFAULT_TABLE table=default.Table_fb391d8a718646b0b47d996c2f98f46f [id=548db2885e3f4ad19e6c310f67ad116e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.596238 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 9800df09eecb4a299a6facf8b85a93e4 (DEFAULT_TABLE table=default.Table_de10497bdced446781f27d9eb54717be [id=b9e3ddc46058486aaef9d221832c636d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.600133 993 leader_election.cc:304] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:58.600399 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a406124a8d34e578ba94fab2a873a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.604555 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet c7f724dc23024a7297cfb8689f199600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:58.606513 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9800df09eecb4a299a6facf8b85a93e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.607581 1609 raft_consensus.cc:2804] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:58.609220 1191 rpcz_store.cc:276] 0616 19:51:57.385859 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.388048 (+ 2189us) service_pool.cc:224] Handling call
0616 19:51:57.633165 (+245117us) ts_tablet_manager.cc:1151] Deleting tablet 19832d0517524c0facf1f97486b1e58e
0616 19:51:57.633178 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:57.657398 (+ 24220us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x616000074254. stack: 00007f92671a0086 00007f926719fe40 00007f92661593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f92731d47e0 00007f9274520933 00007f92770e3ae7 00007f9277116bb4 00007f92770f75d0 00007f92770f735d 0000000000aa681c 00007f92671e5f6f 00007f92671e928b 00007f92671e9108
0616 19:51:58.381555 (+724157us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:58.502347 (+120792us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:58.580576 (+ 78229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54594432,"tablet-delete.queue_time_us":244865}
I20260616 19:51:58.615970 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet e3c4e584fad94633ae49332872de0fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:58.616492 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 43b4c3bd370749b18fb86f7a0aae2c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:58.617098 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54eb61046c954a36a036b24e9e16b5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.618535 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1142b61e40e6499e8244d71f2ad39b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.618971 1609 raft_consensus.cc:697] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:58.619216 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9befb557d84f3bb7781664cbf2f28f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.619307 1609 consensus_queue.cc:237] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.611851 1029 tablet_service.cc:1511] Processing CreateTablet for tablet da039dbc1089426dba1226940e37469e (DEFAULT_TABLE table=default.Table_96a5b2a9fdda4f5b82a47ae1dc7b190c [id=f223ad08623343aeb681a65b744d2476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.620246 1579 raft_consensus.cc:493] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:58.620538 1579 raft_consensus.cc:515] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.621632 1579 leader_election.cc:290] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:58.622622 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee6a9e6d57487bb7d9482f7798e6b6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:58.622833 924 raft_consensus.cc:2468] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:51:58.623235 718 leader_election.cc:304] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:58.623644 1579 raft_consensus.cc:2804] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:58.623792 1579 raft_consensus.cc:493] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:58.623932 1579 raft_consensus.cc:3060] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:58.626613 1579 raft_consensus.cc:515] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.627621 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee6a9e6d57487bb7d9482f7798e6b6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:58.627820 924 raft_consensus.cc:3060] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:58.634483 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5462af2002f9406b85ee20660e001a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.638087 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 26503d1293be438dae39fa1e1ea1885b (DEFAULT_TABLE table=default.Table_c3ed767db6964beebf754607830e97d2 [id=467b42cd85544c589d2cf3f9eaf21754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.638375 1191 tablet_replica.cc:333] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:58.639213 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e316e44693d473dad901eeb95299988 with delete_type TABLET_DATA_DELETED (replaced by tablet 93c940bd14a040ddba5ea058e732bf0c) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:58.639621 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e3778611a24397a1a776be2cc76284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.642676 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 19832d0517524c0facf1f97486b1e58e (table default.Table_b34131cb606f45af969cab4e285a435c [id=f26741a3387e47f2905c06b1d7eecb17]) successfully deleted
I20260616 19:51:58.644817 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf54b260fc941599cffb12581e8116a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:58.645051 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362e7ff9bea3459ca018d1a7febb2ce4" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:58.645205 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf54b260fc941599cffb12581e8116a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:58.645637 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362e7ff9bea3459ca018d1a7febb2ce4" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:51:58.646253 860 consensus_peers.cc:597] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7161894b9f9047fda9ed3f2180518a59. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:51:58.646809 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a95eafa064b4b95b5281915ea5bd9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.647033 922 raft_consensus.cc:2468] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:51:58.647405 718 leader_election.cc:304] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:58.653394 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e3778611a24397a1a776be2cc76284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.656244 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a2e5bc2c47746e88e95634fb073273e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.656446 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c4e584fad94633ae49332872de0fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.656733 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5462af2002f9406b85ee20660e001a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.658577 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f280b9ea1147799635f8a6199f17c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.659921 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4faa62f03c2a4588a776883dc54d0426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.659879 754 tablet_service.cc:1558] Processing DeleteTablet for tablet e3c4e584fad94633ae49332872de0fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:58.662194 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a406124a8d34e578ba94fab2a873a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.664353 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 79d686afeeed4729bd2069296aec82a1 (DEFAULT_TABLE table=default.Table_98dfc128f98d405bb94b36098e43025f [id=06387be97c9c486ea549edbe384d0ce7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.665710 747 tablet_service.cc:1511] Processing CreateTablet for tablet da039dbc1089426dba1226940e37469e (DEFAULT_TABLE table=default.Table_96a5b2a9fdda4f5b82a47ae1dc7b190c [id=f223ad08623343aeb681a65b744d2476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.668401 1036 tablet_service.cc:1511] Processing CreateTablet for tablet c3706f41b0e342a69f66c936173f2ae0 (DEFAULT_TABLE table=default.Table_32f046307a634164a6087e004a8a9494 [id=1e981f1a41514a5283fb6f650cab0c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.669209 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da039dbc1089426dba1226940e37469e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.669616 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26503d1293be438dae39fa1e1ea1885b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.670746 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d686afeeed4729bd2069296aec82a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.672431 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0a6191ad334400a319778fc4e559af (DEFAULT_TABLE table=default.Table_04e2e7eefe2d42298ac7914ba1fba70c [id=c5e9e67dad394bcbb7744662eda892d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.672601 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 613c869d4ac84ee0aa952718ba74917b (DEFAULT_TABLE table=default.Table_3b8f449c385948bcb34abccbf9add4a4 [id=fdee766904ce4ac58aaaa227b066c7d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.670555 1032 tablet_service.cc:1511] Processing CreateTablet for tablet f293d557a9aa4ca4885aa917fe1565e4 (DEFAULT_TABLE table=default.Table_29a007aa6e0a4f58a0c38a06900abdd4 [id=17d6f772e11d42c6a5acb4f6a0269a43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.676862 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d686190fb6a34ab18cc4799197765f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.681829 1458 raft_consensus.cc:493] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:58.681998 1458 raft_consensus.cc:515] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.682753 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3706f41b0e342a69f66c936173f2ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.682780 1458 leader_election.cc:290] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:51:58.679821 719 leader_election.cc:343] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: dfee6a9e6d57487bb7d9482f7798e6b6
I20260616 19:51:58.689153 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af9bdceae184f8dbb9e5db67a11ee63" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:51:58.690523 858 leader_election.cc:343] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:58.696133 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0a6191ad334400a319778fc4e559af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.697522 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet d61873c8aa094d7f899a61307a36f895 (table default.Table_6a6d8516df114593b27d86140407b724 [id=d104c5ac8acc4a6f9ed7cc87879d661b]) successfully deleted
I20260616 19:51:58.700344 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9befb557d84f3bb7781664cbf2f28f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.701789 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54eb61046c954a36a036b24e9e16b5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.706416 924 raft_consensus.cc:2468] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:51:58.710588 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 3c90eb04585c4fa992435d11015ffec7 (DEFAULT_TABLE table=default.Table_88815cb77f064a7d8c61564f6fe9458f [id=0cc25e520828404183490059b522eefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.722465 1567 raft_consensus.cc:493] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:58.725324 1026 tablet_service.cc:1511] Processing CreateTablet for tablet bc2006e262cc4bbb9b291a5bf52653cd (DEFAULT_TABLE table=default.Table_bfaf83b26abe4e78813fd297b564ba57 [id=7145bbb052dc4bddb8f715b6ecaa3b8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.731174 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 83a199f25e5c4accba0acd1007fc73d1 (DEFAULT_TABLE table=default.Table_91f98e62a1f54c249e7932f0f5f259eb [id=d110ad2a9fe84821881b05e621c8f5ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.733363 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 93c940bd14a040ddba5ea058e732bf0c (DEFAULT_TABLE table=default.Table_032fed7521604405ba49b2f399e0f628 [id=5aaccdcce80844bbb73b04f81bde9373]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.741245 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9800df09eecb4a299a6facf8b85a93e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.735697 754 tablet_service.cc:1511] Processing CreateTablet for tablet c3706f41b0e342a69f66c936173f2ae0 (DEFAULT_TABLE table=default.Table_32f046307a634164a6087e004a8a9494 [id=1e981f1a41514a5283fb6f650cab0c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.745857 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet fab8282287434bf8b7e37f008a1b0166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:58.746717 1567 raft_consensus.cc:515] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.748818 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610d6197e35e447ea25cdba2cc454b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.751700 1567 leader_election.cc:290] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:58.752252 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.753018 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.752894 1193 tablet_replica.cc:333] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:58.759627 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c940bd14a040ddba5ea058e732bf0c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:58.764935 996 leader_election.cc:343] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: d61873c8aa094d7f899a61307a36f895
W20260616 19:51:58.765151 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 2141b6c7013648a4b716642ccb4eccd6 (table default.Table_5047c84664124989b931ee92afc5b463 [id=bc83d5c728054794b2c3cc0f9b90e202], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2141b6c7013648a4b716642ccb4eccd6 consensus state has no leader
I20260616 19:51:58.766777 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 43b4c3bd370749b18fb86f7a0aae2c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:58.767289 891 tablet_service.cc:1558] Processing DeleteTablet for tablet c7f724dc23024a7297cfb8689f199600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:58.768074 891 tablet_service.cc:1511] Processing CreateTablet for tablet 5462af2002f9406b85ee20660e001a95 (DEFAULT_TABLE table=default.Table_d9b6ea5cbcd347058c16f26573990825 [id=d2574a03769945e99b662ed1015b2703]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.768915 901 tablet_service.cc:1511] Processing CreateTablet for tablet 26503d1293be438dae39fa1e1ea1885b (DEFAULT_TABLE table=default.Table_c3ed767db6964beebf754607830e97d2 [id=467b42cd85544c589d2cf3f9eaf21754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.769695 902 tablet_service.cc:1511] Processing CreateTablet for tablet da039dbc1089426dba1226940e37469e (DEFAULT_TABLE table=default.Table_96a5b2a9fdda4f5b82a47ae1dc7b190c [id=f223ad08623343aeb681a65b744d2476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.770299 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5462af2002f9406b85ee20660e001a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.770568 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da039dbc1089426dba1226940e37469e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.770676 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1142b61e40e6499e8244d71f2ad39b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.776623 750 tablet_service.cc:1511] Processing CreateTablet for tablet 79d686afeeed4729bd2069296aec82a1 (DEFAULT_TABLE table=default.Table_98dfc128f98d405bb94b36098e43025f [id=06387be97c9c486ea549edbe384d0ce7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.776839 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26503d1293be438dae39fa1e1ea1885b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.777992 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf86e5d5f2341c78705f78c02695c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.779439 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.787412 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26503d1293be438dae39fa1e1ea1885b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.788523 892 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9befb557d84f3bb7781664cbf2f28f (DEFAULT_TABLE table=default.Table_156e92a12c2d49dda4e54f4f3681abb8 [id=fea2a89e41c24f248c1e291f2ad3093b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.789510 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9befb557d84f3bb7781664cbf2f28f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:58.778679 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 97619.1us
I20260616 19:51:58.792933 889 tablet_service.cc:1511] Processing CreateTablet for tablet 9800df09eecb4a299a6facf8b85a93e4 (DEFAULT_TABLE table=default.Table_de10497bdced446781f27d9eb54717be [id=b9e3ddc46058486aaef9d221832c636d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.793313 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9800df09eecb4a299a6facf8b85a93e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.795176 748 tablet_service.cc:1511] Processing CreateTablet for tablet 93c940bd14a040ddba5ea058e732bf0c (DEFAULT_TABLE table=default.Table_032fed7521604405ba49b2f399e0f628 [id=5aaccdcce80844bbb73b04f81bde9373]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.796123 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f293d557a9aa4ca4885aa917fe1565e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.796864 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a199f25e5c4accba0acd1007fc73d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.796861 886 tablet_service.cc:1511] Processing CreateTablet for tablet 0a406124a8d34e578ba94fab2a873a55 (DEFAULT_TABLE table=default.Table_9a33444036b544e8a6d5d5c743ebc5a7 [id=f53951a5b5094a1a8ef37cdba97f251d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.797235 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a406124a8d34e578ba94fab2a873a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.798138 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c90eb04585c4fa992435d11015ffec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.799265 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2006e262cc4bbb9b291a5bf52653cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.800058 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d686afeeed4729bd2069296aec82a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.801914 765 tablet_service.cc:1511] Processing CreateTablet for tablet 3c90eb04585c4fa992435d11015ffec7 (DEFAULT_TABLE table=default.Table_88815cb77f064a7d8c61564f6fe9458f [id=0cc25e520828404183490059b522eefb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:58.804283 996 leader_election.cc:343] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:58.803138 895 tablet_service.cc:1511] Processing CreateTablet for tablet d686190fb6a34ab18cc4799197765f1b (DEFAULT_TABLE table=default.Table_52d50dabb1b2498f88d5a07f62f7d058 [id=e6bef21f2f3644859d5d44ef5d5b5b3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.806226 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d686190fb6a34ab18cc4799197765f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.805078 758 tablet_service.cc:1511] Processing CreateTablet for tablet f293d557a9aa4ca4885aa917fe1565e4 (DEFAULT_TABLE table=default.Table_29a007aa6e0a4f58a0c38a06900abdd4 [id=17d6f772e11d42c6a5acb4f6a0269a43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.815665 759 tablet_service.cc:1511] Processing CreateTablet for tablet 613c869d4ac84ee0aa952718ba74917b (DEFAULT_TABLE table=default.Table_3b8f449c385948bcb34abccbf9add4a4 [id=fdee766904ce4ac58aaaa227b066c7d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.808221 756 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0a6191ad334400a319778fc4e559af (DEFAULT_TABLE table=default.Table_04e2e7eefe2d42298ac7914ba1fba70c [id=c5e9e67dad394bcbb7744662eda892d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.820690 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613c869d4ac84ee0aa952718ba74917b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.803130 887 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc (DEFAULT_TABLE table=default.Table_fb391d8a718646b0b47d996c2f98f46f [id=548db2885e3f4ad19e6c310f67ad116e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.821144 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.821955 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c940bd14a040ddba5ea058e732bf0c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:58.822199 996 leader_election.cc:343] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:51:58.822803 996 leader_election.cc:343] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:58.823387 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f293d557a9aa4ca4885aa917fe1565e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.825877 760 tablet_service.cc:1558] Processing DeleteTablet for tablet fab8282287434bf8b7e37f008a1b0166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:58.827306 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c90eb04585c4fa992435d11015ffec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.803069 894 tablet_service.cc:1511] Processing CreateTablet for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c (DEFAULT_TABLE table=default.Table_ade11253e88d413db148bcee7283260d [id=79346acffcf0424489622058f891d392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.828334 761 tablet_service.cc:1511] Processing CreateTablet for tablet 83a199f25e5c4accba0acd1007fc73d1 (DEFAULT_TABLE table=default.Table_91f98e62a1f54c249e7932f0f5f259eb [id=d110ad2a9fe84821881b05e621c8f5ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.839704 1193 raft_consensus.cc:2243] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:58.844125 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a199f25e5c4accba0acd1007fc73d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.850226 1625 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85d6b13547f2413c86ee07194ca74704)
I20260616 19:51:58.850600 1193 raft_consensus.cc:2272] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:58.850416 1625 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:51:58.851511 1625 leader_election.cc:290] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85d6b13547f2413c86ee07194ca74704 (127.0.105.190:35857), c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219)
I20260616 19:51:58.852829 1193 ts_tablet_manager.cc:1916] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:58.854620 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613c869d4ac84ee0aa952718ba74917b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.856848 746 tablet_service.cc:1511] Processing CreateTablet for tablet bc2006e262cc4bbb9b291a5bf52653cd (DEFAULT_TABLE table=default.Table_bfaf83b26abe4e78813fd297b564ba57 [id=7145bbb052dc4bddb8f715b6ecaa3b8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.864581 1379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 514 } } ignore_live_leader: false dest_uuid: "c404c91cd2194cf6838fddd212f2f4ae" is_pre_election: true
I20260616 19:51:58.867429 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da039dbc1089426dba1226940e37469e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.868135 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3706f41b0e342a69f66c936173f2ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.869046 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0a6191ad334400a319778fc4e559af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.869879 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2006e262cc4bbb9b291a5bf52653cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.870465 1579 leader_election.cc:290] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:58.874898 1191 raft_consensus.cc:2243] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:58.875471 1191 pending_rounds.cc:70] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2: Trying to abort 1 pending ops.
I20260616 19:51:58.876803 1191 pending_rounds.cc:77] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595468126199808 op_type: NO_OP noop_request { }
I20260616 19:51:58.876981 1191 raft_consensus.cc:2889] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:58.877617 1191 raft_consensus.cc:2272] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:58.882717 1526 log.cc:927] Time spent T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: Append to log took a long time: real 0.167s user 0.000s sys 0.000s
W20260616 19:51:58.885967 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 62711.2us
I20260616 19:51:58.852579 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 514 } } ignore_live_leader: false dest_uuid: "85d6b13547f2413c86ee07194ca74704" is_pre_election: true
I20260616 19:51:58.895864 517 leader_election.cc:304] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b8fb7a8523741a2b7a5e75d8b415be0; no voters: 85d6b13547f2413c86ee07194ca74704, c404c91cd2194cf6838fddd212f2f4ae
I20260616 19:51:58.896167 1625 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260616 19:51:58.898138 1612 tablet.cc:1724] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260616 19:51:58.898729 996 leader_election.cc:343] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:51:58.899209 996 leader_election.cc:343] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: d61873c8aa094d7f899a61307a36f895
W20260616 19:51:58.892778 1622 consensus_queue.cc:1175] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61c874fef3684d10a272a9c7f280e0e2" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260616 19:51:58.900628 1191 ts_tablet_manager.cc:1916] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:58.909113 1191 ts_tablet_manager.cc:1929] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:58.909375 903 tablet_service.cc:1511] Processing CreateTablet for tablet 1142b61e40e6499e8244d71f2ad39b1e (DEFAULT_TABLE table=default.Table_f4fa0f49dd9849f18e8d221a29eb24c5 [id=2dcde1c167ce4d8c8f7aab84e86f47d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.909741 888 tablet_service.cc:1511] Processing CreateTablet for tablet 54eb61046c954a36a036b24e9e16b5c4 (DEFAULT_TABLE table=default.Table_a04ece9647b14e4d9cb0d5f5557cc8b4 [id=e89b92f225554748812dc4f9a09e0dc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.910792 899 tablet_service.cc:1511] Processing CreateTablet for tablet c3706f41b0e342a69f66c936173f2ae0 (DEFAULT_TABLE table=default.Table_32f046307a634164a6087e004a8a9494 [id=1e981f1a41514a5283fb6f650cab0c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.911042 896 tablet_service.cc:1558] Processing DeleteTablet for tablet e3c4e584fad94633ae49332872de0fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:58.914599 896 tablet_service.cc:1511] Processing CreateTablet for tablet f293d557a9aa4ca4885aa917fe1565e4 (DEFAULT_TABLE table=default.Table_29a007aa6e0a4f58a0c38a06900abdd4 [id=17d6f772e11d42c6a5acb4f6a0269a43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.915480 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bf54b260fc941599cffb12581e8116a with delete_type TABLET_DATA_DELETED (replaced by tablet 5c74b39e66d344b99f8fc75b855c0520) from {username='slave'} at 127.0.0.1:48636
W20260616 19:51:58.894116 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 163078us
I20260616 19:51:58.898231 1632 tablet.cc:1724] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:51:58.917327 893 tablet_service.cc:1511] Processing CreateTablet for tablet daf86e5d5f2341c78705f78c02695c17 (DEFAULT_TABLE table=default.Table_64de4a339ae243949520501b01d8c41a [id=9982394d897b411c84d41343bb031bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.893857 1198 tablet_bootstrap.cc:492] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:58.917999 1198 ts_tablet_manager.cc:1403] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.513s user 0.008s sys 0.007s
I20260616 19:51:58.918542 1190 ts_tablet_manager.cc:1929] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:58.918691 1190 log.cc:1199] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/8bf87ea2e8604f35bc57b6d2b8b9c61f
I20260616 19:51:58.919134 1190 ts_tablet_manager.cc:1950] T 8bf87ea2e8604f35bc57b6d2b8b9c61f P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:58.919322 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.919497 1198 raft_consensus.cc:359] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:58.919605 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f293d557a9aa4ca4885aa917fe1565e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.919447 902 tablet_service.cc:1511] Processing CreateTablet for tablet 79d686afeeed4729bd2069296aec82a1 (DEFAULT_TABLE table=default.Table_98dfc128f98d405bb94b36098e43025f [id=06387be97c9c486ea549edbe384d0ce7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.919826 1198 raft_consensus.cc:385] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:58.920183 1198 raft_consensus.cc:740] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:58.920646 1198 consensus_queue.cc:260] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:58.921432 1198 ts_tablet_manager.cc:1434] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260616 19:51:58.921886 1198 tablet_bootstrap.cc:492] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:58.924366 1198 tablet_bootstrap.cc:654] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:58.926502 898 tablet_service.cc:1511] Processing CreateTablet for tablet 4faa62f03c2a4588a776883dc54d0426 (DEFAULT_TABLE table=default.Table_7b912aaf74bb4b23a2cd06c0e5a64873 [id=9d94425680c44e4f99c13f70357d7c43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.928522 900 tablet_service.cc:1511] Processing CreateTablet for tablet 93c940bd14a040ddba5ea058e732bf0c (DEFAULT_TABLE table=default.Table_032fed7521604405ba49b2f399e0f628 [id=5aaccdcce80844bbb73b04f81bde9373]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.924625 1191 log.cc:1199] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/d61873c8aa094d7f899a61307a36f895
I20260616 19:51:58.929481 1191 ts_tablet_manager.cc:1950] T d61873c8aa094d7f899a61307a36f895 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:58.930490 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf86e5d5f2341c78705f78c02695c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.932771 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 338) took 1547 ms. Trace:
I20260616 19:51:58.932956 1191 rpcz_store.cc:276] 0616 19:51:57.385398 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.395964 (+ 10566us) service_pool.cc:224] Handling call
0616 19:51:58.620225 (+1224261us) ts_tablet_manager.cc:1151] Deleting tablet d61873c8aa094d7f899a61307a36f895
0616 19:51:58.620237 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:58.875205 (+254968us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x6160000f1c54. stack: 00007f92671a0086 00007f926719fe40 00007f92661593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f92731d47e0 00007f9274520933 00007f92770e3ae7 00007f9277116bb4 00007f92770f75d0 00007f92770f735d 0000000000aa681c 00007f92671e5f6f 00007f92671e928b 00007f92671e9108
0616 19:51:58.905002 (+ 29797us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:58.908995 (+ 3993us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:58.932738 (+ 23743us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542768896,"tablet-delete.queue_time_us":1223963}
I20260616 19:51:58.933261 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99551210f5974332bf6a16ee74b220f6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:58.933465 924 raft_consensus.cc:2468] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:58.933808 890 tablet_service.cc:1511] Processing CreateTablet for tablet d1e3778611a24397a1a776be2cc76284 (DEFAULT_TABLE table=default.Table_aee030c17ec146b0b77a8cfc6e4af008 [id=d1dbf5b9407644a48893bad8d11b16e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.934163 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c940bd14a040ddba5ea058e732bf0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.934132 885 tablet_service.cc:1511] Processing CreateTablet for tablet 3c90eb04585c4fa992435d11015ffec7 (DEFAULT_TABLE table=default.Table_88815cb77f064a7d8c61564f6fe9458f [id=0cc25e520828404183490059b522eefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.934293 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet d61873c8aa094d7f899a61307a36f895 (table default.Table_6a6d8516df114593b27d86140407b724 [id=d104c5ac8acc4a6f9ed7cc87879d661b]) successfully deleted
I20260616 19:51:58.934633 993 leader_election.cc:304] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:58.935041 1628 raft_consensus.cc:2804] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:58.935199 1628 raft_consensus.cc:493] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:58.935393 1628 raft_consensus.cc:3060] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:58.936764 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e3778611a24397a1a776be2cc76284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.936931 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c90eb04585c4fa992435d11015ffec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.937109 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4faa62f03c2a4588a776883dc54d0426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.937984 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d686afeeed4729bd2069296aec82a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.939373 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1142b61e40e6499e8244d71f2ad39b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.939529 1191 tablet_replica.cc:333] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:58.939889 1191 raft_consensus.cc:2243] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:58.940176 1191 pending_rounds.cc:70] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: Trying to abort 1 pending ops.
I20260616 19:51:58.940289 1191 pending_rounds.cc:77] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595467970916352 op_type: NO_OP noop_request { }
I20260616 19:51:58.941478 1191 raft_consensus.cc:2889] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:58.941725 1191 raft_consensus.cc:2272] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:58.942339 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54eb61046c954a36a036b24e9e16b5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:58.941228 1628 raft_consensus.cc:515] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.931821 901 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0a6191ad334400a319778fc4e559af (DEFAULT_TABLE table=default.Table_04e2e7eefe2d42298ac7914ba1fba70c [id=c5e9e67dad394bcbb7744662eda892d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.932688 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 285) took 2488 ms. Trace:
I20260616 19:51:58.945617 1628 leader_election.cc:290] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:58.947695 891 tablet_service.cc:1511] Processing CreateTablet for tablet 613c869d4ac84ee0aa952718ba74917b (DEFAULT_TABLE table=default.Table_3b8f449c385948bcb34abccbf9add4a4 [id=fdee766904ce4ac58aaaa227b066c7d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.947925 1198 tablet_bootstrap.cc:492] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:58.948169 1198 ts_tablet_manager.cc:1403] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.003s
I20260616 19:51:58.949168 1198 raft_consensus.cc:359] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:58.949455 1198 raft_consensus.cc:385] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:58.949602 1198 raft_consensus.cc:740] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:58.949977 1198 consensus_queue.cc:260] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:58.950681 1198 ts_tablet_manager.cc:1434] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:51:58.950981 1198 tablet_bootstrap.cc:492] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:58.953434 1198 tablet_bootstrap.cc:654] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:58.953557 904 tablet_service.cc:1511] Processing CreateTablet for tablet 83a199f25e5c4accba0acd1007fc73d1 (DEFAULT_TABLE table=default.Table_91f98e62a1f54c249e7932f0f5f259eb [id=d110ad2a9fe84821881b05e621c8f5ee]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:51:58.973445 923 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.568s user 0.006s sys 0.006s
I20260616 19:51:58.974434 1198 tablet_bootstrap.cc:492] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:58.974457 1192 tablet_bootstrap.cc:492] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:58.976117 1198 ts_tablet_manager.cc:1403] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.009s
I20260616 19:51:58.976919 897 tablet_service.cc:1558] Processing DeleteTablet for tablet fab8282287434bf8b7e37f008a1b0166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:58.978664 1190 rpcz_store.cc:276] 0616 19:51:56.432549 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.432619 (+ 70us) service_pool.cc:224] Handling call
0616 19:51:58.071275 (+1638656us) ts_tablet_manager.cc:1151] Deleting tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f
0616 19:51:58.071284 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:58.152563 (+ 81279us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:58.894417 (+741854us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:58.921164 (+ 26747us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1638458}
I20260616 19:51:58.980401 1198 raft_consensus.cc:359] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:58.980690 1198 raft_consensus.cc:385] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:58.980795 1198 raft_consensus.cc:740] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:58.981739 1198 consensus_queue.cc:260] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:58.982263 1621 log.cc:927] Time spent T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
W20260616 19:51:58.982667 1621 consensus_queue.cc:1175] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61c874fef3684d10a272a9c7f280e0e2" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260616 19:51:58.983355 1191 ts_tablet_manager.cc:1916] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:58.984741 889 tablet_service.cc:1511] Processing CreateTablet for tablet bc2006e262cc4bbb9b291a5bf52653cd (DEFAULT_TABLE table=default.Table_bfaf83b26abe4e78813fd297b564ba57 [id=7145bbb052dc4bddb8f715b6ecaa3b8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:58.984969 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99551210f5974332bf6a16ee74b220f6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:58.985373 1196 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.929s user 0.063s sys 0.125s
I20260616 19:51:58.986603 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 8bf87ea2e8604f35bc57b6d2b8b9c61f (table default.Table_0531204d83954cb3a55ad0f218d390a1 [id=f99403687f45449d84c7ad8b490f6c2a]) successfully deleted
W20260616 19:51:58.987090 996 leader_election.cc:343] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:58.991080 1191 ts_tablet_manager.cc:1929] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:58.991226 1191 log.cc:1199] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/362e7ff9bea3459ca018d1a7febb2ce4
I20260616 19:51:58.991658 1191 ts_tablet_manager.cc:1950] T 362e7ff9bea3459ca018d1a7febb2ce4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:58.992563 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 340) took 1542 ms. Trace:
I20260616 19:51:58.992712 1191 rpcz_store.cc:276] 0616 19:51:57.450307 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.450358 (+ 51us) service_pool.cc:224] Handling call
0616 19:51:58.933525 (+1483167us) ts_tablet_manager.cc:1151] Deleting tablet 362e7ff9bea3459ca018d1a7febb2ce4
0616 19:51:58.933534 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:58.987917 (+ 54383us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:58.990974 (+ 3057us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:58.992525 (+ 1551us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1482947}
I20260616 19:51:58.993449 1191 tablet_replica.cc:333] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:58.993682 1191 raft_consensus.cc:2243] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:58.993955 1191 pending_rounds.cc:70] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2: Trying to abort 1 pending ops.
I20260616 19:51:58.994086 1191 pending_rounds.cc:77] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595468337229824 op_type: NO_OP noop_request { }
I20260616 19:51:58.994220 1191 raft_consensus.cc:2889] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260616 19:51:58.994537 719 leader_election.cc:343] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: dfee6a9e6d57487bb7d9482f7798e6b6
I20260616 19:51:58.994751 1191 raft_consensus.cc:2272] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:58.994573 1196 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.931s user 0.063s sys 0.125s
I20260616 19:51:58.994645 1198 ts_tablet_manager.cc:1434] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260616 19:51:58.997152 1198 tablet_bootstrap.cc:492] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:58.999418 1198 tablet_bootstrap.cc:654] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:58.996829 1191 ts_tablet_manager.cc:1916] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:51:59.004022 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 62859.1us
I20260616 19:51:59.004817 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99551210f5974332bf6a16ee74b220f6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:51:59.005896 996 leader_election.cc:343] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.014366 1191 ts_tablet_manager.cc:1929] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:59.014609 1191 log.cc:1199] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/0bf54b260fc941599cffb12581e8116a
I20260616 19:51:59.015813 1198 tablet_bootstrap.cc:492] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.015991 1198 ts_tablet_manager.cc:1403] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260616 19:51:59.016814 1198 raft_consensus.cc:359] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.017081 1198 raft_consensus.cc:385] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.017277 1198 raft_consensus.cc:740] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.017592 1198 consensus_queue.cc:260] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.018276 1198 ts_tablet_manager.cc:1434] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:51:59.021474 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3706f41b0e342a69f66c936173f2ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.022439 1196 tablet_bootstrap.cc:492] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.022701 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99551210f5974332bf6a16ee74b220f6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:59.022904 924 raft_consensus.cc:3060] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.023555 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a199f25e5c4accba0acd1007fc73d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.023793 1190 tablet_replica.cc:333] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:59.024107 1192 ts_tablet_manager.cc:1403] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.602s user 0.005s sys 0.006s
W20260616 19:51:59.025398 923 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.569s user 0.007s sys 0.006s
I20260616 19:51:59.027398 1192 raft_consensus.cc:359] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.028271 1192 raft_consensus.cc:385] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.028364 1192 raft_consensus.cc:740] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.028713 1198 tablet_bootstrap.cc:492] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.028755 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613c869d4ac84ee0aa952718ba74917b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.029558 1192 consensus_queue.cc:260] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.031235 1198 tablet_bootstrap.cc:654] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:59.033118 718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 385739us
I20260616 19:51:59.033910 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af9bdceae184f8dbb9e5db67a11ee63" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:59.034848 1192 ts_tablet_manager.cc:1434] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260616 19:51:59.035665 1190 raft_consensus.cc:2243] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.036283 1190 raft_consensus.cc:2272] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.029194 1191 ts_tablet_manager.cc:1950] T 0bf54b260fc941599cffb12581e8116a P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:59.037328 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 341) took 1558 ms. Trace:
I20260616 19:51:59.037580 1191 rpcz_store.cc:276] 0616 19:51:57.479091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.479170 (+ 79us) service_pool.cc:224] Handling call
0616 19:51:58.993387 (+1514217us) ts_tablet_manager.cc:1151] Deleting tablet 0bf54b260fc941599cffb12581e8116a
0616 19:51:58.993397 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.007363 (+ 13966us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.014289 (+ 6926us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.037292 (+ 23003us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1513943}
I20260616 19:51:59.037667 1190 ts_tablet_manager.cc:1916] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.037986 1192 tablet_bootstrap.cc:492] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:59.038146 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 0bf54b260fc941599cffb12581e8116a (table default.Table_7af2cb04d4654ceabe58936f5a687406 [id=7f7faf7145fd4ea5babd783d76d44821]) successfully deleted
I20260616 19:51:59.038472 1191 tablet_replica.cc:333] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:59.038441 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0a6191ad334400a319778fc4e559af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.038714 1191 raft_consensus.cc:2243] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.038856 1191 raft_consensus.cc:2272] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.039376 1191 ts_tablet_manager.cc:1916] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.043766 1626 raft_consensus.cc:493] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.043942 1626 raft_consensus.cc:515] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.044713 1626 leader_election.cc:290] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:59.044927 422 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-tasknFdngH/build/asan/bin/kudu pid 498
I20260616 19:51:59.046016 562 generic_service.cc:196] Checking for leaks (request via RPC)
I20260616 19:51:59.046730 1196 ts_tablet_manager.cc:1403] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.978s user 0.064s sys 0.129s
I20260616 19:51:59.048172 1196 raft_consensus.cc:359] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:59.048674 719 leader_election.cc:343] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: bb2fdea2d4ab42708fcd3102ea54bdb6
I20260616 19:51:59.050369 1196 raft_consensus.cc:385] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.050537 1196 raft_consensus.cc:740] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.059269 1196 consensus_queue.cc:260] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.059768 1196 ts_tablet_manager.cc:1434] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260616 19:51:59.060052 1196 tablet_bootstrap.cc:492] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:59.062922 1191 ts_tablet_manager.cc:1929] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.063642 1198 tablet_bootstrap.cc:492] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.063905 1198 ts_tablet_manager.cc:1403] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.001s
I20260616 19:51:59.064795 1198 raft_consensus.cc:359] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.065065 1198 raft_consensus.cc:385] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.065178 1198 raft_consensus.cc:740] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.065515 1198 consensus_queue.cc:260] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.066216 1198 ts_tablet_manager.cc:1434] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:59.066552 1198 tablet_bootstrap.cc:492] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.069100 1198 tablet_bootstrap.cc:654] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.070091 1191 log.cc:1199] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/99551210f5974332bf6a16ee74b220f6
I20260616 19:51:59.072281 1191 ts_tablet_manager.cc:1950] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:59.072824 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 342) took 1581 ms. Trace:
I20260616 19:51:59.072909 1193 ts_tablet_manager.cc:1929] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.073033 1193 log.cc:1199] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/5c90188c0181467ea3deee14fa5568b3
I20260616 19:51:59.073406 1193 ts_tablet_manager.cc:1950] T 5c90188c0181467ea3deee14fa5568b3 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.073524 1191 rpcz_store.cc:276] 0616 19:51:57.491820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.491872 (+ 52us) service_pool.cc:224] Handling call
0616 19:51:59.038409 (+1546537us) ts_tablet_manager.cc:1151] Deleting tablet 99551210f5974332bf6a16ee74b220f6
0616 19:51:59.038419 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.054526 (+ 16107us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.062855 (+ 8329us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.072773 (+ 9918us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1546284}
I20260616 19:51:59.074153 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 358) took 1324 ms. Trace:
I20260616 19:51:59.074271 1193 rpcz_store.cc:276] 0616 19:51:57.749642 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.749687 (+ 45us) service_pool.cc:224] Handling call
0616 19:51:58.696262 (+946575us) ts_tablet_manager.cc:1151] Deleting tablet 5c90188c0181467ea3deee14fa5568b3
0616 19:51:58.725729 (+ 29467us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.062855 (+337126us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.072826 (+ 9971us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.074120 (+ 1294us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":943531}
I20260616 19:51:59.074579 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 99551210f5974332bf6a16ee74b220f6 (table default.Table_ab3032cb1f934fdc9bde24d4b3b1f5a3 [id=4fbf7d11df5448f4b249f9c831241f38]) successfully deleted
I20260616 19:51:59.074801 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 5c90188c0181467ea3deee14fa5568b3 (table default.Table_fce6c0a420e74d889b4665e221e3c559 [id=0d6caa2121db47609b15d8b087a3752a]) successfully deleted
I20260616 19:51:59.075053 718 leader_election.cc:304] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:51:59.075342 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 343) took 1579 ms. Trace:
W20260616 19:51:59.075832 860 leader_election.cc:343] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.076002 860 leader_election.cc:304] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:51:59.076386 1458 raft_consensus.cc:2749] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:59.076560 1191 rpcz_store.cc:276] 0616 19:51:57.495512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.495577 (+ 65us) service_pool.cc:224] Handling call
0616 19:51:59.074927 (+1579350us) ts_tablet_manager.cc:1151] Deleting tablet a0cb7a1acf35403192254bf5cd1170a2
0616 19:51:59.074936 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.075292 (+ 356us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1579131}
I20260616 19:51:59.076673 1626 raft_consensus.cc:2804] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:59.076830 1626 raft_consensus.cc:697] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
W20260616 19:51:59.077123 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a0cb7a1acf35403192254bf5cd1170a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0cb7a1acf35403192254bf5cd1170a2 already in progress: creating tablet
I20260616 19:51:59.077140 1626 consensus_queue.cc:237] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.078882 1193 tablet_replica.cc:333] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:59.079207 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 345) took 1573 ms. Trace:
I20260616 19:51:59.080113 1191 rpcz_store.cc:276] 0616 19:51:57.505522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.505586 (+ 64us) service_pool.cc:224] Handling call
0616 19:51:59.079055 (+1573469us) ts_tablet_manager.cc:1151] Deleting tablet c6d6071d862241e196a83a23bc939af4
0616 19:51:59.079064 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.079155 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1573245}
I20260616 19:51:59.080669 1196 tablet_bootstrap.cc:654] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:59.080646 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c6d6071d862241e196a83a23bc939af4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6d6071d862241e196a83a23bc939af4 already in progress: creating tablet
I20260616 19:51:59.081141 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 346) took 1574 ms. Trace:
I20260616 19:51:59.082350 1191 rpcz_store.cc:276] 0616 19:51:57.506479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.506533 (+ 54us) service_pool.cc:224] Handling call
0616 19:51:59.080960 (+1574427us) ts_tablet_manager.cc:1151] Deleting tablet fbb308b05bb04bc18ccaa9550a73d3e7
0616 19:51:59.080970 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.081091 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1574211}
W20260616 19:51:59.082994 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet fbb308b05bb04bc18ccaa9550a73d3e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbb308b05bb04bc18ccaa9550a73d3e7 already in progress: creating tablet
I20260616 19:51:59.083516 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 348) took 1560 ms. Trace:
I20260616 19:51:59.088572 1191 rpcz_store.cc:276] 0616 19:51:57.522651 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.522706 (+ 55us) service_pool.cc:224] Handling call
0616 19:51:59.083332 (+1560626us) ts_tablet_manager.cc:1151] Deleting tablet e6f309caaa9042f99432a61fd2ebb089
0616 19:51:59.083345 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.083456 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1560411}
W20260616 19:51:59.089660 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet e6f309caaa9042f99432a61fd2ebb089 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6f309caaa9042f99432a61fd2ebb089 already in progress: creating tablet
I20260616 19:51:59.090314 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 363) took 1190 ms. Trace:
I20260616 19:51:59.090595 924 raft_consensus.cc:2468] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:59.093453 993 leader_election.cc:304] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
W20260616 19:51:59.093743 993 raft_consensus.cc:2686] T 99551210f5974332bf6a16ee74b220f6 P 61c874fef3684d10a272a9c7f280e0e2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:51:59.092346 1191 rpcz_store.cc:276] 0616 19:51:57.899928 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.900526 (+ 598us) service_pool.cc:224] Handling call
0616 19:51:59.090105 (+1189579us) ts_tablet_manager.cc:1151] Deleting tablet ca5dc1e6cde347fc9a34e555385dc646
0616 19:51:59.090119 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.090245 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1166357}
W20260616 19:51:59.096199 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ca5dc1e6cde347fc9a34e555385dc646 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca5dc1e6cde347fc9a34e555385dc646 already in progress: creating tablet
I20260616 19:51:59.098783 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 364) took 1198 ms. Trace:
I20260616 19:51:59.099372 1191 rpcz_store.cc:276] 0616 19:51:57.900083 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.900603 (+ 520us) service_pool.cc:224] Handling call
0616 19:51:59.098592 (+1197989us) ts_tablet_manager.cc:1151] Deleting tablet 1d80d9028184443da49623228259263d
0616 19:51:59.098605 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.098724 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1174600}
W20260616 19:51:59.100483 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 1d80d9028184443da49623228259263d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d80d9028184443da49623228259263d already in progress: creating tablet
I20260616 19:51:59.101189 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 365) took 1200 ms. Trace:
I20260616 19:51:59.104287 1191 rpcz_store.cc:276] 0616 19:51:57.900173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.900893 (+ 720us) service_pool.cc:224] Handling call
0616 19:51:59.100892 (+1199999us) ts_tablet_manager.cc:1151] Deleting tablet c6939d108a7948bb9e56311a34d95486
0616 19:51:59.100906 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.101131 (+ 225us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1176810}
W20260616 19:51:59.105095 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c6939d108a7948bb9e56311a34d95486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6939d108a7948bb9e56311a34d95486 already in progress: creating tablet
I20260616 19:51:59.105669 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 373) took 1192 ms. Trace:
I20260616 19:51:59.106159 1196 tablet_bootstrap.cc:492] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.106156 1191 rpcz_store.cc:276] 0616 19:51:57.912707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.914123 (+ 1416us) service_pool.cc:224] Handling call
0616 19:51:59.105504 (+1191381us) ts_tablet_manager.cc:1151] Deleting tablet 9d800b4e2c2d42279c102e4e061f5530
0616 19:51:59.105514 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.105616 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1172809}
I20260616 19:51:59.106705 1196 ts_tablet_manager.cc:1403] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.047s user 0.008s sys 0.001s
W20260616 19:51:59.107059 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 9d800b4e2c2d42279c102e4e061f5530 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d800b4e2c2d42279c102e4e061f5530 already in progress: creating tablet
I20260616 19:51:59.107435 1192 tablet_bootstrap.cc:654] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:59.107796 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d9c664f0386549d6867c407526ee45a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9c664f0386549d6867c407526ee45a0 already in progress: creating tablet
W20260616 19:51:59.108896 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2e316e44693d473dad901eeb95299988 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e316e44693d473dad901eeb95299988 already in progress: creating tablet
W20260616 19:51:59.109760 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet af5e277102b8480db44e5ffe88267808 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af5e277102b8480db44e5ffe88267808 already in progress: creating tablet
I20260616 19:51:59.109887 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2006e262cc4bbb9b291a5bf52653cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.110350 1191 tablet_replica.cc:333] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:59.112668 1191 raft_consensus.cc:2243] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:59.113363 1191 raft_consensus.cc:2272] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.117729 1196 raft_consensus.cc:359] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.117995 1196 raft_consensus.cc:385] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.118089 1196 raft_consensus.cc:740] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.118273 1191 ts_tablet_manager.cc:1916] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.125008 1196 consensus_queue.cc:260] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.125636 1196 ts_tablet_manager.cc:1434] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260616 19:51:59.126061 1196 tablet_bootstrap.cc:492] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:59.131711 1196 tablet_bootstrap.cc:654] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.136224 1196 tablet_bootstrap.cc:492] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.136406 1196 ts_tablet_manager.cc:1403] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260616 19:51:59.139693 1191 ts_tablet_manager.cc:1929] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:51:59.141414 1196 raft_consensus.cc:359] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.141646 1196 raft_consensus.cc:385] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.141731 1196 raft_consensus.cc:740] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.143041 1196 consensus_queue.cc:260] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.143683 1196 ts_tablet_manager.cc:1434] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260616 19:51:59.144029 1196 tablet_bootstrap.cc:492] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:59.150916 1191 log.cc:1199] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/776841d895d6431fbee76b7c4e28d973
I20260616 19:51:59.152182 1196 tablet_bootstrap.cc:654] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.152873 1191 ts_tablet_manager.cc:1950] T 776841d895d6431fbee76b7c4e28d973 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:59.154450 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 776841d895d6431fbee76b7c4e28d973 (table default.Table_ebec5e10f80244469fca70fe48c270e8 [id=4d2238911f8d432095e4a20ee0dc6217]) successfully deleted
W20260616 19:51:59.156556 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c48314f8e45d4b198306f0ae6e40def7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c48314f8e45d4b198306f0ae6e40def7 already in progress: creating tablet
I20260616 19:51:59.157655 1196 tablet_bootstrap.cc:492] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.157820 1196 ts_tablet_manager.cc:1403] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
W20260616 19:51:59.158941 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 23f280b9ea1147799635f8a6199f17c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23f280b9ea1147799635f8a6199f17c0 already in progress: creating tablet
W20260616 19:51:59.159111 718 leader_election.cc:343] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: bb2fdea2d4ab42708fcd3102ea54bdb6
I20260616 19:51:59.159279 718 leader_election.cc:304] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:51:59.159607 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 610d6197e35e447ea25cdba2cc454b8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 610d6197e35e447ea25cdba2cc454b8d already in progress: creating tablet
I20260616 19:51:59.159762 1579 raft_consensus.cc:2749] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:51:59.160512 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c7f724dc23024a7297cfb8689f199600 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7f724dc23024a7297cfb8689f199600 already in progress: creating tablet
I20260616 19:51:59.159117 1196 raft_consensus.cc:359] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.164197 1196 raft_consensus.cc:385] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.164297 1196 raft_consensus.cc:740] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.164579 1196 consensus_queue.cc:260] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:51:59.164964 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet e3c4e584fad94633ae49332872de0fc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3c4e584fad94633ae49332872de0fc3 already in progress: creating tablet
I20260616 19:51:59.165144 1196 ts_tablet_manager.cc:1434] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260616 19:51:59.165506 1196 tablet_bootstrap.cc:492] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:51:59.166036 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 43b4c3bd370749b18fb86f7a0aae2c50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43b4c3bd370749b18fb86f7a0aae2c50 already in progress: creating tablet
W20260616 19:51:59.166724 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet fab8282287434bf8b7e37f008a1b0166 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fab8282287434bf8b7e37f008a1b0166 already in progress: creating tablet
I20260616 19:51:59.167372 1196 tablet_bootstrap.cc:654] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.179904 1196 tablet_bootstrap.cc:492] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.180110 1196 ts_tablet_manager.cc:1403] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260616 19:51:59.180737 1193 raft_consensus.cc:2243] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:59.181277 1193 pending_rounds.cc:70] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:51:59.181396 1193 pending_rounds.cc:77] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595470142578688 op_type: NO_OP noop_request { }
I20260616 19:51:59.181556 1193 raft_consensus.cc:2889] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260616 19:51:59.180824 447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.188:34219, user_credentials={real_user=slave}} blocked reactor thread for 66952.8us
I20260616 19:51:59.181679 1193 raft_consensus.cc:2272] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.182793 1196 raft_consensus.cc:359] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.183089 1196 raft_consensus.cc:385] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.183223 1196 raft_consensus.cc:740] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
W20260616 19:51:59.183399 1643 consensus_queue.cc:1175] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7245e7dab0ec474a876537be514c8767" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260616 19:51:59.189004 1193 ts_tablet_manager.cc:1916] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.189471 1198 tablet_bootstrap.cc:492] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.189642 1198 ts_tablet_manager.cc:1403] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.123s user 0.009s sys 0.015s
I20260616 19:51:59.190376 1198 raft_consensus.cc:359] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.190573 1198 raft_consensus.cc:385] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.190663 1198 raft_consensus.cc:740] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.190946 1198 consensus_queue.cc:260] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.191696 1198 ts_tablet_manager.cc:1434] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:59.194301 1198 tablet_bootstrap.cc:492] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.195014 1193 ts_tablet_manager.cc:1929] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:59.195139 1193 log.cc:1199] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/dfee6a9e6d57487bb7d9482f7798e6b6
I20260616 19:51:59.195577 1193 ts_tablet_manager.cc:1950] T dfee6a9e6d57487bb7d9482f7798e6b6 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.196816 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 362) took 1297 ms. Trace:
I20260616 19:51:59.196935 1193 rpcz_store.cc:276] 0616 19:51:57.899601 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.899660 (+ 59us) service_pool.cc:224] Handling call
0616 19:51:59.078773 (+1179113us) ts_tablet_manager.cc:1151] Deleting tablet dfee6a9e6d57487bb7d9482f7798e6b6
0616 19:51:59.078783 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.181003 (+102220us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x6160000c2554. stack: 00007f140f1b8086 00007f140f1b7e40 00007f140e1713ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f141b1ec7e0 00007f141c538933 00007f141f0fbae7 00007f141f12ebb4 00007f141f10f5d0 00007f141f10f35d 0000000000aa681c 00007f140f1fdf6f 00007f140f20128b 00007f140f201108
0616 19:51:59.192048 (+ 11045us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.194914 (+ 2866us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.196357 (+ 1443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233563904,"tablet-delete.queue_time_us":1178860}
I20260616 19:51:59.197542 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet dfee6a9e6d57487bb7d9482f7798e6b6 (table default.Table_81e67ee241e34396b9e1c159338b192a [id=074446fd6e71497cb644841e5bbd0510]) successfully deleted
I20260616 19:51:59.198244 1198 tablet_bootstrap.cc:654] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.203472 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 363) took 1303 ms. Trace:
I20260616 19:51:59.203609 1193 rpcz_store.cc:276] 0616 19:51:57.900332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.900384 (+ 52us) service_pool.cc:224] Handling call
0616 19:51:59.203303 (+1302919us) ts_tablet_manager.cc:1151] Deleting tablet ca5dc1e6cde347fc9a34e555385dc646
0616 19:51:59.203314 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.203434 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1302695}
W20260616 19:51:59.204066 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet ca5dc1e6cde347fc9a34e555385dc646 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca5dc1e6cde347fc9a34e555385dc646 already in progress: creating tablet
I20260616 19:51:59.204815 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 364) took 1303 ms. Trace:
I20260616 19:51:59.204938 1193 rpcz_store.cc:276] 0616 19:51:57.901483 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.901529 (+ 46us) service_pool.cc:224] Handling call
0616 19:51:59.204667 (+1303138us) ts_tablet_manager.cc:1151] Deleting tablet 1d80d9028184443da49623228259263d
0616 19:51:59.204678 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.204775 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1302957}
W20260616 19:51:59.205471 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1d80d9028184443da49623228259263d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d80d9028184443da49623228259263d already in progress: creating tablet
W20260616 19:51:59.206182 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d05c86bca9343a2bc8c5709e1c49647 consensus state has no leader
I20260616 19:51:59.207001 1196 consensus_queue.cc:260] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.208375 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 365) took 1302 ms. Trace:
I20260616 19:51:59.208510 1193 rpcz_store.cc:276] 0616 19:51:57.905510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.905564 (+ 54us) service_pool.cc:224] Handling call
0616 19:51:59.208233 (+1302669us) ts_tablet_manager.cc:1151] Deleting tablet c6939d108a7948bb9e56311a34d95486
0616 19:51:59.208243 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.208344 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1302472}
W20260616 19:51:59.208951 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c6939d108a7948bb9e56311a34d95486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6939d108a7948bb9e56311a34d95486 already in progress: creating tablet
I20260616 19:51:59.212918 1628 raft_consensus.cc:493] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.213114 1628 raft_consensus.cc:515] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.213785 1628 leader_election.cc:290] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.214421 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af9bdceae184f8dbb9e5db67a11ee63" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:59.215071 924 raft_consensus.cc:2468] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:59.215075 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af9bdceae184f8dbb9e5db67a11ee63" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:59.215641 993 leader_election.cc:304] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:51:59.216002 996 leader_election.cc:343] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.216534 1628 raft_consensus.cc:2804] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:59.216629 1628 raft_consensus.cc:493] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:59.216725 1628 raft_consensus.cc:3060] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.216796 1196 ts_tablet_manager.cc:1434] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.037s user 0.003s sys 0.000s
I20260616 19:51:59.217132 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 373) took 1295 ms. Trace:
I20260616 19:51:59.219408 1628 raft_consensus.cc:515] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.220224 1383 raft_consensus.cc:493] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.220364 1383 raft_consensus.cc:515] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.220628 1628 leader_election.cc:290] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.220621 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af9bdceae184f8dbb9e5db67a11ee63" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:59.220974 924 raft_consensus.cc:3060] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.221113 1383 leader_election.cc:290] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:59.221279 1383 raft_consensus.cc:493] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.221436 1383 raft_consensus.cc:515] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.221962 1383 leader_election.cc:290] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.223465 1198 tablet_bootstrap.cc:492] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.223634 1198 ts_tablet_manager.cc:1403] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.001s
I20260616 19:51:59.224201 924 raft_consensus.cc:2468] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:59.224445 1198 raft_consensus.cc:359] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.224653 1198 raft_consensus.cc:385] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.224716 1198 raft_consensus.cc:740] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.224944 1198 consensus_queue.cc:260] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.225464 1198 ts_tablet_manager.cc:1434] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:51:59.225754 993 leader_election.cc:304] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:59.225800 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da93e4052094862a44812990df1136a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:59.225980 923 raft_consensus.cc:2468] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:59.226001 1383 raft_consensus.cc:2804] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:59.226109 1383 raft_consensus.cc:697] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:59.226330 1383 consensus_queue.cc:237] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.226526 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f061d4bc90f42409eb99987059e6656" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:59.226707 924 raft_consensus.cc:2468] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:59.228647 993 leader_election.cc:304] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:59.228927 993 leader_election.cc:304] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:59.229233 1627 raft_consensus.cc:2804] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:59.229321 1627 raft_consensus.cc:493] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:59.229406 1627 raft_consensus.cc:3060] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.229689 1190 ts_tablet_manager.cc:1929] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.229838 1190 log.cc:1199] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/d61873c8aa094d7f899a61307a36f895
I20260616 19:51:59.230233 1190 ts_tablet_manager.cc:1950] T d61873c8aa094d7f899a61307a36f895 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:59.231134 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 286) took 2734 ms. Trace:
I20260616 19:51:59.231282 1190 rpcz_store.cc:276] 0616 19:51:56.496846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.496902 (+ 56us) service_pool.cc:224] Handling call
0616 19:51:58.979154 (+2482252us) ts_tablet_manager.cc:1151] Deleting tablet d61873c8aa094d7f899a61307a36f895
0616 19:51:58.979164 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.143161 (+163997us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.220867 (+ 77706us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.230883 (+ 10016us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3820,"tablet-delete.queue_time_us":2481997}
I20260616 19:51:59.231839 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet d61873c8aa094d7f899a61307a36f895 (table default.Table_6a6d8516df114593b27d86140407b724 [id=d104c5ac8acc4a6f9ed7cc87879d661b]) successfully deleted
I20260616 19:51:59.232056 1627 raft_consensus.cc:515] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.232205 1190 tablet_replica.cc:333] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:59.232393 1190 raft_consensus.cc:2243] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.232600 1190 raft_consensus.cc:2272] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.232613 1567 raft_consensus.cc:2804] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:59.232692 1567 raft_consensus.cc:493] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:59.232770 1567 raft_consensus.cc:3060] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.233172 1190 ts_tablet_manager.cc:1916] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.235275 1567 raft_consensus.cc:515] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.236012 1567 leader_election.cc:290] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.236655 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f061d4bc90f42409eb99987059e6656" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:59.236881 924 raft_consensus.cc:3060] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.236967 1627 leader_election.cc:290] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:59.237449 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da93e4052094862a44812990df1136a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:59.237619 923 raft_consensus.cc:3060] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.238292 1193 rpcz_store.cc:276] 0616 19:51:57.921902 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.921967 (+ 65us) service_pool.cc:224] Handling call
0616 19:51:59.216999 (+1295032us) ts_tablet_manager.cc:1151] Deleting tablet 9d800b4e2c2d42279c102e4e061f5530
0616 19:51:59.217008 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.217099 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1294839}
I20260616 19:51:59.238958 1196 tablet_bootstrap.cc:492] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:59.241019 923 raft_consensus.cc:2468] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
W20260616 19:51:59.241230 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 9d800b4e2c2d42279c102e4e061f5530 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d800b4e2c2d42279c102e4e061f5530 already in progress: creating tablet
I20260616 19:51:59.241465 993 leader_election.cc:304] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:59.241734 1627 raft_consensus.cc:2804] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:59.241886 1627 raft_consensus.cc:697] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:59.242164 1627 consensus_queue.cc:237] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.242441 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da93e4052094862a44812990df1136a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:59.242790 1193 tablet_replica.cc:333] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:51:59.243124 996 leader_election.cc:343] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.244534 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af9bdceae184f8dbb9e5db67a11ee63" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:51:59.245008 996 leader_election.cc:343] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.245728 1193 raft_consensus.cc:2243] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.245888 924 raft_consensus.cc:2468] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:59.246292 993 leader_election.cc:304] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:59.246564 1628 raft_consensus.cc:2804] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:59.246696 1628 raft_consensus.cc:697] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:59.246910 1628 consensus_queue.cc:237] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.251646 1193 raft_consensus.cc:2272] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.251674 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da93e4052094862a44812990df1136a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:59.244305 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f061d4bc90f42409eb99987059e6656" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:59.252171 778 raft_consensus.cc:2468] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
W20260616 19:51:59.252650 996 leader_election.cc:343] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.254441 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_08419ba303bb445eac997664503a70a7" } modify_external_catalogs: true
I20260616 19:51:59.254632 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_08419ba303bb445eac997664503a70a7" } modify_external_catalogs: true
I20260616 19:51:59.255681 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_98561738ee7d4ad8bf14170c99d01b96" } modify_external_catalogs: true
I20260616 19:51:59.255838 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_98561738ee7d4ad8bf14170c99d01b96" } modify_external_catalogs: true
I20260616 19:51:59.256637 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6c1f3c5fbc404e8bbdc316236d207917" } modify_external_catalogs: true
I20260616 19:51:59.256803 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6c1f3c5fbc404e8bbdc316236d207917" } modify_external_catalogs: true
W20260616 19:51:59.254695 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b7e2d8c25b8464b94ca386566abc2cc consensus state has no leader
I20260616 19:51:59.257539 454 master_service.cc:960] ReplaceTablet: received request to replace tablet aa72e00b0a3a423f96bdd7abb6013810 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:59.258234 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4a8926e8da30490abeb266622f644d74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:59.258581 1198 tablet_bootstrap.cc:492] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:51:59.258800 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a8926e8da30490abeb266622f644d74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.260167 1198 tablet_bootstrap.cc:654] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.260207 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c4f4a13f09cb47da8cb7a526f431e3c5" } new_table_name: "default.Table_fd6131fab4ae42b89b2d538da3b43a69" modify_external_catalogs: true
I20260616 19:51:59.244441 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f061d4bc90f42409eb99987059e6656" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:59.260486 1193 ts_tablet_manager.cc:1916] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.261593 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c3a414b8774445a4a731cbbfa3f171bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:59.261739 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_190bf8f13ab249eabed966a7a32bc222" } new_table_name: "default.Table_9b86a6539e534ff4a58c2c7ad01e99a0" modify_external_catalogs: true
W20260616 19:51:59.262094 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3a414b8774445a4a731cbbfa3f171bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.262208 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 776841d895d6431fbee76b7c4e28d973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.262442 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 99551210f5974332bf6a16ee74b220f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.262396 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6ecb544894454b0a88d26fa422cab3fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:59.262605 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bf54b260fc941599cffb12581e8116a with delete_type TABLET_DATA_DELETED (replaced by tablet 5c74b39e66d344b99f8fc75b855c0520) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.262754 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 362e7ff9bea3459ca018d1a7febb2ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet ca5dc1e6cde347fc9a34e555385dc646) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:59.262864 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ecb544894454b0a88d26fa422cab3fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.262897 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet d61873c8aa094d7f899a61307a36f895 with delete_type TABLET_DATA_DELETED (replaced by tablet 31592a5ffb04429c9315a4fd72308f28) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:59.263959 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 776841d895d6431fbee76b7c4e28d973 because the tablet was not found. No further retry: Not found: Tablet not found: 776841d895d6431fbee76b7c4e28d973
W20260616 19:51:59.264176 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 99551210f5974332bf6a16ee74b220f6 because the tablet was not found. No further retry: Not found: Tablet not found: 99551210f5974332bf6a16ee74b220f6
W20260616 19:51:59.264374 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0bf54b260fc941599cffb12581e8116a because the tablet was not found. No further retry: Not found: Tablet not found: 0bf54b260fc941599cffb12581e8116a
W20260616 19:51:59.264575 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 362e7ff9bea3459ca018d1a7febb2ce4 because the tablet was not found. No further retry: Not found: Tablet not found: 362e7ff9bea3459ca018d1a7febb2ce4
W20260616 19:51:59.264757 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d61873c8aa094d7f899a61307a36f895 because the tablet was not found. No further retry: Not found: Tablet not found: d61873c8aa094d7f899a61307a36f895
I20260616 19:51:59.268432 1196 tablet_bootstrap.cc:654] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.268643 780 raft_consensus.cc:3060] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.268714 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 90bc7409e31043bd9f47d3628278a2fa
I20260616 19:51:59.269459 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ec5cab88a5f44540b0d789bd2543b79a" } new_table_name: "default.Table_edb542c197924a81a6ae1a4a8a16f34a" modify_external_catalogs: true
I20260616 19:51:59.272097 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 90bc7409e31043bd9f47d3628278a2fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:59.272826 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 90bc7409e31043bd9f47d3628278a2fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90bc7409e31043bd9f47d3628278a2fa already in progress: creating tablet
I20260616 19:51:59.273191 780 raft_consensus.cc:2468] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:59.273610 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 90bc7409e31043bd9f47d3628278a2fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.279343 1193 ts_tablet_manager.cc:1929] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.279485 1193 log.cc:1199] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/97afcb75fdc2440d913ad421534a4ef3
I20260616 19:51:59.279906 1193 ts_tablet_manager.cc:1950] T 97afcb75fdc2440d913ad421534a4ef3 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.283414 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 90bc7409e31043bd9f47d3628278a2fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.284412 1192 tablet_bootstrap.cc:492] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:59.284580 1192 ts_tablet_manager.cc:1403] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.249s user 0.002s sys 0.009s
I20260616 19:51:59.288830 1192 raft_consensus.cc:359] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.289011 1192 raft_consensus.cc:385] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.289167 1192 raft_consensus.cc:740] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.289434 1192 consensus_queue.cc:260] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.291678 1192 ts_tablet_manager.cc:1434] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260616 19:51:59.292016 1192 tablet_bootstrap.cc:492] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:59.292786 1198 tablet_bootstrap.cc:492] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.292840 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 375) took 1340 ms. Trace:
I20260616 19:51:59.293053 1198 ts_tablet_manager.cc:1403] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.003s
I20260616 19:51:59.292946 1193 rpcz_store.cc:276] 0616 19:51:57.952826 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.952875 (+ 49us) service_pool.cc:224] Handling call
0616 19:51:59.238613 (+1285738us) ts_tablet_manager.cc:1151] Deleting tablet 97afcb75fdc2440d913ad421534a4ef3
0616 19:51:59.238626 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.276557 (+ 37931us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.279281 (+ 2724us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.292777 (+ 13496us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1285559}
I20260616 19:51:59.293273 1196 tablet_bootstrap.cc:492] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.293421 1196 ts_tablet_manager.cc:1403] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.076s user 0.004s sys 0.000s
I20260616 19:51:59.293473 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 97afcb75fdc2440d913ad421534a4ef3 (table default.Table_2d821dc335024cba9f1635d15a76a3b9 [id=475a74cfa2ba41998c3ba29ce388cdc8]) successfully deleted
I20260616 19:51:59.294200 1198 raft_consensus.cc:359] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.294209 1196 raft_consensus.cc:359] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.294371 1196 raft_consensus.cc:385] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.294369 1198 raft_consensus.cc:385] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.294458 1196 raft_consensus.cc:740] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.294457 1198 raft_consensus.cc:740] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.294767 1198 consensus_queue.cc:260] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.294709 1196 consensus_queue.cc:260] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.295382 1198 ts_tablet_manager.cc:1434] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:51:59.295657 1196 ts_tablet_manager.cc:1434] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:51:59.295678 1198 tablet_bootstrap.cc:492] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.296599 1192 tablet_bootstrap.cc:654] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.296988 1196 tablet_bootstrap.cc:492] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:59.298592 1196 tablet_bootstrap.cc:654] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.301906 1193 tablet_replica.cc:333] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:59.302141 1193 raft_consensus.cc:2243] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.302525 1190 ts_tablet_manager.cc:1929] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.302662 1190 log.cc:1199] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/5c90188c0181467ea3deee14fa5568b3
I20260616 19:51:59.303035 1190 ts_tablet_manager.cc:1950] T 5c90188c0181467ea3deee14fa5568b3 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:59.303579 1193 raft_consensus.cc:2272] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.307531 1198 tablet_bootstrap.cc:654] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.310024 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 287) took 2812 ms. Trace:
I20260616 19:51:59.310184 1196 tablet_bootstrap.cc:492] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.310166 1190 rpcz_store.cc:276] 0616 19:51:56.497406 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.497456 (+ 50us) service_pool.cc:224] Handling call
0616 19:51:59.232125 (+2734669us) ts_tablet_manager.cc:1151] Deleting tablet 5c90188c0181467ea3deee14fa5568b3
0616 19:51:59.232134 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.249047 (+ 16913us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.302420 (+ 53373us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.309984 (+ 7564us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2734433}
I20260616 19:51:59.310348 1196 ts_tablet_manager.cc:1403] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260616 19:51:59.310628 1193 ts_tablet_manager.cc:1916] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.310678 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 5c90188c0181467ea3deee14fa5568b3 (table default.Table_fce6c0a420e74d889b4665e221e3c559 [id=0d6caa2121db47609b15d8b087a3752a]) successfully deleted
I20260616 19:51:59.313035 1192 tablet_bootstrap.cc:492] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:59.313278 1192 ts_tablet_manager.cc:1403] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.004s
I20260616 19:51:59.314133 1192 raft_consensus.cc:359] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.314410 1192 raft_consensus.cc:385] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.314532 1192 raft_consensus.cc:740] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.314858 1192 consensus_queue.cc:260] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.317178 1192 ts_tablet_manager.cc:1434] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260616 19:51:59.317111 1196 raft_consensus.cc:359] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.317315 1196 raft_consensus.cc:385] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.317409 1196 raft_consensus.cc:740] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.317714 1192 tablet_bootstrap.cc:492] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:59.317682 1196 consensus_queue.cc:260] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.318229 1196 ts_tablet_manager.cc:1434] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260616 19:51:59.323359 1628 raft_consensus.cc:493] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.323515 1628 raft_consensus.cc:515] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.323791 1198 tablet_bootstrap.cc:492] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.323942 1198 ts_tablet_manager.cc:1403] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.002s
I20260616 19:51:59.324229 1628 leader_election.cc:290] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.324615 1196 tablet_bootstrap.cc:492] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:59.324752 1198 raft_consensus.cc:359] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.324797 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7f591d97bc4571b294b06d990d4065" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:59.324925 1198 raft_consensus.cc:385] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.324991 1198 raft_consensus.cc:740] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.325242 1198 consensus_queue.cc:260] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.325852 1198 ts_tablet_manager.cc:1434] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260616 19:51:59.325979 993 leader_election.cc:343] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.326174 1198 tablet_bootstrap.cc:492] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.326709 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7f591d97bc4571b294b06d990d4065" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:59.327195 461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_805133e8e07b40a8a2e8a326ac7991ab [id=122f88b500c0425e833926b349605d6f] alter complete (version 4)
W20260616 19:51:59.327244 996 leader_election.cc:343] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.327354 996 leader_election.cc:304] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:59.327724 1190 tablet_replica.cc:333] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:59.327841 1628 raft_consensus.cc:2749] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:59.327934 1190 raft_consensus.cc:2243] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:59.328300 1190 pending_rounds.cc:70] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:51:59.328387 1190 pending_rounds.cc:77] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595460527972352 op_type: NO_OP noop_request { }
I20260616 19:51:59.328517 1190 raft_consensus.cc:2889] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:59.328645 1190 raft_consensus.cc:2272] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.329160 1190 ts_tablet_manager.cc:1916] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.329999 1198 tablet_bootstrap.cc:654] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.331732 1192 tablet_bootstrap.cc:654] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.332378 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ba0d3e7da3c74f5ea5dc4aac80a01c82
I20260616 19:51:59.333268 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.333375 747 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:59.334143 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 already in progress: creating tablet
I20260616 19:51:59.336289 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 19832d0517524c0facf1f97486b1e58e with delete_type TABLET_DATA_DELETED (replaced by tablet 9c77fd138ce9463b8f2d6f4182a56559) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.336522 746 tablet_service.cc:1558] Processing DeleteTablet for tablet db75a5169c0b4650a551b8a76a724469 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.336673 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f061d4bc90f42409eb99987059e6656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.337702 891 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.339771 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 362e7ff9bea3459ca018d1a7febb2ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet ca5dc1e6cde347fc9a34e555385dc646) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.340013 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bf54b260fc941599cffb12581e8116a with delete_type TABLET_DATA_DELETED (replaced by tablet 5c74b39e66d344b99f8fc75b855c0520) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.342300 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a04ece9647b14e4d9cb0d5f5557cc8b4" } modify_external_catalogs: true
I20260616 19:51:59.342502 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a04ece9647b14e4d9cb0d5f5557cc8b4" } modify_external_catalogs: true
I20260616 19:51:59.343081 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 99551210f5974332bf6a16ee74b220f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.343243 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cfb2238cbdb421a8f5001dc729e9bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.345093 1196 tablet_bootstrap.cc:654] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:59.349412 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b57bceabff64533ae3a49b8afda614d consensus state has no leader
I20260616 19:51:59.349747 459 master_service.cc:960] ReplaceTablet: received request to replace tablet 335f7411fda84fada762345010a4339c from {username='slave'} at 127.0.0.1:41696
W20260616 19:51:59.349897 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1a95eafa064b4b95b5281915ea5bd9f7 consensus state has no leader
I20260616 19:51:59.350138 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 75c08452aeec471f8480a489620cca28 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:59.351421 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 43b4c3bd370749b18fb86f7a0aae2c50 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:59.351898 456 master_service.cc:960] ReplaceTablet: received request to replace tablet cbd1070277a14fd98af5fa45925e4f0f from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:59.352535 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_08f38f9cab7848f598534ba789a70755"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.353107 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08f38f9cab7848f598534ba789a70755 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.358038 1193 ts_tablet_manager.cc:1929] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.358174 1193 log.cc:1199] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/bb2fdea2d4ab42708fcd3102ea54bdb6
I20260616 19:51:59.358529 1193 ts_tablet_manager.cc:1950] T bb2fdea2d4ab42708fcd3102ea54bdb6 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.359266 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 376) took 1406 ms. Trace:
I20260616 19:51:59.359391 1193 rpcz_store.cc:276] 0616 19:51:57.953211 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.953256 (+ 45us) service_pool.cc:224] Handling call
0616 19:51:59.301820 (+1348564us) ts_tablet_manager.cc:1151] Deleting tablet bb2fdea2d4ab42708fcd3102ea54bdb6
0616 19:51:59.301829 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.315578 (+ 13749us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.357937 (+ 42359us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.359230 (+ 1293us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1348383}
I20260616 19:51:59.359826 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet bb2fdea2d4ab42708fcd3102ea54bdb6 (table default.Table_baf21e2369ea4aa6aa6cbf2370be11b9 [id=bb9e8ac09e824ad58ba1ce8f021968a1]) successfully deleted
I20260616 19:51:59.361436 1198 tablet_bootstrap.cc:492] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.361622 1198 ts_tablet_manager.cc:1403] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.003s
I20260616 19:51:59.362665 1198 raft_consensus.cc:359] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.362838 1198 raft_consensus.cc:385] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.362923 1198 raft_consensus.cc:740] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.363497 1193 tablet_replica.cc:333] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:59.363741 1193 raft_consensus.cc:2243] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.363140 1198 consensus_queue.cc:260] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.364604 1198 ts_tablet_manager.cc:1434] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:51:59.364943 1198 tablet_bootstrap.cc:492] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.365569 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_48f9006fbde142939710d3c240a45bee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.366223 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48f9006fbde142939710d3c240a45bee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.370888 1198 tablet_bootstrap.cc:654] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.371585 1193 raft_consensus.cc:2272] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.372190 1193 ts_tablet_manager.cc:1916] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.375937 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_841219ea0cab496193e59d354a6ab57f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.376518 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_841219ea0cab496193e59d354a6ab57f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.381054 1198 tablet_bootstrap.cc:492] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.381246 1198 ts_tablet_manager.cc:1403] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260616 19:51:59.381843 1192 tablet_bootstrap.cc:492] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:59.382056 1192 ts_tablet_manager.cc:1403] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.001s
I20260616 19:51:59.382081 1198 raft_consensus.cc:359] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.382323 1198 raft_consensus.cc:385] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.382421 1198 raft_consensus.cc:740] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.382766 1198 consensus_queue.cc:260] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.383409 1192 raft_consensus.cc:359] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.383622 1192 raft_consensus.cc:385] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.383752 1192 raft_consensus.cc:740] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.384050 1192 consensus_queue.cc:260] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.384852 1198 ts_tablet_manager.cc:1434] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260616 19:51:59.385161 1198 tablet_bootstrap.cc:492] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.388655 1198 tablet_bootstrap.cc:654] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.393846 1192 ts_tablet_manager.cc:1434] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260616 19:51:59.397321 1192 tablet_bootstrap.cc:492] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:59.399297 1192 tablet_bootstrap.cc:654] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.401171 1193 ts_tablet_manager.cc:1929] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.401341 1193 log.cc:1199] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/31d22240d294454cbeb2ca5b07d45273
I20260616 19:51:59.401674 1193 ts_tablet_manager.cc:1950] T 31d22240d294454cbeb2ca5b07d45273 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.402467 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 377) took 1348 ms. Trace:
I20260616 19:51:59.402571 1193 rpcz_store.cc:276] 0616 19:51:58.054250 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.054309 (+ 59us) service_pool.cc:224] Handling call
0616 19:51:59.363420 (+1309111us) ts_tablet_manager.cc:1151] Deleting tablet 31d22240d294454cbeb2ca5b07d45273
0616 19:51:59.363429 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.389356 (+ 25927us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.392411 (+ 3055us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.402405 (+ 9994us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7604,"tablet-delete.queue_time_us":1308859}
I20260616 19:51:59.403015 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 31d22240d294454cbeb2ca5b07d45273 (table default.Table_41371955e37644fda9a23d0fba091c86 [id=3f2766ea54a141eb84ccb6625a0d04b6]) successfully deleted
I20260616 19:51:59.404099 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7a2e5bc2c47746e88e95634fb073273e
I20260616 19:51:59.404940 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a2e5bc2c47746e88e95634fb073273e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.405148 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a2e5bc2c47746e88e95634fb073273e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:59.406062 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 7a2e5bc2c47746e88e95634fb073273e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a2e5bc2c47746e88e95634fb073273e already in progress: creating tablet
I20260616 19:51:59.410398 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a7f1e25312e1460dae26b68c9dc6e727"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.411006 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7f1e25312e1460dae26b68c9dc6e727 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.412343 1196 tablet_bootstrap.cc:492] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.412564 1196 ts_tablet_manager.cc:1403] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.088s user 0.006s sys 0.005s
I20260616 19:51:59.413228 1198 tablet_bootstrap.cc:492] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.413376 1198 ts_tablet_manager.cc:1403] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.001s
I20260616 19:51:59.413396 1196 raft_consensus.cc:359] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.413575 1196 raft_consensus.cc:385] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.413677 1196 raft_consensus.cc:740] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.413807 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 4fc0c02ef58d4e429855e5bbaa4752ad
I20260616 19:51:59.413910 1196 consensus_queue.cc:260] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.414433 1196 ts_tablet_manager.cc:1434] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:51:59.412570 1193 tablet_replica.cc:333] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:59.414687 1193 raft_consensus.cc:2243] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.414623 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_39d47e28935346aa86153d1c60006361"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:59.414865 1193 raft_consensus.cc:2272] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:51:59.415171 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39d47e28935346aa86153d1c60006361 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.415355 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc0c02ef58d4e429855e5bbaa4752ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.415412 1193 ts_tablet_manager.cc:1916] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.415922 1196 tablet_bootstrap.cc:492] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:59.424322 1196 tablet_bootstrap.cc:654] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.425777 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 54eb61046c954a36a036b24e9e16b5c4
I20260616 19:51:59.426810 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 54eb61046c954a36a036b24e9e16b5c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.428130 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ade11253e88d413db148bcee7283260d" } new_table_name: "default.Table_91fa1a22ad84466890a2c7ed02a873c0" modify_external_catalogs: true
I20260616 19:51:59.428236 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 21eb01a4b2424d63affa5d9d71e2fa64 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e7e298c8e374f46aecbb0711760c06c) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.406422 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a2e5bc2c47746e88e95634fb073273e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.416543 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc0c02ef58d4e429855e5bbaa4752ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.426805 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 54eb61046c954a36a036b24e9e16b5c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.437496 1190 ts_tablet_manager.cc:1929] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:59.437496 1193 ts_tablet_manager.cc:1929] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:51:59.437639 1190 log.cc:1199] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/21eb01a4b2424d63affa5d9d71e2fa64
I20260616 19:51:59.437659 1193 log.cc:1199] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/776841d895d6431fbee76b7c4e28d973
I20260616 19:51:59.438086 1193 ts_tablet_manager.cc:1950] T 776841d895d6431fbee76b7c4e28d973 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.438098 1190 ts_tablet_manager.cc:1950] T 21eb01a4b2424d63affa5d9d71e2fa64 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:59.438898 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 392) took 1234 ms. Trace:
I20260616 19:51:59.438899 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 288) took 2940 ms. Trace:
I20260616 19:51:59.439028 1190 rpcz_store.cc:276] 0616 19:51:56.498201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.498248 (+ 47us) service_pool.cc:224] Handling call
0616 19:51:59.327664 (+2829416us) ts_tablet_manager.cc:1151] Deleting tablet 21eb01a4b2424d63affa5d9d71e2fa64
0616 19:51:59.327673 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.370584 (+ 42911us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.437394 (+ 66810us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.438862 (+ 1468us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2829227}
I20260616 19:51:59.439028 1193 rpcz_store.cc:276] 0616 19:51:58.204027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.204105 (+ 78us) service_pool.cc:224] Handling call
0616 19:51:59.412450 (+1208345us) ts_tablet_manager.cc:1151] Deleting tablet 776841d895d6431fbee76b7c4e28d973
0616 19:51:59.412482 (+ 32us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.426667 (+ 14185us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.437394 (+ 10727us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.438856 (+ 1462us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1208091}
I20260616 19:51:59.439395 1190 tablet_replica.cc:333] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:59.439563 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 776841d895d6431fbee76b7c4e28d973 (table default.Table_ebec5e10f80244469fca70fe48c270e8 [id=4d2238911f8d432095e4a20ee0dc6217]) successfully deleted
I20260616 19:51:59.439616 1190 raft_consensus.cc:2243] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:59.439640 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 21eb01a4b2424d63affa5d9d71e2fa64 (table default.Table_873136a2abfb41018a2cec78a9f5fbc9 [id=1938e4f4794c4c3ebd2ea294477e38cd]) successfully deleted
I20260616 19:51:59.444942 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 75c08452aeec471f8480a489620cca28
I20260616 19:51:59.445583 452 catalog_manager.cc:6784] ReplaceTablet: tablet 75c08452aeec471f8480a489620cca28 deleted and replaced by tablet 12944efb54824dc4960db5d09c1a1684
I20260616 19:51:59.446090 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c08452aeec471f8480a489620cca28 with delete_type TABLET_DATA_DELETED (replaced by tablet 12944efb54824dc4960db5d09c1a1684) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.446404 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 393) took 1242 ms. Trace:
I20260616 19:51:59.446985 1193 rpcz_store.cc:276] 0616 19:51:58.204151 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.204200 (+ 49us) service_pool.cc:224] Handling call
0616 19:51:59.446233 (+1242033us) ts_tablet_manager.cc:1151] Deleting tablet c48314f8e45d4b198306f0ae6e40def7
0616 19:51:59.446244 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.446368 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1241795}
W20260616 19:51:59.447484 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c48314f8e45d4b198306f0ae6e40def7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c48314f8e45d4b198306f0ae6e40def7 already in progress: creating tablet
I20260616 19:51:59.448207 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 390) took 1244 ms. Trace:
I20260616 19:51:59.449569 1193 rpcz_store.cc:276] 0616 19:51:58.203783 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.207971 (+ 4188us) service_pool.cc:224] Handling call
0616 19:51:59.448074 (+1240103us) ts_tablet_manager.cc:1151] Deleting tablet 2e316e44693d473dad901eeb95299988
0616 19:51:59.448085 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.448174 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1239523}
W20260616 19:51:59.450392 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2e316e44693d473dad901eeb95299988 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e316e44693d473dad901eeb95299988 already in progress: creating tablet
I20260616 19:51:59.416994 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc0c02ef58d4e429855e5bbaa4752ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.428996 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 54eb61046c954a36a036b24e9e16b5c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.451500 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c08452aeec471f8480a489620cca28 with delete_type TABLET_DATA_DELETED (replaced by tablet 12944efb54824dc4960db5d09c1a1684) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.450858 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 391) took 1246 ms. Trace:
I20260616 19:51:59.451880 1193 rpcz_store.cc:276] 0616 19:51:58.203916 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.211379 (+ 7463us) service_pool.cc:224] Handling call
0616 19:51:59.450720 (+1239341us) ts_tablet_manager.cc:1151] Deleting tablet af5e277102b8480db44e5ffe88267808
0616 19:51:59.450730 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.450817 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1239153}
W20260616 19:51:59.452286 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet af5e277102b8480db44e5ffe88267808 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af5e277102b8480db44e5ffe88267808 already in progress: creating tablet
I20260616 19:51:59.436167 1628 raft_consensus.cc:493] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.452575 1628 raft_consensus.cc:515] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.453245 1628 leader_election.cc:290] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.454341 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb04ccc26e64484a9a29c515d4b954fe" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:59.451205 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c08452aeec471f8480a489620cca28 with delete_type TABLET_DATA_DELETED (replaced by tablet 12944efb54824dc4960db5d09c1a1684) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:59.455330 993 leader_election.cc:343] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.452972 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 389) took 1249 ms. Trace:
I20260616 19:51:59.455612 1193 rpcz_store.cc:276] 0616 19:51:58.203588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.221187 (+ 17599us) service_pool.cc:224] Handling call
0616 19:51:59.452846 (+1231659us) ts_tablet_manager.cc:1151] Deleting tablet d9c664f0386549d6867c407526ee45a0
0616 19:51:59.452855 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.452941 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1231416}
I20260616 19:51:59.455987 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 397) took 1177 ms. Trace:
I20260616 19:51:59.456094 1193 rpcz_store.cc:276] 0616 19:51:58.278622 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.280591 (+ 1969us) service_pool.cc:224] Handling call
0616 19:51:59.455848 (+1175257us) ts_tablet_manager.cc:1151] Deleting tablet 23f280b9ea1147799635f8a6199f17c0
0616 19:51:59.455859 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.455955 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1172554}
W20260616 19:51:59.456821 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d9c664f0386549d6867c407526ee45a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9c664f0386549d6867c407526ee45a0 already in progress: creating tablet
W20260616 19:51:59.457062 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 23f280b9ea1147799635f8a6199f17c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23f280b9ea1147799635f8a6199f17c0 already in progress: creating tablet
W20260616 19:51:59.458165 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 4fc0c02ef58d4e429855e5bbaa4752ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fc0c02ef58d4e429855e5bbaa4752ad already in progress: creating tablet
W20260616 19:51:59.458411 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 54eb61046c954a36a036b24e9e16b5c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54eb61046c954a36a036b24e9e16b5c4 already in progress: creating tablet
I20260616 19:51:59.459239 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f97daa87d0d94205896e1f600ff0ef8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.459715 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 75c08452aeec471f8480a489620cca28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75c08452aeec471f8480a489620cca28 already in progress: creating tablet
W20260616 19:51:59.459800 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f97daa87d0d94205896e1f600ff0ef8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.414149 1198 raft_consensus.cc:359] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.460011 1198 raft_consensus.cc:385] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.460592 1198 raft_consensus.cc:740] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.460816 1198 consensus_queue.cc:260] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.461514 1198 ts_tablet_manager.cc:1434] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.048s user 0.000s sys 0.003s
I20260616 19:51:59.456445 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 398) took 1164 ms. Trace:
I20260616 19:51:59.457333 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb04ccc26e64484a9a29c515d4b954fe" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:59.462431 1193 rpcz_store.cc:276] 0616 19:51:58.291917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.293519 (+ 1602us) service_pool.cc:224] Handling call
0616 19:51:59.456306 (+1162787us) ts_tablet_manager.cc:1151] Deleting tablet 610d6197e35e447ea25cdba2cc454b8d
0616 19:51:59.456315 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.456408 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1156377}
W20260616 19:51:59.462951 996 leader_election.cc:343] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.463068 996 leader_election.cc:304] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:59.463302 1628 raft_consensus.cc:2749] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:51:59.463474 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 610d6197e35e447ea25cdba2cc454b8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 610d6197e35e447ea25cdba2cc454b8d already in progress: creating tablet
I20260616 19:51:59.464385 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 415) took 1007 ms. Trace:
I20260616 19:51:59.464882 1193 rpcz_store.cc:276] 0616 19:51:58.456609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.456823 (+ 214us) service_pool.cc:224] Handling call
0616 19:51:59.464231 (+1007408us) ts_tablet_manager.cc:1151] Deleting tablet 43b4c3bd370749b18fb86f7a0aae2c50
0616 19:51:59.464242 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.464344 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1007200}
W20260616 19:51:59.465312 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 43b4c3bd370749b18fb86f7a0aae2c50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43b4c3bd370749b18fb86f7a0aae2c50 already in progress: creating tablet
I20260616 19:51:59.465924 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 416) took 1009 ms. Trace:
I20260616 19:51:59.466028 1193 rpcz_store.cc:276] 0616 19:51:58.456768 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.457070 (+ 302us) service_pool.cc:224] Handling call
0616 19:51:59.465792 (+1008722us) ts_tablet_manager.cc:1151] Deleting tablet c7f724dc23024a7297cfb8689f199600
0616 19:51:59.465802 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.465880 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1008560}
W20260616 19:51:59.466420 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c7f724dc23024a7297cfb8689f199600 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7f724dc23024a7297cfb8689f199600 already in progress: creating tablet
I20260616 19:51:59.467233 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 420) took 1006 ms. Trace:
I20260616 19:51:59.467340 1193 rpcz_store.cc:276] 0616 19:51:58.460994 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.658190 (+197196us) service_pool.cc:224] Handling call
0616 19:51:59.467099 (+808909us) ts_tablet_manager.cc:1151] Deleting tablet e3c4e584fad94633ae49332872de0fc3
0616 19:51:59.467108 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.467198 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":807081}
W20260616 19:51:59.467731 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet e3c4e584fad94633ae49332872de0fc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3c4e584fad94633ae49332872de0fc3 already in progress: creating tablet
W20260616 19:51:59.468798 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet fab8282287434bf8b7e37f008a1b0166 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fab8282287434bf8b7e37f008a1b0166 already in progress: creating tablet
I20260616 19:51:59.469261 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_014502e208f04aa69b455d4a2fea43e4" } new_table_name: "default.Table_e538b8e003e64be28e91618c3e6a30cf" modify_external_catalogs: true
W20260616 19:51:59.469594 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 90bc7409e31043bd9f47d3628278a2fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90bc7409e31043bd9f47d3628278a2fa already in progress: creating tablet
W20260616 19:51:59.470355 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 already in progress: creating tablet
I20260616 19:51:59.470875 1193 tablet_replica.cc:333] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:59.471084 1193 raft_consensus.cc:2243] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.471736 1193 raft_consensus.cc:2272] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.472114 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_131945fffea34b6bb6a08d2a11f7c486"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:59.472540 1193 ts_tablet_manager.cc:1916] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:51:59.472651 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_131945fffea34b6bb6a08d2a11f7c486 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.481155 1193 ts_tablet_manager.cc:1929] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.481307 1193 log.cc:1199] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/19832d0517524c0facf1f97486b1e58e
I20260616 19:51:59.481681 1193 ts_tablet_manager.cc:1950] T 19832d0517524c0facf1f97486b1e58e P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.482926 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 19832d0517524c0facf1f97486b1e58e (table default.Table_b34131cb606f45af969cab4e285a435c [id=f26741a3387e47f2905c06b1d7eecb17]) successfully deleted
I20260616 19:51:59.483258 1193 tablet_replica.cc:333] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:59.483440 1193 raft_consensus.cc:2243] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.483628 1193 raft_consensus.cc:2272] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.485112 1193 ts_tablet_manager.cc:1916] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.490290 1198 tablet_bootstrap.cc:492] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.490571 1196 tablet_bootstrap.cc:492] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.490742 1196 ts_tablet_manager.cc:1403] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.075s user 0.005s sys 0.008s
I20260616 19:51:59.491482 1196 raft_consensus.cc:359] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.491704 1196 raft_consensus.cc:385] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.491768 1196 raft_consensus.cc:740] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.492002 1198 tablet_bootstrap.cc:654] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.492022 1196 consensus_queue.cc:260] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.495637 1196 ts_tablet_manager.cc:1434] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260616 19:51:59.495985 1196 tablet_bootstrap.cc:492] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:59.501507 1612 tablet.cc:1724] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:51:59.502496 1458 raft_consensus.cc:493] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.502684 1458 raft_consensus.cc:515] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.504002 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_120e5c908fe348a7ab3ff54504e841ec" } modify_external_catalogs: true
I20260616 19:51:59.504197 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_120e5c908fe348a7ab3ff54504e841ec" } modify_external_catalogs: true
I20260616 19:51:59.505790 1192 tablet_bootstrap.cc:492] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:59.506035 1192 ts_tablet_manager.cc:1403] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.109s user 0.003s sys 0.000s
I20260616 19:51:59.506884 1192 raft_consensus.cc:359] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.507162 1192 raft_consensus.cc:385] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.507302 1192 raft_consensus.cc:740] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.507710 1192 consensus_queue.cc:260] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.507913 1680 tablet.cc:1724] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:51:59.508397 1192 ts_tablet_manager.cc:1434] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:59.508785 1192 tablet_bootstrap.cc:492] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:59.510398 1628 raft_consensus.cc:493] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.510596 1628 raft_consensus.cc:515] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.511462 1628 leader_election.cc:290] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.518182 1198 tablet_bootstrap.cc:492] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.520126 1198 ts_tablet_manager.cc:1403] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.002s
I20260616 19:51:59.521373 458 master_service.cc:960] ReplaceTablet: received request to replace tablet 19b9248b88434a6e9ef7a3d602eee70c from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:59.523977 1198 raft_consensus.cc:359] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.524183 1198 raft_consensus.cc:385] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.524252 1198 raft_consensus.cc:740] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.519634 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122a8b15e62f4b23b465e2dbc816df62" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:51:59.524566 1057 raft_consensus.cc:2468] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:51:59.525450 1198 consensus_queue.cc:260] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.526119 1198 ts_tablet_manager.cc:1434] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:51:59.526423 1196 tablet_bootstrap.cc:654] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.526978 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc92bc15da14504a1ff5feda5aff7cf" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:51:59.527560 996 leader_election.cc:343] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.528152 1198 tablet_bootstrap.cc:492] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.529219 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122a8b15e62f4b23b465e2dbc816df62" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:59.531244 1198 tablet_bootstrap.cc:654] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:59.535815 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c consensus state has no leader
I20260616 19:51:59.537688 1193 ts_tablet_manager.cc:1929] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.537842 1193 log.cc:1199] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/db75a5169c0b4650a551b8a76a724469
I20260616 19:51:59.538282 1193 ts_tablet_manager.cc:1950] T db75a5169c0b4650a551b8a76a724469 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.539659 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet db75a5169c0b4650a551b8a76a724469 (table default.Table_be0f2a85266c49789e5476fc2f376467 [id=7a7fd9801283464ea1f9ac454219c3d4]) successfully deleted
I20260616 19:51:59.540030 1193 tablet_replica.cc:333] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:59.545185 1198 tablet_bootstrap.cc:492] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.545333 1198 ts_tablet_manager.cc:1403] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.003s
I20260616 19:51:59.546044 1198 raft_consensus.cc:359] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.546229 1198 raft_consensus.cc:385] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.546324 1198 raft_consensus.cc:740] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.546564 1198 consensus_queue.cc:260] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.547154 1198 ts_tablet_manager.cc:1434] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:59.547434 1198 tablet_bootstrap.cc:492] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.549546 1198 tablet_bootstrap.cc:654] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.554466 1198 tablet_bootstrap.cc:492] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.555199 1198 ts_tablet_manager.cc:1403] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.004s
I20260616 19:51:59.555907 1198 raft_consensus.cc:359] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.556088 1198 raft_consensus.cc:385] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.556165 1198 raft_consensus.cc:740] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.556402 1198 consensus_queue.cc:260] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.558552 1198 ts_tablet_manager.cc:1434] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:51:59.558686 1193 raft_consensus.cc:2243] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.558849 1198 tablet_bootstrap.cc:492] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.558900 1193 raft_consensus.cc:2272] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.559856 1193 ts_tablet_manager.cc:1916] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.560789 1198 tablet_bootstrap.cc:654] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.564929 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_010bd6ff844d4227b21111bb4499d70b" } modify_external_catalogs: true
I20260616 19:51:59.565203 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_010bd6ff844d4227b21111bb4499d70b" } modify_external_catalogs: true
I20260616 19:51:59.571538 1198 tablet_bootstrap.cc:492] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.571686 1198 ts_tablet_manager.cc:1403] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260616 19:51:59.572422 1198 raft_consensus.cc:359] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.572611 1198 raft_consensus.cc:385] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.572702 1198 raft_consensus.cc:740] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.572902 1198 consensus_queue.cc:260] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.575459 1198 ts_tablet_manager.cc:1434] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260616 19:51:59.575762 1198 tablet_bootstrap.cc:492] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.580395 1198 tablet_bootstrap.cc:654] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.584584 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet d51a6fb4c49e461583a5aba1813b2a3e (table default.Table_b3d1ae6133974de8942b6f6a2ae9f310 [id=2d4376cceca648ef87dcf561d1e9e701]). Expected version 1 got 0
I20260616 19:51:59.585400 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2306f75ff05f40bb85834153623949eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.585945 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2306f75ff05f40bb85834153623949eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.588833 455 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]). Expected version 1 got 0
I20260616 19:51:59.589025 455 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet d51a6fb4c49e461583a5aba1813b2a3e (table default.Table_b3d1ae6133974de8942b6f6a2ae9f310 [id=2d4376cceca648ef87dcf561d1e9e701]). Expected version 1 got 0
I20260616 19:51:59.589644 858 leader_election.cc:304] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:51:59.589908 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 64779.3us
I20260616 19:51:59.590006 1026 tablet_service.cc:1511] Processing CreateTablet for tablet c6be4a4739464be7b246a54b7a33adaf (DEFAULT_TABLE table=default.Table_dd8ccdd722484ba5b6d855c64e825279 [id=c0e43fceb55041279bc9f2b415224da8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.590372 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6be4a4739464be7b246a54b7a33adaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.591320 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ac81df7bd9eb47678440fa3b7b932946" } new_table_name: "default.Table_b6f1fb47223d447fb0c0eed0f8b52102" modify_external_catalogs: true
I20260616 19:51:59.591526 1678 raft_consensus.cc:2804] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:59.591637 1678 raft_consensus.cc:493] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:59.591750 1678 raft_consensus.cc:3060] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.592751 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 7dafeb24a59948b28e26730194e29758 (DEFAULT_TABLE table=default.Table_333a3cd8e7d247e7b113f715a2f14955 [id=4be67567b99a44958944933980bbfab3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.593072 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dafeb24a59948b28e26730194e29758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.594667 1678 raft_consensus.cc:515] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.595914 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122a8b15e62f4b23b465e2dbc816df62" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:51:59.596102 1057 raft_consensus.cc:3060] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.596639 1458 leader_election.cc:290] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.596747 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 0884b33082b242e4bb2ae7d53a2b3e29 (DEFAULT_TABLE table=default.Table_87572bccfe72485c994560d15596febe [id=23cfe5608fd743e9b8eeed8e8eca7779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.597064 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0884b33082b242e4bb2ae7d53a2b3e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.598160 461 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 122a8b15e62f4b23b465e2dbc816df62 (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]). Expected version 2 got 0
I20260616 19:51:59.598362 461 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 2c31c8e977da4a70bca1beb00f364627 (table default.Table_9e98175df9ce48a59cb42b1e48cd7fba [id=cb4c50d05fdd4c0a85828222eeb0f06a]). Expected version 1 got 0
W20260616 19:51:59.599308 461 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 122a8b15e62f4b23b465e2dbc816df62 (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 122a8b15e62f4b23b465e2dbc816df62 consensus state has no leader
I20260616 19:51:59.599871 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6a70be3041964598b68e745594423be8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:59.600234 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc92bc15da14504a1ff5feda5aff7cf" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:51:59.600392 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a70be3041964598b68e745594423be8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.600744 750 tablet_service.cc:1511] Processing CreateTablet for tablet b251bdf373574dffb04f9e2c837cfe78 (DEFAULT_TABLE table=default.Table_86e549fb88f34f51a867554c129f5d7b [id=df97d55b6c8d4f0c9e0359d8f4779150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.600919 747 tablet_service.cc:1511] Processing CreateTablet for tablet c6be4a4739464be7b246a54b7a33adaf (DEFAULT_TABLE table=default.Table_dd8ccdd722484ba5b6d855c64e825279 [id=c0e43fceb55041279bc9f2b415224da8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.601162 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b251bdf373574dffb04f9e2c837cfe78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.601256 924 raft_consensus.cc:2468] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:59.601404 746 tablet_service.cc:1511] Processing CreateTablet for tablet 7dafeb24a59948b28e26730194e29758 (DEFAULT_TABLE table=default.Table_333a3cd8e7d247e7b113f715a2f14955 [id=4be67567b99a44958944933980bbfab3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.601784 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dafeb24a59948b28e26730194e29758. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:59.601842 860 leader_election.cc:343] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.604478 758 tablet_service.cc:1511] Processing CreateTablet for tablet b29cc69fd5234becb09a0b73919b461c (DEFAULT_TABLE table=default.Table_c7617de287ff4770bb063b7ee633a61a [id=87238fcdc4114462bb14b2ca9fbc7438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.604701 759 tablet_service.cc:1511] Processing CreateTablet for tablet 0884b33082b242e4bb2ae7d53a2b3e29 (DEFAULT_TABLE table=default.Table_87572bccfe72485c994560d15596febe [id=23cfe5608fd743e9b8eeed8e8eca7779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.604796 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29cc69fd5234becb09a0b73919b461c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.605003 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0884b33082b242e4bb2ae7d53a2b3e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.610793 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6be4a4739464be7b246a54b7a33adaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.611408 1192 tablet_bootstrap.cc:654] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.613056 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122a8b15e62f4b23b465e2dbc816df62" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:59.609234 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_88815cb77f064a7d8c61564f6fe9458f" } new_table_name: "default.Table_8f93c0209c4d41ea9c714fe9ebed8588" modify_external_catalogs: true
W20260616 19:51:59.610718 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76c48e233d184487b7651e9cb105c2cc consensus state has no leader
I20260616 19:51:59.616230 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b352275041f9457091d04f83e545dea0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.616533 860 leader_election.cc:343] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.616693 1678 leader_election.cc:290] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:51:59.616822 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b352275041f9457091d04f83e545dea0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.612061 452 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet d51a6fb4c49e461583a5aba1813b2a3e (table default.Table_b3d1ae6133974de8942b6f6a2ae9f310 [id=2d4376cceca648ef87dcf561d1e9e701]). Expected version 1 got 0
I20260616 19:51:59.618468 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_697a7231aefa42178532aaa38eb61439" } new_table_name: "default.Table_24447e65692d452a82a5ef91bdc6ab4f" modify_external_catalogs: true
I20260616 19:51:59.619932 993 leader_election.cc:304] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:51:59.620370 1022 tablet_service.cc:1511] Processing CreateTablet for tablet b29cc69fd5234becb09a0b73919b461c (DEFAULT_TABLE table=default.Table_c7617de287ff4770bb063b7ee633a61a [id=87238fcdc4114462bb14b2ca9fbc7438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.620494 1628 raft_consensus.cc:2804] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:59.622525 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet c6d6071d862241e196a83a23bc939af4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.626948 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 0da93e4052094862a44812990df1136a with delete_type TABLET_DATA_DELETED (replaced by tablet 49e88f4e88a64eca8aafc325f1834f54) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.627146 1383 raft_consensus.cc:493] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.627784 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cfb2238cbdb421a8f5001dc729e9bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.627951 1191 tablet_replica.cc:333] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:59.631705 1190 pending_rounds.cc:70] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:51:59.631947 1190 pending_rounds.cc:77] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595463342989312 op_type: NO_OP noop_request { }
I20260616 19:51:59.632097 1190 raft_consensus.cc:2889] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:59.632226 1190 raft_consensus.cc:2272] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.635670 1032 tablet_service.cc:1511] Processing CreateTablet for tablet b251bdf373574dffb04f9e2c837cfe78 (DEFAULT_TABLE table=default.Table_86e549fb88f34f51a867554c129f5d7b [id=df97d55b6c8d4f0c9e0359d8f4779150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.637671 746 tablet_service.cc:1511] Processing CreateTablet for tablet 24278ccfca6742aa8972d2b3d2c612d4 (DEFAULT_TABLE table=default.Table_c82451507e00496a8d501a63dddeeec8 [id=13bb6e4c945447fdbc89d2dfb185a01c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.638664 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24278ccfca6742aa8972d2b3d2c612d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.640619 1628 raft_consensus.cc:493] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:59.640806 1628 raft_consensus.cc:3060] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.642098 750 tablet_service.cc:1511] Processing CreateTablet for tablet 137c13d905eb4bf2937f730e5210266f (DEFAULT_TABLE table=default.Table_61d46cd30fe14d8d9e6e45f4a242e6fa [id=e2500dc3c6964e31b81217146003d226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.642755 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137c13d905eb4bf2937f730e5210266f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.644588 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f061d4bc90f42409eb99987059e6656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.644937 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29cc69fd5234becb09a0b73919b461c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.646129 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 5af9bdceae184f8dbb9e5db67a11ee63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.646404 1383 raft_consensus.cc:515] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.647101 1383 leader_election.cc:290] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.645998 1057 raft_consensus.cc:2468] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:51:59.648006 1191 raft_consensus.cc:2243] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.648029 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3645fc39d974bffa8fe52c62e1c7eff" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:59.648203 1191 raft_consensus.cc:2272] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.648931 858 leader_election.cc:304] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:51:59.649976 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b251bdf373574dffb04f9e2c837cfe78. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:51:59.650494 996 leader_election.cc:343] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.650570 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3645fc39d974bffa8fe52c62e1c7eff" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:59.650782 924 raft_consensus.cc:2468] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:59.651302 993 leader_election.cc:304] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:51:59.651255 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 24278ccfca6742aa8972d2b3d2c612d4 (DEFAULT_TABLE table=default.Table_c82451507e00496a8d501a63dddeeec8 [id=13bb6e4c945447fdbc89d2dfb185a01c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.651705 1383 raft_consensus.cc:2804] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:59.651747 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24278ccfca6742aa8972d2b3d2c612d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.651795 1383 raft_consensus.cc:493] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:59.651897 1383 raft_consensus.cc:3060] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.653060 1678 raft_consensus.cc:2804] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:59.653476 1678 raft_consensus.cc:697] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:51:59.653679 1191 ts_tablet_manager.cc:1916] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.653893 1678 consensus_queue.cc:237] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.654527 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 137c13d905eb4bf2937f730e5210266f (DEFAULT_TABLE table=default.Table_61d46cd30fe14d8d9e6e45f4a242e6fa [id=e2500dc3c6964e31b81217146003d226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.654994 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137c13d905eb4bf2937f730e5210266f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.660565 1190 ts_tablet_manager.cc:1916] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.663712 1628 raft_consensus.cc:515] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.665203 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc92bc15da14504a1ff5feda5aff7cf" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:59.665450 924 raft_consensus.cc:3060] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.667354 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc92bc15da14504a1ff5feda5aff7cf" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:51:59.669031 996 leader_election.cc:343] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.669910 924 raft_consensus.cc:2468] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:59.672642 993 leader_election.cc:304] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:51:59.673800 1627 raft_consensus.cc:2804] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:59.673944 1627 raft_consensus.cc:697] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:59.674886 1627 consensus_queue.cc:237] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.675800 1628 leader_election.cc:290] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.679512 1383 raft_consensus.cc:515] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.682808 1196 tablet_bootstrap.cc:492] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.683084 1196 ts_tablet_manager.cc:1403] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.187s user 0.022s sys 0.028s
I20260616 19:51:59.683982 1196 raft_consensus.cc:359] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.686174 1196 raft_consensus.cc:385] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.686604 1196 raft_consensus.cc:740] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.687244 1196 consensus_queue.cc:260] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.688743 1196 ts_tablet_manager.cc:1434] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:51:59.690104 1196 tablet_bootstrap.cc:492] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:59.690945 891 tablet_service.cc:1511] Processing CreateTablet for tablet c6be4a4739464be7b246a54b7a33adaf (DEFAULT_TABLE table=default.Table_dd8ccdd722484ba5b6d855c64e825279 [id=c0e43fceb55041279bc9f2b415224da8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.691346 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6be4a4739464be7b246a54b7a33adaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.695019 1193 ts_tablet_manager.cc:1929] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.698179 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 19b9248b88434a6e9ef7a3d602eee70c
I20260616 19:51:59.698427 891 tablet_service.cc:1511] Processing CreateTablet for tablet 7dafeb24a59948b28e26730194e29758 (DEFAULT_TABLE table=default.Table_333a3cd8e7d247e7b113f715a2f14955 [id=4be67567b99a44958944933980bbfab3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.698872 458 catalog_manager.cc:6784] ReplaceTablet: tablet 19b9248b88434a6e9ef7a3d602eee70c deleted and replaced by tablet 415ad9d0c3564453825c4b30c0ad64fa
I20260616 19:51:59.699003 1193 log.cc:1199] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/0f061d4bc90f42409eb99987059e6656
I20260616 19:51:59.699712 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dafeb24a59948b28e26730194e29758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.700726 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 5029a79e046a489aa9976eff948a3c5b
I20260616 19:51:59.703276 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5376eb58bd584cce9ea6b9260d89a57c" } modify_external_catalogs: true
I20260616 19:51:59.703497 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5376eb58bd584cce9ea6b9260d89a57c" } modify_external_catalogs: true
I20260616 19:51:59.703667 902 tablet_service.cc:1511] Processing CreateTablet for tablet 0884b33082b242e4bb2ae7d53a2b3e29 (DEFAULT_TABLE table=default.Table_87572bccfe72485c994560d15596febe [id=23cfe5608fd743e9b8eeed8e8eca7779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.704129 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0884b33082b242e4bb2ae7d53a2b3e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.707696 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 7dc92bc15da14504a1ff5feda5aff7cf (table default.Table_6955250583bf4c3cbff20316dfa5d1a7 [id=8c7791625cfd4d39ad0dff83be1c7089]). Expected version 1 got 0
I20260616 19:51:59.716221 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 647b1abeb3c14b11b9a5c62b67e83cf8
I20260616 19:51:59.717173 904 tablet_service.cc:1511] Processing CreateTablet for tablet b251bdf373574dffb04f9e2c837cfe78 (DEFAULT_TABLE table=default.Table_86e549fb88f34f51a867554c129f5d7b [id=df97d55b6c8d4f0c9e0359d8f4779150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.717641 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b251bdf373574dffb04f9e2c837cfe78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.721313 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_86e549fb88f34f51a867554c129f5d7b" } modify_external_catalogs: true
I20260616 19:51:59.721573 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_86e549fb88f34f51a867554c129f5d7b" } modify_external_catalogs: true
I20260616 19:51:59.726230 422 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasknFdngH/build/asan/bin/kudu with pid 498
I20260616 19:51:59.728235 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 0da93e4052094862a44812990df1136a with delete_type TABLET_DATA_DELETED (replaced by tablet 49e88f4e88a64eca8aafc325f1834f54) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.728814 904 tablet_service.cc:1511] Processing CreateTablet for tablet b29cc69fd5234becb09a0b73919b461c (DEFAULT_TABLE table=default.Table_c7617de287ff4770bb063b7ee633a61a [id=87238fcdc4114462bb14b2ca9fbc7438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.729465 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29cc69fd5234becb09a0b73919b461c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.733124 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3a7e97060a4b49078e3a1d6d87337196" } modify_external_catalogs: true
I20260616 19:51:59.733328 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3a7e97060a4b49078e3a1d6d87337196" } modify_external_catalogs: true
I20260616 19:51:59.733300 888 tablet_service.cc:1511] Processing CreateTablet for tablet 24278ccfca6742aa8972d2b3d2c612d4 (DEFAULT_TABLE table=default.Table_c82451507e00496a8d501a63dddeeec8 [id=13bb6e4c945447fdbc89d2dfb185a01c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.733753 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24278ccfca6742aa8972d2b3d2c612d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.739821 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 335f7411fda84fada762345010a4339c
I20260616 19:51:59.740365 459 catalog_manager.cc:6784] ReplaceTablet: tablet 335f7411fda84fada762345010a4339c deleted and replaced by tablet 2171eb55560f44dd91ad52e0b5b49408
I20260616 19:51:59.741106 459 master_service.cc:960] ReplaceTablet: received request to replace tablet 102f322eb98f4224acb8637f8c29ac19 from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:59.742479 888 tablet_service.cc:1511] Processing CreateTablet for tablet 137c13d905eb4bf2937f730e5210266f (DEFAULT_TABLE table=default.Table_61d46cd30fe14d8d9e6e45f4a242e6fa [id=e2500dc3c6964e31b81217146003d226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:51:59.743078 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137c13d905eb4bf2937f730e5210266f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:51:59.749327 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3645fc39d974bffa8fe52c62e1c7eff" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:59.749574 924 raft_consensus.cc:3060] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.751091 1196 tablet_bootstrap.cc:654] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.753666 924 raft_consensus.cc:2468] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:59.755129 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 19b9248b88434a6e9ef7a3d602eee70c with delete_type TABLET_DATA_DELETED (replaced by tablet 415ad9d0c3564453825c4b30c0ad64fa) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.756027 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 5029a79e046a489aa9976eff948a3c5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.756767 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 647b1abeb3c14b11b9a5c62b67e83cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.757390 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 335f7411fda84fada762345010a4339c with delete_type TABLET_DATA_DELETED (replaced by tablet 2171eb55560f44dd91ad52e0b5b49408) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.757970 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e4cc2f16ea18496ca63a4bf823ed95e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.758589 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4cc2f16ea18496ca63a4bf823ed95e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.760110 1626 raft_consensus.cc:493] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.760298 1626 raft_consensus.cc:515] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.761370 993 leader_election.cc:304] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:59.761714 1567 raft_consensus.cc:2804] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:59.762241 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 19b9248b88434a6e9ef7a3d602eee70c with delete_type TABLET_DATA_DELETED (replaced by tablet 415ad9d0c3564453825c4b30c0ad64fa) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.763725 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 647b1abeb3c14b11b9a5c62b67e83cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.764568 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 5029a79e046a489aa9976eff948a3c5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:51:59.766700 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d825bcf365f424fb99a10afe3e96501 consensus state has no leader
I20260616 19:51:59.771811 1191 ts_tablet_manager.cc:1929] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.772161 1198 tablet_bootstrap.cc:492] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.782042 1190 ts_tablet_manager.cc:1929] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:59.782176 1190 log.cc:1199] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/7161894b9f9047fda9ed3f2180518a59
I20260616 19:51:59.785116 1192 tablet_bootstrap.cc:492] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:59.785279 1192 ts_tablet_manager.cc:1403] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.277s user 0.009s sys 0.024s
I20260616 19:51:59.786121 1192 raft_consensus.cc:359] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.786314 1192 raft_consensus.cc:385] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.786417 1192 raft_consensus.cc:740] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.786626 1192 consensus_queue.cc:260] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.787186 1192 ts_tablet_manager.cc:1434] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:59.787479 1192 tablet_bootstrap.cc:492] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:59.790163 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c34fe4a4538c4369bb8094e88ca8ec0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.790774 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c34fe4a4538c4369bb8094e88ca8ec0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:51:59.793903 446 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 1d825bcf365f424fb99a10afe3e96501 (table default.Table_b6f1fb47223d447fb0c0eed0f8b52102 [id=d3197da9180e47e18f4e1573504ae8c7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1d825bcf365f424fb99a10afe3e96501 consensus state has no leader
I20260616 19:51:59.793994 1192 tablet_bootstrap.cc:654] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:51:59.800275 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c90eb04585c4fa992435d11015ffec7 consensus state has no leader
I20260616 19:51:59.801371 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_246d3701c107443eafaca0a854ab5d6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.801934 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_246d3701c107443eafaca0a854ab5d6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.804868 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf54b260fc941599cffb12581e8116a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:59.805198 924 raft_consensus.cc:2393] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
I20260616 19:51:59.807991 1628 raft_consensus.cc:493] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.808198 1628 raft_consensus.cc:515] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.809103 1628 leader_election.cc:290] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:59.809350 1628 raft_consensus.cc:493] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.809535 1628 raft_consensus.cc:515] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.810184 1628 leader_election.cc:290] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.810736 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 335f7411fda84fada762345010a4339c with delete_type TABLET_DATA_DELETED (replaced by tablet 2171eb55560f44dd91ad52e0b5b49408) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.810776 1198 ts_tablet_manager.cc:1403] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.199s user 0.012s sys 0.018s
I20260616 19:51:59.811439 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c392b2fecd483d9da12e30e37f27ad" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:59.811632 1198 raft_consensus.cc:359] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.811836 1191 log.cc:1199] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/c6d6071d862241e196a83a23bc939af4
I20260616 19:51:59.812237 1191 ts_tablet_manager.cc:1950] T c6d6071d862241e196a83a23bc939af4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
W20260616 19:51:59.812356 993 leader_election.cc:343] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.812601 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1593e08712fd4d02a8209a16b9d03cf0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:51:59.813169 1191 tablet_replica.cc:333] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:51:59.813210 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1593e08712fd4d02a8209a16b9d03cf0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.813371 1191 raft_consensus.cc:2243] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:59.813333 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet c6d6071d862241e196a83a23bc939af4 (table default.Table_b30d3eb9400f41859828b301e68cfec4 [id=62b01f98d4a940ed90cb63411348c3c6]) successfully deleted
I20260616 19:51:59.813603 1191 pending_rounds.cc:70] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2: Trying to abort 1 pending ops.
I20260616 19:51:59.813634 1383 leader_election.cc:290] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.813733 1198 raft_consensus.cc:385] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.813884 1198 raft_consensus.cc:740] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.814117 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cfb2238cbdb421a8f5001dc729e9bb5" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:59.814141 1198 consensus_queue.cc:260] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.814415 924 raft_consensus.cc:2468] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:59.814612 1198 ts_tablet_manager.cc:1434] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260616 19:51:59.814924 1198 tablet_bootstrap.cc:492] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.816996 1198 tablet_bootstrap.cc:654] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.817978 993 leader_election.cc:304] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:59.818315 1628 raft_consensus.cc:2804] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:59.818416 1628 raft_consensus.cc:493] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:59.818558 1628 raft_consensus.cc:3060] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.813683 1191 pending_rounds.cc:77] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595470818189312 op_type: NO_OP noop_request { }
I20260616 19:51:59.818866 1191 raft_consensus.cc:2889] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:59.818975 1191 raft_consensus.cc:2272] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.819949 1191 ts_tablet_manager.cc:1916] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.821482 1628 raft_consensus.cc:515] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.822764 1628 leader_election.cc:290] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:51:59.823099 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cfb2238cbdb421a8f5001dc729e9bb5" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:59.823352 924 raft_consensus.cc:3060] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.825287 1190 ts_tablet_manager.cc:1950] T 7161894b9f9047fda9ed3f2180518a59 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:59.825892 1191 ts_tablet_manager.cc:1929] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:51:59.826174 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 289) took 3327 ms. Trace:
W20260616 19:51:59.831676 445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.105.189:43055 (error 108) [suppressed 6 similar messages]
I20260616 19:51:59.834084 1191 log.cc:1199] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/0da93e4052094862a44812990df1136a
I20260616 19:51:59.835058 1191 ts_tablet_manager.cc:1950] T 0da93e4052094862a44812990df1136a P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:59.837182 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 19b9248b88434a6e9ef7a3d602eee70c with delete_type TABLET_DATA_DELETED (replaced by tablet 415ad9d0c3564453825c4b30c0ad64fa) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.837337 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 0da93e4052094862a44812990df1136a (table default.Table_fe763512a640490ebb25dca52b04788a [id=ad67f2c8f60f4c8c9b4ca2e57ffdb6f1]) successfully deleted
W20260616 19:51:59.837468 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet afc58b2bda2a43f18f157469b591854b consensus state has no leader
I20260616 19:51:59.839169 1190 rpcz_store.cc:276] 0616 19:51:56.498699 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.498749 (+ 50us) service_pool.cc:224] Handling call
0616 19:51:59.439323 (+2940574us) ts_tablet_manager.cc:1151] Deleting tablet 7161894b9f9047fda9ed3f2180518a59
0616 19:51:59.439335 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.756106 (+316771us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.781949 (+ 25843us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.826129 (+ 44180us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2940423}
I20260616 19:51:59.839510 1190 tablet_replica.cc:333] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:59.839596 1191 tablet_replica.cc:333] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:59.839790 1191 raft_consensus.cc:2243] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.840927 1191 raft_consensus.cc:2272] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.839699 1190 raft_consensus.cc:2243] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.841244 1190 raft_consensus.cc:2272] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.841848 1190 ts_tablet_manager.cc:1916] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.842100 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_792e3d8aaa5a4e939050bd897488eec3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.842726 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_792e3d8aaa5a4e939050bd897488eec3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.842803 1191 ts_tablet_manager.cc:1916] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.826776 924 raft_consensus.cc:2468] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:59.854903 1626 leader_election.cc:290] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:59.855719 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3645fc39d974bffa8fe52c62e1c7eff" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:59.856042 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet b251bdf373574dffb04f9e2c837cfe78
I20260616 19:51:59.857009 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet b251bdf373574dffb04f9e2c837cfe78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.858364 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 5af9bdceae184f8dbb9e5db67a11ee63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:59.858923 1695 negotiation.cc:336] Failed RPC negotiation. Trace:
0616 19:51:59.831524 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.189:43055 (local address 127.0.105.131:59327)
0616 19:51:59.858309 (+ 26785us) negotiation.cc:107] Waiting for socket to connect
0616 19:51:59.858418 (+ 109us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.189:43055: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":26634,"threads_started":1}
W20260616 19:51:59.858860 996 leader_election.cc:343] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.859325 1193 ts_tablet_manager.cc:1950] T 0f061d4bc90f42409eb99987059e6656 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.859428 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 647b1abeb3c14b11b9a5c62b67e83cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:51:59.859560 719 leader_election.cc:343] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 0bf54b260fc941599cffb12581e8116a
I20260616 19:51:59.856170 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 5029a79e046a489aa9976eff948a3c5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.859874 1567 raft_consensus.cc:697] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:59.859902 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f97daa87d0d94205896e1f600ff0ef8f" } new_table_name: "default.Table_f72430c53c2c4cd6920a8fafb2020444" modify_external_catalogs: true
I20260616 19:51:59.860147 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 335f7411fda84fada762345010a4339c with delete_type TABLET_DATA_DELETED (replaced by tablet 2171eb55560f44dd91ad52e0b5b49408) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.860167 1567 consensus_queue.cc:237] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.859299 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c392b2fecd483d9da12e30e37f27ad" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:59.861325 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cfb2238cbdb421a8f5001dc729e9bb5" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:59.861486 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cfb2238cbdb421a8f5001dc729e9bb5" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:59.862067 784 raft_consensus.cc:3060] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.862181 993 leader_election.cc:304] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:51:59.862329 1193 tablet_replica.cc:333] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:51:59.862375 993 raft_consensus.cc:2686] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:51:59.862522 1193 raft_consensus.cc:2243] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.862731 1193 raft_consensus.cc:2272] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.863270 1193 ts_tablet_manager.cc:1916] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:51:59.864629 996 leader_election.cc:343] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:51:59.864761 996 leader_election.cc:304] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:59.865046 1691 raft_consensus.cc:2749] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:59.865172 747 tablet_service.cc:1558] Processing DeleteTablet for tablet b251bdf373574dffb04f9e2c837cfe78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.865305 718 leader_election.cc:304] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:59.869168 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet efd5fecc6d444e5fba9103287c09542e
I20260616 19:51:59.869845 460 master_service.cc:960] ReplaceTablet: received request to replace tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:59.872601 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet efd5fecc6d444e5fba9103287c09542e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:51:59.873842 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 0f061d4bc90f42409eb99987059e6656 (table default.Table_6d7c8b4a63044ff78221b0a47f41d5a1 [id=b90ab6d60662478db8d946925f66450b]) successfully deleted
W20260616 19:51:59.874639 445 consensus_peers.cc:597] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 -> Peer 2b8fb7a8523741a2b7a5e75d8b415be0 (127.0.105.189:43055): Couldn't send request to peer 2b8fb7a8523741a2b7a5e75d8b415be0. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.189:43055: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260616 19:51:59.876677 1696 negotiation.cc:336] Failed RPC negotiation. Trace:
0616 19:51:59.831794 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.189:43055 (local address 127.0.105.130:37595)
0616 19:51:59.876193 (+ 44399us) negotiation.cc:107] Waiting for socket to connect
0616 19:51:59.876298 (+ 105us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.189:43055: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":44289,"threads_started":1}
I20260616 19:51:59.877592 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 7161894b9f9047fda9ed3f2180518a59 (table default.Table_ee130ae3817f41f8ac49a76361fd23ea [id=a69482262948439783492742dcbf0b43]) successfully deleted
W20260616 19:51:59.880402 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 94359.1us
I20260616 19:51:59.881091 1191 ts_tablet_manager.cc:1929] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.881968 1196 tablet_bootstrap.cc:492] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.882088 1688 tablet.cc:1724] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:51:59.882640 1626 raft_consensus.cc:3060] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.883432 784 raft_consensus.cc:2468] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:59.883684 1191 log.cc:1199] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/2cfb2238cbdb421a8f5001dc729e9bb5
I20260616 19:51:59.883809 1196 ts_tablet_manager.cc:1403] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.192s user 0.003s sys 0.003s
I20260616 19:51:59.884948 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_71fb3dee8f0f492ab31a753471d0273b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.885576 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71fb3dee8f0f492ab31a753471d0273b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.877545 892 tablet_service.cc:1558] Processing DeleteTablet for tablet b251bdf373574dffb04f9e2c837cfe78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.877730 902 tablet_service.cc:1558] Processing DeleteTablet for tablet efd5fecc6d444e5fba9103287c09542e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:51:59.878475 1190 ts_tablet_manager.cc:1929] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.888844 1190 log.cc:1199] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/dfee6a9e6d57487bb7d9482f7798e6b6
I20260616 19:51:59.889580 1196 raft_consensus.cc:359] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.889957 1196 raft_consensus.cc:385] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.890074 1196 raft_consensus.cc:740] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.891137 1196 consensus_queue.cc:260] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.893360 1626 raft_consensus.cc:2749] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:59.893769 746 tablet_service.cc:1558] Processing DeleteTablet for tablet efd5fecc6d444e5fba9103287c09542e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:51:59.896962 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5a41286216274f998881eb155b57e7c8" } new_table_name: "default.Table_3d63e27afea44f98a435cca600a9c873" modify_external_catalogs: true
I20260616 19:51:59.897783 1192 tablet_bootstrap.cc:492] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:59.897938 1192 ts_tablet_manager.cc:1403] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.111s user 0.008s sys 0.013s
I20260616 19:51:59.898315 1190 ts_tablet_manager.cc:1950] T dfee6a9e6d57487bb7d9482f7798e6b6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:59.899142 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 290) took 3400 ms. Trace:
I20260616 19:51:59.899247 1190 rpcz_store.cc:276] 0616 19:51:56.499133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.499176 (+ 43us) service_pool.cc:224] Handling call
0616 19:51:59.839439 (+3340263us) ts_tablet_manager.cc:1151] Deleting tablet dfee6a9e6d57487bb7d9482f7798e6b6
0616 19:51:59.839449 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.865861 (+ 26412us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.878399 (+ 12538us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.899086 (+ 20687us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3340078}
I20260616 19:51:59.899740 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet dfee6a9e6d57487bb7d9482f7798e6b6 (table default.Table_81e67ee241e34396b9e1c159338b192a [id=074446fd6e71497cb644841e5bbd0510]) successfully deleted
I20260616 19:51:59.902698 1192 raft_consensus.cc:359] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.902776 1626 raft_consensus.cc:493] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.902905 1192 raft_consensus.cc:385] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.902984 1192 raft_consensus.cc:740] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.903234 1192 consensus_queue.cc:260] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.903731 1192 ts_tablet_manager.cc:1434] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260616 19:51:59.903740 1196 ts_tablet_manager.cc:1434] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.020s user 0.001s sys 0.008s
I20260616 19:51:59.904067 1192 tablet_bootstrap.cc:492] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:51:59.904863 1198 tablet_bootstrap.cc:492] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:51:59.905046 1198 ts_tablet_manager.cc:1403] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.090s user 0.007s sys 0.012s
I20260616 19:51:59.905894 1192 tablet_bootstrap.cc:654] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.905825 1198 raft_consensus.cc:359] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.906044 1198 raft_consensus.cc:385] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.906160 1198 raft_consensus.cc:740] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.906431 1198 consensus_queue.cc:260] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:51:59.907001 1198 ts_tablet_manager.cc:1434] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:51:59.907372 1198 tablet_bootstrap.cc:492] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:51:59.907795 1626 raft_consensus.cc:515] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.908649 1196 tablet_bootstrap.cc:492] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:59.911366 1196 tablet_bootstrap.cc:654] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.912130 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 291) took 3395 ms. Trace:
I20260616 19:51:59.912238 1190 rpcz_store.cc:276] 0616 19:51:56.511539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.511593 (+ 54us) service_pool.cc:224] Handling call
0616 19:51:59.906755 (+3395162us) ts_tablet_manager.cc:1151] Deleting tablet 47b548b6b7f746fe9fd67c2e6563e961
0616 19:51:59.906765 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.906867 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3394982}
W20260616 19:51:59.912742 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 47b548b6b7f746fe9fd67c2e6563e961 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b548b6b7f746fe9fd67c2e6563e961 already in progress: creating tablet
I20260616 19:51:59.917279 1193 ts_tablet_manager.cc:1929] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.917448 1193 log.cc:1199] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/362e7ff9bea3459ca018d1a7febb2ce4
I20260616 19:51:59.918054 1193 ts_tablet_manager.cc:1950] T 362e7ff9bea3459ca018d1a7febb2ce4 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.919258 1193 tablet_replica.cc:333] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:59.919305 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 362e7ff9bea3459ca018d1a7febb2ce4 (table default.Table_ee076c723b314968b2d9f7de0e0947c3 [id=d37e43e64c414245a12d2a86ebcbc24b]) successfully deleted
I20260616 19:51:59.920065 1626 leader_election.cc:290] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:51:59.920523 1190 tablet_replica.cc:333] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:59.922227 1190 raft_consensus.cc:2243] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.924540 1193 raft_consensus.cc:2243] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.924820 1193 raft_consensus.cc:2272] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.925549 1193 ts_tablet_manager.cc:1916] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.928522 1190 raft_consensus.cc:2272] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.929180 1190 ts_tablet_manager.cc:1916] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.930148 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_934ab6946cae48ae8570ec7973cd70fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:51:59.930840 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_934ab6946cae48ae8570ec7973cd70fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:51:59.938143 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 4ffce2dc22e24d1684e6eae92c487cea from {username='slave'} at 127.0.0.1:41696
I20260616 19:51:59.941908 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c99b06b04b8743d5ab70f7e50b641736" } modify_external_catalogs: true
I20260616 19:51:59.942101 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c99b06b04b8743d5ab70f7e50b641736" } modify_external_catalogs: true
I20260616 19:51:59.945351 1196 tablet_bootstrap.cc:492] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.945503 1196 ts_tablet_manager.cc:1403] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.039s user 0.016s sys 0.017s
I20260616 19:51:59.946318 1196 raft_consensus.cc:359] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.946502 1196 raft_consensus.cc:385] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.946619 1196 raft_consensus.cc:740] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.947079 1196 consensus_queue.cc:260] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.947611 1196 ts_tablet_manager.cc:1434] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:59.948289 1196 tablet_bootstrap.cc:492] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:51:59.948949 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99551210f5974332bf6a16ee74b220f6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:59.949209 924 raft_consensus.cc:2393] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
I20260616 19:51:59.949987 1196 tablet_bootstrap.cc:654] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.946318 1193 ts_tablet_manager.cc:1929] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.951633 1193 log.cc:1199] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/0bf54b260fc941599cffb12581e8116a
W20260616 19:51:59.951933 719 leader_election.cc:343] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 99551210f5974332bf6a16ee74b220f6
I20260616 19:51:59.952039 1193 ts_tablet_manager.cc:1950] T 0bf54b260fc941599cffb12581e8116a P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.952093 719 leader_election.cc:304] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:51:59.952598 1700 raft_consensus.cc:3060] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.952987 1193 tablet_replica.cc:333] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:59.953042 1567 raft_consensus.cc:493] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:51:59.953200 1567 raft_consensus.cc:515] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.953891 1567 leader_election.cc:290] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:51:59.954288 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2b3bbc4adb0492a87cd9226cf6a3c8f has no consensus state
I20260616 19:51:59.956036 1700 raft_consensus.cc:2749] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:51:59.956148 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 0bf54b260fc941599cffb12581e8116a (table default.Table_7af2cb04d4654ceabe58936f5a687406 [id=7f7faf7145fd4ea5babd783d76d44821]) successfully deleted
I20260616 19:51:59.956455 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51a6fb4c49e461583a5aba1813b2a3e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:51:59.956673 784 raft_consensus.cc:2468] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:59.956840 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51a6fb4c49e461583a5aba1813b2a3e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:51:59.957041 924 raft_consensus.cc:2468] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:51:59.960335 1193 raft_consensus.cc:2243] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.960784 1193 raft_consensus.cc:2272] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.961576 1193 ts_tablet_manager.cc:1916] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.965796 1190 ts_tablet_manager.cc:1929] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.968894 1190 log.cc:1199] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/fd5a513aeb224609afaee1ded6ede5e6
I20260616 19:51:59.969389 1190 ts_tablet_manager.cc:1950] T fd5a513aeb224609afaee1ded6ede5e6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:51:59.969787 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 292) took 3450 ms. Trace:
I20260616 19:51:59.969962 1190 rpcz_store.cc:276] 0616 19:51:56.519679 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.519734 (+ 55us) service_pool.cc:224] Handling call
0616 19:51:59.913228 (+3393494us) ts_tablet_manager.cc:1151] Deleting tablet fd5a513aeb224609afaee1ded6ede5e6
0616 19:51:59.913236 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.939401 (+ 26165us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.965703 (+ 26302us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:59.969748 (+ 4045us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3393260}
I20260616 19:51:59.970568 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet fd5a513aeb224609afaee1ded6ede5e6 (table default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]) successfully deleted
I20260616 19:51:59.971066 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 293) took 3371 ms. Trace:
I20260616 19:51:59.971230 1190 rpcz_store.cc:276] 0616 19:51:56.599849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.599906 (+ 57us) service_pool.cc:224] Handling call
0616 19:51:59.970894 (+3370988us) ts_tablet_manager.cc:1151] Deleting tablet fb1c2030b3a14c6aafaa961869606f31
0616 19:51:59.970904 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.971017 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3370789}
I20260616 19:51:59.971927 1190 tablet_replica.cc:333] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:51:59.972198 1190 raft_consensus.cc:2243] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.973613 1190 raft_consensus.cc:2272] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.973762 996 leader_election.cc:304] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:51:59.974385 1567 raft_consensus.cc:2804] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:51:59.974534 1567 raft_consensus.cc:493] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:51:59.974651 1567 raft_consensus.cc:3060] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.977473 1567 raft_consensus.cc:515] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.978816 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51a6fb4c49e461583a5aba1813b2a3e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:51:59.978856 1567 leader_election.cc:290] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:51:59.979013 784 raft_consensus.cc:3060] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.979689 1191 ts_tablet_manager.cc:1950] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:51:59.979851 1193 ts_tablet_manager.cc:1929] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.979969 1193 log.cc:1199] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/99551210f5974332bf6a16ee74b220f6
I20260616 19:51:59.980355 1193 ts_tablet_manager.cc:1950] T 99551210f5974332bf6a16ee74b220f6 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.981397 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 99551210f5974332bf6a16ee74b220f6 (table default.Table_ab3032cb1f934fdc9bde24d4b3b1f5a3 [id=4fbf7d11df5448f4b249f9c831241f38]) successfully deleted
I20260616 19:51:59.981763 1193 tablet_replica.cc:333] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:51:59.981863 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 2cfb2238cbdb421a8f5001dc729e9bb5 (table default.Table_f6d740d1faed4c4fa615d5711262ccf9 [id=dadf8402246843219b213be49e8ad54b]) successfully deleted
I20260616 19:51:59.982810 784 raft_consensus.cc:2468] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:59.982867 1191 tablet_replica.cc:333] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:51:59.983060 1191 raft_consensus.cc:2243] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:51:59.983398 1191 pending_rounds.cc:70] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2: Trying to abort 1 pending ops.
I20260616 19:51:59.983600 996 leader_election.cc:304] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:51:59.983814 1193 raft_consensus.cc:2243] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:51:59.983992 1193 raft_consensus.cc:2272] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.984027 1567 raft_consensus.cc:2804] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:51:59.984228 1567 raft_consensus.cc:697] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:51:59.984639 1193 ts_tablet_manager.cc:1916] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.984565 1567 consensus_queue.cc:237] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.989923 1196 tablet_bootstrap.cc:492] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:51:59.990272 1196 ts_tablet_manager.cc:1403] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.042s user 0.017s sys 0.010s
I20260616 19:51:59.991079 1196 raft_consensus.cc:359] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.991302 1196 raft_consensus.cc:385] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.991398 1196 raft_consensus.cc:740] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.991689 1196 consensus_queue.cc:260] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.992365 1196 ts_tablet_manager.cc:1434] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:51:59.975239 1192 tablet_bootstrap.cc:492] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:51:59.978523 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51a6fb4c49e461583a5aba1813b2a3e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:51:59.992659 924 raft_consensus.cc:3060] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:51:59.993081 1190 ts_tablet_manager.cc:1916] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:51:59.993062 1191 pending_rounds.cc:77] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595470837161984 op_type: NO_OP noop_request { }
I20260616 19:51:59.993188 1191 raft_consensus.cc:2889] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:51:59.993296 1191 raft_consensus.cc:2272] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:51:59.983731 1198 tablet_bootstrap.cc:654] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:51:59.995627 924 raft_consensus.cc:2468] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:51:59.997351 1192 ts_tablet_manager.cc:1403] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.093s user 0.004s sys 0.000s
I20260616 19:51:59.997664 1193 ts_tablet_manager.cc:1929] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:51:59.997792 1193 log.cc:1199] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/2cfb2238cbdb421a8f5001dc729e9bb5
I20260616 19:51:59.998154 1193 ts_tablet_manager.cc:1950] T 2cfb2238cbdb421a8f5001dc729e9bb5 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:51:59.998409 1192 raft_consensus.cc:359] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.998618 1192 raft_consensus.cc:385] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:51:59.998724 1192 raft_consensus.cc:740] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:51:59.998975 1192 consensus_queue.cc:260] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:51:59.999595 1192 ts_tablet_manager.cc:1434] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:52:00.000119 1191 ts_tablet_manager.cc:1916] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:00.003937 1191 ts_tablet_manager.cc:1929] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:00.004076 1191 log.cc:1199] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/0f061d4bc90f42409eb99987059e6656
I20260616 19:52:00.004525 1191 ts_tablet_manager.cc:1950] T 0f061d4bc90f42409eb99987059e6656 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:00.005450 1191 tablet_replica.cc:333] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:00.005678 1191 raft_consensus.cc:2243] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:00.005931 1191 pending_rounds.cc:70] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2: Trying to abort 1 pending ops.
I20260616 19:52:00.006094 1191 pending_rounds.cc:77] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595470753021952 op_type: NO_OP noop_request { }
I20260616 19:52:00.006259 1191 raft_consensus.cc:2889] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:00.006340 1192 tablet_bootstrap.cc:492] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:00.006465 1191 raft_consensus.cc:2272] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:00.007885 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f4fa0f49dd9849f18e8d221a29eb24c5" } modify_external_catalogs: true
I20260616 19:52:00.008080 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f4fa0f49dd9849f18e8d221a29eb24c5" } modify_external_catalogs: true
I20260616 19:52:00.009116 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 0f061d4bc90f42409eb99987059e6656 (table default.Table_6d7c8b4a63044ff78221b0a47f41d5a1 [id=b90ab6d60662478db8d946925f66450b]) successfully deleted
I20260616 19:52:00.009336 1691 raft_consensus.cc:493] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.009472 1691 raft_consensus.cc:515] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.010123 1691 leader_election.cc:290] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:00.012384 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c31c8e977da4a70bca1beb00f364627" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:00.013144 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 2cfb2238cbdb421a8f5001dc729e9bb5 (table default.Table_f6d740d1faed4c4fa615d5711262ccf9 [id=dadf8402246843219b213be49e8ad54b]) successfully deleted
I20260616 19:52:00.013370 1193 tablet_replica.cc:333] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:52:00.013417 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 7a2e5bc2c47746e88e95634fb073273e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a2e5bc2c47746e88e95634fb073273e already in progress: creating tablet
I20260616 19:52:00.013547 1193 raft_consensus.cc:2243] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:00.013722 1193 raft_consensus.cc:2272] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:00.014110 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 4fc0c02ef58d4e429855e5bbaa4752ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fc0c02ef58d4e429855e5bbaa4752ad already in progress: creating tablet
I20260616 19:52:00.014258 1193 ts_tablet_manager.cc:1916] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:00.014410 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 54eb61046c954a36a036b24e9e16b5c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54eb61046c954a36a036b24e9e16b5c4 already in progress: creating tablet
I20260616 19:52:00.015065 1691 raft_consensus.cc:493] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.015215 1691 raft_consensus.cc:515] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:00.015899 1691 leader_election.cc:290] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:00.016458 455 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 2c31c8e977da4a70bca1beb00f364627 (table default.Table_9e98175df9ce48a59cb42b1e48cd7fba [id=cb4c50d05fdd4c0a85828222eeb0f06a]). Expected version 1 got 0
I20260616 19:52:00.016594 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3de0e62cfd33410490a0b460fd5f69e9" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:00.016690 455 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet eb04ccc26e64484a9a29c515d4b954fe (table default.Table_62b93909f63642cda25a0d17ce9b567c [id=87e3217093844e81ac448e2e9d8fa3ec]). Expected version 1 got 0
I20260616 19:52:00.016853 455 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 122a8b15e62f4b23b465e2dbc816df62 (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]). Expected version 2 got 0
I20260616 19:52:00.017042 455 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 59812b232848488b9894e8f8057e9def (table default.Table_191f8acd55ae4da9982a9fb3ec2d51cd [id=1beb7d130df7492ab9b834d005eba63a]). Expected version 2 got 0
I20260616 19:52:00.017211 455 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 7dc92bc15da14504a1ff5feda5aff7cf (table default.Table_6955250583bf4c3cbff20316dfa5d1a7 [id=8c7791625cfd4d39ad0dff83be1c7089]). Expected version 1 got 0
W20260616 19:52:00.017639 993 leader_election.cc:343] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.017714 1190 ts_tablet_manager.cc:1929] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:00.017876 1190 log.cc:1199] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/362e7ff9bea3459ca018d1a7febb2ce4
I20260616 19:52:00.018338 904 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0114e46af944bc9a6fa02c151089fd (DEFAULT_TABLE table=default.Table_08f38f9cab7848f598534ba789a70755 [id=7dd5d9499cc44e448936d8c6fe411c9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.018766 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0114e46af944bc9a6fa02c151089fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.020210 458 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_edb542c197924a81a6ae1a4a8a16f34a [id=1e3bc78bafc8405c8e57142c8236aef3] alter complete (version 1)
I20260616 19:52:00.018406 1190 ts_tablet_manager.cc:1950] T 362e7ff9bea3459ca018d1a7febb2ce4 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:00.021399 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 294) took 3394 ms. Trace:
I20260616 19:52:00.021484 1190 rpcz_store.cc:276] 0616 19:51:56.626743 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.626801 (+ 58us) service_pool.cc:224] Handling call
0616 19:51:59.971860 (+3345059us) ts_tablet_manager.cc:1151] Deleting tablet 362e7ff9bea3459ca018d1a7febb2ce4
0616 19:51:59.971870 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:51:59.996415 (+ 24545us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:00.017628 (+ 21213us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:00.021341 (+ 3713us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3344823}
I20260616 19:52:00.021621 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 1c35e4c8e9304e798c9031469877b70e from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:00.022023 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 295) took 3390 ms. Trace:
I20260616 19:52:00.022102 1190 rpcz_store.cc:276] 0616 19:51:56.631283 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.631342 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:00.021872 (+3390530us) ts_tablet_manager.cc:1151] Deleting tablet 79250767a94141cd900a9715e86128b8
0616 19:52:00.021879 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.021964 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3390298}
I20260616 19:52:00.022568 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 296) took 3374 ms. Trace:
I20260616 19:52:00.022651 1190 rpcz_store.cc:276] 0616 19:51:56.647803 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.647861 (+ 58us) service_pool.cc:224] Handling call
0616 19:52:00.022433 (+3374572us) ts_tablet_manager.cc:1151] Deleting tablet 8a718fefe07141119b7ef7edcbf61123
0616 19:52:00.022442 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.022519 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3374352}
I20260616 19:52:00.025122 1190 tablet_replica.cc:333] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
W20260616 19:52:00.025249 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 79250767a94141cd900a9715e86128b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79250767a94141cd900a9715e86128b8 already in progress: creating tablet
W20260616 19:52:00.025496 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 8a718fefe07141119b7ef7edcbf61123 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a718fefe07141119b7ef7edcbf61123 already in progress: creating tablet
I20260616 19:52:00.028434 1190 raft_consensus.cc:2243] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:00.029202 1198 tablet_bootstrap.cc:492] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:00.029418 1190 raft_consensus.cc:2272] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:00.029565 891 tablet_service.cc:1511] Processing CreateTablet for tablet ed8e5b059700443faab937488002de37 (DEFAULT_TABLE table=default.Table_c3a414b8774445a4a731cbbfa3f171bb [id=49d4de6b80e9492f8dfd7ea7d7bc5254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.029913 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed8e5b059700443faab937488002de37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.030058 1198 ts_tablet_manager.cc:1403] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.123s user 0.002s sys 0.003s
I20260616 19:52:00.030839 1198 raft_consensus.cc:359] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.031020 1198 raft_consensus.cc:385] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:00.031086 1198 raft_consensus.cc:740] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.031332 1198 consensus_queue.cc:260] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.029917 1190 ts_tablet_manager.cc:1916] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:00.032785 902 tablet_service.cc:1511] Processing CreateTablet for tablet 8f02d84ab7324b4c80875acf7f33199d (DEFAULT_TABLE table=default.Table_39d47e28935346aa86153d1c60006361 [id=e5b0f7437a4f4005bf65793acdba8c42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.033175 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f02d84ab7324b4c80875acf7f33199d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.035213 455 catalog_manager.cc:5696] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:00.035650 455 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 122a8b15e62f4b23b465e2dbc816df62 (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]). Expected version 2 got 0
I20260616 19:52:00.035889 455 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet eb04ccc26e64484a9a29c515d4b954fe (table default.Table_62b93909f63642cda25a0d17ce9b567c [id=87e3217093844e81ac448e2e9d8fa3ec]). Expected version 1 got 0
I20260616 19:52:00.037173 892 tablet_service.cc:1558] Processing DeleteTablet for tablet d3645fc39d974bffa8fe52c62e1c7eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.037160 1692 raft_consensus.cc:493] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.037317 1692 raft_consensus.cc:515] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.037956 1692 leader_election.cc:290] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:00.029163 888 tablet_service.cc:1511] Processing CreateTablet for tablet 899b5f53d3fd4e2ab7222555dcc120e2 (DEFAULT_TABLE table=default.Table_6ecb544894454b0a88d26fa422cab3fc [id=2b5cbc44f830478a8868749acfbdb1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.038792 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 899b5f53d3fd4e2ab7222555dcc120e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.038489 1198 ts_tablet_manager.cc:1434] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260616 19:52:00.039191 1198 tablet_bootstrap.cc:492] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:00.042279 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59812b232848488b9894e8f8057e9def" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:00.044032 1198 tablet_bootstrap.cc:654] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.044564 750 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0114e46af944bc9a6fa02c151089fd (DEFAULT_TABLE table=default.Table_08f38f9cab7848f598534ba789a70755 [id=7dd5d9499cc44e448936d8c6fe411c9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.045022 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0114e46af944bc9a6fa02c151089fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.045346 756 tablet_service.cc:1511] Processing CreateTablet for tablet 12944efb54824dc4960db5d09c1a1684 (DEFAULT_TABLE table=default.Table_45887a2d367d4294bce394b38dbe33ac [id=10ba0af63bcc4e46a6053933ffd539db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.045723 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12944efb54824dc4960db5d09c1a1684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.046268 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 7161894b9f9047fda9ed3f2180518a59 with delete_type TABLET_DATA_DELETED (replaced by tablet 4ffce2dc22e24d1684e6eae92c487cea) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.048745 901 tablet_service.cc:1511] Processing CreateTablet for tablet c0f19c77783a4b53b160589b74dbd20d (DEFAULT_TABLE table=default.Table_841219ea0cab496193e59d354a6ab57f [id=f3cb645d87e347ccbdf397b09b00bd22]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:00.046640 993 leader_election.cc:343] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.049119 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f19c77783a4b53b160589b74dbd20d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.049546 889 tablet_service.cc:1511] Processing CreateTablet for tablet 12944efb54824dc4960db5d09c1a1684 (DEFAULT_TABLE table=default.Table_45887a2d367d4294bce394b38dbe33ac [id=10ba0af63bcc4e46a6053933ffd539db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.049731 892 tablet_service.cc:1511] Processing CreateTablet for tablet c40408ccc3394b53b5bef1344a8378b4 (DEFAULT_TABLE table=default.Table_4a8926e8da30490abeb266622f644d74 [id=629d022afed4493da92785730b3681fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.049896 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12944efb54824dc4960db5d09c1a1684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.050213 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40408ccc3394b53b5bef1344a8378b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.051121 758 tablet_service.cc:1511] Processing CreateTablet for tablet 8f02d84ab7324b4c80875acf7f33199d (DEFAULT_TABLE table=default.Table_39d47e28935346aa86153d1c60006361 [id=e5b0f7437a4f4005bf65793acdba8c42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.051743 763 tablet_service.cc:1511] Processing CreateTablet for tablet cb771d17bd034199a1d615a6e98ba196 (DEFAULT_TABLE table=default.Table_48f9006fbde142939710d3c240a45bee [id=8bfb762bb5ce4787bfb3d24cfa6662b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.052124 746 tablet_service.cc:1511] Processing CreateTablet for tablet 899b5f53d3fd4e2ab7222555dcc120e2 (DEFAULT_TABLE table=default.Table_6ecb544894454b0a88d26fa422cab3fc [id=2b5cbc44f830478a8868749acfbdb1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.052546 752 tablet_service.cc:1511] Processing CreateTablet for tablet c40408ccc3394b53b5bef1344a8378b4 (DEFAULT_TABLE table=default.Table_4a8926e8da30490abeb266622f644d74 [id=629d022afed4493da92785730b3681fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.052742 898 tablet_service.cc:1511] Processing CreateTablet for tablet 32bf8c116d6d4c8780dc6aecb2570f9a (DEFAULT_TABLE table=default.Table_a7f1e25312e1460dae26b68c9dc6e727 [id=230151ddbf8a4332a8a9935670952bed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.052899 759 tablet_service.cc:1511] Processing CreateTablet for tablet c0f19c77783a4b53b160589b74dbd20d (DEFAULT_TABLE table=default.Table_841219ea0cab496193e59d354a6ab57f [id=f3cb645d87e347ccbdf397b09b00bd22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.053030 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32bf8c116d6d4c8780dc6aecb2570f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.053243 747 tablet_service.cc:1511] Processing CreateTablet for tablet ed8e5b059700443faab937488002de37 (DEFAULT_TABLE table=default.Table_c3a414b8774445a4a731cbbfa3f171bb [id=49d4de6b80e9492f8dfd7ea7d7bc5254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.053570 754 tablet_service.cc:1511] Processing CreateTablet for tablet d2b3bbc4adb0492a87cd9226cf6a3c8f (DEFAULT_TABLE table=default.Table_f72430c53c2c4cd6920a8fafb2020444 [id=43471edc259147898f90d4c639f647ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.053876 761 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4d4c8b67aa44f68a974f7ca7090dd4 (DEFAULT_TABLE table=default.Table_131945fffea34b6bb6a08d2a11f7c486 [id=be8da43787504535afda28af1077dd2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.054193 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0114e46af944bc9a6fa02c151089fd (DEFAULT_TABLE table=default.Table_08f38f9cab7848f598534ba789a70755 [id=7dd5d9499cc44e448936d8c6fe411c9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.054332 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f02d84ab7324b4c80875acf7f33199d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.054579 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0114e46af944bc9a6fa02c151089fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.055783 748 tablet_service.cc:1511] Processing CreateTablet for tablet 32bf8c116d6d4c8780dc6aecb2570f9a (DEFAULT_TABLE table=default.Table_a7f1e25312e1460dae26b68c9dc6e727 [id=230151ddbf8a4332a8a9935670952bed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.056126 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32bf8c116d6d4c8780dc6aecb2570f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.056593 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4d4c8b67aa44f68a974f7ca7090dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.056706 899 tablet_service.cc:1511] Processing CreateTablet for tablet d2b3bbc4adb0492a87cd9226cf6a3c8f (DEFAULT_TABLE table=default.Table_f72430c53c2c4cd6920a8fafb2020444 [id=43471edc259147898f90d4c639f647ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.056758 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 899b5f53d3fd4e2ab7222555dcc120e2 (DEFAULT_TABLE table=default.Table_6ecb544894454b0a88d26fa422cab3fc [id=2b5cbc44f830478a8868749acfbdb1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.057080 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 899b5f53d3fd4e2ab7222555dcc120e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.057166 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f19c77783a4b53b160589b74dbd20d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.060447 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed8e5b059700443faab937488002de37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.060706 1037 tablet_service.cc:1511] Processing CreateTablet for tablet ed8e5b059700443faab937488002de37 (DEFAULT_TABLE table=default.Table_c3a414b8774445a4a731cbbfa3f171bb [id=49d4de6b80e9492f8dfd7ea7d7bc5254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.061304 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 32bf8c116d6d4c8780dc6aecb2570f9a (DEFAULT_TABLE table=default.Table_a7f1e25312e1460dae26b68c9dc6e727 [id=230151ddbf8a4332a8a9935670952bed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.062077 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb771d17bd034199a1d615a6e98ba196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.062156 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 8f02d84ab7324b4c80875acf7f33199d (DEFAULT_TABLE table=default.Table_39d47e28935346aa86153d1c60006361 [id=e5b0f7437a4f4005bf65793acdba8c42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.062274 1026 tablet_service.cc:1511] Processing CreateTablet for tablet c40408ccc3394b53b5bef1344a8378b4 (DEFAULT_TABLE table=default.Table_4a8926e8da30490abeb266622f644d74 [id=629d022afed4493da92785730b3681fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.061718 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c0f19c77783a4b53b160589b74dbd20d (DEFAULT_TABLE table=default.Table_841219ea0cab496193e59d354a6ab57f [id=f3cb645d87e347ccbdf397b09b00bd22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.062937 885 tablet_service.cc:1511] Processing CreateTablet for tablet cb771d17bd034199a1d615a6e98ba196 (DEFAULT_TABLE table=default.Table_48f9006fbde142939710d3c240a45bee [id=8bfb762bb5ce4787bfb3d24cfa6662b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.063059 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed8e5b059700443faab937488002de37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.063288 900 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4d4c8b67aa44f68a974f7ca7090dd4 (DEFAULT_TABLE table=default.Table_131945fffea34b6bb6a08d2a11f7c486 [id=be8da43787504535afda28af1077dd2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.063299 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3de0e62cfd33410490a0b460fd5f69e9" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:00.063728 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32bf8c116d6d4c8780dc6aecb2570f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.064625 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59812b232848488b9894e8f8057e9def" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:00.065080 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b3bbc4adb0492a87cd9226cf6a3c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.066218 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 899b5f53d3fd4e2ab7222555dcc120e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.067278 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40408ccc3394b53b5bef1344a8378b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.068943 1678 raft_consensus.cc:493] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.069080 1678 raft_consensus.cc:515] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.069741 1678 leader_election.cc:290] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:00.070338 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6071d862241e196a83a23bc939af4" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:00.074203 860 leader_election.cc:343] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.075902 1645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "85d6b13547f2413c86ee07194ca74704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:52:00.076159 1645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: This master's current role is: LEADER
I20260616 19:52:00.076679 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7c5d4c5de0074eeab591e9440641ef8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.077283 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c5d4c5de0074eeab591e9440641ef8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.081691 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet d3645fc39d974bffa8fe52c62e1c7eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.082672 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f02d84ab7324b4c80875acf7f33199d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.082924 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f19c77783a4b53b160589b74dbd20d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.083016 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 815d213bf1904353b4f0b2e2f8954db9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.085492 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40408ccc3394b53b5bef1344a8378b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.091390 1196 tablet_bootstrap.cc:492] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:00.091465 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 662e2d573bd7489a81697c17393ce088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.092836 1198 tablet_bootstrap.cc:492] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:00.092980 1198 ts_tablet_manager.cc:1403] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.002s
I20260616 19:52:00.095170 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 12944efb54824dc4960db5d09c1a1684 (DEFAULT_TABLE table=default.Table_45887a2d367d4294bce394b38dbe33ac [id=10ba0af63bcc4e46a6053933ffd539db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.095636 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12944efb54824dc4960db5d09c1a1684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.095973 1691 raft_consensus.cc:493] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.107261 1193 ts_tablet_manager.cc:1929] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:00.107414 1193 log.cc:1199] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/21eb01a4b2424d63affa5d9d71e2fa64
I20260616 19:52:00.108331 1691 raft_consensus.cc:515] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.109987 1198 raft_consensus.cc:359] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.110204 1198 raft_consensus.cc:385] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:00.112206 1190 ts_tablet_manager.cc:1929] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:00.112383 1190 log.cc:1199] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/0f061d4bc90f42409eb99987059e6656
I20260616 19:52:00.112444 1678 raft_consensus.cc:493] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.114212 1691 leader_election.cc:290] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:00.115492 858 leader_election.cc:343] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: c6d6071d862241e196a83a23bc939af4
I20260616 19:52:00.117199 1037 tablet_service.cc:1511] Processing CreateTablet for tablet d2b3bbc4adb0492a87cd9226cf6a3c8f (DEFAULT_TABLE table=default.Table_f72430c53c2c4cd6920a8fafb2020444 [id=43471edc259147898f90d4c639f647ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.118382 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb771d17bd034199a1d615a6e98ba196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.119652 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93dd295602840319f72e7021ddfd61a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:00.119989 1031 tablet_service.cc:1511] Processing CreateTablet for tablet cb771d17bd034199a1d615a6e98ba196 (DEFAULT_TABLE table=default.Table_48f9006fbde142939710d3c240a45bee [id=8bfb762bb5ce4787bfb3d24cfa6662b2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:00.120239 993 leader_election.cc:343] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:00.120836 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76d73be228664063822c41cbefafcab8 consensus state has no leader
I20260616 19:52:00.117771 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c31c8e977da4a70bca1beb00f364627" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:00.121441 1193 ts_tablet_manager.cc:1950] T 21eb01a4b2424d63affa5d9d71e2fa64 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:00.121764 1196 tablet_bootstrap.cc:654] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.121295 1678 raft_consensus.cc:515] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.122624 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1593e08712fd4d02a8209a16b9d03cf0" } new_table_name: "default.Table_38a9745c06b24df1a9c2a5865aa12075" modify_external_catalogs: true
I20260616 19:52:00.123205 1190 ts_tablet_manager.cc:1950] T 0f061d4bc90f42409eb99987059e6656 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:00.123594 924 raft_consensus.cc:2468] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:00.124176 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b3bbc4adb0492a87cd9226cf6a3c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.131148 858 leader_election.cc:304] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:00.132071 1679 raft_consensus.cc:2749] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:00.133733 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c31c8e977da4a70bca1beb00f364627" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:00.134357 1192 tablet_bootstrap.cc:654] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.134660 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 297) took 3482 ms. Trace:
I20260616 19:52:00.135664 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4d4c8b67aa44f68a974f7ca7090dd4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:00.136636 860 leader_election.cc:343] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.139608 1678 leader_election.cc:290] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:00.140121 1190 rpcz_store.cc:276] 0616 19:51:56.648502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.648549 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:00.025036 (+3376487us) ts_tablet_manager.cc:1151] Deleting tablet 0f061d4bc90f42409eb99987059e6656
0616 19:52:00.025045 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.034645 (+ 9600us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:00.073845 (+ 39200us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:00.130954 (+ 57109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3376322}
I20260616 19:52:00.140697 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 307) took 3351 ms. Trace:
I20260616 19:52:00.141918 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 0f061d4bc90f42409eb99987059e6656 (table default.Table_6d7c8b4a63044ff78221b0a47f41d5a1 [id=b90ab6d60662478db8d946925f66450b]) successfully deleted
I20260616 19:52:00.142594 1190 rpcz_store.cc:276] 0616 19:51:56.789448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.790992 (+ 1544us) service_pool.cc:224] Handling call
0616 19:52:00.140456 (+3349464us) ts_tablet_manager.cc:1151] Deleting tablet 6cc988a195ec4bbf8691801421fed8bb
0616 19:52:00.140505 (+ 49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.140659 (+ 154us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3349264}
I20260616 19:52:00.143074 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 308) took 3353 ms. Trace:
W20260616 19:52:00.143566 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 6cc988a195ec4bbf8691801421fed8bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cc988a195ec4bbf8691801421fed8bb already in progress: creating tablet
I20260616 19:52:00.144392 1190 rpcz_store.cc:276] 0616 19:51:56.789554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.791225 (+ 1671us) service_pool.cc:224] Handling call
0616 19:52:00.142910 (+3351685us) ts_tablet_manager.cc:1151] Deleting tablet 17029c1ba36644e9847200b54bf9094c
0616 19:52:00.142923 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.143036 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3351531}
I20260616 19:52:00.144827 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 309) took 3355 ms. Trace:
I20260616 19:52:00.145100 1190 rpcz_store.cc:276] 0616 19:51:56.789650 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.791406 (+ 1756us) service_pool.cc:224] Handling call
0616 19:52:00.144681 (+3353275us) ts_tablet_manager.cc:1151] Deleting tablet 15d6a025b9a248c5ab9422fe1c340f3e
0616 19:52:00.144688 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.144791 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3309366}
I20260616 19:52:00.145514 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 310) took 3355 ms. Trace:
I20260616 19:52:00.145785 1190 rpcz_store.cc:276] 0616 19:51:56.789770 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.791465 (+ 1695us) service_pool.cc:224] Handling call
0616 19:52:00.145404 (+3353939us) ts_tablet_manager.cc:1151] Deleting tablet 67ac2e31a1ba40b39145c26a1e4e0884
0616 19:52:00.145413 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.145485 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3309904}
I20260616 19:52:00.146087 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 312) took 3290 ms. Trace:
I20260616 19:52:00.146185 1190 rpcz_store.cc:276] 0616 19:51:56.855745 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.856343 (+ 598us) service_pool.cc:224] Handling call
0616 19:52:00.145970 (+3289627us) ts_tablet_manager.cc:1151] Deleting tablet aabf57dd6d704645b6bf97b730dbe964
0616 19:52:00.145977 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.146061 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3289408}
I20260616 19:52:00.146445 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 314) took 3238 ms. Trace:
I20260616 19:52:00.146526 1190 rpcz_store.cc:276] 0616 19:51:56.908379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.909366 (+ 987us) service_pool.cc:224] Handling call
0616 19:52:00.146347 (+3236981us) ts_tablet_manager.cc:1151] Deleting tablet aa72e00b0a3a423f96bdd7abb6013810
0616 19:52:00.146354 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.146418 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3225376}
I20260616 19:52:00.146788 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 313) took 3282 ms. Trace:
I20260616 19:52:00.146884 1190 rpcz_store.cc:276] 0616 19:51:56.864339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:56.864402 (+ 63us) service_pool.cc:224] Handling call
0616 19:52:00.146692 (+3282290us) ts_tablet_manager.cc:1151] Deleting tablet 1e8160ad4cf74f16a586ae59291ce7d1
0616 19:52:00.146699 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.146761 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3222731}
I20260616 19:52:00.147089 1190 tablet_replica.cc:333] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:00.147280 1190 raft_consensus.cc:2243] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:00.147413 1190 raft_consensus.cc:2272] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:00.147940 1190 ts_tablet_manager.cc:1916] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:00.150345 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 17029c1ba36644e9847200b54bf9094c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17029c1ba36644e9847200b54bf9094c already in progress: creating tablet
W20260616 19:52:00.150599 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 15d6a025b9a248c5ab9422fe1c340f3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15d6a025b9a248c5ab9422fe1c340f3e already in progress: creating tablet
W20260616 19:52:00.150818 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 67ac2e31a1ba40b39145c26a1e4e0884 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67ac2e31a1ba40b39145c26a1e4e0884 already in progress: creating tablet
W20260616 19:52:00.151062 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet aabf57dd6d704645b6bf97b730dbe964 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aabf57dd6d704645b6bf97b730dbe964 already in progress: creating tablet
W20260616 19:52:00.151278 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet aa72e00b0a3a423f96bdd7abb6013810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa72e00b0a3a423f96bdd7abb6013810 already in progress: creating tablet
W20260616 19:52:00.151511 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 1e8160ad4cf74f16a586ae59291ce7d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e8160ad4cf74f16a586ae59291ce7d1 already in progress: creating tablet
I20260616 19:52:00.120584 1198 raft_consensus.cc:740] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.152405 1198 consensus_queue.cc:260] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.153119 1198 ts_tablet_manager.cc:1434] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.060s user 0.002s sys 0.000s
I20260616 19:52:00.153453 1198 tablet_bootstrap.cc:492] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:52:00.135053 996 leader_election.cc:343] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:00.153833 996 leader_election.cc:343] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.153971 996 leader_election.cc:304] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:00.154343 996 leader_election.cc:343] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.154505 996 leader_election.cc:304] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:00.154788 1692 raft_consensus.cc:2749] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:00.154999 1692 raft_consensus.cc:2749] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:00.155588 993 leader_election.cc:304] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:00.155951 1691 raft_consensus.cc:2804] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:00.156071 1691 raft_consensus.cc:493] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:00.156211 1691 raft_consensus.cc:3060] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.157063 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93dd295602840319f72e7021ddfd61a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:00.157279 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c31c8e977da4a70bca1beb00f364627" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:52:00.159359 996 leader_election.cc:343] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.159456 1691 raft_consensus.cc:515] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.159512 996 leader_election.cc:304] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:00.159811 1057 raft_consensus.cc:2393] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
I20260616 19:52:00.159888 1692 raft_consensus.cc:2749] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:00.160148 1691 leader_election.cc:290] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:00.135417 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b3bbc4adb0492a87cd9226cf6a3c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.160754 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c31c8e977da4a70bca1beb00f364627" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:00.161650 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb771d17bd034199a1d615a6e98ba196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.141099 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4d4c8b67aa44f68a974f7ca7090dd4 (DEFAULT_TABLE table=default.Table_131945fffea34b6bb6a08d2a11f7c486 [id=be8da43787504535afda28af1077dd2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.141112 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c392b2fecd483d9da12e30e37f27ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.120522 1191 ts_tablet_manager.cc:1916] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:00.166934 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 21eb01a4b2424d63affa5d9d71e2fa64 (table default.Table_873136a2abfb41018a2cec78a9f5fbc9 [id=1938e4f4794c4c3ebd2ea294477e38cd]) successfully deleted
I20260616 19:52:00.167212 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4d4c8b67aa44f68a974f7ca7090dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.168309 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c31c8e977da4a70bca1beb00f364627" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:00.166206 996 leader_election.cc:343] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.168668 858 leader_election.cc:304] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:00.169808 1198 tablet_bootstrap.cc:654] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.171232 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 28cd1ad6e8744d33a2845e9f3dda4a7b
I20260616 19:52:00.172205 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b
I20260616 19:52:00.172710 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd
I20260616 19:52:00.173766 1700 raft_consensus.cc:493] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.173911 1700 raft_consensus.cc:515] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:00.174248 460 catalog_manager.cc:6784] ReplaceTablet: tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b deleted and replaced by tablet f54eef97f8db47449564b49be608902f
I20260616 19:52:00.174571 1700 leader_election.cc:290] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:00.175217 754 tablet_service.cc:1558] Processing DeleteTablet for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b with delete_type TABLET_DATA_DELETED (replaced by tablet f54eef97f8db47449564b49be608902f) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.175529 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.175760 746 tablet_service.cc:1558] Processing DeleteTablet for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.177428 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:00.177874 719 leader_election.cc:343] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 0da93e4052094862a44812990df1136a
I20260616 19:52:00.178697 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.179176 924 raft_consensus.cc:3060] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.180830 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b with delete_type TABLET_DATA_DELETED (replaced by tablet f54eef97f8db47449564b49be608902f) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.183527 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da93e4052094862a44812990df1136a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:00.183915 923 raft_consensus.cc:2393] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
I20260616 19:52:00.184894 718 leader_election.cc:304] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:00.185360 1700 raft_consensus.cc:3060] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.187986 1700 raft_consensus.cc:2749] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:00.188359 888 tablet_service.cc:1558] Processing DeleteTablet for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b with delete_type TABLET_DATA_DELETED (replaced by tablet f54eef97f8db47449564b49be608902f) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.188843 902 tablet_service.cc:1558] Processing DeleteTablet for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.189057 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.190604 924 raft_consensus.cc:2468] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:00.191958 1678 raft_consensus.cc:2749] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:00.192088 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c8b5b92a83934f0f9255bf06e1438618"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.192823 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8b5b92a83934f0f9255bf06e1438618 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.194587 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ecd46c80217f4f00882db6c53db0eae5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.195180 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecd46c80217f4f00882db6c53db0eae5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.196563 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f325b72bd9214978b04a89c26e52749d" } new_table_name: "default.Table_e7a1f09b06ba438e894fb6f7190e6a49" modify_external_catalogs: true
I20260616 19:52:00.197860 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cb218be8407c4256b227a291d63e7ea5" } new_table_name: "default.Table_fd335042e2c64bfa9299d235a674767a" modify_external_catalogs: true
I20260616 19:52:00.200323 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1142b61e40e6499e8244d71f2ad39b1e
I20260616 19:52:00.200871 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1c35e4c8e9304e798c9031469877b70e
I20260616 19:52:00.201298 456 catalog_manager.cc:6784] ReplaceTablet: tablet 1c35e4c8e9304e798c9031469877b70e deleted and replaced by tablet b2e5e84b95c7429bb53dd616f118500a
I20260616 19:52:00.202244 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c35e4c8e9304e798c9031469877b70e with delete_type TABLET_DATA_DELETED (replaced by tablet b2e5e84b95c7429bb53dd616f118500a) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.202704 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 83a199f25e5c4accba0acd1007fc73d1 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:00.203274 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 1142b61e40e6499e8244d71f2ad39b1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.203845 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 1142b61e40e6499e8244d71f2ad39b1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.204128 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c35e4c8e9304e798c9031469877b70e with delete_type TABLET_DATA_DELETED (replaced by tablet b2e5e84b95c7429bb53dd616f118500a) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.204118 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c34fe4a4538c4369bb8094e88ca8ec0e" } modify_external_catalogs: true
I20260616 19:52:00.204288 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c34fe4a4538c4369bb8094e88ca8ec0e" } modify_external_catalogs: true
I20260616 19:52:00.204916 1196 tablet_bootstrap.cc:492] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:00.205087 1196 ts_tablet_manager.cc:1403] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.114s user 0.002s sys 0.002s
I20260616 19:52:00.205963 1196 raft_consensus.cc:359] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.206159 1196 raft_consensus.cc:385] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:00.206254 1196 raft_consensus.cc:740] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.206496 1196 consensus_queue.cc:260] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.207031 1196 ts_tablet_manager.cc:1434] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260616 19:52:00.207993 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 75c08452aeec471f8480a489620cca28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75c08452aeec471f8480a489620cca28 already in progress: creating tablet
W20260616 19:52:00.208933 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 19b9248b88434a6e9ef7a3d602eee70c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19b9248b88434a6e9ef7a3d602eee70c already in progress: creating tablet
W20260616 19:52:00.210191 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 647b1abeb3c14b11b9a5c62b67e83cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 647b1abeb3c14b11b9a5c62b67e83cf8 already in progress: creating tablet
W20260616 19:52:00.210784 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 5029a79e046a489aa9976eff948a3c5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5029a79e046a489aa9976eff948a3c5b already in progress: creating tablet
I20260616 19:52:00.211288 1193 tablet_replica.cc:333] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:00.211500 1193 raft_consensus.cc:2243] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:00.212136 1193 raft_consensus.cc:2272] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:00.212750 1193 ts_tablet_manager.cc:1916] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:00.213369 1192 tablet_bootstrap.cc:492] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:00.217254 459 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet eb04ccc26e64484a9a29c515d4b954fe (table default.Table_62b93909f63642cda25a0d17ce9b567c [id=87e3217093844e81ac448e2e9d8fa3ec]). Expected version 1 got 0
I20260616 19:52:00.218266 1192 ts_tablet_manager.cc:1403] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.212s user 0.005s sys 0.002s
I20260616 19:52:00.218905 763 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c392b2fecd483d9da12e30e37f27ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.219142 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 0da93e4052094862a44812990df1136a with delete_type TABLET_DATA_DELETED (replaced by tablet 49e88f4e88a64eca8aafc325f1834f54) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.219529 1192 raft_consensus.cc:359] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.219717 1192 raft_consensus.cc:385] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:00.219782 1192 raft_consensus.cc:740] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.220212 1192 consensus_queue.cc:260] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.221236 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_39d47e28935346aa86153d1c60006361" } modify_external_catalogs: true
I20260616 19:52:00.221439 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_39d47e28935346aa86153d1c60006361" } modify_external_catalogs: true
I20260616 19:52:00.222838 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f7a7857183304cac8a4969045913a3d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.223367 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7a7857183304cac8a4969045913a3d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.223655 1196 tablet_bootstrap.cc:492] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:00.225142 1192 ts_tablet_manager.cc:1434] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260616 19:52:00.225955 1678 raft_consensus.cc:493] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.226111 1678 raft_consensus.cc:515] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.226760 1678 leader_election.cc:290] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:00.227470 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb04ccc26e64484a9a29c515d4b954fe" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:00.227694 778 raft_consensus.cc:2468] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:00.228114 860 leader_election.cc:304] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:00.228456 1678 raft_consensus.cc:2804] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:00.228567 1678 raft_consensus.cc:493] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:00.228698 1678 raft_consensus.cc:3060] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.229725 1192 tablet_bootstrap.cc:492] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:00.231134 1196 tablet_bootstrap.cc:654] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.231325 1192 tablet_bootstrap.cc:654] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.231405 1678 raft_consensus.cc:515] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.233518 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb04ccc26e64484a9a29c515d4b954fe" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:00.233722 778 raft_consensus.cc:3060] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.236611 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 815d213bf1904353b4f0b2e2f8954db9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.236370 778 raft_consensus.cc:2468] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:00.237596 860 leader_election.cc:304] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:00.237921 1679 raft_consensus.cc:2804] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
W20260616 19:52:00.239666 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fac9c314b1824e3297cf568ea0b14865 has no consensus state
I20260616 19:52:00.241079 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4ab08a7ef94e463799cff8417484c512"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.241780 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ab08a7ef94e463799cff8417484c512 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.243294 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2046c3a7f01d4a9ca807fe953a4bf57e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.243773 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2046c3a7f01d4a9ca807fe953a4bf57e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.244779 1678 leader_election.cc:290] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:00.248922 1691 raft_consensus.cc:493] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.248762 993 leader_election.cc:304] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
W20260616 19:52:00.250438 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 consensus state has no leader
I20260616 19:52:00.250577 1193 ts_tablet_manager.cc:1929] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:00.250880 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_068824f36dc346c9bd18faf35c514ac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.251372 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_068824f36dc346c9bd18faf35c514ac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.256987 1692 raft_consensus.cc:2804] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:00.257164 1692 raft_consensus.cc:697] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:00.258520 1193 log.cc:1199] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/5af9bdceae184f8dbb9e5db67a11ee63
I20260616 19:52:00.258951 1193 ts_tablet_manager.cc:1950] T 5af9bdceae184f8dbb9e5db67a11ee63 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:00.259985 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 5af9bdceae184f8dbb9e5db67a11ee63 (table default.Table_bed17ff52ac5410784b004e2ef370bac [id=d948f287146b431dbce6363443e953a0]) successfully deleted
I20260616 19:52:00.260376 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 1142b61e40e6499e8244d71f2ad39b1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.260568 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c35e4c8e9304e798c9031469877b70e with delete_type TABLET_DATA_DELETED (replaced by tablet b2e5e84b95c7429bb53dd616f118500a) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:00.260876 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 335f7411fda84fada762345010a4339c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 335f7411fda84fada762345010a4339c already in progress: creating tablet
W20260616 19:52:00.262522 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df036f9d31ca4770bb00bc9cece46953 consensus state has no leader
W20260616 19:52:00.262645 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet b251bdf373574dffb04f9e2c837cfe78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b251bdf373574dffb04f9e2c837cfe78 already in progress: creating tablet
I20260616 19:52:00.262910 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_fd6b8678fea647c791ab6cdd5765f37e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.263448 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd6b8678fea647c791ab6cdd5765f37e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.264061 1196 tablet_bootstrap.cc:492] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:00.264214 1196 ts_tablet_manager.cc:1403] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.003s
I20260616 19:52:00.264705 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 83a199f25e5c4accba0acd1007fc73d1
W20260616 19:52:00.264880 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 58524.2us
I20260616 19:52:00.265264 457 catalog_manager.cc:6784] ReplaceTablet: tablet 83a199f25e5c4accba0acd1007fc73d1 deleted and replaced by tablet 3d589aa93d154fdcbf865774216a8738
I20260616 19:52:00.265483 1679 raft_consensus.cc:697] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:00.265646 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_805133e8e07b40a8a2e8a326ac7991ab" } new_table_name: "default.Table_0a6adf1d7e5244debb4424a25d63a45d" modify_external_catalogs: true
I20260616 19:52:00.265919 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 83a199f25e5c4accba0acd1007fc73d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d589aa93d154fdcbf865774216a8738) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.265902 1679 consensus_queue.cc:237] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.266090 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb04ccc26e64484a9a29c515d4b954fe" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:00.264981 1196 raft_consensus.cc:359] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.266376 1196 raft_consensus.cc:385] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:00.266500 1196 raft_consensus.cc:740] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.266834 1196 consensus_queue.cc:260] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.267549 456 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet c09295d3a83c4d4dbeac08cbec461cf0
I20260616 19:52:00.267711 1057 raft_consensus.cc:2468] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:00.269023 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 83a199f25e5c4accba0acd1007fc73d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d589aa93d154fdcbf865774216a8738) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.269342 1196 ts_tablet_manager.cc:1434] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260616 19:52:00.269729 1196 tablet_bootstrap.cc:492] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:00.269187 1692 consensus_queue.cc:237] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.271803 1196 tablet_bootstrap.cc:654] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.272013 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 83a199f25e5c4accba0acd1007fc73d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d589aa93d154fdcbf865774216a8738) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.272197 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb04ccc26e64484a9a29c515d4b954fe" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
W20260616 19:52:00.273281 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet efd5fecc6d444e5fba9103287c09542e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efd5fecc6d444e5fba9103287c09542e already in progress: creating tablet
W20260616 19:52:00.274132 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b already in progress: creating tablet
I20260616 19:52:00.274168 1057 raft_consensus.cc:3060] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.278532 1057 raft_consensus.cc:2468] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:00.278801 1198 tablet_bootstrap.cc:492] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
W20260616 19:52:00.279173 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28cd1ad6e8744d33a2845e9f3dda4a7b already in progress: creating tablet
I20260616 19:52:00.279649 1198 ts_tablet_manager.cc:1403] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.126s user 0.008s sys 0.006s
W20260616 19:52:00.279883 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd already in progress: creating tablet
W20260616 19:52:00.280613 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1c35e4c8e9304e798c9031469877b70e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c35e4c8e9304e798c9031469877b70e already in progress: creating tablet
I20260616 19:52:00.280680 1198 raft_consensus.cc:359] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.275187 1691 raft_consensus.cc:515] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:00.281450 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1142b61e40e6499e8244d71f2ad39b1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1142b61e40e6499e8244d71f2ad39b1e already in progress: creating tablet
I20260616 19:52:00.281688 1198 raft_consensus.cc:385] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:00.281812 1198 raft_consensus.cc:740] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.281961 1193 tablet_replica.cc:333] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:00.282192 1193 raft_consensus.cc:2243] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:00.282410 1193 raft_consensus.cc:2272] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:00.282953 1198 consensus_queue.cc:260] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.282970 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662e2d573bd7489a81697c17393ce088" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:00.283176 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662e2d573bd7489a81697c17393ce088" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:00.283702 996 leader_election.cc:343] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.284339 1193 ts_tablet_manager.cc:1916] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:00.288538 1691 leader_election.cc:290] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:00.289738 1198 ts_tablet_manager.cc:1434] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260616 19:52:00.290134 1198 tablet_bootstrap.cc:492] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:52:00.294447 993 leader_election.cc:343] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.294644 993 leader_election.cc:304] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:00.295281 1691 raft_consensus.cc:2749] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:00.298699 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8f02d84ab7324b4c80875acf7f33199d
I20260616 19:52:00.300961 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0d0fae5747a8441a9d7f5abd3f5c2687"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:00.301152 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f02d84ab7324b4c80875acf7f33199d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.301169 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f02d84ab7324b4c80875acf7f33199d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:00.301539 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d0fae5747a8441a9d7f5abd3f5c2687 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.302205 1196 tablet_bootstrap.cc:492] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:00.302371 1196 ts_tablet_manager.cc:1403] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260616 19:52:00.303079 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f02d84ab7324b4c80875acf7f33199d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.304347 1196 raft_consensus.cc:359] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.304558 1196 raft_consensus.cc:385] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:00.304670 1196 raft_consensus.cc:740] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.304991 1196 consensus_queue.cc:260] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.305598 1196 ts_tablet_manager.cc:1434] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:00.306002 1196 tablet_bootstrap.cc:492] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:00.311913 1196 tablet_bootstrap.cc:654] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.317705 1198 tablet_bootstrap.cc:654] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.317839 1193 ts_tablet_manager.cc:1929] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:00.317989 1193 log.cc:1199] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/f2c392b2fecd483d9da12e30e37f27ad
I20260616 19:52:00.318379 1193 ts_tablet_manager.cc:1950] T f2c392b2fecd483d9da12e30e37f27ad P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:00.320093 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet f2c392b2fecd483d9da12e30e37f27ad (table default.Table_ce91ab4603cc400d94cf6e1fcfe99048 [id=e05ed7086cba4c24b2a2d5968338a743]) successfully deleted
I20260616 19:52:00.324661 1691 raft_consensus.cc:493] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.324890 1691 raft_consensus.cc:515] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.325585 1691 leader_election.cc:290] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:00.326717 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815d213bf1904353b4f0b2e2f8954db9" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:00.326929 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815d213bf1904353b4f0b2e2f8954db9" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:00.326963 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_99062c985ddb45478d3464befd327e07" } new_table_name: "default.Table_5dad654c95f74c999b6dc8e20626e23e" modify_external_catalogs: true
I20260616 19:52:00.327185 924 raft_consensus.cc:2468] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
W20260616 19:52:00.327418 996 leader_election.cc:343] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.327643 993 leader_election.cc:304] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:00.327831 1193 tablet_replica.cc:333] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:00.328076 1193 raft_consensus.cc:2243] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:00.328099 1691 raft_consensus.cc:2804] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:00.328302 1691 raft_consensus.cc:493] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:00.328313 1193 raft_consensus.cc:2272] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:00.328745 1691 raft_consensus.cc:3060] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.332005 1691 raft_consensus.cc:515] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.332955 1193 ts_tablet_manager.cc:1916] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:00.343638 860 consensus_peers.cc:597] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:00.349264 1190 ts_tablet_manager.cc:1929] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:00.349422 1190 log.cc:1199] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/19832d0517524c0facf1f97486b1e58e
I20260616 19:52:00.349809 1190 ts_tablet_manager.cc:1950] T 19832d0517524c0facf1f97486b1e58e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:00.350171 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 325) took 3320 ms. Trace:
I20260616 19:52:00.350273 1190 rpcz_store.cc:276] 0616 19:51:57.029576 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.030387 (+ 811us) service_pool.cc:224] Handling call
0616 19:52:00.147041 (+3116654us) ts_tablet_manager.cc:1151] Deleting tablet 19832d0517524c0facf1f97486b1e58e
0616 19:52:00.147048 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.201697 (+ 54649us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:00.349183 (+147486us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:00.350123 (+ 940us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3059041}
I20260616 19:52:00.350728 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 19832d0517524c0facf1f97486b1e58e (table default.Table_b34131cb606f45af969cab4e285a435c [id=f26741a3387e47f2905c06b1d7eecb17]) successfully deleted
I20260616 19:52:00.351976 1691 leader_election.cc:290] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:00.352059 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815d213bf1904353b4f0b2e2f8954db9" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:00.352620 996 leader_election.cc:343] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.352682 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815d213bf1904353b4f0b2e2f8954db9" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:00.352888 924 raft_consensus.cc:3060] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.354171 1720 raft_consensus.cc:493] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:00.354501 1193 ts_tablet_manager.cc:1929] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:00.354365 1720 raft_consensus.cc:515] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:00.354647 1193 log.cc:1199] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/0da93e4052094862a44812990df1136a
I20260616 19:52:00.354967 1193 ts_tablet_manager.cc:1950] T 0da93e4052094862a44812990df1136a P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:00.355151 1720 leader_election.cc:290] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:00.355679 924 raft_consensus.cc:2468] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:00.355945 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 0da93e4052094862a44812990df1136a (table default.Table_fe763512a640490ebb25dca52b04788a [id=ad67f2c8f60f4c8c9b4ca2e57ffdb6f1]) successfully deleted
I20260616 19:52:00.356050 1192 tablet_bootstrap.cc:492] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:00.356207 1192 ts_tablet_manager.cc:1403] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.127s user 0.003s sys 0.000s
W20260616 19:52:00.357034 860 leader_election.cc:343] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: b5f60e9778dd429c8bdbf96261901a56
I20260616 19:52:00.357178 993 leader_election.cc:304] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:00.358491 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 269c1dea941c481fb6fd2e4d59c877c0 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:00.358817 1198 tablet_bootstrap.cc:492] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:00.360749 1198 ts_tablet_manager.cc:1403] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.002s
W20260616 19:52:00.361142 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 83a199f25e5c4accba0acd1007fc73d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83a199f25e5c4accba0acd1007fc73d1 already in progress: creating tablet
W20260616 19:52:00.361783 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8f02d84ab7324b4c80875acf7f33199d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f02d84ab7324b4c80875acf7f33199d already in progress: creating tablet
I20260616 19:52:00.361755 1198 raft_consensus.cc:359] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.361948 1198 raft_consensus.cc:385] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:00.362059 1198 raft_consensus.cc:740] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.362314 1691 raft_consensus.cc:2804] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:00.362829 1691 raft_consensus.cc:697] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:00.363250 1691 consensus_queue.cc:237] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.374897 1057 raft_consensus.cc:1275] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Refusing update from remote peer ae28da1c4102450ab76eb2946a5cbf2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:52:00.378146 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasknFdngH/build/asan/bin/kudu
/tmp/dist-test-tasknFdngH/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.189:43055
--webserver_interface=127.0.105.189
--webserver_port=42593
--builtin_ntp_servers=127.0.105.148:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260616 19:52:00.385396 858 leader_election.cc:343] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: b5f60e9778dd429c8bdbf96261901a56
I20260616 19:52:00.385681 858 leader_election.cc:304] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:00.385990 1678 consensus_queue.cc:1048] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:00.386518 1678 raft_consensus.cc:2749] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:00.390072 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_861e66e4d4424b7d91d0a3a5d3519db8" } modify_external_catalogs: true
I20260616 19:52:00.390270 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_861e66e4d4424b7d91d0a3a5d3519db8" } modify_external_catalogs: true
I20260616 19:52:00.391920 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8a1c5003a0044581ad712e93bff911e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:00.392992 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_032fed7521604405ba49b2f399e0f628" } modify_external_catalogs: true
W20260616 19:52:00.393215 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a1c5003a0044581ad712e93bff911e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.395802 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_032fed7521604405ba49b2f399e0f628" } modify_external_catalogs: true
I20260616 19:52:00.398399 1196 tablet_bootstrap.cc:492] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:00.399012 1196 ts_tablet_manager.cc:1403] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.093s user 0.011s sys 0.002s
I20260616 19:52:00.400554 1196 raft_consensus.cc:359] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.406586 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8f93c0209c4d41ea9c714fe9ebed8588" } modify_external_catalogs: true
I20260616 19:52:00.406806 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8f93c0209c4d41ea9c714fe9ebed8588" } modify_external_catalogs: true
I20260616 19:52:00.411545 1192 raft_consensus.cc:359] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.411809 1192 raft_consensus.cc:385] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:00.411907 1192 raft_consensus.cc:740] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.413532 1198 consensus_queue.cc:260] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.412213 1192 consensus_queue.cc:260] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.414644 1192 ts_tablet_manager.cc:1434] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.058s user 0.001s sys 0.000s
I20260616 19:52:00.412770 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 327) took 3323 ms. Trace:
I20260616 19:52:00.417068 1190 rpcz_store.cc:276] 0616 19:51:57.089685 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.090488 (+ 803us) service_pool.cc:224] Handling call
0616 19:52:00.412547 (+3322059us) ts_tablet_manager.cc:1151] Deleting tablet 40bdb01a15254c329d82f0d40919b880
0616 19:52:00.412561 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.412701 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3307092}
W20260616 19:52:00.417626 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 40bdb01a15254c329d82f0d40919b880 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40bdb01a15254c329d82f0d40919b880 already in progress: creating tablet
I20260616 19:52:00.418303 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 328) took 3324 ms. Trace:
I20260616 19:52:00.419935 456 master_service.cc:960] ReplaceTablet: received request to replace tablet a817b1d4c7b640db8894bc801878caae from {username='slave'} at 127.0.0.1:41696
W20260616 19:52:00.421324 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a817b1d4c7b640db8894bc801878caae consensus state has no leader
I20260616 19:52:00.421968 458 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 59812b232848488b9894e8f8057e9def (table default.Table_191f8acd55ae4da9982a9fb3ec2d51cd [id=1beb7d130df7492ab9b834d005eba63a]). Expected version 2 got 0
I20260616 19:52:00.423079 461 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 59812b232848488b9894e8f8057e9def (table default.Table_191f8acd55ae4da9982a9fb3ec2d51cd [id=1beb7d130df7492ab9b834d005eba63a]). Expected version 2 got 0
I20260616 19:52:00.423995 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 915267e7ff3c439385a861dfb954b852 (DEFAULT_TABLE table=default.Table_792e3d8aaa5a4e939050bd897488eec3 [id=a3a54feadc5346c0a9d3c20dd65fa346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.425088 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915267e7ff3c439385a861dfb954b852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.428706 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]). Expected version 1 got 0
I20260616 19:52:00.428759 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 9105320d5b36457d9dd74b553a44db2c (DEFAULT_TABLE table=default.Table_71fb3dee8f0f492ab31a753471d0273b [id=06fe6890f62a4fecbd0fad95f9678c52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.428892 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 7dc92bc15da14504a1ff5feda5aff7cf (table default.Table_6955250583bf4c3cbff20316dfa5d1a7 [id=8c7791625cfd4d39ad0dff83be1c7089]). Expected version 1 got 0
I20260616 19:52:00.429147 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9105320d5b36457d9dd74b553a44db2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.431157 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 3de0e62cfd33410490a0b460fd5f69e9 (table default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]). Expected version 2 got 0
I20260616 19:52:00.431404 459 catalog_manager.cc:5696] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131). New cstate: current_term: 1 leader_uuid: "61c874fef3684d10a272a9c7f280e0e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:00.431744 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca03b6e81e546adada566607257369f (DEFAULT_TABLE table=default.Table_246d3701c107443eafaca0a854ab5d6c [id=70e0a5d50fe7400297a4b0ceccaaaed7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.431851 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet d51a6fb4c49e461583a5aba1813b2a3e (table default.Table_b3d1ae6133974de8942b6f6a2ae9f310 [id=2d4376cceca648ef87dcf561d1e9e701]). Expected version 1 got 0
I20260616 19:52:00.432076 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca03b6e81e546adada566607257369f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.432263 459 catalog_manager.cc:5696] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131). New cstate: current_term: 1 leader_uuid: "61c874fef3684d10a272a9c7f280e0e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:00.432715 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 7dc92bc15da14504a1ff5feda5aff7cf (table default.Table_6955250583bf4c3cbff20316dfa5d1a7 [id=8c7791625cfd4d39ad0dff83be1c7089]). Expected version 1 got 0
I20260616 19:52:00.437938 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 90630f9e6f314c5d9589e673339f475a (DEFAULT_TABLE table=default.Table_e4cc2f16ea18496ca63a4bf823ed95e9 [id=a57245b522504194adefc86368c73083]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.438308 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90630f9e6f314c5d9589e673339f475a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.440735 1028 tablet_service.cc:1511] Processing CreateTablet for tablet d597510008ca4412a92d35f889e72ac3 (DEFAULT_TABLE table=default.Table_b352275041f9457091d04f83e545dea0 [id=82609a0917c2404abf231a3b5a595821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.441074 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d597510008ca4412a92d35f889e72ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.443229 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7b40c6fbe572449e9bf54bdd4a500c41" } new_table_name: "default.Table_d2059128d10847918c1d4b6546fda761" modify_external_catalogs: true
I20260616 19:52:00.444500 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4d37635717d84d3e9891538926193745"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:00.444691 1030 tablet_service.cc:1511] Processing CreateTablet for tablet b85b7b89ea1f4a1eab7f132f8edd1e17 (DEFAULT_TABLE table=default.Table_2306f75ff05f40bb85834153623949eb [id=3cf95f04697549b383f0110d9e73997d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.445020 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85b7b89ea1f4a1eab7f132f8edd1e17. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:00.445012 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d37635717d84d3e9891538926193745 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.446182 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8a8ebba0148c494180484e421fa045e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.446651 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a8ebba0148c494180484e421fa045e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.452133 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 415ad9d0c3564453825c4b30c0ad64fa (DEFAULT_TABLE table=default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4 [id=7c1cbcd4d250459cba3590b94f9c8519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.452617 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415ad9d0c3564453825c4b30c0ad64fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.456746 1026 tablet_service.cc:1511] Processing CreateTablet for tablet fac9c314b1824e3297cf568ea0b14865 (DEFAULT_TABLE table=default.Table_38a9745c06b24df1a9c2a5865aa12075 [id=522a3615be8349dd9db1f00a5dc5f400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.457604 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 269c1dea941c481fb6fd2e4d59c877c0
I20260616 19:52:00.457849 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac9c314b1824e3297cf568ea0b14865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.458134 460 catalog_manager.cc:6784] ReplaceTablet: tablet 269c1dea941c481fb6fd2e4d59c877c0 deleted and replaced by tablet 6b0f5388a73143569012ed714e53a8be
I20260616 19:52:00.460549 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1e4310104a4b238d80116604a1af3a (DEFAULT_TABLE table=default.Table_6a70be3041964598b68e745594423be8 [id=7bb8a414fe93474099f6e24139a4054e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.460691 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 482411d57f24459d8e7ed0eeb573234d
I20260616 19:52:00.460901 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1e4310104a4b238d80116604a1af3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.461354 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 269c1dea941c481fb6fd2e4d59c877c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b0f5388a73143569012ed714e53a8be) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.461755 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a817b1d4c7b640db8894bc801878caae
I20260616 19:52:00.462224 456 catalog_manager.cc:6784] ReplaceTablet: tablet a817b1d4c7b640db8894bc801878caae deleted and replaced by tablet cf23aef677064e43bbba3ffba26f2719
I20260616 19:52:00.462608 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 2171eb55560f44dd91ad52e0b5b49408 (DEFAULT_TABLE table=default.Table_a84e0dab565b459c96cdce84214af742 [id=be40d7e74be1474c98f06b62d98de5db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.462931 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2171eb55560f44dd91ad52e0b5b49408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.462973 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 3c90eb04585c4fa992435d11015ffec7
I20260616 19:52:00.463824 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 93c940bd14a040ddba5ea058e732bf0c
I20260616 19:52:00.466557 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet a817b1d4c7b640db8894bc801878caae with delete_type TABLET_DATA_DELETED (replaced by tablet cf23aef677064e43bbba3ffba26f2719) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.467989 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 93c940bd14a040ddba5ea058e732bf0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.468971 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c90eb04585c4fa992435d11015ffec7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.469520 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 482411d57f24459d8e7ed0eeb573234d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.470199 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 350453721d13427a946ac5c5ee7c62a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.470386 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet a93dd295602840319f72e7021ddfd61a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.470834 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f85a1250cf4542d0802dc876e5da7b25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.471395 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f85a1250cf4542d0802dc876e5da7b25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.472436 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e2695b46a446427381c2ea1d260bed78" } new_table_name: "default.Table_3536b19bb5a945fe82c917a32a72747f" modify_external_catalogs: true
I20260616 19:52:00.475749 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7bcf075ada124095b23b2fb0b84099ca" } new_table_name: "default.Table_af4ff5c6788b42c9942e0038b22cd2bf" modify_external_catalogs: true
I20260616 19:52:00.476399 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6ecb544894454b0a88d26fa422cab3fc" } modify_external_catalogs: true
W20260616 19:52:00.479928 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e03e6a2614564eeeb8ec382b16f0ece1 consensus state has no leader
I20260616 19:52:00.484074 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6ecb544894454b0a88d26fa422cab3fc" } modify_external_catalogs: true
W20260616 19:52:00.504036 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db750fc9641f492494fdb167de86f6df consensus state has no leader
I20260616 19:52:00.505116 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_465ef4c1c4044473a6e721ae45cbd7a1" } modify_external_catalogs: true
I20260616 19:52:00.505367 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_465ef4c1c4044473a6e721ae45cbd7a1" } modify_external_catalogs: true
W20260616 19:52:00.517251 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c19c2e43a944893b86982bee1eb2f30 consensus state has no leader
I20260616 19:52:00.428503 900 tablet_service.cc:1511] Processing CreateTablet for tablet 9105320d5b36457d9dd74b553a44db2c (DEFAULT_TABLE table=default.Table_71fb3dee8f0f492ab31a753471d0273b [id=06fe6890f62a4fecbd0fad95f9678c52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.429564 885 tablet_service.cc:1511] Processing CreateTablet for tablet 915267e7ff3c439385a861dfb954b852 (DEFAULT_TABLE table=default.Table_792e3d8aaa5a4e939050bd897488eec3 [id=a3a54feadc5346c0a9d3c20dd65fa346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.431183 899 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca03b6e81e546adada566607257369f (DEFAULT_TABLE table=default.Table_246d3701c107443eafaca0a854ab5d6c [id=70e0a5d50fe7400297a4b0ceccaaaed7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.434876 902 tablet_service.cc:1511] Processing CreateTablet for tablet d597510008ca4412a92d35f889e72ac3 (DEFAULT_TABLE table=default.Table_b352275041f9457091d04f83e545dea0 [id=82609a0917c2404abf231a3b5a595821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.435200 892 tablet_service.cc:1511] Processing CreateTablet for tablet 90630f9e6f314c5d9589e673339f475a (DEFAULT_TABLE table=default.Table_e4cc2f16ea18496ca63a4bf823ed95e9 [id=a57245b522504194adefc86368c73083]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.436920 888 tablet_service.cc:1511] Processing CreateTablet for tablet b85b7b89ea1f4a1eab7f132f8edd1e17 (DEFAULT_TABLE table=default.Table_2306f75ff05f40bb85834153623949eb [id=3cf95f04697549b383f0110d9e73997d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.444378 891 tablet_service.cc:1511] Processing CreateTablet for tablet 415ad9d0c3564453825c4b30c0ad64fa (DEFAULT_TABLE table=default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4 [id=7c1cbcd4d250459cba3590b94f9c8519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.448745 889 tablet_service.cc:1511] Processing CreateTablet for tablet fac9c314b1824e3297cf568ea0b14865 (DEFAULT_TABLE table=default.Table_38a9745c06b24df1a9c2a5865aa12075 [id=522a3615be8349dd9db1f00a5dc5f400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.449082 901 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1e4310104a4b238d80116604a1af3a (DEFAULT_TABLE table=default.Table_6a70be3041964598b68e745594423be8 [id=7bb8a414fe93474099f6e24139a4054e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.451050 898 tablet_service.cc:1511] Processing CreateTablet for tablet 2171eb55560f44dd91ad52e0b5b49408 (DEFAULT_TABLE table=default.Table_a84e0dab565b459c96cdce84214af742 [id=be40d7e74be1474c98f06b62d98de5db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.458990 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 269c1dea941c481fb6fd2e4d59c877c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b0f5388a73143569012ed714e53a8be) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.461886 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 482411d57f24459d8e7ed0eeb573234d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.463215 893 tablet_service.cc:1558] Processing DeleteTablet for tablet a817b1d4c7b640db8894bc801878caae with delete_type TABLET_DATA_DELETED (replaced by tablet cf23aef677064e43bbba3ffba26f2719) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.466265 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c90eb04585c4fa992435d11015ffec7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.466441 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 93c940bd14a040ddba5ea058e732bf0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.522789 1190 rpcz_store.cc:276] 0616 19:51:57.093746 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.093862 (+ 116us) service_pool.cc:224] Handling call
0616 19:52:00.418139 (+3324277us) ts_tablet_manager.cc:1151] Deleting tablet bfff9d60bb7e4a86b14687b581b45efe
0616 19:52:00.418149 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.418249 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3312389}
W20260616 19:52:00.524785 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet bfff9d60bb7e4a86b14687b581b45efe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfff9d60bb7e4a86b14687b581b45efe already in progress: creating tablet
I20260616 19:52:00.524971 1627 raft_consensus.cc:493] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.525148 1627 raft_consensus.cc:515] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.525774 1627 leader_election.cc:290] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:00.527875 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f52eebdc79460a9ff33191086e87c6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:00.528884 993 leader_election.cc:343] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.529078 1567 consensus_queue.cc:1048] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:00.536124 897 tablet_service.cc:1511] Processing CreateTablet for tablet 88246ba54ff543cb8effb3b96019a2b8 (DEFAULT_TABLE table=default.Table_8a1c5003a0044581ad712e93bff911e2 [id=003b87fcdc824c5c9dffad8092480ee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.536720 890 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbe171dfa104821bccfb19e1a0f5d3a (DEFAULT_TABLE table=default.Table_0d0fae5747a8441a9d7f5abd3f5c2687 [id=2e950d9b9bd444518ec4d1661c261f5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.537257 893 tablet_service.cc:1511] Processing CreateTablet for tablet 26b044bb36c84f64a32c774515a339c4 (DEFAULT_TABLE table=default.Table_4ab08a7ef94e463799cff8417484c512 [id=37e9d08c995f41c4b6c1be16e2a4db2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.427521 763 tablet_service.cc:1511] Processing CreateTablet for tablet 915267e7ff3c439385a861dfb954b852 (DEFAULT_TABLE table=default.Table_792e3d8aaa5a4e939050bd897488eec3 [id=a3a54feadc5346c0a9d3c20dd65fa346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.539785 1196 raft_consensus.cc:385] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:00.427646 746 tablet_service.cc:1511] Processing CreateTablet for tablet 9105320d5b36457d9dd74b553a44db2c (DEFAULT_TABLE table=default.Table_71fb3dee8f0f492ab31a753471d0273b [id=06fe6890f62a4fecbd0fad95f9678c52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.540089 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915267e7ff3c439385a861dfb954b852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.427789 754 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c392b2fecd483d9da12e30e37f27ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.428088 752 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca03b6e81e546adada566607257369f (DEFAULT_TABLE table=default.Table_246d3701c107443eafaca0a854ab5d6c [id=70e0a5d50fe7400297a4b0ceccaaaed7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.540303 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_212faf407ae04371ba02a809674afe10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:00.540524 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca03b6e81e546adada566607257369f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:00.540982 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_212faf407ae04371ba02a809674afe10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.541945 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2e2432072a8f43cfa54ceabaaf6a7528"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.542423 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e2432072a8f43cfa54ceabaaf6a7528 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.544008 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b41e8d48509440ddbbced9c3783efd0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.544521 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b41e8d48509440ddbbced9c3783efd0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.432518 747 tablet_service.cc:1511] Processing CreateTablet for tablet 90630f9e6f314c5d9589e673339f475a (DEFAULT_TABLE table=default.Table_e4cc2f16ea18496ca63a4bf823ed95e9 [id=a57245b522504194adefc86368c73083]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.433826 750 tablet_service.cc:1511] Processing CreateTablet for tablet d597510008ca4412a92d35f889e72ac3 (DEFAULT_TABLE table=default.Table_b352275041f9457091d04f83e545dea0 [id=82609a0917c2404abf231a3b5a595821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.544981 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9105320d5b36457d9dd74b553a44db2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.545212 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d597510008ca4412a92d35f889e72ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.435878 756 tablet_service.cc:1511] Processing CreateTablet for tablet b85b7b89ea1f4a1eab7f132f8edd1e17 (DEFAULT_TABLE table=default.Table_2306f75ff05f40bb85834153623949eb [id=3cf95f04697549b383f0110d9e73997d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.442723 758 tablet_service.cc:1511] Processing CreateTablet for tablet 415ad9d0c3564453825c4b30c0ad64fa (DEFAULT_TABLE table=default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4 [id=7c1cbcd4d250459cba3590b94f9c8519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.445863 748 tablet_service.cc:1511] Processing CreateTablet for tablet fac9c314b1824e3297cf568ea0b14865 (DEFAULT_TABLE table=default.Table_38a9745c06b24df1a9c2a5865aa12075 [id=522a3615be8349dd9db1f00a5dc5f400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.448021 759 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1e4310104a4b238d80116604a1af3a (DEFAULT_TABLE table=default.Table_6a70be3041964598b68e745594423be8 [id=7bb8a414fe93474099f6e24139a4054e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.449956 761 tablet_service.cc:1511] Processing CreateTablet for tablet 2171eb55560f44dd91ad52e0b5b49408 (DEFAULT_TABLE table=default.Table_a84e0dab565b459c96cdce84214af742 [id=be40d7e74be1474c98f06b62d98de5db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.458583 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 269c1dea941c481fb6fd2e4d59c877c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b0f5388a73143569012ed714e53a8be) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.461544 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 482411d57f24459d8e7ed0eeb573234d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.462836 753 tablet_service.cc:1558] Processing DeleteTablet for tablet a817b1d4c7b640db8894bc801878caae with delete_type TABLET_DATA_DELETED (replaced by tablet cf23aef677064e43bbba3ffba26f2719) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.465736 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c90eb04585c4fa992435d11015ffec7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.467482 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 93c940bd14a040ddba5ea058e732bf0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.533012 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f52eebdc79460a9ff33191086e87c6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:00.533838 764 tablet_service.cc:1511] Processing CreateTablet for tablet 88246ba54ff543cb8effb3b96019a2b8 (DEFAULT_TABLE table=default.Table_8a1c5003a0044581ad712e93bff911e2 [id=003b87fcdc824c5c9dffad8092480ee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.534017 762 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbe171dfa104821bccfb19e1a0f5d3a (DEFAULT_TABLE table=default.Table_0d0fae5747a8441a9d7f5abd3f5c2687 [id=2e950d9b9bd444518ec4d1661c261f5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.534384 751 tablet_service.cc:1511] Processing CreateTablet for tablet 26b044bb36c84f64a32c774515a339c4 (DEFAULT_TABLE table=default.Table_4ab08a7ef94e463799cff8417484c512 [id=37e9d08c995f41c4b6c1be16e2a4db2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.549213 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbe171dfa104821bccfb19e1a0f5d3a (DEFAULT_TABLE table=default.Table_0d0fae5747a8441a9d7f5abd3f5c2687 [id=2e950d9b9bd444518ec4d1661c261f5e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:00.551115 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f2c392b2fecd483d9da12e30e37f27ad because the tablet was not found. No further retry: Not found: Tablet not found: f2c392b2fecd483d9da12e30e37f27ad
I20260616 19:52:00.551976 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 899b5f53d3fd4e2ab7222555dcc120e2
I20260616 19:52:00.552238 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbe171dfa104821bccfb19e1a0f5d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.555006 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_df7c593c98334922b13b1cfc1cae9340"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.555668 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df7c593c98334922b13b1cfc1cae9340 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.557546 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85b7b89ea1f4a1eab7f132f8edd1e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.539896 1196 raft_consensus.cc:740] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.557974 749 tablet_service.cc:1511] Processing CreateTablet for tablet f9484090f92e48e3869d777f55f5cd17 (DEFAULT_TABLE table=default.Table_2046c3a7f01d4a9ca807fe953a4bf57e [id=b38ae8727f66492abedb96a6127b4132]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.559839 1196 consensus_queue.cc:260] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.560508 1196 ts_tablet_manager.cc:1434] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.161s user 0.002s sys 0.000s
I20260616 19:52:00.561794 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90630f9e6f314c5d9589e673339f475a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.562134 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415ad9d0c3564453825c4b30c0ad64fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.562534 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88246ba54ff543cb8effb3b96019a2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.562758 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2171eb55560f44dd91ad52e0b5b49408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.567238 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 731556662b62419dae76149b22469ebd
I20260616 19:52:00.568673 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b044bb36c84f64a32c774515a339c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.549718 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 26b044bb36c84f64a32c774515a339c4 (DEFAULT_TABLE table=default.Table_4ab08a7ef94e463799cff8417484c512 [id=37e9d08c995f41c4b6c1be16e2a4db2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.566859 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 88246ba54ff543cb8effb3b96019a2b8 (DEFAULT_TABLE table=default.Table_8a1c5003a0044581ad712e93bff911e2 [id=003b87fcdc824c5c9dffad8092480ee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.571302 1196 tablet_bootstrap.cc:492] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:00.573438 1196 tablet_bootstrap.cc:654] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.573504 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac9c314b1824e3297cf568ea0b14865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.576596 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b044bb36c84f64a32c774515a339c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.578243 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbe171dfa104821bccfb19e1a0f5d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.579021 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88246ba54ff543cb8effb3b96019a2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.580749 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9484090f92e48e3869d777f55f5cd17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.584779 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1e4310104a4b238d80116604a1af3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.592437 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 899b5f53d3fd4e2ab7222555dcc120e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.592700 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 731556662b62419dae76149b22469ebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:00.594445 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 269c1dea941c481fb6fd2e4d59c877c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 269c1dea941c481fb6fd2e4d59c877c0 already in progress: creating tablet
W20260616 19:52:00.594698 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a817b1d4c7b640db8894bc801878caae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a817b1d4c7b640db8894bc801878caae already in progress: creating tablet
W20260616 19:52:00.594902 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 3c90eb04585c4fa992435d11015ffec7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c90eb04585c4fa992435d11015ffec7 already in progress: creating tablet
W20260616 19:52:00.595115 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 93c940bd14a040ddba5ea058e732bf0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93c940bd14a040ddba5ea058e732bf0c already in progress: creating tablet
W20260616 19:52:00.595322 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 482411d57f24459d8e7ed0eeb573234d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 482411d57f24459d8e7ed0eeb573234d already in progress: creating tablet
I20260616 19:52:00.596614 1700 raft_consensus.cc:493] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.596807 1700 raft_consensus.cc:515] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.597433 1700 leader_election.cc:290] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:00.597586 1700 raft_consensus.cc:493] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.597606 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f708aab917b844abbd6f94d1e60d14b3" } new_table_name: "default.Table_4721681e12e54cae8311e14d084247db" modify_external_catalogs: true
I20260616 19:52:00.597693 1700 raft_consensus.cc:515] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.598233 1700 leader_election.cc:290] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:00.599646 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59812b232848488b9894e8f8057e9def" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:00.599709 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7f591d97bc4571b294b06d990d4065" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:00.599889 924 raft_consensus.cc:2468] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
W20260616 19:52:00.600345 718 leader_election.cc:343] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.600607 718 leader_election.cc:304] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:00.600602 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_57a368898c984d4bb5a93f59c565c654"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.601166 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57a368898c984d4bb5a93f59c565c654 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.611230 1700 raft_consensus.cc:2804] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:00.611366 1700 raft_consensus.cc:493] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:00.611452 1700 raft_consensus.cc:3060] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.622488 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e507611d620b4d9aa713d673c64bd815"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.623162 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e507611d620b4d9aa713d673c64bd815 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.625066 903 tablet_service.cc:1511] Processing CreateTablet for tablet f9484090f92e48e3869d777f55f5cd17 (DEFAULT_TABLE table=default.Table_2046c3a7f01d4a9ca807fe953a4bf57e [id=b38ae8727f66492abedb96a6127b4132]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.625622 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59812b232848488b9894e8f8057e9def" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:00.625612 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 899b5f53d3fd4e2ab7222555dcc120e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:00.625723 996 leader_election.cc:343] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.619457 1192 tablet_bootstrap.cc:492] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:00.636686 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9484090f92e48e3869d777f55f5cd17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.636970 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85b7b89ea1f4a1eab7f132f8edd1e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.637228 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac9c314b1824e3297cf568ea0b14865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.637405 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b34131cb606f45af969cab4e285a435c" } new_table_name: "default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b" modify_external_catalogs: true
I20260616 19:52:00.648183 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415ad9d0c3564453825c4b30c0ad64fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.648450 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915267e7ff3c439385a861dfb954b852. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:00.649886 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 41f2d259a31c4f4eaeceaba57fb978b2 consensus state has no leader
I20260616 19:52:00.650321 903 tablet_service.cc:1511] Processing CreateTablet for tablet 795c9643c1e84ddabc9130ef42d5c793 (DEFAULT_TABLE table=default.Table_f7a7857183304cac8a4969045913a3d5 [id=c246c995867d41ca9895cbfcae5b7c7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.650728 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795c9643c1e84ddabc9130ef42d5c793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.651678 1196 tablet_bootstrap.cc:492] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:00.651839 1196 ts_tablet_manager.cc:1403] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.081s user 0.003s sys 0.000s
I20260616 19:52:00.651957 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90630f9e6f314c5d9589e673339f475a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.652601 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88246ba54ff543cb8effb3b96019a2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.652678 1196 raft_consensus.cc:359] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.652863 1196 raft_consensus.cc:385] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:00.652951 1196 raft_consensus.cc:740] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.656610 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d597510008ca4412a92d35f889e72ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.658499 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbe171dfa104821bccfb19e1a0f5d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.660596 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9105320d5b36457d9dd74b553a44db2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.663166 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2171eb55560f44dd91ad52e0b5b49408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.665297 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca03b6e81e546adada566607257369f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.670078 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1e4310104a4b238d80116604a1af3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.672979 1739 tablet.cc:1724] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260616 19:52:00.677256 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9e98175df9ce48a59cb42b1e48cd7fba" } modify_external_catalogs: true
I20260616 19:52:00.677488 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9e98175df9ce48a59cb42b1e48cd7fba" } modify_external_catalogs: true
I20260616 19:52:00.678385 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7f591d97bc4571b294b06d990d4065" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:00.678617 1058 raft_consensus.cc:2468] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:00.679018 1059 raft_consensus.cc:2468] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:00.678985 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_de40de7f1c184226aad857d32b71c326"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.679558 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de40de7f1c184226aad857d32b71c326 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.679896 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 731556662b62419dae76149b22469ebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.680241 996 leader_election.cc:304] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:00.680658 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 54959.4us
I20260616 19:52:00.680910 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_29a007aa6e0a4f58a0c38a06900abdd4" } modify_external_catalogs: true
I20260616 19:52:00.681092 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_29a007aa6e0a4f58a0c38a06900abdd4" } modify_external_catalogs: true
I20260616 19:52:00.681308 719 leader_election.cc:304] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:00.681516 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_212faf407ae04371ba02a809674afe10" } new_table_name: "default.Table_647d295a0348455285299b2011b05288" modify_external_catalogs: true
I20260616 19:52:00.682053 1032 tablet_service.cc:1511] Processing CreateTablet for tablet f9484090f92e48e3869d777f55f5cd17 (DEFAULT_TABLE table=default.Table_2046c3a7f01d4a9ca807fe953a4bf57e [id=b38ae8727f66492abedb96a6127b4132]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.682706 1743 raft_consensus.cc:2804] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:00.682878 1743 raft_consensus.cc:493] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:00.683087 1743 raft_consensus.cc:3060] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.684600 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9484090f92e48e3869d777f55f5cd17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.685313 778 raft_consensus.cc:3060] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.685328 1692 raft_consensus.cc:2749] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:00.685529 1198 ts_tablet_manager.cc:1434] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.254s user 0.002s sys 0.002s
I20260616 19:52:00.683722 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_940a8144c5014fc9b2fcb74257f85d89" } modify_external_catalogs: true
I20260616 19:52:00.685714 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_940a8144c5014fc9b2fcb74257f85d89" } modify_external_catalogs: true
I20260616 19:52:00.687055 1198 tablet_bootstrap.cc:492] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:00.688658 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 95c5ec6f236f4e6c8c2a5b4f99a466b9 (DEFAULT_TABLE table=default.Table_ecd46c80217f4f00882db6c53db0eae5 [id=f397c850fa1d41f5b91c3e1d7a5d3c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.689018 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c5ec6f236f4e6c8c2a5b4f99a466b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.688905 1700 raft_consensus.cc:515] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.689821 762 tablet_service.cc:1511] Processing CreateTablet for tablet f68719133f9340399dfdd97a07abf331 (DEFAULT_TABLE table=default.Table_c8b5b92a83934f0f9255bf06e1438618 [id=ee0feb5556ec40dc9c83fd83d7db4368]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.689957 1700 leader_election.cc:290] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:00.690224 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 795c9643c1e84ddabc9130ef42d5c793 (DEFAULT_TABLE table=default.Table_f7a7857183304cac8a4969045913a3d5 [id=c246c995867d41ca9895cbfcae5b7c7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.690301 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68719133f9340399dfdd97a07abf331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.690584 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795c9643c1e84ddabc9130ef42d5c793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.691452 1037 tablet_service.cc:1511] Processing CreateTablet for tablet b5bf7b099549418b982ea0dfc916e57e (DEFAULT_TABLE table=default.Table_7c5d4c5de0074eeab591e9440641ef8d [id=db802e6b94734f51a7c0298a8c0535ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.691768 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bf7b099549418b982ea0dfc916e57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.692452 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 1e8d16ee7d094d61884c72d8eac98e37 (DEFAULT_TABLE table=default.Table_934ab6946cae48ae8570ec7973cd70fa [id=a1deeb0c167e4ff5bf955b7c06b6b087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.693254 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 899b5f53d3fd4e2ab7222555dcc120e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.693289 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59812b232848488b9894e8f8057e9def" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:00.693493 1059 raft_consensus.cc:3060] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.693948 746 tablet_service.cc:1558] Processing DeleteTablet for tablet c6d6071d862241e196a83a23bc939af4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.694216 1193 tablet_replica.cc:333] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:00.694391 1193 raft_consensus.cc:2243] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:00.694573 1193 raft_consensus.cc:2272] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:00.695276 1193 ts_tablet_manager.cc:1916] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:00.695416 1196 consensus_queue.cc:260] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.696003 1196 ts_tablet_manager.cc:1434] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.044s user 0.002s sys 0.000s
I20260616 19:52:00.695923 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cc60987ac3314143a7ef361f4c8e9a26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.696745 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc60987ac3314143a7ef361f4c8e9a26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.699642 1027 tablet_service.cc:1511] Processing CreateTablet for tablet f68719133f9340399dfdd97a07abf331 (DEFAULT_TABLE table=default.Table_c8b5b92a83934f0f9255bf06e1438618 [id=ee0feb5556ec40dc9c83fd83d7db4368]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.700623 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 0d4634afc3364221b4fdfcd3ce108a60 (DEFAULT_TABLE table=default.Table_fd6b8678fea647c791ab6cdd5765f37e [id=6f55ed77e4b5436e8faa63d8dded8b79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.701421 1193 ts_tablet_manager.cc:1929] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:00.701619 1193 log.cc:1199] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/c6d6071d862241e196a83a23bc939af4
I20260616 19:52:00.701619 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 1910784172ce4a598d896e305b53ff4e (DEFAULT_TABLE table=default.Table_068824f36dc346c9bd18faf35c514ac1 [id=3b8ed2cf07074cc2a8ccc48a2549cbad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.702118 1193 ts_tablet_manager.cc:1950] T c6d6071d862241e196a83a23bc939af4 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:00.703279 748 tablet_service.cc:1511] Processing CreateTablet for tablet b5bf7b099549418b982ea0dfc916e57e (DEFAULT_TABLE table=default.Table_7c5d4c5de0074eeab591e9440641ef8d [id=db802e6b94734f51a7c0298a8c0535ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.703608 1028 tablet_service.cc:1511] Processing CreateTablet for tablet b2e5e84b95c7429bb53dd616f118500a (DEFAULT_TABLE table=default.Table_940a8144c5014fc9b2fcb74257f85d89 [id=7278ea7c992e450d840d9174df3f1ca0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.703733 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bf7b099549418b982ea0dfc916e57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.704736 758 tablet_service.cc:1511] Processing CreateTablet for tablet 1e8d16ee7d094d61884c72d8eac98e37 (DEFAULT_TABLE table=default.Table_934ab6946cae48ae8570ec7973cd70fa [id=a1deeb0c167e4ff5bf955b7c06b6b087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.705335 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e8d16ee7d094d61884c72d8eac98e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.708325 752 tablet_service.cc:1511] Processing CreateTablet for tablet 95c5ec6f236f4e6c8c2a5b4f99a466b9 (DEFAULT_TABLE table=default.Table_ecd46c80217f4f00882db6c53db0eae5 [id=f397c850fa1d41f5b91c3e1d7a5d3c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.708763 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c5ec6f236f4e6c8c2a5b4f99a466b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:00.710979 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c77fd138ce9463b8f2d6f4182a56559 consensus state has no leader
I20260616 19:52:00.716252 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c525e769b75a483aa546c7a2c607aa70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:00.716544 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_741bad4ee8914381a7b50c35e8f2b298"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.716899 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c525e769b75a483aa546c7a2c607aa70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:00.717072 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_741bad4ee8914381a7b50c35e8f2b298 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.718236 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b41e8d48509440ddbbced9c3783efd0c" } new_table_name: "default.Table_4b866c96bb9c475a8c4fafe10fe1e53a" modify_external_catalogs: true
I20260616 19:52:00.722172 1031 tablet_service.cc:1511] Processing CreateTablet for tablet f54eef97f8db47449564b49be608902f (DEFAULT_TABLE table=default.Table_2349f63e2a7e4af4ae0a80e8ed86c6a9 [id=f37d0e612ff74a31842cf47ec47beb3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.722714 749 tablet_service.cc:1511] Processing CreateTablet for tablet 795c9643c1e84ddabc9130ef42d5c793 (DEFAULT_TABLE table=default.Table_f7a7857183304cac8a4969045913a3d5 [id=c246c995867d41ca9895cbfcae5b7c7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.723183 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795c9643c1e84ddabc9130ef42d5c793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.727675 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2c31c8e977da4a70bca1beb00f364627
W20260616 19:52:00.729921 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 899b5f53d3fd4e2ab7222555dcc120e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 899b5f53d3fd4e2ab7222555dcc120e2 already in progress: creating tablet
I20260616 19:52:00.730055 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c31c8e977da4a70bca1beb00f364627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.730259 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet c6d6071d862241e196a83a23bc939af4 (table default.Table_b30d3eb9400f41859828b301e68cfec4 [id=62b01f98d4a940ed90cb63411348c3c6]) successfully deleted
I20260616 19:52:00.731047 1692 consensus_queue.cc:1048] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:00.731666 1196 tablet_bootstrap.cc:492] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:00.732113 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_10d86a39b61c40c496871f63597d86ed" } new_table_name: "default.Table_16ebbe6e3c3b4fd185b78b20b1098bd5" modify_external_catalogs: true
I20260616 19:52:00.739228 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 731556662b62419dae76149b22469ebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.740758 1196 tablet_bootstrap.cc:654] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.742164 746 tablet_service.cc:1511] Processing CreateTablet for tablet f54eef97f8db47449564b49be608902f (DEFAULT_TABLE table=default.Table_2349f63e2a7e4af4ae0a80e8ed86c6a9 [id=f37d0e612ff74a31842cf47ec47beb3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.742612 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54eef97f8db47449564b49be608902f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.744825 759 tablet_service.cc:1511] Processing CreateTablet for tablet b2e5e84b95c7429bb53dd616f118500a (DEFAULT_TABLE table=default.Table_940a8144c5014fc9b2fcb74257f85d89 [id=7278ea7c992e450d840d9174df3f1ca0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.745218 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e5e84b95c7429bb53dd616f118500a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.748020 1191 ts_tablet_manager.cc:1929] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:00.748416 1191 log.cc:1199] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/5af9bdceae184f8dbb9e5db67a11ee63
I20260616 19:52:00.749491 1191 ts_tablet_manager.cc:1950] T 5af9bdceae184f8dbb9e5db67a11ee63 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:00.677836 1627 consensus_queue.cc:1048] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.129s
I20260616 19:52:00.753849 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c31c8e977da4a70bca1beb00f364627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.754416 751 tablet_service.cc:1511] Processing CreateTablet for tablet cf23aef677064e43bbba3ffba26f2719 (DEFAULT_TABLE table=default.Table_5dad654c95f74c999b6dc8e20626e23e [id=f212bb8d2d614707bc55ef08138d29d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.754834 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf23aef677064e43bbba3ffba26f2719. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:00.757781 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a4a2f467b5b4121ae9a9973c153c69f has no consensus state
I20260616 19:52:00.758832 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0f5388a73143569012ed714e53a8be (DEFAULT_TABLE table=default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb [id=2c7a8a72acf5496eaebb585c459112fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.760207 1021 tablet_service.cc:1511] Processing CreateTablet for tablet cf23aef677064e43bbba3ffba26f2719 (DEFAULT_TABLE table=default.Table_5dad654c95f74c999b6dc8e20626e23e [id=f212bb8d2d614707bc55ef08138d29d3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:00.761415 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 731556662b62419dae76149b22469ebd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 731556662b62419dae76149b22469ebd already in progress: creating tablet
W20260616 19:52:00.769078 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2c31c8e977da4a70bca1beb00f364627 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c31c8e977da4a70bca1beb00f364627 already in progress: creating tablet
I20260616 19:52:00.770150 761 tablet_service.cc:1511] Processing CreateTablet for tablet 3d589aa93d154fdcbf865774216a8738 (DEFAULT_TABLE table=default.Table_91f98e62a1f54c249e7932f0f5f259eb [id=d110ad2a9fe84821881b05e621c8f5ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.770553 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d589aa93d154fdcbf865774216a8738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.782584 1700 raft_consensus.cc:493] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.782759 1700 raft_consensus.cc:515] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.783355 1059 raft_consensus.cc:2468] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:00.783502 1700 leader_election.cc:290] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:00.784000 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e8d16ee7d094d61884c72d8eac98e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.784520 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1910784172ce4a598d896e305b53ff4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.784809 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0f5388a73143569012ed714e53a8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.788632 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf23aef677064e43bbba3ffba26f2719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.789247 1743 raft_consensus.cc:515] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.789983 1743 leader_election.cc:290] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:00.790462 752 tablet_service.cc:1511] Processing CreateTablet for tablet 1910784172ce4a598d896e305b53ff4e (DEFAULT_TABLE table=default.Table_068824f36dc346c9bd18faf35c514ac1 [id=3b8ed2cf07074cc2a8ccc48a2549cbad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.790865 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1910784172ce4a598d896e305b53ff4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.792797 748 tablet_service.cc:1511] Processing CreateTablet for tablet 0d4634afc3364221b4fdfcd3ce108a60 (DEFAULT_TABLE table=default.Table_fd6b8678fea647c791ab6cdd5765f37e [id=6f55ed77e4b5436e8faa63d8dded8b79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.793274 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e5e84b95c7429bb53dd616f118500a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.794226 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4634afc3364221b4fdfcd3ce108a60. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:00.795293 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet fbe784716b3c4293bd4eddf57f6c9048 (table default.Table_dc19f0ab5b6c47ea854f9d8bfdf6f905 [id=16e9ecefa14243e9988253004dcd756b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fbe784716b3c4293bd4eddf57f6c9048 consensus state has no leader
I20260616 19:52:00.793349 746 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0f5388a73143569012ed714e53a8be (DEFAULT_TABLE table=default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb [id=2c7a8a72acf5496eaebb585c459112fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.796802 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9eedef731fd84c70a73a66128d239708" } modify_external_catalogs: true
I20260616 19:52:00.797238 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6a6d8516df114593b27d86140407b724" } modify_external_catalogs: true
I20260616 19:52:00.798698 453 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_0a6adf1d7e5244debb4424a25d63a45d [id=122f88b500c0425e833926b349605d6f] alter complete (version 5)
I20260616 19:52:00.799221 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68719133f9340399dfdd97a07abf331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.799260 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_30c975e6226e45f88f761eeaca5fe355"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:00.803323 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4634afc3364221b4fdfcd3ce108a60. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:00.803475 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30c975e6226e45f88f761eeaca5fe355 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.804170 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0f5388a73143569012ed714e53a8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.821570 719 leader_election.cc:304] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:00.821911 1743 raft_consensus.cc:2804] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:00.822141 1743 raft_consensus.cc:697] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:00.824648 1743 consensus_queue.cc:237] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.824867 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815d213bf1904353b4f0b2e2f8954db9" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:00.825856 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7f591d97bc4571b294b06d990d4065" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:00.826159 1058 raft_consensus.cc:3060] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.829303 1058 raft_consensus.cc:2468] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:00.830711 1198 tablet_bootstrap.cc:654] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.837337 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f293d557a9aa4ca4885aa917fe1565e4
I20260616 19:52:00.838208 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5669ec43b5604db88e68c905ddf440a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.838768 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5669ec43b5604db88e68c905ddf440a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.838810 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f293d557a9aa4ca4885aa917fe1565e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:00.839429 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f293d557a9aa4ca4885aa917fe1565e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f293d557a9aa4ca4885aa917fe1565e4 already in progress: creating tablet
I20260616 19:52:00.839861 1196 tablet_bootstrap.cc:492] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:00.840060 1196 ts_tablet_manager.cc:1403] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.109s user 0.011s sys 0.002s
I20260616 19:52:00.840142 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6a6d8516df114593b27d86140407b724" } modify_external_catalogs: true
I20260616 19:52:00.841081 1196 raft_consensus.cc:359] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.841662 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9eedef731fd84c70a73a66128d239708" } modify_external_catalogs: true
I20260616 19:52:00.842926 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet b2e5e84b95c7429bb53dd616f118500a
I20260616 19:52:00.843648 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ee33e081bec640ffb218fc7912367a71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.844211 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee33e081bec640ffb218fc7912367a71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.845716 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54eef97f8db47449564b49be608902f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.847029 758 tablet_service.cc:1558] Processing DeleteTablet for tablet b2e5e84b95c7429bb53dd616f118500a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:00.847584 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet b2e5e84b95c7429bb53dd616f118500a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2e5e84b95c7429bb53dd616f118500a already in progress: creating tablet
I20260616 19:52:00.847856 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_88a6448fd79944399d261dfe7a13259b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.848320 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88a6448fd79944399d261dfe7a13259b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.849642 1196 raft_consensus.cc:385] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260616 19:52:00.849642 996 consensus_peers.cc:597] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:00.849748 1196 raft_consensus.cc:740] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.850004 1196 consensus_queue.cc:260] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.850739 719 leader_election.cc:304] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:00.850894 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet f293d557a9aa4ca4885aa917fe1565e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.851145 1700 raft_consensus.cc:2804] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:00.851642 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 3d589aa93d154fdcbf865774216a8738 (DEFAULT_TABLE table=default.Table_91f98e62a1f54c249e7932f0f5f259eb [id=d110ad2a9fe84821881b05e621c8f5ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.851992 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet b2e5e84b95c7429bb53dd616f118500a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.852962 1196 ts_tablet_manager.cc:1434] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260616 19:52:00.855047 1196 tablet_bootstrap.cc:492] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:00.861984 1196 tablet_bootstrap.cc:654] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:00.867290 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d589aa93d154fdcbf865774216a8738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.871999 458 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 7dc92bc15da14504a1ff5feda5aff7cf (table default.Table_6955250583bf4c3cbff20316dfa5d1a7 [id=8c7791625cfd4d39ad0dff83be1c7089]). Expected version 1 got 0
I20260616 19:52:00.873179 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7f591d97bc4571b294b06d990d4065" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:00.873194 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_57a368898c984d4bb5a93f59c565c654" } new_table_name: "default.Table_192beab5edd04401aa4c5067c9f141c9" modify_external_catalogs: true
I20260616 19:52:00.873773 887 tablet_service.cc:1511] Processing CreateTablet for tablet f68719133f9340399dfdd97a07abf331 (DEFAULT_TABLE table=default.Table_c8b5b92a83934f0f9255bf06e1438618 [id=ee0feb5556ec40dc9c83fd83d7db4368]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.874004 894 tablet_service.cc:1511] Processing CreateTablet for tablet 1910784172ce4a598d896e305b53ff4e (DEFAULT_TABLE table=default.Table_068824f36dc346c9bd18faf35c514ac1 [id=3b8ed2cf07074cc2a8ccc48a2549cbad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.876425 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 815d213bf1904353b4f0b2e2f8954db9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.876976 1193 tablet_replica.cc:333] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:00.877223 1193 raft_consensus.cc:2243] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:00.877381 1193 raft_consensus.cc:2272] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:00.878153 1193 ts_tablet_manager.cc:1916] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:00.878892 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b044bb36c84f64a32c774515a339c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.878880 1196 tablet_bootstrap.cc:492] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:00.879187 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68719133f9340399dfdd97a07abf331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.879246 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 329) took 3693 ms. Trace:
I20260616 19:52:00.880214 1196 ts_tablet_manager.cc:1403] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.002s
I20260616 19:52:00.881126 1196 raft_consensus.cc:359] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.881333 1196 raft_consensus.cc:385] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:00.883628 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_24ad15d9fa8442738b87cc9d4ca64e87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.884210 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24ad15d9fa8442738b87cc9d4ca64e87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.884444 1196 raft_consensus.cc:740] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:00.884814 1196 consensus_queue.cc:260] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.886504 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 449) took 1244 ms. Trace:
I20260616 19:52:00.888686 1193 ts_tablet_manager.cc:1929] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:00.888829 1193 log.cc:1199] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/815d213bf1904353b4f0b2e2f8954db9
W20260616 19:52:00.890025 718 leader_election.cc:343] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.890347 1743 raft_consensus.cc:493] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.890558 1743 raft_consensus.cc:515] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.891216 1743 leader_election.cc:290] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:00.891490 895 tablet_service.cc:1511] Processing CreateTablet for tablet 1e8d16ee7d094d61884c72d8eac98e37 (DEFAULT_TABLE table=default.Table_934ab6946cae48ae8570ec7973cd70fa [id=a1deeb0c167e4ff5bf955b7c06b6b087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.889596 1190 rpcz_store.cc:276] 0616 19:51:57.181574 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.181727 (+ 153us) service_pool.cc:224] Handling call
0616 19:52:00.669868 (+3488141us) ts_tablet_manager.cc:1151] Deleting tablet 2e1696a3c9f24001a4aaf99725f73f62
0616 19:52:00.669880 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.875411 (+205531us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3466750}
I20260616 19:52:00.891638 886 tablet_service.cc:1511] Processing CreateTablet for tablet b2e5e84b95c7429bb53dd616f118500a (DEFAULT_TABLE table=default.Table_940a8144c5014fc9b2fcb74257f85d89 [id=7278ea7c992e450d840d9174df3f1ca0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.897117 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0d4634afc3364221b4fdfcd3ce108a60 (DEFAULT_TABLE table=default.Table_fd6b8678fea647c791ab6cdd5765f37e [id=6f55ed77e4b5436e8faa63d8dded8b79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.897349 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59812b232848488b9894e8f8057e9def" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:00.897537 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815d213bf1904353b4f0b2e2f8954db9" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:00.898788 904 tablet_service.cc:1511] Processing CreateTablet for tablet b5bf7b099549418b982ea0dfc916e57e (DEFAULT_TABLE table=default.Table_7c5d4c5de0074eeab591e9440641ef8d [id=db802e6b94734f51a7c0298a8c0535ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.899295 924 raft_consensus.cc:3060] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.899786 923 raft_consensus.cc:2393] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
I20260616 19:52:00.900163 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1910784172ce4a598d896e305b53ff4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.895183 890 tablet_service.cc:1511] Processing CreateTablet for tablet f54eef97f8db47449564b49be608902f (DEFAULT_TABLE table=default.Table_2349f63e2a7e4af4ae0a80e8ed86c6a9 [id=f37d0e612ff74a31842cf47ec47beb3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.904623 1700 raft_consensus.cc:697] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:00.906008 1700 consensus_queue.cc:237] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:00.906826 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 2e1696a3c9f24001a4aaf99725f73f62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e1696a3c9f24001a4aaf99725f73f62 already in progress: creating tablet
W20260616 19:52:00.909322 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e7f55f5946043108153b4c452a3d961 has no consensus state
I20260616 19:52:00.908604 903 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0f5388a73143569012ed714e53a8be (DEFAULT_TABLE table=default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb [id=2c7a8a72acf5496eaebb585c459112fb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:00.917395 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf136fa86c264f69a1703596cfd0e77a consensus state has no leader
I20260616 19:52:00.917788 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7e1dbf9e64af41fc9d18cf1267dad2ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:00.918509 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e1dbf9e64af41fc9d18cf1267dad2ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.920480 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c31c8e977da4a70bca1beb00f364627" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:00.920955 457 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 7dc92bc15da14504a1ff5feda5aff7cf (table default.Table_6955250583bf4c3cbff20316dfa5d1a7 [id=8c7791625cfd4d39ad0dff83be1c7089]). Expected version 1 got 0
I20260616 19:52:00.921205 457 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 122a8b15e62f4b23b465e2dbc816df62 (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]). Expected version 2 got 0
I20260616 19:52:00.921401 457 catalog_manager.cc:5696] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } }
I20260616 19:52:00.921840 457 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 59812b232848488b9894e8f8057e9def (table default.Table_191f8acd55ae4da9982a9fb3ec2d51cd [id=1beb7d130df7492ab9b834d005eba63a]). Expected version 2 got 0
I20260616 19:52:00.923353 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 330) took 3710 ms. Trace:
I20260616 19:52:00.923679 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bf7b099549418b982ea0dfc916e57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.906670 718 leader_election.cc:304] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:00.924213 718 raft_consensus.cc:2686] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:52:00.925738 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c31c8e977da4a70bca1beb00f364627" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:00.927317 1691 raft_consensus.cc:493] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:00.927696 1691 raft_consensus.cc:515] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:00.923911 1191 rpcz_store.cc:276] 0616 19:51:59.622054 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.622798 (+ 744us) service_pool.cc:224] Handling call
0616 19:52:00.005373 (+382575us) ts_tablet_manager.cc:1151] Deleting tablet 5af9bdceae184f8dbb9e5db67a11ee63
0616 19:52:00.005384 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.322172 (+316788us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:00.747815 (+425643us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:00.866873 (+119058us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":359143}
I20260616 19:52:00.933358 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fd6131fab4ae42b89b2d538da3b43a69" } new_table_name: "default.Table_bf7b4202c79a461d935e4aa929bcb500" modify_external_catalogs: true
I20260616 19:52:00.933166 1193 ts_tablet_manager.cc:1950] T 815d213bf1904353b4f0b2e2f8954db9 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:00.933511 1691 leader_election.cc:290] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:00.940986 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 31592a5ffb04429c9315a4fd72308f28
I20260616 19:52:00.941769 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 31592a5ffb04429c9315a4fd72308f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:00.941797 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_04e2e7eefe2d42298ac7914ba1fba70c" } modify_external_catalogs: true
I20260616 19:52:00.941988 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_04e2e7eefe2d42298ac7914ba1fba70c" } modify_external_catalogs: true
I20260616 19:52:00.945092 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350453721d13427a946ac5c5ee7c62a0" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:00.945850 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 5af9bdceae184f8dbb9e5db67a11ee63 (table default.Table_bed17ff52ac5410784b004e2ef370bac [id=d948f287146b431dbce6363443e953a0]) successfully deleted
I20260616 19:52:00.938508 885 tablet_service.cc:1511] Processing CreateTablet for tablet cf23aef677064e43bbba3ffba26f2719 (DEFAULT_TABLE table=default.Table_5dad654c95f74c999b6dc8e20626e23e [id=f212bb8d2d614707bc55ef08138d29d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.948069 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c31c8e977da4a70bca1beb00f364627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.948587 898 tablet_service.cc:1511] Processing CreateTablet for tablet 3d589aa93d154fdcbf865774216a8738 (DEFAULT_TABLE table=default.Table_91f98e62a1f54c249e7932f0f5f259eb [id=d110ad2a9fe84821881b05e621c8f5ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.948990 923 raft_consensus.cc:2393] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
I20260616 19:52:00.949350 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54eef97f8db47449564b49be608902f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.950037 1738 tablet.cc:1724] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260616 19:52:00.950770 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d589aa93d154fdcbf865774216a8738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.951792 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4634afc3364221b4fdfcd3ce108a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.952152 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e5e84b95c7429bb53dd616f118500a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.959223 718 leader_election.cc:304] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:00.960408 888 tablet_service.cc:1511] Processing CreateTablet for tablet 95c5ec6f236f4e6c8c2a5b4f99a466b9 (DEFAULT_TABLE table=default.Table_ecd46c80217f4f00882db6c53db0eae5 [id=f397c850fa1d41f5b91c3e1d7a5d3c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:00.960563 1751 raft_consensus.cc:3060] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:00.958779 1190 rpcz_store.cc:276] 0616 19:51:57.198704 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.198806 (+ 102us) service_pool.cc:224] Handling call
0616 19:52:00.895769 (+3696963us) ts_tablet_manager.cc:1151] Deleting tablet cbd1070277a14fd98af5fa45925e4f0f
0616 19:52:00.895776 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.908645 (+ 12869us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3689340}
W20260616 19:52:00.961918 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet cbd1070277a14fd98af5fa45925e4f0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbd1070277a14fd98af5fa45925e4f0f already in progress: creating tablet
I20260616 19:52:00.963367 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350453721d13427a946ac5c5ee7c62a0" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:00.965536 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet b718514e4fbd4601afeb021ed35643e6
I20260616 19:52:00.966444 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2365f5983f194955a1a82ebcca715137"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:00.966859 746 tablet_service.cc:1558] Processing DeleteTablet for tablet b718514e4fbd4601afeb021ed35643e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:00.967011 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2365f5983f194955a1a82ebcca715137 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:00.967029 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 456) took 1176 ms. Trace:
I20260616 19:52:00.968506 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6a70be3041964598b68e745594423be8" } new_table_name: "default.Table_9ec01309e72d4e3b9b0af09a393415cb" modify_external_catalogs: true
I20260616 19:52:00.969038 1191 rpcz_store.cc:276] 0616 19:51:59.763171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.763629 (+ 458us) service_pool.cc:224] Handling call
0616 19:52:00.930258 (+1166629us) ts_tablet_manager.cc:1151] Deleting tablet 647b1abeb3c14b11b9a5c62b67e83cf8
0616 19:52:00.930269 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.939330 (+ 9061us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1166357}
I20260616 19:52:00.969550 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 455) took 1206 ms. Trace:
I20260616 19:52:00.969676 1191 rpcz_store.cc:276] 0616 19:51:59.763010 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.764451 (+ 1441us) service_pool.cc:224] Handling call
0616 19:52:00.969368 (+1204917us) ts_tablet_manager.cc:1151] Deleting tablet 5029a79e046a489aa9976eff948a3c5b
0616 19:52:00.969380 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.969510 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1204695}
I20260616 19:52:00.970067 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 457) took 1206 ms. Trace:
I20260616 19:52:00.970191 1191 rpcz_store.cc:276] 0616 19:51:59.763283 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.764707 (+ 1424us) service_pool.cc:224] Handling call
0616 19:52:00.969920 (+1205213us) ts_tablet_manager.cc:1151] Deleting tablet 335f7411fda84fada762345010a4339c
0616 19:52:00.969932 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.970019 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159035}
I20260616 19:52:00.970546 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 454) took 1208 ms. Trace:
I20260616 19:52:00.970649 1191 rpcz_store.cc:276] 0616 19:51:59.761877 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.837062 (+ 75185us) service_pool.cc:224] Handling call
0616 19:52:00.970414 (+1133352us) ts_tablet_manager.cc:1151] Deleting tablet 19b9248b88434a6e9ef7a3d602eee70c
0616 19:52:00.970424 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.970507 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1133035}
I20260616 19:52:00.971011 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 458) took 1114 ms. Trace:
I20260616 19:52:00.971163 1191 rpcz_store.cc:276] 0616 19:51:59.856832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.856897 (+ 65us) service_pool.cc:224] Handling call
0616 19:52:00.970880 (+1113983us) ts_tablet_manager.cc:1151] Deleting tablet b251bdf373574dffb04f9e2c837cfe78
0616 19:52:00.970889 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.970977 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1113621}
I20260616 19:52:00.971496 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 459) took 1101 ms. Trace:
I20260616 19:52:00.971591 1191 rpcz_store.cc:276] 0616 19:51:59.869915 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.872524 (+ 2609us) service_pool.cc:224] Handling call
0616 19:52:00.971376 (+1098852us) ts_tablet_manager.cc:1151] Deleting tablet efd5fecc6d444e5fba9103287c09542e
0616 19:52:00.971383 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.971467 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1098564}
I20260616 19:52:00.971901 1191 tablet_replica.cc:333] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:00.972154 1191 raft_consensus.cc:2243] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:00.972434 1191 pending_rounds.cc:70] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2: Trying to abort 1 pending ops.
I20260616 19:52:00.975679 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 339) took 3602 ms. Trace:
I20260616 19:52:00.975795 1190 rpcz_store.cc:276] 0616 19:51:57.361958 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.362258 (+ 300us) service_pool.cc:224] Handling call
0616 19:52:00.960872 (+3598614us) ts_tablet_manager.cc:1151] Deleting tablet 5c74b39e66d344b99f8fc75b855c0520
0616 19:52:00.960885 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.964173 (+ 3288us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3598392}
W20260616 19:52:00.977346 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 5c74b39e66d344b99f8fc75b855c0520 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c74b39e66d344b99f8fc75b855c0520 already in progress: creating tablet
I20260616 19:52:00.978925 1691 raft_consensus.cc:493] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:52:00.979322 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 647b1abeb3c14b11b9a5c62b67e83cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 647b1abeb3c14b11b9a5c62b67e83cf8 already in progress: creating tablet
W20260616 19:52:00.979579 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 5029a79e046a489aa9976eff948a3c5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5029a79e046a489aa9976eff948a3c5b already in progress: creating tablet
W20260616 19:52:00.979784 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 335f7411fda84fada762345010a4339c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 335f7411fda84fada762345010a4339c already in progress: creating tablet
W20260616 19:52:00.979982 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 19b9248b88434a6e9ef7a3d602eee70c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19b9248b88434a6e9ef7a3d602eee70c already in progress: creating tablet
W20260616 19:52:00.980144 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet b251bdf373574dffb04f9e2c837cfe78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b251bdf373574dffb04f9e2c837cfe78 already in progress: creating tablet
W20260616 19:52:00.980322 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet efd5fecc6d444e5fba9103287c09542e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efd5fecc6d444e5fba9103287c09542e already in progress: creating tablet
I20260616 19:52:00.983436 1191 pending_rounds.cc:77] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595473351266304 op_type: NO_OP noop_request { }
I20260616 19:52:00.990839 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e8d16ee7d094d61884c72d8eac98e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.991771 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0f5388a73143569012ed714e53a8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:00.994338 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c5ec6f236f4e6c8c2a5b4f99a466b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:00.983654 993 leader_election.cc:343] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:00.983644 1191 raft_consensus.cc:2889] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:00.996378 1191 raft_consensus.cc:2272] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:00.997015 1191 ts_tablet_manager.cc:1916] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:01.003505 924 raft_consensus.cc:2468] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:01.004408 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f707c504e25144e2a117f9d5f7c28b25 has no consensus state
I20260616 19:52:01.006651 1192 tablet_bootstrap.cc:654] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.007438 889 tablet_service.cc:1558] Processing DeleteTablet for tablet f293d557a9aa4ca4885aa917fe1565e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.008782 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf23aef677064e43bbba3ffba26f2719. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:01.008970 996 leader_election.cc:343] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.009871 902 tablet_service.cc:1558] Processing DeleteTablet for tablet b2e5e84b95c7429bb53dd616f118500a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:00.986666 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 31592a5ffb04429c9315a4fd72308f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:00.989094 1691 raft_consensus.cc:515] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.011605 1691 leader_election.cc:290] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:01.012310 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 31592a5ffb04429c9315a4fd72308f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.012938 996 leader_election.cc:304] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:01.013530 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 341) took 3612 ms. Trace:
I20260616 19:52:01.014810 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125dce4d32a416498b42a1b599355fd" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:01.015085 1627 raft_consensus.cc:2749] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:01.016340 996 leader_election.cc:343] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.022277 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet b718514e4fbd4601afeb021ed35643e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.012969 892 tablet_service.cc:1558] Processing DeleteTablet for tablet b718514e4fbd4601afeb021ed35643e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.032564 1190 rpcz_store.cc:276] 0616 19:51:57.364742 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.365767 (+ 1025us) service_pool.cc:224] Handling call
0616 19:52:00.976041 (+3610274us) ts_tablet_manager.cc:1151] Deleting tablet 65b0dc43b40649f29037f40d2ea9247e
0616 19:52:00.976052 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:00.976912 (+ 860us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3610006}
I20260616 19:52:01.035849 1691 consensus_queue.cc:1048] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:01.044477 1691 consensus_queue.cc:1048] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:01.045230 1720 raft_consensus.cc:493] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:01.045100 1198 tablet_bootstrap.cc:492] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:01.046202 1198 ts_tablet_manager.cc:1403] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.359s user 0.007s sys 0.002s
I20260616 19:52:01.046123 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125dce4d32a416498b42a1b599355fd" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:01.046705 993 leader_election.cc:343] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.046886 993 leader_election.cc:304] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:01.047303 1691 raft_consensus.cc:2749] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:01.047242 1198 raft_consensus.cc:359] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.047477 1198 raft_consensus.cc:385] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.047552 1198 raft_consensus.cc:740] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.047535 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dc19f0ab5b6c47ea854f9d8bfdf6f905" } modify_external_catalogs: true
I20260616 19:52:01.047752 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dc19f0ab5b6c47ea854f9d8bfdf6f905" } modify_external_catalogs: true
I20260616 19:52:01.047801 1198 consensus_queue.cc:260] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.049196 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7fce2ed3c7c848d0934500fec50d1198"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.049746 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fce2ed3c7c848d0934500fec50d1198 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.049993 1198 ts_tablet_manager.cc:1434] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260616 19:52:01.050942 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_71fb3dee8f0f492ab31a753471d0273b" } modify_external_catalogs: true
I20260616 19:52:01.051105 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_71fb3dee8f0f492ab31a753471d0273b" } modify_external_catalogs: true
I20260616 19:52:01.051306 1198 tablet_bootstrap.cc:492] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:01.054244 1751 raft_consensus.cc:2749] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:01.056501 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 815d213bf1904353b4f0b2e2f8954db9 (table default.Table_cb8601ac90d549099be33b639d901c21 [id=4819ad51aafb4dd4a283d2240306d7a5]) successfully deleted
W20260616 19:52:01.056982 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 31592a5ffb04429c9315a4fd72308f28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31592a5ffb04429c9315a4fd72308f28 already in progress: creating tablet
W20260616 19:52:01.057423 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet b718514e4fbd4601afeb021ed35643e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b718514e4fbd4601afeb021ed35643e6 already in progress: creating tablet
I20260616 19:52:01.060325 1190 tablet_replica.cc:333] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:01.064191 1196 ts_tablet_manager.cc:1434] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.184s user 0.011s sys 0.062s
I20260616 19:52:01.064949 1196 tablet_bootstrap.cc:492] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:01.066772 1196 tablet_bootstrap.cc:654] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.067229 1720 raft_consensus.cc:515] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.068332 1191 ts_tablet_manager.cc:1929] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:01.071630 1191 log.cc:1199] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/d3645fc39d974bffa8fe52c62e1c7eff
I20260616 19:52:01.071928 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_95e22ec4d7a84936891845fe5e39f547"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.072711 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95e22ec4d7a84936891845fe5e39f547 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.072803 1691 raft_consensus.cc:493] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:01.073072 1691 raft_consensus.cc:515] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.073662 1691 leader_election.cc:290] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:01.074156 1190 raft_consensus.cc:2243] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:01.075364 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99740ab59f947aabcac88dc2bf2de86" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:01.076012 996 leader_election.cc:343] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.079335 1198 tablet_bootstrap.cc:654] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:01.080646 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1a95eafa064b4b95b5281915ea5bd9f7 consensus state has no leader
I20260616 19:52:01.079519 1191 ts_tablet_manager.cc:1950] T d3645fc39d974bffa8fe52c62e1c7eff P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:01.082621 1196 tablet_bootstrap.cc:492] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:01.082706 1190 raft_consensus.cc:2272] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:01.082872 1196 ts_tablet_manager.cc:1403] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.001s
I20260616 19:52:01.083458 1190 ts_tablet_manager.cc:1916] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:01.083717 1196 raft_consensus.cc:359] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.084123 1196 raft_consensus.cc:385] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.084266 1196 raft_consensus.cc:740] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.084662 1196 consensus_queue.cc:260] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.085837 1196 ts_tablet_manager.cc:1434] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:01.086651 1196 tablet_bootstrap.cc:492] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:01.090348 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 467) took 1036 ms. Trace:
I20260616 19:52:01.091147 1196 tablet_bootstrap.cc:654] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.092856 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99740ab59f947aabcac88dc2bf2de86" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:01.090469 1191 rpcz_store.cc:276] 0616 19:52:00.053881 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.074088 (+ 20207us) service_pool.cc:224] Handling call
0616 19:52:00.971831 (+897743us) ts_tablet_manager.cc:1151] Deleting tablet d3645fc39d974bffa8fe52c62e1c7eff
0616 19:52:00.971842 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.026158 (+ 54316us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.068240 (+ 42082us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.090305 (+ 22065us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":890012}
I20260616 19:52:01.093849 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet d3645fc39d974bffa8fe52c62e1c7eff (table default.Table_8498a9716d0241898b3508012accd7e4 [id=684dd57c6c084da39a4046776066b1da]) successfully deleted
I20260616 19:52:01.093924 1191 tablet_replica.cc:333] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:01.094226 1191 raft_consensus.cc:2243] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
W20260616 19:52:01.083845 1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s user 0.039s sys 0.054s
I20260616 19:52:01.095829 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d0870f2740ce4ea08b6f6fc61f15e814"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.096386 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0870f2740ce4ea08b6f6fc61f15e814 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.097699 1191 pending_rounds.cc:70] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2: Trying to abort 1 pending ops.
W20260616 19:52:01.098278 860 leader_election.cc:343] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: f2c392b2fecd483d9da12e30e37f27ad
W20260616 19:52:01.098739 993 leader_election.cc:343] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.099011 993 leader_election.cc:304] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:01.099418 1691 raft_consensus.cc:2749] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:01.099978 1720 leader_election.cc:290] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:01.099897 1191 pending_rounds.cc:77] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595475395956736 op_type: NO_OP noop_request { }
I20260616 19:52:01.100190 1191 raft_consensus.cc:2889] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:01.100355 1191 raft_consensus.cc:2272] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:01.104230 1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s user 0.040s sys 0.054s
I20260616 19:52:01.105136 1192 tablet_bootstrap.cc:492] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:01.106444 1196 tablet_bootstrap.cc:492] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:01.106611 1196 ts_tablet_manager.cc:1403] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.007s
I20260616 19:52:01.107375 1191 ts_tablet_manager.cc:1916] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:01.107391 1196 raft_consensus.cc:359] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:01.108866 1196 raft_consensus.cc:385] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.109033 1196 raft_consensus.cc:740] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.109369 1196 consensus_queue.cc:260] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:01.111060 1196 ts_tablet_manager.cc:1434] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260616 19:52:01.111145 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bae68fd4354043c283c58e7a0ecea689" } new_table_name: "default.Table_368e4b7684c64cdcb5a8ac4665e649d2" modify_external_catalogs: true
I20260616 19:52:01.113034 1196 tablet_bootstrap.cc:492] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:01.114811 1196 tablet_bootstrap.cc:654] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.117453 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8c0a6191ad334400a319778fc4e559af
I20260616 19:52:01.118790 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c0a6191ad334400a319778fc4e559af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.119378 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3b8f449c385948bcb34abccbf9add4a4" } new_table_name: "default.Table_395859028237411ba660f017c299cccf" modify_external_catalogs: true
I20260616 19:52:01.119508 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c0a6191ad334400a319778fc4e559af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:01.120270 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8c0a6191ad334400a319778fc4e559af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c0a6191ad334400a319778fc4e559af already in progress: creating tablet
W20260616 19:52:01.124512 445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:43055, user_credentials={real_user=slave}} blocked reactor thread for 108645us
I20260616 19:52:01.135329 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7b0af6c08cd34ef09c44a86ea3f12671"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:01.135519 1192 ts_tablet_manager.cc:1403] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.690s user 0.009s sys 0.011s
W20260616 19:52:01.135950 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b0af6c08cd34ef09c44a86ea3f12671 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:01.139746 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 65b0dc43b40649f29037f40d2ea9247e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65b0dc43b40649f29037f40d2ea9247e already in progress: creating tablet
I20260616 19:52:01.139940 1567 consensus_queue.cc:1048] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:01.145632 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a1e4310104a4b238d80116604a1af3a consensus state has no leader
I20260616 19:52:01.146520 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fbe784716b3c4293bd4eddf57f6c9048
I20260616 19:52:01.147341 746 tablet_service.cc:1558] Processing DeleteTablet for tablet fbe784716b3c4293bd4eddf57f6c9048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.147794 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet fbe784716b3c4293bd4eddf57f6c9048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:01.148445 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet fbe784716b3c4293bd4eddf57f6c9048 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbe784716b3c4293bd4eddf57f6c9048 already in progress: creating tablet
I20260616 19:52:01.152030 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c0a6191ad334400a319778fc4e559af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.156683 1198 tablet_bootstrap.cc:492] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:01.156831 1198 ts_tablet_manager.cc:1403] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.000s
I20260616 19:52:01.160153 1198 raft_consensus.cc:359] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.160234 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 122a8b15e62f4b23b465e2dbc816df62 (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]). Expected version 2 got 0
I20260616 19:52:01.160720 1198 raft_consensus.cc:385] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.160763 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e7a1f09b06ba438e894fb6f7190e6a49" } modify_external_catalogs: true
I20260616 19:52:01.160847 1198 raft_consensus.cc:740] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.160962 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e7a1f09b06ba438e894fb6f7190e6a49" } modify_external_catalogs: true
I20260616 19:52:01.161137 1198 consensus_queue.cc:260] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.163800 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 39f52eebdc79460a9ff33191086e87c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e8160ad4cf74f16a586ae59291ce7d1) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.164477 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 8125dce4d32a416498b42a1b599355fd with delete_type TABLET_DATA_DELETED (replaced by tablet 9060de590fa84ea08dc7d39765bc9308) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.167308 1198 ts_tablet_manager.cc:1434] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260616 19:52:01.168124 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1b0deebdd1844949b9064d3e3ab11920" } modify_external_catalogs: true
I20260616 19:52:01.168357 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1b0deebdd1844949b9064d3e3ab11920" } modify_external_catalogs: true
I20260616 19:52:01.169215 1738 tablet.cc:1724] T 122a8b15e62f4b23b465e2dbc816df62 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:01.173694 1198 tablet_bootstrap.cc:492] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:52:01.174052 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 96616us
I20260616 19:52:01.175478 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c392b2fecd483d9da12e30e37f27ad" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:01.175690 1057 raft_consensus.cc:2468] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:01.176129 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a25d7029a177435bb8a1ea52446e1933"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.176680 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a25d7029a177435bb8a1ea52446e1933 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.179522 898 tablet_service.cc:1558] Processing DeleteTablet for tablet fbe784716b3c4293bd4eddf57f6c9048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.179919 1196 tablet_bootstrap.cc:492] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:01.180081 1196 ts_tablet_manager.cc:1403] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.067s user 0.008s sys 0.016s
I20260616 19:52:01.180825 1196 raft_consensus.cc:359] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.180999 1196 raft_consensus.cc:385] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.181056 1196 raft_consensus.cc:740] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.181324 1196 consensus_queue.cc:260] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.183406 1196 ts_tablet_manager.cc:1434] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:01.185482 858 leader_election.cc:304] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:01.191907 1192 raft_consensus.cc:359] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.194361 1679 raft_consensus.cc:2804] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:01.194538 1679 raft_consensus.cc:493] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:01.197979 1196 tablet_bootstrap.cc:492] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:01.200446 1196 tablet_bootstrap.cc:654] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.200695 922 raft_consensus.cc:1275] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Refusing update from remote peer 7245e7dab0ec474a876537be514c8767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:52:01.201371 1753 consensus_queue.cc:1048] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:01.205662 1057 raft_consensus.cc:1275] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Refusing update from remote peer 7245e7dab0ec474a876537be514c8767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:52:01.206246 1771 tablet.cc:1724] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260616 19:52:01.206403 1753 consensus_queue.cc:1048] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:01.225775 1196 tablet_bootstrap.cc:492] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:01.225945 1196 ts_tablet_manager.cc:1403] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.003s
I20260616 19:52:01.226910 1196 raft_consensus.cc:359] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.227115 1196 raft_consensus.cc:385] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.227197 1196 raft_consensus.cc:740] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.227414 1196 consensus_queue.cc:260] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.228518 1192 raft_consensus.cc:385] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.228642 1192 raft_consensus.cc:740] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.228482 1679 raft_consensus.cc:3060] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:01.229215 1192 consensus_queue.cc:260] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.229794 1192 ts_tablet_manager.cc:1434] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.094s user 0.000s sys 0.002s
I20260616 19:52:01.230759 1196 ts_tablet_manager.cc:1434] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260616 19:52:01.232120 1196 tablet_bootstrap.cc:492] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:01.233685 1196 tablet_bootstrap.cc:654] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.238170 1627 consensus_queue.cc:1048] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:01.231702 1770 tablet.cc:1724] T 122a8b15e62f4b23b465e2dbc816df62 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:01.240128 1192 tablet_bootstrap.cc:492] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:01.243448 1190 ts_tablet_manager.cc:1929] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:01.254876 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9105320d5b36457d9dd74b553a44db2c
I20260616 19:52:01.255784 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 9105320d5b36457d9dd74b553a44db2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:01.256948 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 9105320d5b36457d9dd74b553a44db2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9105320d5b36457d9dd74b553a44db2c already in progress: creating tablet
I20260616 19:52:01.259016 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 9105320d5b36457d9dd74b553a44db2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.259380 1192 tablet_bootstrap.cc:654] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.259615 1190 log.cc:1199] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/b5f60e9778dd429c8bdbf96261901a56
I20260616 19:52:01.262298 1770 tablet.cc:1724] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260616 19:52:01.273016 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 802d30c340494490896c8da33d110708 consensus state has no leader
W20260616 19:52:01.273710 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 613c869d4ac84ee0aa952718ba74917b consensus state has no leader
I20260616 19:52:01.275189 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 9105320d5b36457d9dd74b553a44db2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.278033 1190 ts_tablet_manager.cc:1950] T b5f60e9778dd429c8bdbf96261901a56 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:01.278448 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 338) took 3916 ms. Trace:
I20260616 19:52:01.279465 1190 rpcz_store.cc:276] 0616 19:51:57.361683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.378737 (+ 17054us) service_pool.cc:224] Handling call
0616 19:52:01.039280 (+3660543us) ts_tablet_manager.cc:1151] Deleting tablet b5f60e9778dd429c8bdbf96261901a56
0616 19:52:01.039290 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.189855 (+150565us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.230185 (+ 40330us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.278415 (+ 48230us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3660258}
I20260616 19:52:01.279964 1190 tablet_replica.cc:333] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:01.280632 1190 raft_consensus.cc:2243] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:01.281594 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet b5f60e9778dd429c8bdbf96261901a56 (table default.Table_dfb3308f15684b20b5d49353c0a255e7 [id=91db6a529c234ab1b026fba00e18a7ef]) successfully deleted
I20260616 19:52:01.282006 1198 tablet_bootstrap.cc:654] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.282945 1190 raft_consensus.cc:2272] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:01.283319 1777 tablet.cc:1724] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:01.283818 1190 ts_tablet_manager.cc:1916] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:01.289995 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7
I20260616 19:52:01.291378 746 tablet_service.cc:1558] Processing DeleteTablet for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.291397 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:01.292935 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 already in progress: creating tablet
I20260616 19:52:01.295504 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e20dacac303a4fdfbb7580b7a07a0f91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.296186 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e20dacac303a4fdfbb7580b7a07a0f91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.296705 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_32f046307a634164a6087e004a8a9494" } new_table_name: "default.Table_5c350aaa51a946fdb5ae09ea14521686" modify_external_catalogs: true
I20260616 19:52:01.297691 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_28f9c1cb3aa04a959b05b1cc91b14891"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:01.297927 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_398beedaedf34f3680d72afcb4ead9c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.298209 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28f9c1cb3aa04a959b05b1cc91b14891 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:01.298374 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_398beedaedf34f3680d72afcb4ead9c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.298985 1191 ts_tablet_manager.cc:1929] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:01.299134 1191 log.cc:1199] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/815d213bf1904353b4f0b2e2f8954db9
I20260616 19:52:01.299393 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d0870f2740ce4ea08b6f6fc61f15e814" } new_table_name: "default.Table_253cae986d644063bf9fe7a2a9fb9ce9" modify_external_catalogs: true
I20260616 19:52:01.299443 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7b1eed4af94f4d9497213d6a3bc40ddc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:01.299662 1191 ts_tablet_manager.cc:1950] T 815d213bf1904353b4f0b2e2f8954db9 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
W20260616 19:52:01.299865 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b1eed4af94f4d9497213d6a3bc40ddc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.302699 1679 raft_consensus.cc:515] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.313335 1196 tablet_bootstrap.cc:492] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:01.313699 1196 ts_tablet_manager.cc:1403] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.081s user 0.005s sys 0.001s
I20260616 19:52:01.314694 1196 raft_consensus.cc:359] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.314930 1196 raft_consensus.cc:385] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.315014 1196 raft_consensus.cc:740] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.315306 1196 consensus_queue.cc:260] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:01.317642 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee10d6f8fd5040aebd9c9592d84534fc has no consensus state
W20260616 19:52:01.319100 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c3706f41b0e342a69f66c936173f2ae0 consensus state has no leader
I20260616 19:52:01.321977 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c392b2fecd483d9da12e30e37f27ad" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:01.322188 1060 raft_consensus.cc:3060] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:01.323123 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bfaf83b26abe4e78813fd297b564ba57" } modify_external_catalogs: true
I20260616 19:52:01.323307 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bfaf83b26abe4e78813fd297b564ba57" } modify_external_catalogs: true
I20260616 19:52:01.323729 1679 leader_election.cc:290] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:01.326050 1198 tablet_bootstrap.cc:492] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:01.326227 1198 ts_tablet_manager.cc:1403] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.153s user 0.004s sys 0.000s
I20260616 19:52:01.326457 1060 raft_consensus.cc:2468] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:01.327148 1198 raft_consensus.cc:359] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.327389 1198 raft_consensus.cc:385] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260616 19:52:01.327414 860 leader_election.cc:343] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: f2c392b2fecd483d9da12e30e37f27ad
I20260616 19:52:01.327476 1198 raft_consensus.cc:740] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.327719 858 leader_election.cc:304] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:01.327732 1198 consensus_queue.cc:260] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.328299 886 tablet_service.cc:1558] Processing DeleteTablet for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.328399 1198 ts_tablet_manager.cc:1434] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260616 19:52:01.328742 1198 tablet_bootstrap.cc:492] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:01.336820 1679 raft_consensus.cc:2804] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:01.337206 1751 raft_consensus.cc:493] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:01.337358 1751 raft_consensus.cc:515] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.338014 1751 leader_election.cc:290] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:01.338565 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122a8b15e62f4b23b465e2dbc816df62" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:01.338788 1679 raft_consensus.cc:697] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:01.339228 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 468) took 1257 ms. Trace:
I20260616 19:52:01.339361 1191 rpcz_store.cc:276] 0616 19:52:00.081461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.081523 (+ 62us) service_pool.cc:224] Handling call
0616 19:52:01.093831 (+1012308us) ts_tablet_manager.cc:1151] Deleting tablet 815d213bf1904353b4f0b2e2f8954db9
0616 19:52:01.093841 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.129686 (+ 35845us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.298867 (+169181us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.339194 (+ 40327us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1010703}
I20260616 19:52:01.339221 1679 consensus_queue.cc:237] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.339761 1191 tablet_replica.cc:333] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:01.339448 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122a8b15e62f4b23b465e2dbc816df62" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:01.339891 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 815d213bf1904353b4f0b2e2f8954db9 (table default.Table_cb8601ac90d549099be33b639d901c21 [id=4819ad51aafb4dd4a283d2240306d7a5]) successfully deleted
I20260616 19:52:01.340875 718 leader_election.cc:304] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:01.341172 1751 raft_consensus.cc:2749] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:01.345656 1191 raft_consensus.cc:2243] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:01.346437 1191 raft_consensus.cc:2272] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:01.347226 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f53395a2b4ee42de9731707666f67440"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.347806 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f53395a2b4ee42de9731707666f67440 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.348901 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_425ca87bdf224de58078e9b95a26897e" } new_table_name: "default.Table_e6e1b5837078493bae82bdb7db0c81dd" modify_external_catalogs: true
I20260616 19:52:01.351012 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_792e3d8aaa5a4e939050bd897488eec3" } modify_external_catalogs: true
I20260616 19:52:01.351191 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_792e3d8aaa5a4e939050bd897488eec3" } modify_external_catalogs: true
I20260616 19:52:01.352555 1190 ts_tablet_manager.cc:1929] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:01.352726 1190 log.cc:1199] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/c6d6071d862241e196a83a23bc939af4
I20260616 19:52:01.346279 1198 tablet_bootstrap.cc:654] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.353104 1190 ts_tablet_manager.cc:1950] T c6d6071d862241e196a83a23bc939af4 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:01.353463 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 344) took 3847 ms. Trace:
I20260616 19:52:01.353564 1190 rpcz_store.cc:276] 0616 19:51:57.506005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.506063 (+ 58us) service_pool.cc:224] Handling call
0616 19:52:01.279889 (+3773826us) ts_tablet_manager.cc:1151] Deleting tablet c6d6071d862241e196a83a23bc939af4
0616 19:52:01.279901 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.334678 (+ 54777us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.352456 (+ 17778us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.353414 (+ 958us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3773558}
I20260616 19:52:01.354017 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet c6d6071d862241e196a83a23bc939af4 (table default.Table_b30d3eb9400f41859828b301e68cfec4 [id=62b01f98d4a940ed90cb63411348c3c6]) successfully deleted
I20260616 19:52:01.354458 1191 ts_tablet_manager.cc:1916] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:01.356789 1196 ts_tablet_manager.cc:1434] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.043s user 0.001s sys 0.001s
I20260616 19:52:01.358866 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 59812b232848488b9894e8f8057e9def (table default.Table_191f8acd55ae4da9982a9fb3ec2d51cd [id=1beb7d130df7492ab9b834d005eba63a]). Expected version 2 got 0
I20260616 19:52:01.359186 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet d51a6fb4c49e461583a5aba1813b2a3e (table default.Table_b3d1ae6133974de8942b6f6a2ae9f310 [id=2d4376cceca648ef87dcf561d1e9e701]). Expected version 1 got 0
I20260616 19:52:01.359392 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 122a8b15e62f4b23b465e2dbc816df62 (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]). Expected version 2 got 0
I20260616 19:52:01.359573 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 7dc92bc15da14504a1ff5feda5aff7cf (table default.Table_6955250583bf4c3cbff20316dfa5d1a7 [id=8c7791625cfd4d39ad0dff83be1c7089]). Expected version 1 got 0
I20260616 19:52:01.359762 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet d5741b92cafb4d53987dbeeef66ccd56 (table default.Table_a5a8fee8fc214408ae98d4e88d6f66a5 [id=ee6ce577050e45c5b9b014d3827e5046]). Expected version 1 got 0
I20260616 19:52:01.361917 746 tablet_service.cc:1511] Processing CreateTablet for tablet 90852e10a6804cb1bee075b0e9c0eeaf (DEFAULT_TABLE table=default.Table_de40de7f1c184226aad857d32b71c326 [id=f9acaf28e30146e3a511a9a898a9dc5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.362339 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90852e10a6804cb1bee075b0e9c0eeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.364528 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet b99740ab59f947aabcac88dc2bf2de86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.364640 752 tablet_service.cc:1511] Processing CreateTablet for tablet 65164c1907674ddd968e1acf0aee40e1 (DEFAULT_TABLE table=default.Table_e507611d620b4d9aa713d673c64bd815 [id=f04b8cde42004f63988ea1647f24e512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.364763 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet eb024637294148c18b74bef47fb2fcce with delete_type TABLET_DATA_DELETED (replaced by tablet 64aa32856ca34743933931fb51f2bd7b) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.365016 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65164c1907674ddd968e1acf0aee40e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.365293 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 90852e10a6804cb1bee075b0e9c0eeaf (DEFAULT_TABLE table=default.Table_de40de7f1c184226aad857d32b71c326 [id=f9acaf28e30146e3a511a9a898a9dc5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.365692 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90852e10a6804cb1bee075b0e9c0eeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.365442 460 catalog_manager.cc:5696] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } }
I20260616 19:52:01.365993 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]). Expected version 1 got 0
I20260616 19:52:01.366247 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet d51a6fb4c49e461583a5aba1813b2a3e (table default.Table_b3d1ae6133974de8942b6f6a2ae9f310 [id=2d4376cceca648ef87dcf561d1e9e701]). Expected version 1 got 0
I20260616 19:52:01.366386 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 3de0e62cfd33410490a0b460fd5f69e9 (table default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]). Expected version 2 got 0
I20260616 19:52:01.359184 456 catalog_manager.cc:5696] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:01.368209 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet eb04ccc26e64484a9a29c515d4b954fe (table default.Table_62b93909f63642cda25a0d17ce9b567c [id=87e3217093844e81ac448e2e9d8fa3ec]). Expected version 1 got 0
I20260616 19:52:01.376178 1196 tablet_bootstrap.cc:492] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:01.379138 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 65164c1907674ddd968e1acf0aee40e1 (DEFAULT_TABLE table=default.Table_e507611d620b4d9aa713d673c64bd815 [id=f04b8cde42004f63988ea1647f24e512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.379567 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65164c1907674ddd968e1acf0aee40e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.381904 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bb4236ba15c042c2a67d464a935dd973"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.382593 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb4236ba15c042c2a67d464a935dd973 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.383348 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 7955886341a94249afa849c51d34a0be (DEFAULT_TABLE table=default.Table_2e2432072a8f43cfa54ceabaaf6a7528 [id=935fa232f32d405ca9cc5e9ef1fb4d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.383725 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7955886341a94249afa849c51d34a0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.385404 748 tablet_service.cc:1511] Processing CreateTablet for tablet 46faf1477a4b4c9994e556308647cad3 (DEFAULT_TABLE table=default.Table_8a8ebba0148c494180484e421fa045e3 [id=85f8392a4b6c4aaa9f8679d6a68148b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.385877 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46faf1477a4b4c9994e556308647cad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.388787 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4a2f467b5b4121ae9a9973c153c69f (DEFAULT_TABLE table=default.Table_647d295a0348455285299b2011b05288 [id=4b6cf5696a3f49b4b9af0340906497c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.389140 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4a2f467b5b4121ae9a9973c153c69f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:01.395447 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61189a715da140a6833801681bbd5ef4 consensus state has no leader
I20260616 19:52:01.399343 461 master_service.cc:960] ReplaceTablet: received request to replace tablet ca5dc1e6cde347fc9a34e555385dc646 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:01.403178 461 master_service.cc:960] ReplaceTablet: received request to replace tablet b718514e4fbd4601afeb021ed35643e6 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:01.405367 752 tablet_service.cc:1511] Processing CreateTablet for tablet 7955886341a94249afa849c51d34a0be (DEFAULT_TABLE table=default.Table_2e2432072a8f43cfa54ceabaaf6a7528 [id=935fa232f32d405ca9cc5e9ef1fb4d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.405939 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7955886341a94249afa849c51d34a0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.409363 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 08db2c1398b946c180d81b88504c1d9c
I20260616 19:52:01.410161 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 08db2c1398b946c180d81b88504c1d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.410331 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 08db2c1398b946c180d81b88504c1d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.412076 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 915267e7ff3c439385a861dfb954b852
I20260616 19:52:01.413236 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 915267e7ff3c439385a861dfb954b852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.414281 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet bc2006e262cc4bbb9b291a5bf52653cd
I20260616 19:52:01.416659 1678 raft_consensus.cc:493] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61c874fef3684d10a272a9c7f280e0e2)
I20260616 19:52:01.418171 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet bc2006e262cc4bbb9b291a5bf52653cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:01.421378 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 08db2c1398b946c180d81b88504c1d9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08db2c1398b946c180d81b88504c1d9c already in progress: creating tablet
I20260616 19:52:01.421535 888 tablet_service.cc:1511] Processing CreateTablet for tablet 90852e10a6804cb1bee075b0e9c0eeaf (DEFAULT_TABLE table=default.Table_de40de7f1c184226aad857d32b71c326 [id=f9acaf28e30146e3a511a9a898a9dc5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.422344 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c31c8e977da4a70bca1beb00f364627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.422613 751 tablet_service.cc:1558] Processing DeleteTablet for tablet d3645fc39d974bffa8fe52c62e1c7eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:52 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.422806 759 tablet_service.cc:1558] Processing DeleteTablet for tablet bc2006e262cc4bbb9b291a5bf52653cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.423007 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 915267e7ff3c439385a861dfb954b852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.423282 1193 tablet_replica.cc:333] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:01.423556 1193 raft_consensus.cc:2243] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:01.423803 1193 raft_consensus.cc:2272] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:01.425375 1193 ts_tablet_manager.cc:1916] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:01.426656 1191 ts_tablet_manager.cc:1929] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:01.426807 1191 log.cc:1199] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/662e2d573bd7489a81697c17393ce088
I20260616 19:52:01.427163 1191 ts_tablet_manager.cc:1950] T 662e2d573bd7489a81697c17393ce088 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:01.427829 1192 tablet_bootstrap.cc:492] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:01.427801 1738 tablet.cc:1724] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:01.427996 1192 ts_tablet_manager.cc:1403] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.197s user 0.007s sys 0.006s
I20260616 19:52:01.429065 1192 raft_consensus.cc:359] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.429275 1192 raft_consensus.cc:385] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.429379 1192 raft_consensus.cc:740] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.429647 1192 consensus_queue.cc:260] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.430233 1192 ts_tablet_manager.cc:1434] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:01.430444 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet d51a6fb4c49e461583a5aba1813b2a3e (table default.Table_b3d1ae6133974de8942b6f6a2ae9f310 [id=2d4376cceca648ef87dcf561d1e9e701]). Expected version 1 got 0
I20260616 19:52:01.431770 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 87ca1b3a712845f9a93653faa0e95291 (DEFAULT_TABLE table=default.Table_4d37635717d84d3e9891538926193745 [id=9e6423a3efd748ee92cf51f955402ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.432166 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ca1b3a712845f9a93653faa0e95291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.432284 1678 raft_consensus.cc:515] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:01.432346 759 tablet_service.cc:1511] Processing CreateTablet for tablet 0c166a93c88b45f799e14e10e802b5a0 (DEFAULT_TABLE table=default.Table_df7c593c98334922b13b1cfc1cae9340 [id=716467ae002249e59523641d02907298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.432900 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c166a93c88b45f799e14e10e802b5a0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:01.434365 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 46510.3us
I20260616 19:52:01.434963 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 2e059efed3da48b9a516fd3905f6d298 (DEFAULT_TABLE table=default.Table_f85a1250cf4542d0802dc876e5da7b25 [id=78b145e646b4426ab5f3db938ee5e8ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.435424 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e059efed3da48b9a516fd3905f6d298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.436889 751 tablet_service.cc:1511] Processing CreateTablet for tablet 2e059efed3da48b9a516fd3905f6d298 (DEFAULT_TABLE table=default.Table_f85a1250cf4542d0802dc876e5da7b25 [id=78b145e646b4426ab5f3db938ee5e8ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.437367 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e059efed3da48b9a516fd3905f6d298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.439253 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 0c166a93c88b45f799e14e10e802b5a0 (DEFAULT_TABLE table=default.Table_df7c593c98334922b13b1cfc1cae9340 [id=716467ae002249e59523641d02907298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.439607 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c166a93c88b45f799e14e10e802b5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.440835 758 tablet_service.cc:1511] Processing CreateTablet for tablet 87ca1b3a712845f9a93653faa0e95291 (DEFAULT_TABLE table=default.Table_4d37635717d84d3e9891538926193745 [id=9e6423a3efd748ee92cf51f955402ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.441294 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ca1b3a712845f9a93653faa0e95291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.444283 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 46faf1477a4b4c9994e556308647cad3 (DEFAULT_TABLE table=default.Table_8a8ebba0148c494180484e421fa045e3 [id=85f8392a4b6c4aaa9f8679d6a68148b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.444682 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46faf1477a4b4c9994e556308647cad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.445663 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7f55f5946043108153b4c452a3d961 (DEFAULT_TABLE table=default.Table_4b866c96bb9c475a8c4fafe10fe1e53a [id=d7274a95cefb41908624e55013f7b28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.446081 1027 tablet_service.cc:1511] Processing CreateTablet for tablet f707c504e25144e2a117f9d5f7c28b25 (DEFAULT_TABLE table=default.Table_192beab5edd04401aa4c5067c9f141c9 [id=f1ff8664045d411283ce03c8ad6a2b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.446964 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7f55f5946043108153b4c452a3d961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.450919 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f707c504e25144e2a117f9d5f7c28b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.457619 1198 tablet_bootstrap.cc:492] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:01.457773 1198 ts_tablet_manager.cc:1403] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.129s user 0.003s sys 0.000s
I20260616 19:52:01.458014 749 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7f55f5946043108153b4c452a3d961 (DEFAULT_TABLE table=default.Table_4b866c96bb9c475a8c4fafe10fe1e53a [id=d7274a95cefb41908624e55013f7b28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.458411 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7f55f5946043108153b4c452a3d961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.458660 1198 raft_consensus.cc:359] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.458874 1198 raft_consensus.cc:385] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.458984 1198 raft_consensus.cc:740] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.459227 1198 consensus_queue.cc:260] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.459764 1198 ts_tablet_manager.cc:1434] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:01.460072 1198 tablet_bootstrap.cc:492] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:01.461549 762 tablet_service.cc:1511] Processing CreateTablet for tablet f707c504e25144e2a117f9d5f7c28b25 (DEFAULT_TABLE table=default.Table_192beab5edd04401aa4c5067c9f141c9 [id=f1ff8664045d411283ce03c8ad6a2b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.461894 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f707c504e25144e2a117f9d5f7c28b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.461905 1198 tablet_bootstrap.cc:654] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.463179 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 345) took 3926 ms. Trace:
I20260616 19:52:01.463296 1190 rpcz_store.cc:276] 0616 19:51:57.506625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.506671 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:01.418488 (+3911817us) ts_tablet_manager.cc:1151] Deleting tablet fbb308b05bb04bc18ccaa9550a73d3e7
0616 19:52:01.418702 (+ 214us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.433230 (+ 14528us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3859203}
I20260616 19:52:01.470184 1198 tablet_bootstrap.cc:492] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:01.470327 1198 ts_tablet_manager.cc:1403] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260616 19:52:01.471843 1198 raft_consensus.cc:359] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.472040 1198 raft_consensus.cc:385] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.472110 1198 raft_consensus.cc:740] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.472354 1198 consensus_queue.cc:260] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.472923 1198 ts_tablet_manager.cc:1434] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:01.473079 1719 raft_consensus.cc:493] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:01.473285 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 469) took 1388 ms. Trace:
I20260616 19:52:01.473389 1191 rpcz_store.cc:276] 0616 19:52:00.084745 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.084791 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:01.339690 (+1254899us) ts_tablet_manager.cc:1151] Deleting tablet 662e2d573bd7489a81697c17393ce088
0616 19:52:01.339701 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.412584 (+ 72883us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.426583 (+ 13999us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.473203 (+ 46620us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1248103}
I20260616 19:52:01.474012 1191 tablet_replica.cc:333] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:01.474246 1191 raft_consensus.cc:2243] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:01.474414 1191 raft_consensus.cc:2272] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:01.475055 1191 ts_tablet_manager.cc:1916] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:01.475363 1627 raft_consensus.cc:493] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:01.475534 1627 raft_consensus.cc:515] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.476164 1627 leader_election.cc:290] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:01.476670 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5741b92cafb4d53987dbeeef66ccd56" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:01.477000 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 662e2d573bd7489a81697c17393ce088 (table default.Table_11377e6262de467fbd54d3ab881b4362 [id=543aa36f72844ba182c88e2510bfe65c]) successfully deleted
W20260616 19:52:01.477202 996 leader_election.cc:343] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.477349 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 343) took 3967 ms. Trace:
I20260616 19:52:01.477447 1190 rpcz_store.cc:276] 0616 19:51:57.505713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.507881 (+ 2168us) service_pool.cc:224] Handling call
0616 19:52:01.463585 (+3955704us) ts_tablet_manager.cc:1151] Deleting tablet a0cb7a1acf35403192254bf5cd1170a2
0616 19:52:01.467116 (+ 3531us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.472983 (+ 5867us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3955466}
I20260616 19:52:01.477887 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90852e10a6804cb1bee075b0e9c0eeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.478006 1192 tablet_bootstrap.cc:492] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:01.479022 1190 tablet_replica.cc:333] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:01.479724 1190 raft_consensus.cc:2243] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:01.475188 886 tablet_service.cc:1511] Processing CreateTablet for tablet 65164c1907674ddd968e1acf0aee40e1 (DEFAULT_TABLE table=default.Table_e507611d620b4d9aa713d673c64bd815 [id=f04b8cde42004f63988ea1647f24e512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.484319 1191 ts_tablet_manager.cc:1929] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:01.484319 1678 leader_election.cc:290] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:01.485505 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e6e1b5837078493bae82bdb7db0c81dd" } modify_external_catalogs: true
I20260616 19:52:01.485787 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e6e1b5837078493bae82bdb7db0c81dd" } modify_external_catalogs: true
I20260616 19:52:01.485924 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2e6556b04f044419a12f88274c124086" } new_table_name: "default.Table_8f2f5974ba694802a093f7c3adbacd48" modify_external_catalogs: true
I20260616 19:52:01.487210 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_49f2a480dfe747e1b60b94db3199fe38" } new_table_name: "default.Table_8f195aaf0b9c47169f6c04a5e380bd22" modify_external_catalogs: true
I20260616 19:52:01.487257 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_dde23fc788a44a2ebd6cf100e56067db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:01.487603 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_97d5a00d96fe4b9dbb89960e2abc62a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.487748 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dde23fc788a44a2ebd6cf100e56067db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:01.488200 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97d5a00d96fe4b9dbb89960e2abc62a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.488519 895 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4a2f467b5b4121ae9a9973c153c69f (DEFAULT_TABLE table=default.Table_647d295a0348455285299b2011b05288 [id=4b6cf5696a3f49b4b9af0340906497c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.488897 893 tablet_service.cc:1511] Processing CreateTablet for tablet 7955886341a94249afa849c51d34a0be (DEFAULT_TABLE table=default.Table_2e2432072a8f43cfa54ceabaaf6a7528 [id=935fa232f32d405ca9cc5e9ef1fb4d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.473238 1719 raft_consensus.cc:515] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.490456 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5741b92cafb4d53987dbeeef66ccd56" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:01.484681 1198 tablet_bootstrap.cc:492] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:01.493391 885 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c392b2fecd483d9da12e30e37f27ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.493691 894 tablet_service.cc:1558] Processing DeleteTablet for tablet bc2006e262cc4bbb9b291a5bf52653cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:01.494485 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet fbb308b05bb04bc18ccaa9550a73d3e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbb308b05bb04bc18ccaa9550a73d3e7 already in progress: creating tablet
I20260616 19:52:01.494503 896 tablet_service.cc:1511] Processing CreateTablet for tablet 87ca1b3a712845f9a93653faa0e95291 (DEFAULT_TABLE table=default.Table_4d37635717d84d3e9891538926193745 [id=9e6423a3efd748ee92cf51f955402ba9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:01.494809 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a0cb7a1acf35403192254bf5cd1170a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0cb7a1acf35403192254bf5cd1170a2 already in progress: creating tablet
I20260616 19:52:01.495013 898 tablet_service.cc:1511] Processing CreateTablet for tablet 0c166a93c88b45f799e14e10e802b5a0 (DEFAULT_TABLE table=default.Table_df7c593c98334922b13b1cfc1cae9340 [id=716467ae002249e59523641d02907298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.495909 901 tablet_service.cc:1511] Processing CreateTablet for tablet 2e059efed3da48b9a516fd3905f6d298 (DEFAULT_TABLE table=default.Table_f85a1250cf4542d0802dc876e5da7b25 [id=78b145e646b4426ab5f3db938ee5e8ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.496395 899 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7f55f5946043108153b4c452a3d961 (DEFAULT_TABLE table=default.Table_4b866c96bb9c475a8c4fafe10fe1e53a [id=d7274a95cefb41908624e55013f7b28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.496909 1198 tablet_bootstrap.cc:654] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.496917 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_88f278e7debf4f848f8569bea8b9b8f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:01.497385 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 08db2c1398b946c180d81b88504c1d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:01.497404 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88f278e7debf4f848f8569bea8b9b8f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.497736 887 tablet_service.cc:1511] Processing CreateTablet for tablet 46faf1477a4b4c9994e556308647cad3 (DEFAULT_TABLE table=default.Table_8a8ebba0148c494180484e421fa045e3 [id=85f8392a4b6c4aaa9f8679d6a68148b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.497900 1191 log.cc:1199] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/f2c392b2fecd483d9da12e30e37f27ad
I20260616 19:52:01.498327 1191 ts_tablet_manager.cc:1950] T f2c392b2fecd483d9da12e30e37f27ad P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:01.498824 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_630c32eab3fb4372a3a7de16f0f7916c" } modify_external_catalogs: true
I20260616 19:52:01.499019 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_630c32eab3fb4372a3a7de16f0f7916c" } modify_external_catalogs: true
W20260616 19:52:01.499225 993 leader_election.cc:343] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.499362 993 leader_election.cc:304] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:01.500277 1627 raft_consensus.cc:2749] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:01.501052 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65164c1907674ddd968e1acf0aee40e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.501658 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 915267e7ff3c439385a861dfb954b852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.496343 746 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4a2f467b5b4121ae9a9973c153c69f (DEFAULT_TABLE table=default.Table_647d295a0348455285299b2011b05288 [id=4b6cf5696a3f49b4b9af0340906497c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.502894 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cb98fbb879cb4612a266b8db4ec3972a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.503360 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb98fbb879cb4612a266b8db4ec3972a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.503453 885 tablet_service.cc:1511] Processing CreateTablet for tablet f707c504e25144e2a117f9d5f7c28b25 (DEFAULT_TABLE table=default.Table_192beab5edd04401aa4c5067c9f141c9 [id=f1ff8664045d411283ce03c8ad6a2b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.503778 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f707c504e25144e2a117f9d5f7c28b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.504101 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7f55f5946043108153b4c452a3d961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.505365 1193 ts_tablet_manager.cc:1929] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:01.505492 1193 log.cc:1199] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/2c31c8e977da4a70bca1beb00f364627
I20260616 19:52:01.505962 1193 ts_tablet_manager.cc:1950] T 2c31c8e977da4a70bca1beb00f364627 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:01.506299 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4a2f467b5b4121ae9a9973c153c69f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.502643 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 470) took 1411 ms. Trace:
I20260616 19:52:01.506969 1191 rpcz_store.cc:276] 0616 19:52:00.091301 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.092531 (+ 1230us) service_pool.cc:224] Handling call
0616 19:52:01.473759 (+1381228us) ts_tablet_manager.cc:1151] Deleting tablet f2c392b2fecd483d9da12e30e37f27ad
0616 19:52:01.473940 (+ 181us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.481329 (+ 7389us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.484240 (+ 2911us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.502608 (+ 18368us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308581}
I20260616 19:52:01.507388 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet f2c392b2fecd483d9da12e30e37f27ad (table default.Table_ce91ab4603cc400d94cf6e1fcfe99048 [id=e05ed7086cba4c24b2a2d5968338a743]) successfully deleted
I20260616 19:52:01.508673 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 475) took 1332 ms. Trace:
I20260616 19:52:01.508698 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ca1b3a712845f9a93653faa0e95291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.509056 1191 rpcz_store.cc:276] 0616 19:52:00.175995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.177328 (+ 1333us) service_pool.cc:224] Handling call
0616 19:52:01.508060 (+1330732us) ts_tablet_manager.cc:1151] Deleting tablet 28cd1ad6e8744d33a2845e9f3dda4a7b
0616 19:52:01.508072 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.508637 (+ 565us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1330482}
W20260616 19:52:01.509915 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28cd1ad6e8744d33a2845e9f3dda4a7b already in progress: creating tablet
I20260616 19:52:01.510324 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 476) took 1334 ms. Trace:
I20260616 19:52:01.511497 1191 rpcz_store.cc:276] 0616 19:52:00.176116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.177929 (+ 1813us) service_pool.cc:224] Handling call
0616 19:52:01.510185 (+1332256us) ts_tablet_manager.cc:1151] Deleting tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd
0616 19:52:01.510197 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.510292 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1331167}
I20260616 19:52:01.511920 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46faf1477a4b4c9994e556308647cad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.512668 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 61189a715da140a6833801681bbd5ef4
I20260616 19:52:01.514498 1196 tablet_bootstrap.cc:654] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.515386 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e059efed3da48b9a516fd3905f6d298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.516013 1777 tablet.cc:1724] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:01.522349 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7955886341a94249afa849c51d34a0be. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:01.522934 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e896d5aa87f14e5593d01085bb6d434f consensus state has no leader
W20260616 19:52:01.524057 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3f96ef25396a4092bc475f4aab269bc7 consensus state has no leader
I20260616 19:52:01.515231 1770 tablet.cc:1724] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:01.523710 1691 raft_consensus.cc:493] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:01.525316 1691 raft_consensus.cc:515] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.525974 1691 leader_election.cc:290] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:01.526542 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ea9b8ba668410bae016a008cf37910" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:01.526997 996 leader_election.cc:343] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.525066 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 61189a715da140a6833801681bbd5ef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.527758 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 477) took 1351 ms. Trace:
I20260616 19:52:01.527861 1191 rpcz_store.cc:276] 0616 19:52:00.176364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.176977 (+ 613us) service_pool.cc:224] Handling call
0616 19:52:01.527600 (+1350623us) ts_tablet_manager.cc:1151] Deleting tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b
0616 19:52:01.527610 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.527724 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1346611}
I20260616 19:52:01.528714 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4a2f467b5b4121ae9a9973c153c69f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:01.529435 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd already in progress: creating tablet
I20260616 19:52:01.529495 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 479) took 1271 ms. Trace:
I20260616 19:52:01.529587 1191 rpcz_store.cc:276] 0616 19:52:00.258202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.258249 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:01.529368 (+1271119us) ts_tablet_manager.cc:1151] Deleting tablet 1142b61e40e6499e8244d71f2ad39b1e
0616 19:52:01.529377 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.529465 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1268829}
W20260616 19:52:01.529709 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b already in progress: creating tablet
W20260616 19:52:01.530061 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 1142b61e40e6499e8244d71f2ad39b1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1142b61e40e6499e8244d71f2ad39b1e already in progress: creating tablet
I20260616 19:52:01.531380 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 478) took 1273 ms. Trace:
I20260616 19:52:01.531509 1191 rpcz_store.cc:276] 0616 19:52:00.257809 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.257862 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:01.530946 (+1273084us) ts_tablet_manager.cc:1151] Deleting tablet 1c35e4c8e9304e798c9031469877b70e
0616 19:52:01.531262 (+ 316us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.531343 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1270282}
I20260616 19:52:01.532682 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 480) took 1264 ms. Trace:
I20260616 19:52:01.532954 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c166a93c88b45f799e14e10e802b5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.533257 1191 rpcz_store.cc:276] 0616 19:52:00.268007 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.268050 (+ 43us) service_pool.cc:224] Handling call
0616 19:52:01.532568 (+1264518us) ts_tablet_manager.cc:1151] Deleting tablet 83a199f25e5c4accba0acd1007fc73d1
0616 19:52:01.532577 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.532652 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1260416}
I20260616 19:52:01.533449 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f13d175adfe540b39fd55004a11c9aad
I20260616 19:52:01.535702 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 481) took 1234 ms. Trace:
W20260616 19:52:01.536952 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 83a199f25e5c4accba0acd1007fc73d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83a199f25e5c4accba0acd1007fc73d1 already in progress: creating tablet
I20260616 19:52:01.537001 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet f13d175adfe540b39fd55004a11c9aad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.537341 1191 rpcz_store.cc:276] 0616 19:52:00.301011 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.301065 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:01.535573 (+1234508us) ts_tablet_manager.cc:1151] Deleting tablet 8f02d84ab7324b4c80875acf7f33199d
0616 19:52:01.535583 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.535670 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1234294}
I20260616 19:52:01.538352 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 492) took 1078 ms. Trace:
I20260616 19:52:01.539103 1191 rpcz_store.cc:276] 0616 19:52:00.459819 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.459883 (+ 64us) service_pool.cc:224] Handling call
0616 19:52:01.538234 (+1078351us) ts_tablet_manager.cc:1151] Deleting tablet 269c1dea941c481fb6fd2e4d59c877c0
0616 19:52:01.538242 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.538321 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1076780}
W20260616 19:52:01.539304 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8f02d84ab7324b4c80875acf7f33199d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f02d84ab7324b4c80875acf7f33199d already in progress: creating tablet
I20260616 19:52:01.539930 453 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_191f8acd55ae4da9982a9fb3ec2d51cd [id=1beb7d130df7492ab9b834d005eba63a] alter complete (version 2)
I20260616 19:52:01.540266 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 494) took 1075 ms. Trace:
I20260616 19:52:01.540937 1191 rpcz_store.cc:276] 0616 19:52:00.465237 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.465357 (+ 120us) service_pool.cc:224] Handling call
0616 19:52:01.540141 (+1074784us) ts_tablet_manager.cc:1151] Deleting tablet a817b1d4c7b640db8894bc801878caae
0616 19:52:01.540150 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.540227 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1073464}
W20260616 19:52:01.542173 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 269c1dea941c481fb6fd2e4d59c877c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 269c1dea941c481fb6fd2e4d59c877c0 already in progress: creating tablet
W20260616 19:52:01.542438 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a817b1d4c7b640db8894bc801878caae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a817b1d4c7b640db8894bc801878caae already in progress: creating tablet
I20260616 19:52:01.545506 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 61189a715da140a6833801681bbd5ef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.545822 759 tablet_service.cc:1558] Processing DeleteTablet for tablet f13d175adfe540b39fd55004a11c9aad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.547425 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 495) took 1082 ms. Trace:
I20260616 19:52:01.547544 1191 rpcz_store.cc:276] 0616 19:52:00.465325 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.465456 (+ 131us) service_pool.cc:224] Handling call
0616 19:52:01.545246 (+1079790us) ts_tablet_manager.cc:1151] Deleting tablet 3c90eb04585c4fa992435d11015ffec7
0616 19:52:01.545255 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.547388 (+ 2133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1076159}
I20260616 19:52:01.548255 457 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41] alter complete (version 2)
I20260616 19:52:01.548955 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 493) took 1083 ms. Trace:
I20260616 19:52:01.549077 1191 rpcz_store.cc:276] 0616 19:52:00.465125 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.465502 (+ 377us) service_pool.cc:224] Handling call
0616 19:52:01.548818 (+1083316us) ts_tablet_manager.cc:1151] Deleting tablet 482411d57f24459d8e7ed0eeb573234d
0616 19:52:01.548830 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.548919 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1079188}
I20260616 19:52:01.549409 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 662e2d573bd7489a81697c17393ce088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.549750 759 tablet_service.cc:1558] Processing DeleteTablet for tablet a93dd295602840319f72e7021ddfd61a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.550055 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 350453721d13427a946ac5c5ee7c62a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:01.550349 858 leader_election.cc:343] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 776841d895d6431fbee76b7c4e28d973
I20260616 19:52:01.547160 1190 raft_consensus.cc:2272] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:01.550530 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 496) took 1085 ms. Trace:
I20260616 19:52:01.550635 1191 rpcz_store.cc:276] 0616 19:52:00.465451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.465481 (+ 30us) service_pool.cc:224] Handling call
0616 19:52:01.550400 (+1084919us) ts_tablet_manager.cc:1151] Deleting tablet 93c940bd14a040ddba5ea058e732bf0c
0616 19:52:01.550408 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.550491 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1080717}
I20260616 19:52:01.551970 1191 tablet_replica.cc:333] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:01.552201 1191 raft_consensus.cc:2243] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:01.552404 1191 raft_consensus.cc:2272] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:01.552599 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_61d46cd30fe14d8d9e6e45f4a242e6fa" } new_table_name: "default.Table_fc0e76e3150e401ca073ed6fda000612" modify_external_catalogs: true
I20260616 19:52:01.552987 1191 ts_tablet_manager.cc:1916] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:01.554315 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1a7673e0f4cd433792d8ef02de3304ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.554441 860 leader_election.cc:343] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 776841d895d6431fbee76b7c4e28d973
I20260616 19:52:01.554579 1190 ts_tablet_manager.cc:1916] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:01.554772 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_63c1b65ae6ec44da84f6afa7c1a16ec0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:01.555050 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6f9f2452db504153b1a3fe18c9a6498d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.556375 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 50615.8us
I20260616 19:52:01.556759 1678 consensus_queue.cc:1048] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:01.558001 1193 tablet_replica.cc:333] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:01.559026 1193 raft_consensus.cc:2243] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:01.559531 1193 raft_consensus.cc:2272] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:01.560555 903 tablet_service.cc:1558] Processing DeleteTablet for tablet f13d175adfe540b39fd55004a11c9aad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:01.562772 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 137c13d905eb4bf2937f730e5210266f consensus state has no leader
I20260616 19:52:01.566301 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 61189a715da140a6833801681bbd5ef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.566401 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7f591d97bc4571b294b06d990d4065" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:01.566630 1058 raft_consensus.cc:2393] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:01.569033 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f059ca67519042369942560b08e0d06c" } new_table_name: "default.Table_3f1ead1791b844acbe29bd0f9c9e6488" modify_external_catalogs: true
I20260616 19:52:01.571048 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5436b0719642405e902210bdd7310a37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:01.572100 456 master_service.cc:960] ReplaceTablet: received request to replace tablet e6530753b4184cfe972ae3a43f23d589 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:01.572821 860 leader_election.cc:304] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
W20260616 19:52:01.573169 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 72105.7us
I20260616 19:52:01.573967 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7f591d97bc4571b294b06d990d4065" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:01.574045 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ea9b8ba668410bae016a008cf37910" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:01.576125 1720 raft_consensus.cc:2749] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260616 19:52:01.577682 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f1e12555be64192860eab59b3aeb562 consensus state has no leader
I20260616 19:52:01.577682 1678 consensus_queue.cc:1048] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260616 19:52:01.579236 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 2c31c8e977da4a70bca1beb00f364627 (table default.Table_9e98175df9ce48a59cb42b1e48cd7fba [id=cb4c50d05fdd4c0a85828222eeb0f06a]) successfully deleted
I20260616 19:52:01.580920 1192 tablet_bootstrap.cc:654] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.585731 1691 raft_consensus.cc:493] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:01.585886 1691 raft_consensus.cc:515] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.586591 1691 leader_election.cc:290] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:01.587312 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb024637294148c18b74bef47fb2fcce" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:01.587932 996 leader_election.cc:343] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.589872 1719 leader_election.cc:290] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:01.590034 858 leader_election.cc:304] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:01.590472 1719 raft_consensus.cc:3060] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:01.591019 993 leader_election.cc:343] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.593505 993 leader_election.cc:304] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:01.593991 1691 raft_consensus.cc:2749] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:01.599957 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c3a414b8774445a4a731cbbfa3f171bb" } new_table_name: "default.Table_ef3897a753a842809aa6476dbe464fe3" modify_external_catalogs: true
I20260616 19:52:01.605607 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e004f84474eb4deba328c85df07a597d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:01.607859 1193 ts_tablet_manager.cc:1916] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:01.610152 454 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]). Expected version 1 got 0
I20260616 19:52:01.610558 454 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 7dc92bc15da14504a1ff5feda5aff7cf (table default.Table_6955250583bf4c3cbff20316dfa5d1a7 [id=8c7791625cfd4d39ad0dff83be1c7089]). Expected version 1 got 0
I20260616 19:52:01.610751 454 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet d51a6fb4c49e461583a5aba1813b2a3e (table default.Table_b3d1ae6133974de8942b6f6a2ae9f310 [id=2d4376cceca648ef87dcf561d1e9e701]). Expected version 1 got 0
W20260616 19:52:01.615196 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed8e5b059700443faab937488002de37 consensus state has no leader
W20260616 19:52:01.616107 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e004f84474eb4deba328c85df07a597d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:01.616206 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f9f2452db504153b1a3fe18c9a6498d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:01.617535 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a7673e0f4cd433792d8ef02de3304ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:01.548807 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 3c90eb04585c4fa992435d11015ffec7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c90eb04585c4fa992435d11015ffec7 already in progress: creating tablet
W20260616 19:52:01.626430 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 77608.1us
I20260616 19:52:01.626724 881 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:48628 (request call id 166) took 1205 ms. Trace:
W20260616 19:52:01.626662 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5436b0719642405e902210bdd7310a37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.626854 881 rpcz_store.cc:276] 0616 19:52:00.421074 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.421140 (+ 66us) service_pool.cc:224] Handling call
0616 19:52:01.062535 (+641395us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x6160000b0f30. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7d0976673 00007fb7d34a0d28 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138 0000000000aa681c
0616 19:52:01.124877 (+ 62342us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x6160000b1530. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7d0976673 00007fb7d34a0d28 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138 0000000000aa681c
0616 19:52:01.171752 (+ 46875us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x6160001c0954. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7cf5ef8c0 00007fb7d34a0f1f 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138 0000000000aa681c
0616 19:52:01.375362 (+203610us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x616000152554. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7cf5ef8c0 00007fb7d34a0f1f 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138 0000000000aa681c
0616 19:52:01.597616 (+222254us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x6160000e3e54. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7cf5ef8c0 00007fb7d34a0f1f 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138 0000000000aa681c
0616 19:52:01.626656 (+ 29040us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533607424}
W20260616 19:52:01.628551 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63c1b65ae6ec44da84f6afa7c1a16ec0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.631088 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d368ec65b624ea58f7b750097a78ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:01.629837 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 482411d57f24459d8e7ed0eeb573234d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 482411d57f24459d8e7ed0eeb573234d already in progress: creating tablet
W20260616 19:52:01.631538 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 93c940bd14a040ddba5ea058e732bf0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93c940bd14a040ddba5ea058e732bf0c already in progress: creating tablet
I20260616 19:52:01.633617 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet eb04ccc26e64484a9a29c515d4b954fe (table default.Table_62b93909f63642cda25a0d17ce9b567c [id=87e3217093844e81ac448e2e9d8fa3ec]). Expected version 1 got 0
I20260616 19:52:01.636155 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ea9b8ba668410bae016a008cf37910 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.636396 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 10fc1d2ecaa746bab980a708dd8eb93a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.633255 453 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_b3d1ae6133974de8942b6f6a2ae9f310 [id=2d4376cceca648ef87dcf561d1e9e701] alter complete (version 1)
I20260616 19:52:01.637490 1198 tablet_bootstrap.cc:492] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:01.637768 1198 ts_tablet_manager.cc:1403] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.165s user 0.009s sys 0.027s
I20260616 19:52:01.640921 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_de40de7f1c184226aad857d32b71c326" } modify_external_catalogs: true
I20260616 19:52:01.641124 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_de40de7f1c184226aad857d32b71c326" } modify_external_catalogs: true
I20260616 19:52:01.641819 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_246d3701c107443eafaca0a854ab5d6c" } modify_external_catalogs: true
I20260616 19:52:01.642038 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_246d3701c107443eafaca0a854ab5d6c" } modify_external_catalogs: true
I20260616 19:52:01.643167 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9b154e7b9f584385866a56cfaa2bbd49" } modify_external_catalogs: true
I20260616 19:52:01.643404 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9b154e7b9f584385866a56cfaa2bbd49" } modify_external_catalogs: true
I20260616 19:52:01.644191 1198 raft_consensus.cc:359] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.644379 1198 raft_consensus.cc:385] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.644490 1198 raft_consensus.cc:740] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.644721 1198 consensus_queue.cc:260] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.647382 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet eb04ccc26e64484a9a29c515d4b954fe (table default.Table_62b93909f63642cda25a0d17ce9b567c [id=87e3217093844e81ac448e2e9d8fa3ec]). Expected version 1 got 0
I20260616 19:52:01.649303 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8744a2db15fd49259e0900a69941415d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.649889 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8744a2db15fd49259e0900a69941415d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.650813 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet fdc6222db09d4cd987cbdf70e4d40f70 with delete_type TABLET_DATA_DELETED (replaced by tablet d5c82b71969e4cbcb890d16e1cdd5348) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.650959 1719 raft_consensus.cc:2749] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:01.652895 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 59812b232848488b9894e8f8057e9def from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:01.657696 1738 tablet.cc:1724] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:01.657774 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb024637294148c18b74bef47fb2fcce" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:01.658412 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet eb04ccc26e64484a9a29c515d4b954fe (table default.Table_62b93909f63642cda25a0d17ce9b567c [id=87e3217093844e81ac448e2e9d8fa3ec]). Expected version 1 got 0
W20260616 19:52:01.661511 993 leader_election.cc:343] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.662129 993 leader_election.cc:304] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:01.662516 1777 tablet.cc:1724] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:01.662966 1691 raft_consensus.cc:2749] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:01.667147 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 59812b232848488b9894e8f8057e9def
I20260616 19:52:01.667661 454 catalog_manager.cc:6784] ReplaceTablet: tablet 59812b232848488b9894e8f8057e9def deleted and replaced by tablet 70e1f138c3154dfbb93aca7bed67719d
I20260616 19:52:01.668846 1198 ts_tablet_manager.cc:1434] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.024s user 0.000s sys 0.001s
I20260616 19:52:01.670511 1196 tablet_bootstrap.cc:492] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:01.674515 1738 tablet.cc:1724] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:01.674595 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 59812b232848488b9894e8f8057e9def with delete_type TABLET_DATA_DELETED (replaced by tablet 70e1f138c3154dfbb93aca7bed67719d) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.675817 1198 tablet_bootstrap.cc:492] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:01.679692 454 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_62b93909f63642cda25a0d17ce9b567c [id=87e3217093844e81ac448e2e9d8fa3ec] alter complete (version 1)
I20260616 19:52:01.687254 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1a7b177800174706a985c11e5876b9d3
I20260616 19:52:01.691718 1198 tablet_bootstrap.cc:654] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.692909 1691 raft_consensus.cc:493] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:01.693084 1691 raft_consensus.cc:515] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.693902 1691 leader_election.cc:290] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:01.688155 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0ca03b6e81e546adada566607257369f
I20260616 19:52:01.694376 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a7b177800174706a985c11e5876b9d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.690800 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet e6530753b4184cfe972ae3a43f23d589
I20260616 19:52:01.695874 456 catalog_manager.cc:6784] ReplaceTablet: tablet e6530753b4184cfe972ae3a43f23d589 deleted and replaced by tablet f89a0c065a4a4fb7afa8cab29d78c2e5
I20260616 19:52:01.696009 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ca03b6e81e546adada566607257369f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.696599 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet e6530753b4184cfe972ae3a43f23d589 with delete_type TABLET_DATA_DELETED (replaced by tablet f89a0c065a4a4fb7afa8cab29d78c2e5) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.693240 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 90852e10a6804cb1bee075b0e9c0eeaf
I20260616 19:52:01.697942 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 90852e10a6804cb1bee075b0e9c0eeaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.699180 1196 ts_tablet_manager.cc:1403] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.295s user 0.002s sys 0.002s
I20260616 19:52:01.699486 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ca03b6e81e546adada566607257369f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.699719 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 90852e10a6804cb1bee075b0e9c0eeaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.700206 759 tablet_service.cc:1558] Processing DeleteTablet for tablet e6530753b4184cfe972ae3a43f23d589 with delete_type TABLET_DATA_DELETED (replaced by tablet f89a0c065a4a4fb7afa8cab29d78c2e5) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.700707 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a7b177800174706a985c11e5876b9d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.700922 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d368ec65b624ea58f7b750097a78ede" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:01.701525 996 leader_election.cc:343] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.703738 1196 raft_consensus.cc:359] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.703969 1196 raft_consensus.cc:385] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.704100 1196 raft_consensus.cc:740] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.704846 1196 consensus_queue.cc:260] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.708261 1196 ts_tablet_manager.cc:1434] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260616 19:52:01.710867 752 tablet_service.cc:1511] Processing CreateTablet for tablet 9446df9472e34ac79ec24cce89e3f5e5 (DEFAULT_TABLE table=default.Table_bb4236ba15c042c2a67d464a935dd973 [id=285a48bd855f45609454a65af963f0f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.711234 458 master_service.cc:960] ReplaceTablet: received request to replace tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:01.711304 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9446df9472e34ac79ec24cce89e3f5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.712175 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d368ec65b624ea58f7b750097a78ede" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:01.714031 993 leader_election.cc:343] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.714205 993 leader_election.cc:304] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:01.714617 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 59812b232848488b9894e8f8057e9def with delete_type TABLET_DATA_DELETED (replaced by tablet 70e1f138c3154dfbb93aca7bed67719d) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.714762 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 8125dce4d32a416498b42a1b599355fd with delete_type TABLET_DATA_DELETED (replaced by tablet 9060de590fa84ea08dc7d39765bc9308) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.715234 1691 raft_consensus.cc:2749] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:01.719655 886 tablet_service.cc:1511] Processing CreateTablet for tablet 9446df9472e34ac79ec24cce89e3f5e5 (DEFAULT_TABLE table=default.Table_bb4236ba15c042c2a67d464a935dd973 [id=285a48bd855f45609454a65af963f0f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.720574 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 90852e10a6804cb1bee075b0e9c0eeaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.720610 1770 tablet.cc:1724] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:01.720942 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ca03b6e81e546adada566607257369f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.724236 888 tablet_service.cc:1558] Processing DeleteTablet for tablet e6530753b4184cfe972ae3a43f23d589 with delete_type TABLET_DATA_DELETED (replaced by tablet f89a0c065a4a4fb7afa8cab29d78c2e5) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.724895 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2349f63e2a7e4af4ae0a80e8ed86c6a9" } modify_external_catalogs: true
I20260616 19:52:01.725127 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2349f63e2a7e4af4ae0a80e8ed86c6a9" } modify_external_catalogs: true
I20260616 19:52:01.726979 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 9446df9472e34ac79ec24cce89e3f5e5 (DEFAULT_TABLE table=default.Table_bb4236ba15c042c2a67d464a935dd973 [id=285a48bd855f45609454a65af963f0f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.727361 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9446df9472e34ac79ec24cce89e3f5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.727371 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a7b177800174706a985c11e5876b9d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.730618 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 662e2d573bd7489a81697c17393ce088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.730921 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9446df9472e34ac79ec24cce89e3f5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.732503 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce0d37e91de4b4db94f535fbd3fcc94 (DEFAULT_TABLE table=default.Table_398beedaedf34f3680d72afcb4ead9c0 [id=58d9f7c6431f47a7b5dd0b2785b6fffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.733301 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce0d37e91de4b4db94f535fbd3fcc94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.734472 1190 ts_tablet_manager.cc:1929] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:01.734611 1190 log.cc:1199] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/99551210f5974332bf6a16ee74b220f6
I20260616 19:52:01.734583 887 tablet_service.cc:1511] Processing CreateTablet for tablet ee10d6f8fd5040aebd9c9592d84534fc (DEFAULT_TABLE table=default.Table_253cae986d644063bf9fe7a2a9fb9ce9 [id=d273d64384f34f039e001c43e52aa048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.734987 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee10d6f8fd5040aebd9c9592d84534fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.735280 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f54eef97f8db47449564b49be608902f
I20260616 19:52:01.735426 893 tablet_service.cc:1511] Processing CreateTablet for tablet 1930d9628e9b4d948accc9093d4f442f (DEFAULT_TABLE table=default.Table_a25d7029a177435bb8a1ea52446e1933 [id=d38f6bfd99b345cea3e107dc884c10d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.735817 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1930d9628e9b4d948accc9093d4f442f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.737880 751 tablet_service.cc:1511] Processing CreateTablet for tablet 1930d9628e9b4d948accc9093d4f442f (DEFAULT_TABLE table=default.Table_a25d7029a177435bb8a1ea52446e1933 [id=d38f6bfd99b345cea3e107dc884c10d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.738289 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1930d9628e9b4d948accc9093d4f442f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.739225 1751 consensus_queue.cc:1048] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260616 19:52:01.740928 898 tablet_service.cc:1558] Processing DeleteTablet for tablet f54eef97f8db47449564b49be608902f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.742566 759 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce0d37e91de4b4db94f535fbd3fcc94 (DEFAULT_TABLE table=default.Table_398beedaedf34f3680d72afcb4ead9c0 [id=58d9f7c6431f47a7b5dd0b2785b6fffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.742977 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce0d37e91de4b4db94f535fbd3fcc94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.745970 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6f9f2452db504153b1a3fe18c9a6498d" } new_table_name: "default.Table_f7b097131a324d9f90b11941f4f31708" modify_external_catalogs: true
I20260616 19:52:01.748631 887 tablet_service.cc:1511] Processing CreateTablet for tablet a2904f2e00314858899a760b84950e1f (DEFAULT_TABLE table=default.Table_7fce2ed3c7c848d0934500fec50d1198 [id=f3aa08d6e2c0416e86881a647e0ad703]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.748823 899 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce0d37e91de4b4db94f535fbd3fcc94 (DEFAULT_TABLE table=default.Table_398beedaedf34f3680d72afcb4ead9c0 [id=58d9f7c6431f47a7b5dd0b2785b6fffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.749074 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2904f2e00314858899a760b84950e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.749183 1190 ts_tablet_manager.cc:1950] T 99551210f5974332bf6a16ee74b220f6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:01.749946 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 342) took 4244 ms. Trace:
I20260616 19:52:01.750078 1190 rpcz_store.cc:276] 0616 19:51:57.505407 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.508147 (+ 2740us) service_pool.cc:224] Handling call
0616 19:52:01.477672 (+3969525us) ts_tablet_manager.cc:1151] Deleting tablet 99551210f5974332bf6a16ee74b220f6
0616 19:52:01.477685 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.723944 (+246259us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.734389 (+ 10445us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:01.749501 (+ 15112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3969356}
I20260616 19:52:01.750471 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 99551210f5974332bf6a16ee74b220f6 (table default.Table_ab3032cb1f934fdc9bde24d4b3b1f5a3 [id=4fbf7d11df5448f4b249f9c831241f38]) successfully deleted
I20260616 19:52:01.750633 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 347) took 4196 ms. Trace:
I20260616 19:52:01.750741 1190 rpcz_store.cc:276] 0616 19:51:57.553886 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.600746 (+ 46860us) service_pool.cc:224] Handling call
0616 19:52:01.750487 (+4149741us) ts_tablet_manager.cc:1151] Deleting tablet e6f309caaa9042f99432a61fd2ebb089
0616 19:52:01.750498 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.750604 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4135238}
I20260616 19:52:01.751135 1190 tablet_replica.cc:333] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
W20260616 19:52:01.751169 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet e6f309caaa9042f99432a61fd2ebb089 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6f309caaa9042f99432a61fd2ebb089 already in progress: creating tablet
I20260616 19:52:01.751365 1190 raft_consensus.cc:2243] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:01.751546 1190 raft_consensus.cc:2272] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:01.751937 758 tablet_service.cc:1511] Processing CreateTablet for tablet ee10d6f8fd5040aebd9c9592d84534fc (DEFAULT_TABLE table=default.Table_253cae986d644063bf9fe7a2a9fb9ce9 [id=d273d64384f34f039e001c43e52aa048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.752103 1190 ts_tablet_manager.cc:1916] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:01.752316 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee10d6f8fd5040aebd9c9592d84534fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.752902 898 tablet_service.cc:1511] Processing CreateTablet for tablet c090cf49c61e487a974d953ed1903db7 (DEFAULT_TABLE table=default.Table_7e1dbf9e64af41fc9d18cf1267dad2ee [id=c571c6a4ed8b48a0b7c59bbf1bbfc18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.753321 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c090cf49c61e487a974d953ed1903db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.756531 748 tablet_service.cc:1558] Processing DeleteTablet for tablet f54eef97f8db47449564b49be608902f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:01.757071 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1eacae5ee28947a9a4fb2315165c4df2 has no consensus state
I20260616 19:52:01.758591 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet f54eef97f8db47449564b49be608902f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:01.758816 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce0d37e91de4b4db94f535fbd3fcc94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.759033 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ee10d6f8fd5040aebd9c9592d84534fc (DEFAULT_TABLE table=default.Table_253cae986d644063bf9fe7a2a9fb9ce9 [id=d273d64384f34f039e001c43e52aa048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.759902 1035 tablet_service.cc:1511] Processing CreateTablet for tablet a2904f2e00314858899a760b84950e1f (DEFAULT_TABLE table=default.Table_7fce2ed3c7c848d0934500fec50d1198 [id=f3aa08d6e2c0416e86881a647e0ad703]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.760294 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2904f2e00314858899a760b84950e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.765408 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 1930d9628e9b4d948accc9093d4f442f (DEFAULT_TABLE table=default.Table_a25d7029a177435bb8a1ea52446e1933 [id=d38f6bfd99b345cea3e107dc884c10d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.765870 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1930d9628e9b4d948accc9093d4f442f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.772826 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee10d6f8fd5040aebd9c9592d84534fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.777884 1192 tablet_bootstrap.cc:492] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:01.778133 1192 ts_tablet_manager.cc:1403] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.312s user 0.005s sys 0.011s
I20260616 19:52:01.779052 1192 raft_consensus.cc:359] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.779208 898 tablet_service.cc:1511] Processing CreateTablet for tablet 4bde746e334a4f59aded168c6b2bb348 (DEFAULT_TABLE table=default.Table_24ad15d9fa8442738b87cc9d4ca64e87 [id=3c3db4dc67514942909aacccd43c4f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.779345 1192 raft_consensus.cc:385] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.779508 1192 raft_consensus.cc:740] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.779850 1192 consensus_queue.cc:260] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.782153 458 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]). Expected version 1 got 0
I20260616 19:52:01.783257 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bde746e334a4f59aded168c6b2bb348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.786784 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 350453721d13427a946ac5c5ee7c62a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:01.787788 1198 tablet_bootstrap.cc:492] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:01.788002 1198 ts_tablet_manager.cc:1403] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.118s user 0.004s sys 0.000s
I20260616 19:52:01.789109 1198 raft_consensus.cc:359] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.789443 1198 raft_consensus.cc:385] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:01.789592 1198 raft_consensus.cc:740] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:01.789896 1198 consensus_queue.cc:260] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.790771 1198 ts_tablet_manager.cc:1434] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:01.791127 1198 tablet_bootstrap.cc:492] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:01.791869 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 4bde746e334a4f59aded168c6b2bb348 (DEFAULT_TABLE table=default.Table_24ad15d9fa8442738b87cc9d4ca64e87 [id=3c3db4dc67514942909aacccd43c4f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.792282 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bde746e334a4f59aded168c6b2bb348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.792968 1198 tablet_bootstrap.cc:654] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:01.793702 893 tablet_service.cc:1511] Processing CreateTablet for tablet 89432adb0a4b442bbc5e46ee43a3e1b2 (DEFAULT_TABLE table=default.Table_ee33e081bec640ffb218fc7912367a71 [id=380b26d6654c430c9717906ee3dcb9bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.794116 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89432adb0a4b442bbc5e46ee43a3e1b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:01.795859 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 1eacae5ee28947a9a4fb2315165c4df2 (table default.Table_f7b097131a324d9f90b11941f4f31708 [id=5bf04207e9a947d4ab1880ad5f2f630b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1eacae5ee28947a9a4fb2315165c4df2 has no consensus state
I20260616 19:52:01.800501 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 89432adb0a4b442bbc5e46ee43a3e1b2 (DEFAULT_TABLE table=default.Table_ee33e081bec640ffb218fc7912367a71 [id=380b26d6654c430c9717906ee3dcb9bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.800912 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89432adb0a4b442bbc5e46ee43a3e1b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.801753 888 tablet_service.cc:1511] Processing CreateTablet for tablet d7c3e760d24247a5bc2b17a610ff49dc (DEFAULT_TABLE table=default.Table_f53395a2b4ee42de9731707666f67440 [id=699a0a35222f4c7c92c322d6ed679a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.802116 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c3e760d24247a5bc2b17a610ff49dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.805349 895 tablet_service.cc:1511] Processing CreateTablet for tablet e88de49e07a4467d9698d71c321c16f5 (DEFAULT_TABLE table=default.Table_2365f5983f194955a1a82ebcca715137 [id=5682cf33fff94019bfc8633594d65f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.805454 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 72850fb9855c48ba8540b2775055fbe5 (DEFAULT_TABLE table=default.Table_cc60987ac3314143a7ef361f4c8e9a26 [id=1a82722ccc994677a8a696a4ac9e0baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.805557 1022 tablet_service.cc:1511] Processing CreateTablet for tablet d7c3e760d24247a5bc2b17a610ff49dc (DEFAULT_TABLE table=default.Table_f53395a2b4ee42de9731707666f67440 [id=699a0a35222f4c7c92c322d6ed679a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.805711 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88de49e07a4467d9698d71c321c16f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.805817 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72850fb9855c48ba8540b2775055fbe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.806061 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c3e760d24247a5bc2b17a610ff49dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.808923 1021 tablet_service.cc:1511] Processing CreateTablet for tablet a7cc0edadc1948ffbe15febbebb27b45 (DEFAULT_TABLE table=default.Table_28f9c1cb3aa04a959b05b1cc91b14891 [id=5072bf93c69647a2974966d7f011eb09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.809345 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cc0edadc1948ffbe15febbebb27b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.811865 1691 raft_consensus.cc:493] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:01.812026 1691 raft_consensus.cc:515] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.812703 1691 leader_election.cc:290] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:01.812733 1037 tablet_service.cc:1511] Processing CreateTablet for tablet e88de49e07a4467d9698d71c321c16f5 (DEFAULT_TABLE table=default.Table_2365f5983f194955a1a82ebcca715137 [id=5682cf33fff94019bfc8633594d65f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.813673 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88de49e07a4467d9698d71c321c16f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.815153 901 tablet_service.cc:1511] Processing CreateTablet for tablet a7cc0edadc1948ffbe15febbebb27b45 (DEFAULT_TABLE table=default.Table_28f9c1cb3aa04a959b05b1cc91b14891 [id=5072bf93c69647a2974966d7f011eb09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.815547 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cc0edadc1948ffbe15febbebb27b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.820735 1753 consensus_queue.cc:1048] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260616 19:52:01.822220 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fc1d2ecaa746bab980a708dd8eb93a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:01.823786 1192 ts_tablet_manager.cc:1434] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.045s user 0.001s sys 0.001s
I20260616 19:52:01.824399 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fc1d2ecaa746bab980a708dd8eb93a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:01.826481 778 raft_consensus.cc:3060] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:01.836077 898 tablet_service.cc:1511] Processing CreateTablet for tablet 4970ac68130e40fa8288c8c74f705378 (DEFAULT_TABLE table=default.Table_e20dacac303a4fdfbb7580b7a07a0f91 [id=98a9b15d55fa492ba9d582fac0cee86b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.836661 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4970ac68130e40fa8288c8c74f705378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.836702 456 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]). Expected version 1 got 0
W20260616 19:52:01.839533 996 leader_election.cc:343] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.843746 903 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac5b6be55944bdfb12db675442b1f1d (DEFAULT_TABLE table=default.Table_30c975e6226e45f88f761eeaca5fe355 [id=56cdfe3dd2ca46338485a32451849632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.844208 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac5b6be55944bdfb12db675442b1f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.846014 894 tablet_service.cc:1511] Processing CreateTablet for tablet f6054dc3492e4fa5a89359f8e48762ff (DEFAULT_TABLE table=default.Table_741bad4ee8914381a7b50c35e8f2b298 [id=4a9a1425ea3f4cc382073895f9657d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.846390 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6054dc3492e4fa5a89359f8e48762ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.846455 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_232c28cfcefb46c48f728eb603081963"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:01.846603 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9a17c0908668403b9d99e81dc05eccd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:01.847023 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_232c28cfcefb46c48f728eb603081963 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:01.847822 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a17c0908668403b9d99e81dc05eccd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:01.849524 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dde23fc788a44a2ebd6cf100e56067db" } new_table_name: "default.Table_b31b1a4576bc486c965cd83367a24953" modify_external_catalogs: true
I20260616 19:52:01.850339 885 tablet_service.cc:1511] Processing CreateTablet for tablet 47bbf21dc1d945ce8f5edd27cdf26817 (DEFAULT_TABLE table=default.Table_5669ec43b5604db88e68c905ddf440a2 [id=9cf96fd3b67e49f28ab797deaba57ce9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.850888 904 tablet_service.cc:1511] Processing CreateTablet for tablet 9a354b06adc343ef94b295916d582b49 (DEFAULT_TABLE table=default.Table_c525e769b75a483aa546c7a2c607aa70 [id=d4d84720adf748878db425165974a28e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.851619 896 tablet_service.cc:1511] Processing CreateTablet for tablet e1ab9d0ac7df4d549d52014a0ecd9d1a (DEFAULT_TABLE table=default.Table_7b1eed4af94f4d9497213d6a3bc40ddc [id=e8d609624264417786b2a623ba317a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.852214 891 tablet_service.cc:1511] Processing CreateTablet for tablet df1ee0d1e1514c86802cdce5ae0756eb (DEFAULT_TABLE table=default.Table_95e22ec4d7a84936891845fe5e39f547 [id=62bf513c98b2495592537b5db5ef309d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.852582 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47bbf21dc1d945ce8f5edd27cdf26817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.853003 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df1ee0d1e1514c86802cdce5ae0756eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.853705 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ab9d0ac7df4d549d52014a0ecd9d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.855355 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a354b06adc343ef94b295916d582b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.856314 749 tablet_service.cc:1511] Processing CreateTablet for tablet 4bde746e334a4f59aded168c6b2bb348 (DEFAULT_TABLE table=default.Table_24ad15d9fa8442738b87cc9d4ca64e87 [id=3c3db4dc67514942909aacccd43c4f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.856748 762 tablet_service.cc:1511] Processing CreateTablet for tablet 89432adb0a4b442bbc5e46ee43a3e1b2 (DEFAULT_TABLE table=default.Table_ee33e081bec640ffb218fc7912367a71 [id=380b26d6654c430c9717906ee3dcb9bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.857111 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89432adb0a4b442bbc5e46ee43a3e1b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.858464 761 tablet_service.cc:1511] Processing CreateTablet for tablet 72850fb9855c48ba8540b2775055fbe5 (DEFAULT_TABLE table=default.Table_cc60987ac3314143a7ef361f4c8e9a26 [id=1a82722ccc994677a8a696a4ac9e0baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.858814 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72850fb9855c48ba8540b2775055fbe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.859488 764 tablet_service.cc:1511] Processing CreateTablet for tablet d7c3e760d24247a5bc2b17a610ff49dc (DEFAULT_TABLE table=default.Table_f53395a2b4ee42de9731707666f67440 [id=699a0a35222f4c7c92c322d6ed679a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.859838 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c3e760d24247a5bc2b17a610ff49dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.860761 747 tablet_service.cc:1511] Processing CreateTablet for tablet a7cc0edadc1948ffbe15febbebb27b45 (DEFAULT_TABLE table=default.Table_28f9c1cb3aa04a959b05b1cc91b14891 [id=5072bf93c69647a2974966d7f011eb09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.861112 756 tablet_service.cc:1511] Processing CreateTablet for tablet e88de49e07a4467d9698d71c321c16f5 (DEFAULT_TABLE table=default.Table_2365f5983f194955a1a82ebcca715137 [id=5682cf33fff94019bfc8633594d65f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.861487 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88de49e07a4467d9698d71c321c16f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.862177 763 tablet_service.cc:1511] Processing CreateTablet for tablet 4970ac68130e40fa8288c8c74f705378 (DEFAULT_TABLE table=default.Table_e20dacac303a4fdfbb7580b7a07a0f91 [id=98a9b15d55fa492ba9d582fac0cee86b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.862519 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4970ac68130e40fa8288c8c74f705378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.863396 755 tablet_service.cc:1511] Processing CreateTablet for tablet 47bbf21dc1d945ce8f5edd27cdf26817 (DEFAULT_TABLE table=default.Table_5669ec43b5604db88e68c905ddf440a2 [id=9cf96fd3b67e49f28ab797deaba57ce9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.863818 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47bbf21dc1d945ce8f5edd27cdf26817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.865005 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac5b6be55944bdfb12db675442b1f1d (DEFAULT_TABLE table=default.Table_30c975e6226e45f88f761eeaca5fe355 [id=56cdfe3dd2ca46338485a32451849632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.865439 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac5b6be55944bdfb12db675442b1f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.867143 753 tablet_service.cc:1511] Processing CreateTablet for tablet 9a354b06adc343ef94b295916d582b49 (DEFAULT_TABLE table=default.Table_c525e769b75a483aa546c7a2c607aa70 [id=d4d84720adf748878db425165974a28e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.867970 765 tablet_service.cc:1511] Processing CreateTablet for tablet f6054dc3492e4fa5a89359f8e48762ff (DEFAULT_TABLE table=default.Table_741bad4ee8914381a7b50c35e8f2b298 [id=4a9a1425ea3f4cc382073895f9657d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.868294 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6054dc3492e4fa5a89359f8e48762ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.868758 748 tablet_service.cc:1511] Processing CreateTablet for tablet c090cf49c61e487a974d953ed1903db7 (DEFAULT_TABLE table=default.Table_7e1dbf9e64af41fc9d18cf1267dad2ee [id=c571c6a4ed8b48a0b7c59bbf1bbfc18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.869083 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c090cf49c61e487a974d953ed1903db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.871848 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]). Expected version 1 got 0
I20260616 19:52:01.872438 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bde746e334a4f59aded168c6b2bb348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.872711 1719 raft_consensus.cc:493] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:01.872874 1719 raft_consensus.cc:515] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.873513 1719 leader_election.cc:290] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:01.875988 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350453721d13427a946ac5c5ee7c62a0" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:01.876194 784 raft_consensus.cc:2468] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:01.876718 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cc0edadc1948ffbe15febbebb27b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.876817 860 leader_election.cc:304] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:01.877117 1719 raft_consensus.cc:2804] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:01.877209 1719 raft_consensus.cc:493] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:01.877307 1719 raft_consensus.cc:3060] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:01.878197 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]). Expected version 1 got 0
I20260616 19:52:01.879910 1719 raft_consensus.cc:515] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.863091 750 tablet_service.cc:1511] Processing CreateTablet for tablet e1ab9d0ac7df4d549d52014a0ecd9d1a (DEFAULT_TABLE table=default.Table_7b1eed4af94f4d9497213d6a3bc40ddc [id=e8d609624264417786b2a623ba317a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.880820 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ab9d0ac7df4d549d52014a0ecd9d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.892251 1719 leader_election.cc:290] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:01.903726 1192 tablet_bootstrap.cc:492] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:01.890982 886 tablet_service.cc:1511] Processing CreateTablet for tablet 72850fb9855c48ba8540b2775055fbe5 (DEFAULT_TABLE table=default.Table_cc60987ac3314143a7ef361f4c8e9a26 [id=1a82722ccc994677a8a696a4ac9e0baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.921303 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350453721d13427a946ac5c5ee7c62a0" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:01.921568 784 raft_consensus.cc:3060] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:01.923594 1753 raft_consensus.cc:493] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:01.924023 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a354b06adc343ef94b295916d582b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.925061 1753 raft_consensus.cc:515] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.929318 784 raft_consensus.cc:2468] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:01.934252 860 leader_election.cc:304] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:01.935189 1719 raft_consensus.cc:2804] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:01.935359 1719 raft_consensus.cc:697] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:01.935655 1719 consensus_queue.cc:237] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:01.933591 1753 leader_election.cc:290] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:01.942060 759 tablet_service.cc:1511] Processing CreateTablet for tablet a2904f2e00314858899a760b84950e1f (DEFAULT_TABLE table=default.Table_7fce2ed3c7c848d0934500fec50d1198 [id=f3aa08d6e2c0416e86881a647e0ad703]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.943058 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2904f2e00314858899a760b84950e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.947204 1777 tablet.cc:1724] T 122a8b15e62f4b23b465e2dbc816df62 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260616 19:52:01.949213 993 leader_election.cc:343] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:01.951967 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 59812b232848488b9894e8f8057e9def with delete_type TABLET_DATA_DELETED (replaced by tablet 70e1f138c3154dfbb93aca7bed67719d) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:01.953266 1196 tablet_bootstrap.cc:492] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:01.965327 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77386c95d63047c1a3b779e53f54d33d consensus state has no leader
I20260616 19:52:01.968598 455 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 122a8b15e62f4b23b465e2dbc816df62 (table default.Table_5f871d83f28b40d6839cc165a1c29263 [id=b04cd7f15b3f43968eec7989c20caa41]). Expected version 2 got 0
I20260616 19:52:01.971468 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72850fb9855c48ba8540b2775055fbe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:01.984238 996 leader_election.cc:304] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:01.985239 901 tablet_service.cc:1511] Processing CreateTablet for tablet 7e2fb4a0198342edaf87eb1b1f6406fb (DEFAULT_TABLE table=default.Table_7b0af6c08cd34ef09c44a86ea3f12671 [id=e4f93a88af014b3bba91d60882fc4ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.985487 1691 raft_consensus.cc:2749] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:01.985692 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e2fb4a0198342edaf87eb1b1f6406fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:01.986884 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 161987us
I20260616 19:52:01.987988 1193 ts_tablet_manager.cc:1929] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:01.988240 1193 log.cc:1199] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/d3645fc39d974bffa8fe52c62e1c7eff
I20260616 19:52:01.988662 1193 ts_tablet_manager.cc:1950] T d3645fc39d974bffa8fe52c62e1c7eff P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:52:01.989928 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 161795us
I20260616 19:52:01.994788 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_fab90e4faa8a4f4ba8ef27e88ab0b680"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:01.995677 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c525e769b75a483aa546c7a2c607aa70" } modify_external_catalogs: true
I20260616 19:52:01.995852 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c525e769b75a483aa546c7a2c607aa70" } modify_external_catalogs: true
I20260616 19:52:01.997382 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350453721d13427a946ac5c5ee7c62a0" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:01.997359 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_93b5e652dc2a4061abf781fea9c4aae1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:01.998044 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_550c0ce5672e4d06a8224cafdc7d1479" } new_table_name: "default.Table_66d56024dca749dfb6300ffa4cb0dec9" modify_external_catalogs: true
W20260616 19:52:01.998183 858 leader_election.cc:343] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: Tablet not RUNNING: STOPPED
I20260616 19:52:01.999317 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_97d5a00d96fe4b9dbb89960e2abc62a5" } new_table_name: "default.Table_943726059a874d73a2fb021f8c95b8b4" modify_external_catalogs: true
I20260616 19:52:02.000674 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e96176d8842641a9b655bab99c8b35f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.000905 1036 tablet_service.cc:1511] Processing CreateTablet for tablet d0e9ed8303274b5f8ec3a2bd0a070b48 (DEFAULT_TABLE table=default.Table_88a6448fd79944399d261dfe7a13259b [id=f1801498fba14f14886c1c550e426b1b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:02.001143 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e96176d8842641a9b655bab99c8b35f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.001197 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce69dcb31fe41879e9feb3b01547dd9 (DEFAULT_TABLE table=default.Table_8744a2db15fd49259e0900a69941415d [id=e522a397df99474a903238f496af2ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.001618 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4be8f181fb634263aea92a56d3ca447d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.001720 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93b5e652dc2a4061abf781fea9c4aae1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.001747 1028 tablet_service.cc:1511] Processing CreateTablet for tablet f851c41915c44cdea7cd46da2ad886ea (DEFAULT_TABLE table=default.Table_1a7673e0f4cd433792d8ef02de3304ac [id=921de543d8f84cc79443e383b0181902]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:02.002094 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4be8f181fb634263aea92a56d3ca447d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.002377 1032 tablet_service.cc:1511] Processing CreateTablet for tablet a6565379687e4ddfb471b513939775be (DEFAULT_TABLE table=default.Table_97d5a00d96fe4b9dbb89960e2abc62a5 [id=768e4429cd704ed9b825c21f3c52b282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.003328 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 47bbf21dc1d945ce8f5edd27cdf26817 (DEFAULT_TABLE table=default.Table_5669ec43b5604db88e68c905ddf440a2 [id=9cf96fd3b67e49f28ab797deaba57ce9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.003403 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 77386c95d63047c1a3b779e53f54d33d (DEFAULT_TABLE table=default.Table_dde23fc788a44a2ebd6cf100e56067db [id=24db2d9e161a4d5196ba69d0ede7bade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.003750 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 957302ca5638411b9a636442323ba8ed (DEFAULT_TABLE table=default.Table_e004f84474eb4deba328c85df07a597d [id=4f94a56da429443ca2f30b22a3a42610]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.003984 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 4970ac68130e40fa8288c8c74f705378 (DEFAULT_TABLE table=default.Table_e20dacac303a4fdfbb7580b7a07a0f91 [id=98a9b15d55fa492ba9d582fac0cee86b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.004388 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93dd295602840319f72e7021ddfd61a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:02.005028 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350453721d13427a946ac5c5ee7c62a0" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
W20260616 19:52:02.005241 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fab90e4faa8a4f4ba8ef27e88ab0b680 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.005381 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 9a354b06adc343ef94b295916d582b49 (DEFAULT_TABLE table=default.Table_c525e769b75a483aa546c7a2c607aa70 [id=d4d84720adf748878db425165974a28e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.005710 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e1ab9d0ac7df4d549d52014a0ecd9d1a (DEFAULT_TABLE table=default.Table_7b1eed4af94f4d9497213d6a3bc40ddc [id=e8d609624264417786b2a623ba317a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.006067 1196 tablet_bootstrap.cc:654] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.006059 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 7e2fb4a0198342edaf87eb1b1f6406fb (DEFAULT_TABLE table=default.Table_7b0af6c08cd34ef09c44a86ea3f12671 [id=e4f93a88af014b3bba91d60882fc4ed2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:02.006843 858 leader_election.cc:343] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: Tablet not RUNNING: STOPPED
I20260616 19:52:02.009075 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9a354b06adc343ef94b295916d582b49
I20260616 19:52:02.008615 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c3ed767db6964beebf754607830e97d2" } new_table_name: "default.Table_62387b40bb174f7e863bfe1bd975d949" modify_external_catalogs: true
I20260616 19:52:02.009691 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c122cc9356db42c7818089c702bd75a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.009754 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d32f04655f8b45cab54470ba15670dcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.010219 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d32f04655f8b45cab54470ba15670dcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:02.012419 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c122cc9356db42c7818089c702bd75a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.018023 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_279bcff593544d69870123063bfb53b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.018246 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e85e2861c41f402d88cafe64a6871429 consensus state has no leader
W20260616 19:52:02.018510 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_279bcff593544d69870123063bfb53b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.018575 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a707b4fa17524ae8a9589674a12ed919"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.019034 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a707b4fa17524ae8a9589674a12ed919 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:02.020097 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6565379687e4ddfb471b513939775be consensus state has no leader
I20260616 19:52:02.020835 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b9effa349ec04a8989934380e9153218" } modify_external_catalogs: true
I20260616 19:52:02.021044 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b9effa349ec04a8989934380e9153218" } modify_external_catalogs: true
I20260616 19:52:02.023379 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9a89b6471d8c42e594c15f43327d9572" } modify_external_catalogs: true
I20260616 19:52:02.023578 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9a89b6471d8c42e594c15f43327d9572" } modify_external_catalogs: true
I20260616 19:52:02.025177 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_af4ff5c6788b42c9942e0038b22cd2bf" } modify_external_catalogs: true
I20260616 19:52:02.025367 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_af4ff5c6788b42c9942e0038b22cd2bf" } modify_external_catalogs: true
I20260616 19:52:02.026551 904 tablet_service.cc:1511] Processing CreateTablet for tablet f851c41915c44cdea7cd46da2ad886ea (DEFAULT_TABLE table=default.Table_1a7673e0f4cd433792d8ef02de3304ac [id=921de543d8f84cc79443e383b0181902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.029614 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e9ed8303274b5f8ec3a2bd0a070b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.029685 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 892ec2013b9f4c9292bf745e2aeae4ed (DEFAULT_TABLE table=default.Table_88f278e7debf4f848f8569bea8b9b8f7 [id=a123de75eb2640868a84b202e3bb6d56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.029881 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e2fb4a0198342edaf87eb1b1f6406fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.029974 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 99b211692aca478bb40f0f2c3f50ca44 with delete_type TABLET_DATA_DELETED (replaced by tablet 44493f0ffd064249a28628cf24895395) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.030325 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 957302ca5638411b9a636442323ba8ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.033823 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a354b06adc343ef94b295916d582b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.036221 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f851c41915c44cdea7cd46da2ad886ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.036644 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ab9d0ac7df4d549d52014a0ecd9d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.036695 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac5b6be55944bdfb12db675442b1f1d (DEFAULT_TABLE table=default.Table_30c975e6226e45f88f761eeaca5fe355 [id=56cdfe3dd2ca46338485a32451849632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.036646 1060 raft_consensus.cc:2468] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:02.037542 719 leader_election.cc:304] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:02.040946 1033 tablet_service.cc:1511] Processing CreateTablet for tablet c090cf49c61e487a974d953ed1903db7 (DEFAULT_TABLE table=default.Table_7e1dbf9e64af41fc9d18cf1267dad2ee [id=c571c6a4ed8b48a0b7c59bbf1bbfc18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:01.990398 887 tablet_service.cc:1511] Processing CreateTablet for tablet d0e9ed8303274b5f8ec3a2bd0a070b48 (DEFAULT_TABLE table=default.Table_88a6448fd79944399d261dfe7a13259b [id=f1801498fba14f14886c1c550e426b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.042567 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6565379687e4ddfb471b513939775be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.050065 1190 ts_tablet_manager.cc:1929] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:02.059353 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce69dcb31fe41879e9feb3b01547dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.059960 899 tablet_service.cc:1511] Processing CreateTablet for tablet a6565379687e4ddfb471b513939775be (DEFAULT_TABLE table=default.Table_97d5a00d96fe4b9dbb89960e2abc62a5 [id=768e4429cd704ed9b825c21f3c52b282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.060942 891 tablet_service.cc:1511] Processing CreateTablet for tablet 77386c95d63047c1a3b779e53f54d33d (DEFAULT_TABLE table=default.Table_dde23fc788a44a2ebd6cf100e56067db [id=24db2d9e161a4d5196ba69d0ede7bade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.061453 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a354b06adc343ef94b295916d582b49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.062652 1190 log.cc:1199] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/2cfb2238cbdb421a8f5001dc729e9bb5
I20260616 19:52:02.065217 896 tablet_service.cc:1511] Processing CreateTablet for tablet ab68d403f07148de90b6094d607db866 (DEFAULT_TABLE table=default.Table_cb98fbb879cb4612a266b8db4ec3972a [id=6d65833057c6403fbef81f2a401d175b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.065587 761 tablet_service.cc:1511] Processing CreateTablet for tablet f851c41915c44cdea7cd46da2ad886ea (DEFAULT_TABLE table=default.Table_1a7673e0f4cd433792d8ef02de3304ac [id=921de543d8f84cc79443e383b0181902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.065994 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f851c41915c44cdea7cd46da2ad886ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.063033 888 tablet_service.cc:1511] Processing CreateTablet for tablet 892ec2013b9f4c9292bf745e2aeae4ed (DEFAULT_TABLE table=default.Table_88f278e7debf4f848f8569bea8b9b8f7 [id=a123de75eb2640868a84b202e3bb6d56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.071537 885 tablet_service.cc:1511] Processing CreateTablet for tablet 90643052a7f34442a8f43a2c58f3b7d3 (DEFAULT_TABLE table=default.Table_5436b0719642405e902210bdd7310a37 [id=9cb0c781701342baaaccab6c225e1a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.074225 890 tablet_service.cc:1511] Processing CreateTablet for tablet 1eacae5ee28947a9a4fb2315165c4df2 (DEFAULT_TABLE table=default.Table_f7b097131a324d9f90b11941f4f31708 [id=5bf04207e9a947d4ab1880ad5f2f630b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.076505 1192 tablet_bootstrap.cc:654] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.077190 893 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce69dcb31fe41879e9feb3b01547dd9 (DEFAULT_TABLE table=default.Table_8744a2db15fd49259e0900a69941415d [id=e522a397df99474a903238f496af2ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.078356 903 tablet_service.cc:1511] Processing CreateTablet for tablet 957302ca5638411b9a636442323ba8ed (DEFAULT_TABLE table=default.Table_e004f84474eb4deba328c85df07a597d [id=4f94a56da429443ca2f30b22a3a42610]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.079110 1190 ts_tablet_manager.cc:1950] T 2cfb2238cbdb421a8f5001dc729e9bb5 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:02.079746 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a354b06adc343ef94b295916d582b49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.080025 900 tablet_service.cc:1511] Processing CreateTablet for tablet f89a0c065a4a4fb7afa8cab29d78c2e5 (DEFAULT_TABLE table=default.Table_827a69aca36a453db1e09ffa7d2b535c [id=99e870e6f821406bb65af1f96f5ad30f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.080474 894 tablet_service.cc:1511] Processing CreateTablet for tablet 70e1f138c3154dfbb93aca7bed67719d (DEFAULT_TABLE table=default.Table_191f8acd55ae4da9982a9fb3ec2d51cd [id=1beb7d130df7492ab9b834d005eba63a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.081005 1753 raft_consensus.cc:2804] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:02.081118 1753 raft_consensus.cc:493] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:02.081254 1753 raft_consensus.cc:3060] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.082203 1751 raft_consensus.cc:493] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:02.082388 1751 raft_consensus.cc:515] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:02.083132 1751 leader_election.cc:290] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:02.085073 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93dd295602840319f72e7021ddfd61a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:02.086306 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f851c41915c44cdea7cd46da2ad886ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.087107 1753 raft_consensus.cc:515] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.088485 892 tablet_service.cc:1511] Processing CreateTablet for tablet 2010246823574515a7437f92484bc701 (DEFAULT_TABLE table=default.Table_63c1b65ae6ec44da84f6afa7c1a16ec0 [id=186eeaf3fba345aaa15b414e2e21030f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:02.093314 718 leader_election.cc:343] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:02.103814 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 364) took 4258 ms. Trace:
I20260616 19:52:02.104753 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3de0e62cfd33410490a0b460fd5f69e9" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:02.105875 718 leader_election.cc:343] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:02.106062 1190 rpcz_store.cc:276] 0616 19:51:57.827762 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.827819 (+ 57us) service_pool.cc:224] Handling call
0616 19:52:01.751076 (+3923257us) ts_tablet_manager.cc:1151] Deleting tablet 2cfb2238cbdb421a8f5001dc729e9bb5
0616 19:52:01.751084 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.903541 (+152457us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.049951 (+146410us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.086157 (+ 36206us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3923024}
I20260616 19:52:02.106947 1700 raft_consensus.cc:493] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:02.107098 1700 raft_consensus.cc:515] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.107782 1700 leader_election.cc:290] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:02.108647 1190 tablet_replica.cc:333] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:02.108875 1190 raft_consensus.cc:2243] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:02.109418 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 2cfb2238cbdb421a8f5001dc729e9bb5 (table default.Table_f6d740d1faed4c4fa615d5711262ccf9 [id=dadf8402246843219b213be49e8ad54b]) successfully deleted
I20260616 19:52:02.109676 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e9ed8303274b5f8ec3a2bd0a070b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.110257 1190 raft_consensus.cc:2272] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:02.110309 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e1f138c3154dfbb93aca7bed67719d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.110880 1190 ts_tablet_manager.cc:1916] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:02.111068 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6565379687e4ddfb471b513939775be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.111274 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89a0c065a4a4fb7afa8cab29d78c2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.111306 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662e2d573bd7489a81697c17393ce088" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:02.111759 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 892ec2013b9f4c9292bf745e2aeae4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.112248 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eacae5ee28947a9a4fb2315165c4df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.112574 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90643052a7f34442a8f43a2c58f3b7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.112826 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 957302ca5638411b9a636442323ba8ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.113027 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2010246823574515a7437f92484bc701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.067230 750 tablet_service.cc:1511] Processing CreateTablet for tablet 892ec2013b9f4c9292bf745e2aeae4ed (DEFAULT_TABLE table=default.Table_88f278e7debf4f848f8569bea8b9b8f7 [id=a123de75eb2640868a84b202e3bb6d56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.116613 748 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce69dcb31fe41879e9feb3b01547dd9 (DEFAULT_TABLE table=default.Table_8744a2db15fd49259e0900a69941415d [id=e522a397df99474a903238f496af2ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.116808 921 raft_consensus.cc:2468] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:02.118646 1191 ts_tablet_manager.cc:1929] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:02.120255 1022 tablet_service.cc:1511] Processing CreateTablet for tablet f6054dc3492e4fa5a89359f8e48762ff (DEFAULT_TABLE table=default.Table_741bad4ee8914381a7b50c35e8f2b298 [id=4a9a1425ea3f4cc382073895f9657d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.117720 718 leader_election.cc:304] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:02.128378 1700 raft_consensus.cc:2804] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:02.128538 1700 raft_consensus.cc:493] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:02.128630 1700 raft_consensus.cc:3060] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.131523 1700 raft_consensus.cc:515] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.132270 1700 leader_election.cc:290] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:02.068451 763 tablet_service.cc:1511] Processing CreateTablet for tablet d0e9ed8303274b5f8ec3a2bd0a070b48 (DEFAULT_TABLE table=default.Table_88a6448fd79944399d261dfe7a13259b [id=f1801498fba14f14886c1c550e426b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.133930 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77386c95d63047c1a3b779e53f54d33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.135986 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab68d403f07148de90b6094d607db866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.137372 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662e2d573bd7489a81697c17393ce088" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:02.137552 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 70e1f138c3154dfbb93aca7bed67719d (DEFAULT_TABLE table=default.Table_191f8acd55ae4da9982a9fb3ec2d51cd [id=1beb7d130df7492ab9b834d005eba63a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.137923 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77386c95d63047c1a3b779e53f54d33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.138167 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac5b6be55944bdfb12db675442b1f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.138146 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7e2fb4a0198342edaf87eb1b1f6406fb (DEFAULT_TABLE table=default.Table_7b0af6c08cd34ef09c44a86ea3f12671 [id=e4f93a88af014b3bba91d60882fc4ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.138427 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e1f138c3154dfbb93aca7bed67719d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.139361 921 raft_consensus.cc:3060] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.141273 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce69dcb31fe41879e9feb3b01547dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.141417 1198 tablet_bootstrap.cc:492] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:02.144407 755 tablet_service.cc:1511] Processing CreateTablet for tablet a6565379687e4ddfb471b513939775be (DEFAULT_TABLE table=default.Table_97d5a00d96fe4b9dbb89960e2abc62a5 [id=768e4429cd704ed9b825c21f3c52b282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.146627 753 tablet_service.cc:1511] Processing CreateTablet for tablet df1ee0d1e1514c86802cdce5ae0756eb (DEFAULT_TABLE table=default.Table_95e22ec4d7a84936891845fe5e39f547 [id=62bf513c98b2495592537b5db5ef309d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.147756 1753 leader_election.cc:290] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:02.148298 1193 tablet_replica.cc:333] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:02.148519 1193 raft_consensus.cc:2243] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:02.148737 1193 raft_consensus.cc:2272] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:02.149262 1193 ts_tablet_manager.cc:1916] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:02.150250 764 tablet_service.cc:1511] Processing CreateTablet for tablet 77386c95d63047c1a3b779e53f54d33d (DEFAULT_TABLE table=default.Table_dde23fc788a44a2ebd6cf100e56067db [id=24db2d9e161a4d5196ba69d0ede7bade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.150725 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77386c95d63047c1a3b779e53f54d33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.151273 1038 tablet_service.cc:1511] Processing CreateTablet for tablet f89a0c065a4a4fb7afa8cab29d78c2e5 (DEFAULT_TABLE table=default.Table_827a69aca36a453db1e09ffa7d2b535c [id=99e870e6f821406bb65af1f96f5ad30f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.158200 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 892ec2013b9f4c9292bf745e2aeae4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.159296 1198 ts_tablet_manager.cc:1403] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.351s user 0.006s sys 0.012s
I20260616 19:52:02.165378 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 90643052a7f34442a8f43a2c58f3b7d3 (DEFAULT_TABLE table=default.Table_5436b0719642405e902210bdd7310a37 [id=9cb0c781701342baaaccab6c225e1a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.167011 1034 tablet_service.cc:1511] Processing CreateTablet for tablet df1ee0d1e1514c86802cdce5ae0756eb (DEFAULT_TABLE table=default.Table_95e22ec4d7a84936891845fe5e39f547 [id=62bf513c98b2495592537b5db5ef309d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.167222 921 raft_consensus.cc:2468] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:02.167622 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47bbf21dc1d945ce8f5edd27cdf26817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.167799 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93dd295602840319f72e7021ddfd61a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:02.167899 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 892ec2013b9f4c9292bf745e2aeae4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.168437 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4970ac68130e40fa8288c8c74f705378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.168776 1021 tablet_service.cc:1511] Processing CreateTablet for tablet ab68d403f07148de90b6094d607db866 (DEFAULT_TABLE table=default.Table_cb98fbb879cb4612a266b8db4ec3972a [id=6d65833057c6403fbef81f2a401d175b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.169217 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab68d403f07148de90b6094d607db866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.169492 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c090cf49c61e487a974d953ed1903db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.170787 718 leader_election.cc:304] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:02.171144 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6054dc3492e4fa5a89359f8e48762ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.176323 746 tablet_service.cc:1511] Processing CreateTablet for tablet 70e1f138c3154dfbb93aca7bed67719d (DEFAULT_TABLE table=default.Table_191f8acd55ae4da9982a9fb3ec2d51cd [id=1beb7d130df7492ab9b834d005eba63a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.178211 752 tablet_service.cc:1511] Processing CreateTablet for tablet ab68d403f07148de90b6094d607db866 (DEFAULT_TABLE table=default.Table_cb98fbb879cb4612a266b8db4ec3972a [id=6d65833057c6403fbef81f2a401d175b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.178762 756 tablet_service.cc:1511] Processing CreateTablet for tablet f89a0c065a4a4fb7afa8cab29d78c2e5 (DEFAULT_TABLE table=default.Table_827a69aca36a453db1e09ffa7d2b535c [id=99e870e6f821406bb65af1f96f5ad30f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.179399 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet d3645fc39d974bffa8fe52c62e1c7eff (table default.Table_8498a9716d0241898b3508012accd7e4 [id=684dd57c6c084da39a4046776066b1da]) successfully deleted
W20260616 19:52:02.179800 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet bc2006e262cc4bbb9b291a5bf52653cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc2006e262cc4bbb9b291a5bf52653cd already in progress: creating tablet
W20260616 19:52:02.180028 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 915267e7ff3c439385a861dfb954b852 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 915267e7ff3c439385a861dfb954b852 already in progress: creating tablet
W20260616 19:52:02.180218 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 61189a715da140a6833801681bbd5ef4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61189a715da140a6833801681bbd5ef4 already in progress: creating tablet
W20260616 19:52:02.181098 718 raft_consensus.cc:2686] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260616 19:52:02.181324 718 leader_election.cc:343] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:02.181784 747 tablet_service.cc:1511] Processing CreateTablet for tablet 1eacae5ee28947a9a4fb2315165c4df2 (DEFAULT_TABLE table=default.Table_f7b097131a324d9f90b11941f4f31708 [id=5bf04207e9a947d4ab1880ad5f2f630b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.182592 762 tablet_service.cc:1511] Processing CreateTablet for tablet 90643052a7f34442a8f43a2c58f3b7d3 (DEFAULT_TABLE table=default.Table_5436b0719642405e902210bdd7310a37 [id=9cb0c781701342baaaccab6c225e1a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.183018 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e9ed8303274b5f8ec3a2bd0a070b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.183722 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89a0c065a4a4fb7afa8cab29d78c2e5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:02.184139 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f13d175adfe540b39fd55004a11c9aad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f13d175adfe540b39fd55004a11c9aad already in progress: creating tablet
I20260616 19:52:02.187397 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89a0c065a4a4fb7afa8cab29d78c2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.187722 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df1ee0d1e1514c86802cdce5ae0756eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.188510 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90643052a7f34442a8f43a2c58f3b7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.187371 1191 log.cc:1199] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/350453721d13427a946ac5c5ee7c62a0
I20260616 19:52:02.196406 1192 tablet_bootstrap.cc:492] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:02.197264 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 1eacae5ee28947a9a4fb2315165c4df2 (DEFAULT_TABLE table=default.Table_f7b097131a324d9f90b11941f4f31708 [id=5bf04207e9a947d4ab1880ad5f2f630b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.200223 1192 ts_tablet_manager.cc:1403] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.312s user 0.006s sys 0.002s
I20260616 19:52:02.203711 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3de0e62cfd33410490a0b460fd5f69e9" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:02.207021 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 2010246823574515a7437f92484bc701 (DEFAULT_TABLE table=default.Table_63c1b65ae6ec44da84f6afa7c1a16ec0 [id=186eeaf3fba345aaa15b414e2e21030f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.212503 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1054530674ec44d19e673765aefe6cdf" } modify_external_catalogs: true
I20260616 19:52:02.212556 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_24ad15d9fa8442738b87cc9d4ca64e87" } new_table_name: "default.Table_9bdaebf159a743c09c4c8a5b3e57c61d" modify_external_catalogs: true
I20260616 19:52:02.212781 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1054530674ec44d19e673765aefe6cdf" } modify_external_catalogs: true
I20260616 19:52:02.213122 458 master_service.cc:960] ReplaceTablet: received request to replace tablet 1bc181171b134de2b946376f468aec72 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:02.214035 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eacae5ee28947a9a4fb2315165c4df2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:02.214571 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 26503d1293be438dae39fa1e1ea1885b consensus state has no leader
I20260616 19:52:02.214579 1060 raft_consensus.cc:2468] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:02.221037 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0d3438f6bffd41d9b903bdd1ac90f560"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.224282 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93dd295602840319f72e7021ddfd61a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:02.226840 1058 raft_consensus.cc:3060] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.229671 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]). Expected version 1 got 0
I20260616 19:52:02.231535 1192 raft_consensus.cc:359] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.232245 1192 raft_consensus.cc:385] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:02.232348 1192 raft_consensus.cc:740] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
W20260616 19:52:02.229691 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d3438f6bffd41d9b903bdd1ac90f560 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.238593 1198 raft_consensus.cc:359] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.243316 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90643052a7f34442a8f43a2c58f3b7d3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:02.242573 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 62812.5us
I20260616 19:52:02.245604 1196 tablet_bootstrap.cc:492] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:02.245844 749 tablet_service.cc:1511] Processing CreateTablet for tablet 2010246823574515a7437f92484bc701 (DEFAULT_TABLE table=default.Table_63c1b65ae6ec44da84f6afa7c1a16ec0 [id=186eeaf3fba345aaa15b414e2e21030f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:02.246251 719 leader_election.cc:343] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 662e2d573bd7489a81697c17393ce088
W20260616 19:52:02.246632 719 leader_election.cc:343] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 662e2d573bd7489a81697c17393ce088
I20260616 19:52:02.246979 719 leader_election.cc:304] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:02.247259 1753 raft_consensus.cc:2804] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:02.247401 1753 raft_consensus.cc:493] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:02.247502 1753 raft_consensus.cc:3060] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.248911 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e1f138c3154dfbb93aca7bed67719d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.249598 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eacae5ee28947a9a4fb2315165c4df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.250777 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a354b06adc343ef94b295916d582b49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.251433 1196 ts_tablet_manager.cc:1403] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.293s user 0.007s sys 0.005s
I20260616 19:52:02.251595 759 tablet_service.cc:1511] Processing CreateTablet for tablet 957302ca5638411b9a636442323ba8ed (DEFAULT_TABLE table=default.Table_e004f84474eb4deba328c85df07a597d [id=4f94a56da429443ca2f30b22a3a42610]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.252507 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce69dcb31fe41879e9feb3b01547dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.252784 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2010246823574515a7437f92484bc701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.253916 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 957302ca5638411b9a636442323ba8ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.254753 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab68d403f07148de90b6094d607db866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.255671 1196 raft_consensus.cc:359] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.255865 1196 raft_consensus.cc:385] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:02.255949 1196 raft_consensus.cc:740] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:02.256177 1196 consensus_queue.cc:260] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.256711 1196 ts_tablet_manager.cc:1434] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260616 19:52:02.262701 1196 tablet_bootstrap.cc:492] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:02.262970 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6565379687e4ddfb471b513939775be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.265061 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8c19c2e43a944893b86982bee1eb2f30
I20260616 19:52:02.267586 1192 consensus_queue.cc:260] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.268384 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c239a24dbdc047f9beb2ed7e1492acfe
I20260616 19:52:02.279359 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2010246823574515a7437f92484bc701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.279487 1198 raft_consensus.cc:385] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:02.280229 1191 ts_tablet_manager.cc:1950] T 350453721d13427a946ac5c5ee7c62a0 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:02.283705 1198 raft_consensus.cc:740] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:02.283958 1198 consensus_queue.cc:260] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.285789 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c19c2e43a944893b86982bee1eb2f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.288654 1192 ts_tablet_manager.cc:1434] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.084s user 0.001s sys 0.002s
I20260616 19:52:02.289011 1192 tablet_bootstrap.cc:492] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:02.290972 1192 tablet_bootstrap.cc:654] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.303433 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet c239a24dbdc047f9beb2ed7e1492acfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:02.306674 996 consensus_peers.cc:597] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c31c8e977da4a70bca1beb00f364627. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:02.312397 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 497) took 1829 ms. Trace:
I20260616 19:52:02.313927 1198 ts_tablet_manager.cc:1434] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.142s user 0.001s sys 0.001s
I20260616 19:52:02.314257 1198 tablet_bootstrap.cc:492] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:02.316009 1198 tablet_bootstrap.cc:654] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.318327 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c19c2e43a944893b86982bee1eb2f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.327040 1191 rpcz_store.cc:276] 0616 19:52:00.469914 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.470145 (+ 231us) service_pool.cc:224] Handling call
0616 19:52:01.551908 (+1081763us) ts_tablet_manager.cc:1151] Deleting tablet 350453721d13427a946ac5c5ee7c62a0
0616 19:52:01.551917 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:01.657143 (+105226us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.118550 (+461407us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.299402 (+180852us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1081605}
I20260616 19:52:02.333421 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f1a09d62e68148349b337c5075763672
I20260616 19:52:02.337204 1803 raft_consensus.cc:493] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:52:02.337430 1158 log.cc:927] Time spent T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
I20260616 19:52:02.337400 1803 raft_consensus.cc:515] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.338743 1803 leader_election.cc:290] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:02.340420 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6222db09d4cd987cbdf70e4d40f70" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:02.340557 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 350453721d13427a946ac5c5ee7c62a0 (table default.Table_955814ce18d044e2b9e30c0074b7a8b0 [id=baa5ee1fdc8f4fb785c49501ba1c8144]) successfully deleted
W20260616 19:52:02.340958 993 leader_election.cc:343] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:02.341413 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a09d62e68148349b337c5075763672 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.347886 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 5e68e2c6caff4ac38aa52b8b29f5ace6
I20260616 19:52:02.349089 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d3601aa415b44973be55e69c2ea3ee5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.357878 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d2059128d10847918c1d4b6546fda761" } modify_external_catalogs: true
W20260616 19:52:02.358055 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3601aa415b44973be55e69c2ea3ee5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.358103 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cef65e1f2a234a8498e16b9138776e71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.358064 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d2059128d10847918c1d4b6546fda761" } modify_external_catalogs: true
W20260616 19:52:02.358628 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cef65e1f2a234a8498e16b9138776e71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.359083 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c8b5b92a83934f0f9255bf06e1438618" } new_table_name: "default.Table_bb73cdb58e944393b45a9218e3deaa8b" modify_external_catalogs: true
I20260616 19:52:02.359256 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_00a384409532486b8ea5a32b1d61a7eb" } new_table_name: "default.Table_8b66b38f443d4eaebf8391a80ef74818" modify_external_catalogs: true
I20260616 19:52:02.359540 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_838d3611ece94aee9524fc9a2d485353"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.359607 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c82451507e00496a8d501a63dddeeec8" } new_table_name: "default.Table_6ff69aa268bc43f99b003e8db11d759c" modify_external_catalogs: true
W20260616 19:52:02.359997 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_838d3611ece94aee9524fc9a2d485353 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.360703 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f03a1110ec2a465ab56428dfb9d56c3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.361114 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f03a1110ec2a465ab56428dfb9d56c3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.363696 888 tablet_service.cc:1558] Processing DeleteTablet for tablet c239a24dbdc047f9beb2ed7e1492acfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:02.372641 1797 log.cc:927] Time spent T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e: Append to log took a long time: real 0.110s user 0.000s sys 0.000s
I20260616 19:52:02.373292 1191 tablet_replica.cc:333] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:02.382179 1190 ts_tablet_manager.cc:1929] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:02.382314 1190 log.cc:1199] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/5af9bdceae184f8dbb9e5db67a11ee63
I20260616 19:52:02.382692 1190 ts_tablet_manager.cc:1950] T 5af9bdceae184f8dbb9e5db67a11ee63 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
W20260616 19:52:02.383553 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4bde746e334a4f59aded168c6b2bb348 consensus state has no leader
I20260616 19:52:02.388829 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 365) took 4560 ms. Trace:
I20260616 19:52:02.389005 1190 rpcz_store.cc:276] 0616 19:51:57.828365 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.828411 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:02.106432 (+4278021us) ts_tablet_manager.cc:1151] Deleting tablet 5af9bdceae184f8dbb9e5db67a11ee63
0616 19:52:02.106442 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.294279 (+187837us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.382091 (+ 87812us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.388786 (+ 6695us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4277798}
I20260616 19:52:02.392764 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 366) took 4563 ms. Trace:
I20260616 19:52:02.392951 1190 rpcz_store.cc:276] 0616 19:51:57.829416 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.829485 (+ 69us) service_pool.cc:224] Handling call
0616 19:52:02.392615 (+4563130us) ts_tablet_manager.cc:1151] Deleting tablet ca5dc1e6cde347fc9a34e555385dc646
0616 19:52:02.392624 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.392720 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4562939}
I20260616 19:52:02.393499 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 367) took 4563 ms. Trace:
I20260616 19:52:02.394335 1190 rpcz_store.cc:276] 0616 19:51:57.830013 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.830064 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:02.393361 (+4563297us) ts_tablet_manager.cc:1151] Deleting tablet 1d80d9028184443da49623228259263d
0616 19:52:02.393370 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.393472 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4563094}
I20260616 19:52:02.402025 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 368) took 4571 ms. Trace:
I20260616 19:52:02.402216 1190 rpcz_store.cc:276] 0616 19:51:57.830605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.830655 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:02.401900 (+4571245us) ts_tablet_manager.cc:1151] Deleting tablet c6939d108a7948bb9e56311a34d95486
0616 19:52:02.401909 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.401994 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4571068}
I20260616 19:52:02.402841 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 376) took 4502 ms. Trace:
I20260616 19:52:02.402997 1190 rpcz_store.cc:276] 0616 19:51:57.900619 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:57.901049 (+ 430us) service_pool.cc:224] Handling call
0616 19:52:02.402721 (+4501672us) ts_tablet_manager.cc:1151] Deleting tablet 9d800b4e2c2d42279c102e4e061f5530
0616 19:52:02.402730 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.402811 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4438938}
I20260616 19:52:02.403508 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 390) took 4059 ms. Trace:
I20260616 19:52:02.403666 1190 rpcz_store.cc:276] 0616 19:51:58.344160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.345539 (+ 1379us) service_pool.cc:224] Handling call
0616 19:52:02.403395 (+4057856us) ts_tablet_manager.cc:1151] Deleting tablet d9c664f0386549d6867c407526ee45a0
0616 19:52:02.403404 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.403480 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4053325}
I20260616 19:52:02.404177 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 392) took 4045 ms. Trace:
I20260616 19:52:02.404336 1190 rpcz_store.cc:276] 0616 19:51:58.358233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.358679 (+ 446us) service_pool.cc:224] Handling call
0616 19:52:02.404063 (+4045384us) ts_tablet_manager.cc:1151] Deleting tablet af5e277102b8480db44e5ffe88267808
0616 19:52:02.404072 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.404149 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4041764}
I20260616 19:52:02.404788 1190 tablet_replica.cc:333] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:02.405038 1190 raft_consensus.cc:2243] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:02.405293 1190 raft_consensus.cc:2272] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:02.406356 1190 ts_tablet_manager.cc:1916] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:02.415071 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e2fb4a0198342edaf87eb1b1f6406fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.416316 461 master_service.cc:960] ReplaceTablet: received request to replace tablet 4fc0c02ef58d4e429855e5bbaa4752ad from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:02.417196 1192 tablet_bootstrap.cc:492] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:02.417376 1192 ts_tablet_manager.cc:1403] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.128s user 0.000s sys 0.010s
W20260616 19:52:02.417472 445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:43055, user_credentials={real_user=slave}} blocked reactor thread for 78752.3us
I20260616 19:52:02.418069 900 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a09d62e68148349b337c5075763672 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.418318 1192 raft_consensus.cc:359] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:02.418593 1192 raft_consensus.cc:385] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:02.418738 1192 raft_consensus.cc:740] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:02.418839 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.419071 1192 consensus_queue.cc:260] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:02.419616 1192 ts_tablet_manager.cc:1434] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260616 19:52:02.423177 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.423807 1192 tablet_bootstrap.cc:492] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:02.425487 1192 tablet_bootstrap.cc:654] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.426394 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 5af9bdceae184f8dbb9e5db67a11ee63 (table default.Table_bed17ff52ac5410784b004e2ef370bac [id=d948f287146b431dbce6363443e953a0]) successfully deleted
W20260616 19:52:02.426633 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet ca5dc1e6cde347fc9a34e555385dc646 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca5dc1e6cde347fc9a34e555385dc646 already in progress: creating tablet
W20260616 19:52:02.426864 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 1d80d9028184443da49623228259263d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d80d9028184443da49623228259263d already in progress: creating tablet
W20260616 19:52:02.427062 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c6939d108a7948bb9e56311a34d95486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6939d108a7948bb9e56311a34d95486 already in progress: creating tablet
W20260616 19:52:02.427287 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 9d800b4e2c2d42279c102e4e061f5530 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d800b4e2c2d42279c102e4e061f5530 already in progress: creating tablet
W20260616 19:52:02.427554 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet af5e277102b8480db44e5ffe88267808 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af5e277102b8480db44e5ffe88267808 already in progress: creating tablet
I20260616 19:52:02.427656 1058 raft_consensus.cc:2468] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:02.427754 445 consensus_peers.cc:597] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 -> Peer 2b8fb7a8523741a2b7a5e75d8b415be0 (127.0.105.189:43055): Couldn't send request to peer 2b8fb7a8523741a2b7a5e75d8b415be0. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.189:43055: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260616 19:52:02.430948 1198 tablet_bootstrap.cc:492] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:02.417168 1196 tablet_bootstrap.cc:654] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.432611 719 leader_election.cc:304] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:02.439800 1700 raft_consensus.cc:2804] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:02.439937 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df1ee0d1e1514c86802cdce5ae0756eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.439970 1700 raft_consensus.cc:697] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:02.440708 1700 consensus_queue.cc:237] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.447141 1191 raft_consensus.cc:2243] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:02.450443 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6222db09d4cd987cbdf70e4d40f70" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:02.453002 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c19c2e43a944893b86982bee1eb2f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.456027 1192 tablet_bootstrap.cc:492] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:02.456256 1192 ts_tablet_manager.cc:1403] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260616 19:52:02.457275 1192 raft_consensus.cc:359] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.457522 1192 raft_consensus.cc:385] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:02.457687 1192 raft_consensus.cc:740] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:02.458019 1192 consensus_queue.cc:260] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.459278 1192 ts_tablet_manager.cc:1434] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:02.460371 1192 tablet_bootstrap.cc:492] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:02.462715 1192 tablet_bootstrap.cc:654] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.463157 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 383589f0e211418bbdf5046ed90db410 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:02.463716 461 master_service.cc:960] ReplaceTablet: received request to replace tablet fac9c314b1824e3297cf568ea0b14865 from {username='slave'} at 127.0.0.1:41696
W20260616 19:52:02.463033 858 consensus_peers.cc:597] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2c392b2fecd483d9da12e30e37f27ad. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:02.470743 900 tablet_service.cc:1558] Processing DeleteTablet for tablet a93dd295602840319f72e7021ddfd61a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.471947 1192 tablet_bootstrap.cc:492] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:02.472656 1192 ts_tablet_manager.cc:1403] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.003s
I20260616 19:52:02.473615 1192 raft_consensus.cc:359] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.474750 1192 raft_consensus.cc:385] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:02.474989 1192 raft_consensus.cc:740] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:02.475404 1192 consensus_queue.cc:260] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.476261 1192 ts_tablet_manager.cc:1434] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260616 19:52:02.479411 1192 tablet_bootstrap.cc:492] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:02.481370 1192 tablet_bootstrap.cc:654] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:02.483263 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49ab6193c479400da00e1fa80a5274a2 consensus state has no leader
I20260616 19:52:02.482750 1190 ts_tablet_manager.cc:1929] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:02.483757 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f39fe2b06c8c47e3bd6617baa83fe439"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.484131 1190 log.cc:1199] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/776841d895d6431fbee76b7c4e28d973
W20260616 19:52:02.484431 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f39fe2b06c8c47e3bd6617baa83fe439 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.484804 1190 ts_tablet_manager.cc:1950] T 776841d895d6431fbee76b7c4e28d973 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:02.485051 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cf880b7d3c21448793fe88b254cf5a2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.485330 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 393) took 4125 ms. Trace:
W20260616 19:52:02.485545 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf880b7d3c21448793fe88b254cf5a2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.486088 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 79d686afeeed4729bd2069296aec82a1 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:02.484336 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7e558c6a3c4b44cc94a6ec89871cfa59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.486364 1190 rpcz_store.cc:276] 0616 19:51:58.360053 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.360567 (+ 514us) service_pool.cc:224] Handling call
0616 19:52:02.404733 (+4044166us) ts_tablet_manager.cc:1151] Deleting tablet 776841d895d6431fbee76b7c4e28d973
0616 19:52:02.404741 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.435285 (+ 30544us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.482674 (+ 47389us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.485157 (+ 2483us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4042134}
W20260616 19:52:02.486977 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e558c6a3c4b44cc94a6ec89871cfa59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.487393 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 776841d895d6431fbee76b7c4e28d973 (table default.Table_ebec5e10f80244469fca70fe48c270e8 [id=4d2238911f8d432095e4a20ee0dc6217]) successfully deleted
I20260616 19:52:02.487886 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 399) took 4118 ms. Trace:
W20260616 19:52:02.489025 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24278ccfca6742aa8972d2b3d2c612d4 consensus state has no leader
I20260616 19:52:02.489367 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_be7daca5af8f4b14b93e1f45984f985f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.489817 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be7daca5af8f4b14b93e1f45984f985f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.490487 1190 rpcz_store.cc:276] 0616 19:51:58.369232 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.370125 (+ 893us) service_pool.cc:224] Handling call
0616 19:52:02.487721 (+4117596us) ts_tablet_manager.cc:1151] Deleting tablet 23f280b9ea1147799635f8a6199f17c0
0616 19:52:02.487730 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.487837 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4109772}
I20260616 19:52:02.491658 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 383589f0e211418bbdf5046ed90db410
I20260616 19:52:02.492237 455 catalog_manager.cc:6784] ReplaceTablet: tablet 383589f0e211418bbdf5046ed90db410 deleted and replaced by tablet b18f270bdda4413d811e2a32ade37dd3
I20260616 19:52:02.492584 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9a17c0908668403b9d99e81dc05eccd3" } new_table_name: "default.Table_44bfcb23c9f046779ebc73bdcbc6f552" modify_external_catalogs: true
W20260616 19:52:02.494383 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f68719133f9340399dfdd97a07abf331 consensus state has no leader
I20260616 19:52:02.494259 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 383589f0e211418bbdf5046ed90db410 with delete_type TABLET_DATA_DELETED (replaced by tablet b18f270bdda4413d811e2a32ade37dd3) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:02.496270 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 23f280b9ea1147799635f8a6199f17c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23f280b9ea1147799635f8a6199f17c0 already in progress: creating tablet
I20260616 19:52:02.496703 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 400) took 4127 ms. Trace:
I20260616 19:52:02.496809 1190 rpcz_store.cc:276] 0616 19:51:58.369345 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.370150 (+ 805us) service_pool.cc:224] Handling call
0616 19:52:02.496529 (+4126379us) ts_tablet_manager.cc:1151] Deleting tablet 610d6197e35e447ea25cdba2cc454b8d
0616 19:52:02.496541 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.496652 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4103608}
W20260616 19:52:02.497229 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 610d6197e35e447ea25cdba2cc454b8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 610d6197e35e447ea25cdba2cc454b8d already in progress: creating tablet
I20260616 19:52:02.505234 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 394) took 4136 ms. Trace:
I20260616 19:52:02.509021 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 3de0e62cfd33410490a0b460fd5f69e9 (table default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]). Expected version 2 got 0
I20260616 19:52:02.509305 1190 rpcz_store.cc:276] 0616 19:51:58.368735 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.370997 (+ 2262us) service_pool.cc:224] Handling call
0616 19:52:02.504895 (+4133898us) ts_tablet_manager.cc:1151] Deleting tablet c48314f8e45d4b198306f0ae6e40def7
0616 19:52:02.504911 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.505122 (+ 211us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4100847}
W20260616 19:52:02.509941 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c48314f8e45d4b198306f0ae6e40def7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c48314f8e45d4b198306f0ae6e40def7 already in progress: creating tablet
I20260616 19:52:02.510558 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 8125dce4d32a416498b42a1b599355fd with delete_type TABLET_DATA_DELETED (replaced by tablet 9060de590fa84ea08dc7d39765bc9308) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:02.512617 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20b9e3626794464aa823724bee0a1682 consensus state has no leader
I20260616 19:52:02.515513 900 tablet_service.cc:1511] Processing CreateTablet for tablet 20b9e3626794464aa823724bee0a1682 (DEFAULT_TABLE table=default.Table_44bfcb23c9f046779ebc73bdcbc6f552 [id=9e2544e6f31749259b394f3de29358ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.515933 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b9e3626794464aa823724bee0a1682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.523968 891 tablet_service.cc:1558] Processing DeleteTablet for tablet b99740ab59f947aabcac88dc2bf2de86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.525950 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fac9c314b1824e3297cf568ea0b14865
I20260616 19:52:02.526053 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet e03e6a2614564eeeb8ec382b16f0ece1
I20260616 19:52:02.526463 461 catalog_manager.cc:6784] ReplaceTablet: tablet fac9c314b1824e3297cf568ea0b14865 deleted and replaced by tablet d9f9cd8a901e41b0a92d7d37ed338ee9
I20260616 19:52:02.526803 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 79d686afeeed4729bd2069296aec82a1
I20260616 19:52:02.527280 456 catalog_manager.cc:6784] ReplaceTablet: tablet 79d686afeeed4729bd2069296aec82a1 deleted and replaced by tablet 81618a3f43ad40fc8173e266cc106899
I20260616 19:52:02.527297 890 tablet_service.cc:1558] Processing DeleteTablet for tablet e03e6a2614564eeeb8ec382b16f0ece1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.527496 891 tablet_service.cc:1558] Processing DeleteTablet for tablet fac9c314b1824e3297cf568ea0b14865 with delete_type TABLET_DATA_DELETED (replaced by tablet d9f9cd8a901e41b0a92d7d37ed338ee9) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.528069 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 79d686afeeed4729bd2069296aec82a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 81618a3f43ad40fc8173e266cc106899) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.531163 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 391) took 4173 ms. Trace:
I20260616 19:52:02.531342 1190 rpcz_store.cc:276] 0616 19:51:58.357328 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.639130 (+281802us) service_pool.cc:224] Handling call
0616 19:52:02.530971 (+3891841us) ts_tablet_manager.cc:1151] Deleting tablet 2e316e44693d473dad901eeb95299988
0616 19:52:02.530980 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.531088 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3891447}
I20260616 19:52:02.532264 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 79d686afeeed4729bd2069296aec82a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 81618a3f43ad40fc8173e266cc106899) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.533245 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 418) took 3766 ms. Trace:
I20260616 19:52:02.534379 1190 rpcz_store.cc:276] 0616 19:51:58.766628 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.766673 (+ 45us) service_pool.cc:224] Handling call
0616 19:52:02.533082 (+3766409us) ts_tablet_manager.cc:1151] Deleting tablet 43b4c3bd370749b18fb86f7a0aae2c50
0616 19:52:02.533094 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.533188 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3766140}
W20260616 19:52:02.534813 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 43b4c3bd370749b18fb86f7a0aae2c50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43b4c3bd370749b18fb86f7a0aae2c50 already in progress: creating tablet
I20260616 19:52:02.535315 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 419) took 3768 ms. Trace:
I20260616 19:52:02.536824 1191 raft_consensus.cc:2272] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:02.537606 1751 raft_consensus.cc:493] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:02.537921 1190 rpcz_store.cc:276] 0616 19:51:58.767188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.767232 (+ 44us) service_pool.cc:224] Handling call
0616 19:52:02.535078 (+3767846us) ts_tablet_manager.cc:1151] Deleting tablet c7f724dc23024a7297cfb8689f199600
0616 19:52:02.535086 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.535260 (+ 174us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3767675}
I20260616 19:52:02.538137 1191 ts_tablet_manager.cc:1916] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:02.538337 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c7f724dc23024a7297cfb8689f199600 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7f724dc23024a7297cfb8689f199600 already in progress: creating tablet
I20260616 19:52:02.537349 900 tablet_service.cc:1511] Processing CreateTablet for tablet 92fcb0f60c474fbabce31a2c970ceb52 (DEFAULT_TABLE table=default.Table_e96176d8842641a9b655bab99c8b35f9 [id=4b8bcf84a29c492e8e21b001c47e2af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.536944 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 383589f0e211418bbdf5046ed90db410 with delete_type TABLET_DATA_DELETED (replaced by tablet b18f270bdda4413d811e2a32ade37dd3) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.542958 1198 ts_tablet_manager.cc:1403] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.117s user 0.008s sys 0.004s
I20260616 19:52:02.544339 1198 raft_consensus.cc:359] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.544907 761 tablet_service.cc:1558] Processing DeleteTablet for tablet c239a24dbdc047f9beb2ed7e1492acfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.550752 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:02.551589 860 consensus_peers.cc:597] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2c392b2fecd483d9da12e30e37f27ad. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:02.553305 456 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet d5741b92cafb4d53987dbeeef66ccd56 (table default.Table_a5a8fee8fc214408ae98d4e88d6f66a5 [id=ee6ce577050e45c5b9b014d3827e5046]). Expected version 1 got 0
I20260616 19:52:02.554656 1198 raft_consensus.cc:385] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:02.555071 1198 raft_consensus.cc:740] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:02.537750 1751 raft_consensus.cc:515] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.555553 1198 consensus_queue.cc:260] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:02.552481 996 leader_election.cc:343] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:02.556121 1700 raft_consensus.cc:493] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:02.556253 756 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a09d62e68148349b337c5075763672 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.556254 996 leader_election.cc:304] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:02.556545 1803 raft_consensus.cc:2749] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:02.557324 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet c44422ddb8ce45a48bb9aaeb6c209f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.557875 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 92fcb0f60c474fbabce31a2c970ceb52 (DEFAULT_TABLE table=default.Table_e96176d8842641a9b655bab99c8b35f9 [id=4b8bcf84a29c492e8e21b001c47e2af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.558073 891 tablet_service.cc:1511] Processing CreateTablet for tablet 01a31bde2bbc45ca86f7f3ce58ea1f37 (DEFAULT_TABLE table=default.Table_232c28cfcefb46c48f728eb603081963 [id=c5439a97b869408fac78293786f35a9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.558387 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92fcb0f60c474fbabce31a2c970ceb52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.558460 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125dce4d32a416498b42a1b599355fd" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:02.558683 922 raft_consensus.cc:2468] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:02.543300 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet e03e6a2614564eeeb8ec382b16f0ece1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.560889 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 383589f0e211418bbdf5046ed90db410 with delete_type TABLET_DATA_DELETED (replaced by tablet b18f270bdda4413d811e2a32ade37dd3) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.561326 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92fcb0f60c474fbabce31a2c970ceb52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.561808 761 tablet_service.cc:1511] Processing CreateTablet for tablet 20b9e3626794464aa823724bee0a1682 (DEFAULT_TABLE table=default.Table_44bfcb23c9f046779ebc73bdcbc6f552 [id=9e2544e6f31749259b394f3de29358ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.563313 890 tablet_service.cc:1511] Processing CreateTablet for tablet a14416733ff7463082843ef2597ebc88 (DEFAULT_TABLE table=default.Table_93b5e652dc2a4061abf781fea9c4aae1 [id=c53336c48c5e45d0bf581f7f9918960e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.564519 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c11b3c4a27ad4ff4859736ff527242ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.565289 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4f13e0ca57ec46899092c426fb249611" } modify_external_catalogs: true
W20260616 19:52:02.565511 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c11b3c4a27ad4ff4859736ff527242ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.565454 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4f13e0ca57ec46899092c426fb249611" } modify_external_catalogs: true
I20260616 19:52:02.566120 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0a6adf1d7e5244debb4424a25d63a45d" } modify_external_catalogs: true
I20260616 19:52:02.566296 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0a6adf1d7e5244debb4424a25d63a45d" } modify_external_catalogs: true
I20260616 19:52:02.567461 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_df7c593c98334922b13b1cfc1cae9340" } modify_external_catalogs: true
I20260616 19:52:02.567620 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_df7c593c98334922b13b1cfc1cae9340" } modify_external_catalogs: true
I20260616 19:52:02.569060 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125dce4d32a416498b42a1b599355fd" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:02.569314 1058 raft_consensus.cc:2468] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:02.570037 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 01a31bde2bbc45ca86f7f3ce58ea1f37 (DEFAULT_TABLE table=default.Table_232c28cfcefb46c48f728eb603081963 [id=c5439a97b869408fac78293786f35a9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.570694 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a31bde2bbc45ca86f7f3ce58ea1f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.575198 1039 tablet_service.cc:1511] Processing CreateTablet for tablet a14416733ff7463082843ef2597ebc88 (DEFAULT_TABLE table=default.Table_93b5e652dc2a4061abf781fea9c4aae1 [id=c53336c48c5e45d0bf581f7f9918960e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.575627 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14416733ff7463082843ef2597ebc88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.579083 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ab33d99d857145dfbda54ff2f7464486
I20260616 19:52:02.545420 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet fac9c314b1824e3297cf568ea0b14865 with delete_type TABLET_DATA_DELETED (replaced by tablet d9f9cd8a901e41b0a92d7d37ed338ee9) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.537362 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 20b9e3626794464aa823724bee0a1682 (DEFAULT_TABLE table=default.Table_44bfcb23c9f046779ebc73bdcbc6f552 [id=9e2544e6f31749259b394f3de29358ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.579854 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b9e3626794464aa823724bee0a1682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.580493 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2d05c86bca9343a2bc8c5709e1c49647
I20260616 19:52:02.580747 764 tablet_service.cc:1558] Processing DeleteTablet for tablet e03e6a2614564eeeb8ec382b16f0ece1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.581781 893 tablet_service.cc:1558] Processing DeleteTablet for tablet ab33d99d857145dfbda54ff2f7464486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.582026 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d05c86bca9343a2bc8c5709e1c49647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.583002 718 leader_election.cc:304] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:02.583491 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d05c86bca9343a2bc8c5709e1c49647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.584079 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet ab33d99d857145dfbda54ff2f7464486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.586230 1751 leader_election.cc:290] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:02.586390 1751 raft_consensus.cc:2804] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:02.586759 765 tablet_service.cc:1511] Processing CreateTablet for tablet 92fcb0f60c474fbabce31a2c970ceb52 (DEFAULT_TABLE table=default.Table_e96176d8842641a9b655bab99c8b35f9 [id=4b8bcf84a29c492e8e21b001c47e2af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.593158 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b9e3626794464aa823724bee0a1682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.594080 754 tablet_service.cc:1511] Processing CreateTablet for tablet 2fab0e788ab74d2dae042e30b594e971 (DEFAULT_TABLE table=default.Table_4be8f181fb634263aea92a56d3ca447d [id=8c64d57f5fa6431cb2b96d60937ffcad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.594449 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fab0e788ab74d2dae042e30b594e971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.595454 1198 ts_tablet_manager.cc:1434] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.052s user 0.002s sys 0.000s
I20260616 19:52:02.595634 764 tablet_service.cc:1511] Processing CreateTablet for tablet 01a31bde2bbc45ca86f7f3ce58ea1f37 (DEFAULT_TABLE table=default.Table_232c28cfcefb46c48f728eb603081963 [id=c5439a97b869408fac78293786f35a9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.595997 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a31bde2bbc45ca86f7f3ce58ea1f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.596602 756 tablet_service.cc:1558] Processing DeleteTablet for tablet fac9c314b1824e3297cf568ea0b14865 with delete_type TABLET_DATA_DELETED (replaced by tablet d9f9cd8a901e41b0a92d7d37ed338ee9) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.596655 758 tablet_service.cc:1511] Processing CreateTablet for tablet a14416733ff7463082843ef2597ebc88 (DEFAULT_TABLE table=default.Table_93b5e652dc2a4061abf781fea9c4aae1 [id=c53336c48c5e45d0bf581f7f9918960e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.597086 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14416733ff7463082843ef2597ebc88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.598199 1751 raft_consensus.cc:493] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:02.598775 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 79d686afeeed4729bd2069296aec82a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 81618a3f43ad40fc8173e266cc106899) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.599399 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 12944efb54824dc4960db5d09c1a1684 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:02.599542 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 423) took 3829 ms. Trace:
I20260616 19:52:02.599627 1190 rpcz_store.cc:276] 0616 19:51:58.770243 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.832261 (+ 62018us) service_pool.cc:224] Handling call
0616 19:52:02.544590 (+3712329us) ts_tablet_manager.cc:1151] Deleting tablet e3c4e584fad94633ae49332872de0fc3
0616 19:52:02.599304 (+ 54714us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.599487 (+ 183us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3633392}
W20260616 19:52:02.600212 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet e3c4e584fad94633ae49332872de0fc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3c4e584fad94633ae49332872de0fc3 already in progress: creating tablet
I20260616 19:52:02.600770 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92fcb0f60c474fbabce31a2c970ceb52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.602371 1751 raft_consensus.cc:3060] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.602975 756 tablet_service.cc:1558] Processing DeleteTablet for tablet ab33d99d857145dfbda54ff2f7464486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.603245 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d05c86bca9343a2bc8c5709e1c49647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.605500 888 tablet_service.cc:1511] Processing CreateTablet for tablet 2fab0e788ab74d2dae042e30b594e971 (DEFAULT_TABLE table=default.Table_4be8f181fb634263aea92a56d3ca447d [id=8c64d57f5fa6431cb2b96d60937ffcad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.612828 1700 raft_consensus.cc:515] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.614215 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14416733ff7463082843ef2597ebc88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.617440 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a31bde2bbc45ca86f7f3ce58ea1f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.618716 1198 tablet_bootstrap.cc:492] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:02.620878 1198 tablet_bootstrap.cc:654] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.631744 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fab0e788ab74d2dae042e30b594e971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.637825 1191 ts_tablet_manager.cc:1929] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:02.637987 1191 log.cc:1199] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/a93dd295602840319f72e7021ddfd61a
I20260616 19:52:02.638393 1191 ts_tablet_manager.cc:1950] T a93dd295602840319f72e7021ddfd61a P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:02.640163 1190 tablet_replica.cc:333] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:02.640426 1190 raft_consensus.cc:2243] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:02.641064 1190 raft_consensus.cc:2272] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:02.641660 1190 ts_tablet_manager.cc:1916] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:02.645860 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5741b92cafb4d53987dbeeef66ccd56" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:02.652259 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2fab0e788ab74d2dae042e30b594e971 (DEFAULT_TABLE table=default.Table_4be8f181fb634263aea92a56d3ca447d [id=8c64d57f5fa6431cb2b96d60937ffcad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.652843 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fab0e788ab74d2dae042e30b594e971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.657405 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_06cfa94be6934d30830e13d6af1ba8a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.657974 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06cfa94be6934d30830e13d6af1ba8a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.660367 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet da51a682de41402cb537ab113f876a2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.660657 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5dad654c95f74c999b6dc8e20626e23e" } new_table_name: "default.Table_516f90bc9f17467796c1a387794b5568" modify_external_catalogs: true
I20260616 19:52:02.661334 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_156e92a12c2d49dda4e54f4f3681abb8" } modify_external_catalogs: true
W20260616 19:52:02.666486 718 leader_election.cc:343] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:02.669515 1192 tablet_bootstrap.cc:492] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:02.669694 1192 ts_tablet_manager.cc:1403] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.190s user 0.022s sys 0.063s
I20260616 19:52:02.670897 1700 leader_election.cc:290] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:02.670876 1192 raft_consensus.cc:359] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.671047 1192 raft_consensus.cc:385] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:02.671147 1192 raft_consensus.cc:740] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:02.671377 1192 consensus_queue.cc:260] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.671520 1753 raft_consensus.cc:515] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:02.672277 1753 leader_election.cc:290] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:02.673691 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_609f08c548144b62a7533ccf6f2d5219"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.674252 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_609f08c548144b62a7533ccf6f2d5219 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.676620 1193 ts_tablet_manager.cc:1929] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:02.676676 1192 ts_tablet_manager.cc:1434] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260616 19:52:02.676759 1193 log.cc:1199] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/662e2d573bd7489a81697c17393ce088
I20260616 19:52:02.677188 1193 ts_tablet_manager.cc:1950] T 662e2d573bd7489a81697c17393ce088 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:02.677623 1192 tablet_bootstrap.cc:492] T d5741b92cafb4d53987dbeeef66ccd56 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:02.678503 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 544) took 1131 ms. Trace:
I20260616 19:52:02.679672 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3de0e62cfd33410490a0b460fd5f69e9" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:02.679854 922 raft_consensus.cc:3060] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.682626 922 raft_consensus.cc:2468] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:02.683228 1803 raft_consensus.cc:493] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:02.683404 1803 raft_consensus.cc:515] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.684098 1803 leader_election.cc:290] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:02.685786 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3de0e62cfd33410490a0b460fd5f69e9" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:02.686017 1060 raft_consensus.cc:3060] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.688230 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b211692aca478bb40f0f2c3f50ca44" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:02.688860 1192 tablet_bootstrap.cc:654] T d5741b92cafb4d53987dbeeef66ccd56 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.689138 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_398beedaedf34f3680d72afcb4ead9c0" } new_table_name: "default.Table_fcd5b381e53d45478f45e2f78aaae323" modify_external_catalogs: true
I20260616 19:52:02.689524 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]). Expected version 1 got 0
I20260616 19:52:02.689869 1060 raft_consensus.cc:2468] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:02.690980 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_156e92a12c2d49dda4e54f4f3681abb8" } modify_external_catalogs: true
I20260616 19:52:02.692148 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5741b92cafb4d53987dbeeef66ccd56" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:52:02.692305 993 leader_election.cc:343] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:02.692399 1058 raft_consensus.cc:2468] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:02.698514 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0c166a93c88b45f799e14e10e802b5a0
I20260616 19:52:02.698777 1193 rpcz_store.cc:276] 0616 19:52:01.546863 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.549203 (+ 2340us) service_pool.cc:224] Handling call
0616 19:52:02.148226 (+599023us) ts_tablet_manager.cc:1151] Deleting tablet 662e2d573bd7489a81697c17393ce088
0616 19:52:02.148232 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.546257 (+398025us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.676536 (+130279us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.678467 (+ 1931us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":598623}
I20260616 19:52:02.699385 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 662e2d573bd7489a81697c17393ce088 (table default.Table_11377e6262de467fbd54d3ab881b4362 [id=543aa36f72844ba182c88e2510bfe65c]) successfully deleted
I20260616 19:52:02.700152 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b211692aca478bb40f0f2c3f50ca44" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:02.700911 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c166a93c88b45f799e14e10e802b5a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.701020 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 39f52eebdc79460a9ff33191086e87c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e8160ad4cf74f16a586ae59291ce7d1) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:02.700237 1732 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260616 19:52:02.702098 1732 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260616 19:52:02.702230 1732 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260616 19:52:02.702430 996 leader_election.cc:343] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:02.703333 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 12944efb54824dc4960db5d09c1a1684
I20260616 19:52:02.703608 1193 tablet_replica.cc:333] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:02.703847 452 catalog_manager.cc:6784] ReplaceTablet: tablet 12944efb54824dc4960db5d09c1a1684 deleted and replaced by tablet ea0a7f80c5a34dbfabce579b6f574f93
I20260616 19:52:02.705348 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_827a69aca36a453db1e09ffa7d2b535c" } new_table_name: "default.Table_449f169e33f9407da529eb6b6fa2391b" modify_external_catalogs: true
I20260616 19:52:02.700809 718 leader_election.cc:304] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:02.712112 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 12944efb54824dc4960db5d09c1a1684 with delete_type TABLET_DATA_DELETED (replaced by tablet ea0a7f80c5a34dbfabce579b6f574f93) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.712289 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d1c9326d48f345f4b4b368dad96e1369"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.712556 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f67b3d225b1640d8abebc117046112d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.712980 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1c9326d48f345f4b4b368dad96e1369 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.713620 1198 tablet_bootstrap.cc:492] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:02.713644 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5a1b414e058f427e9bb10ce0b4b789bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.713848 1198 ts_tablet_manager.cc:1403] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.095s user 0.004s sys 0.000s
W20260616 19:52:02.714147 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a1b414e058f427e9bb10ce0b4b789bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.714936 996 leader_election.cc:304] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:02.715198 1803 raft_consensus.cc:2749] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:02.715605 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7aeeccc151924d7f9851b501e784bde7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.715973 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c166a93c88b45f799e14e10e802b5a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:02.716041 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7aeeccc151924d7f9851b501e784bde7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.716399 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 12944efb54824dc4960db5d09c1a1684 with delete_type TABLET_DATA_DELETED (replaced by tablet ea0a7f80c5a34dbfabce579b6f574f93) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.716602 1190 ts_tablet_manager.cc:1929] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:02.716730 1190 log.cc:1199] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/0bf54b260fc941599cffb12581e8116a
I20260616 19:52:02.717202 1190 ts_tablet_manager.cc:1950] T 0bf54b260fc941599cffb12581e8116a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
W20260616 19:52:02.717340 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f67b3d225b1640d8abebc117046112d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.717592 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 413) took 3951 ms. Trace:
I20260616 19:52:02.717700 1190 rpcz_store.cc:276] 0616 19:51:58.766241 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.827946 (+ 61705us) service_pool.cc:224] Handling call
0616 19:52:02.602511 (+3774565us) ts_tablet_manager.cc:1151] Deleting tablet 0bf54b260fc941599cffb12581e8116a
0616 19:52:02.631416 (+ 28905us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.654914 (+ 23498us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.716444 (+ 61530us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.717543 (+ 1099us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3686877}
I20260616 19:52:02.718197 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 0bf54b260fc941599cffb12581e8116a (table default.Table_7af2cb04d4654ceabe58936f5a687406 [id=7f7faf7145fd4ea5babd783d76d44821]) successfully deleted
I20260616 19:52:02.719733 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 432) took 3773 ms. Trace:
I20260616 19:52:02.719920 1190 rpcz_store.cc:276] 0616 19:51:58.946233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.946302 (+ 69us) service_pool.cc:224] Handling call
0616 19:52:02.719575 (+3773273us) ts_tablet_manager.cc:1151] Deleting tablet fab8282287434bf8b7e37f008a1b0166
0616 19:52:02.719584 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.719691 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3742493}
I20260616 19:52:02.720247 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fdb76eb70534433eae79f807fd35fb90" } new_table_name: "default.Table_b70123afde084dac9b1dfd2fc95935c7" modify_external_catalogs: true
W20260616 19:52:02.720710 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet fab8282287434bf8b7e37f008a1b0166 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fab8282287434bf8b7e37f008a1b0166 already in progress: creating tablet
I20260616 19:52:02.721191 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 434) took 3438 ms. Trace:
I20260616 19:52:02.721352 1190 rpcz_store.cc:276] 0616 19:51:59.283129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.283226 (+ 97us) service_pool.cc:224] Handling call
0616 19:52:02.721032 (+3437806us) ts_tablet_manager.cc:1151] Deleting tablet 90bc7409e31043bd9f47d3628278a2fa
0616 19:52:02.721040 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.721154 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3437467}
I20260616 19:52:02.721606 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e7113aa5e6074bba96617bb94cd588a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.722048 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7113aa5e6074bba96617bb94cd588a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:02.723246 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 90bc7409e31043bd9f47d3628278a2fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90bc7409e31043bd9f47d3628278a2fa already in progress: creating tablet
I20260616 19:52:02.724427 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 435) took 3386 ms. Trace:
I20260616 19:52:02.724627 1190 rpcz_store.cc:276] 0616 19:51:59.337450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.337636 (+ 186us) service_pool.cc:224] Handling call
0616 19:52:02.724283 (+3386647us) ts_tablet_manager.cc:1151] Deleting tablet ba0d3e7da3c74f5ea5dc4aac80a01c82
0616 19:52:02.724292 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.724383 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3386463}
W20260616 19:52:02.725432 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 already in progress: creating tablet
I20260616 19:52:02.726009 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 438) took 3311 ms. Trace:
I20260616 19:52:02.726174 1190 rpcz_store.cc:276] 0616 19:51:59.415005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.416443 (+ 1438us) service_pool.cc:224] Handling call
0616 19:52:02.725694 (+3309251us) ts_tablet_manager.cc:1151] Deleting tablet 4fc0c02ef58d4e429855e5bbaa4752ad
0616 19:52:02.725702 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.725967 (+ 265us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3290954}
W20260616 19:52:02.726792 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 4fc0c02ef58d4e429855e5bbaa4752ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fc0c02ef58d4e429855e5bbaa4752ad already in progress: creating tablet
I20260616 19:52:02.727237 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 439) took 3300 ms. Trace:
I20260616 19:52:02.727392 1190 rpcz_store.cc:276] 0616 19:51:59.426653 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.426712 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:02.727086 (+3300374us) ts_tablet_manager.cc:1151] Deleting tablet 54eb61046c954a36a036b24e9e16b5c4
0616 19:52:02.727094 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.727204 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26,"tablet-delete.queue_time_us":3292347}
W20260616 19:52:02.727869 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 54eb61046c954a36a036b24e9e16b5c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54eb61046c954a36a036b24e9e16b5c4 already in progress: creating tablet
I20260616 19:52:02.728271 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 437) took 3322 ms. Trace:
I20260616 19:52:02.728425 1190 rpcz_store.cc:276] 0616 19:51:59.405457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.405823 (+ 366us) service_pool.cc:224] Handling call
0616 19:52:02.728121 (+3322298us) ts_tablet_manager.cc:1151] Deleting tablet 7a2e5bc2c47746e88e95634fb073273e
0616 19:52:02.728142 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.728237 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3293251}
I20260616 19:52:02.717406 1198 raft_consensus.cc:359] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:02.728914 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 7a2e5bc2c47746e88e95634fb073273e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a2e5bc2c47746e88e95634fb073273e already in progress: creating tablet
I20260616 19:52:02.729136 1198 raft_consensus.cc:385] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:02.729386 1198 raft_consensus.cc:740] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:02.729785 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 440) took 3278 ms. Trace:
I20260616 19:52:02.729866 1198 consensus_queue.cc:260] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.729938 1190 rpcz_store.cc:276] 0616 19:51:59.451008 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.451421 (+ 413us) service_pool.cc:224] Handling call
0616 19:52:02.729666 (+3278245us) ts_tablet_manager.cc:1151] Deleting tablet 75c08452aeec471f8480a489620cca28
0616 19:52:02.729675 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.729757 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3278035}
W20260616 19:52:02.730396 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 75c08452aeec471f8480a489620cca28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75c08452aeec471f8480a489620cca28 already in progress: creating tablet
I20260616 19:52:02.730693 1190 tablet_replica.cc:333] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:02.731979 1198 ts_tablet_manager.cc:1434] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260616 19:52:02.733871 1192 tablet_bootstrap.cc:492] T d5741b92cafb4d53987dbeeef66ccd56 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:02.730928 1190 raft_consensus.cc:2243] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:02.734100 1192 ts_tablet_manager.cc:1403] T d5741b92cafb4d53987dbeeef66ccd56 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.057s user 0.008s sys 0.001s
I20260616 19:52:02.734220 1190 raft_consensus.cc:2272] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:02.734908 1192 raft_consensus.cc:359] T d5741b92cafb4d53987dbeeef66ccd56 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.735536 1192 raft_consensus.cc:385] T d5741b92cafb4d53987dbeeef66ccd56 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:02.735663 1192 raft_consensus.cc:740] T d5741b92cafb4d53987dbeeef66ccd56 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:02.735957 1190 ts_tablet_manager.cc:1916] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:02.736596 1192 consensus_queue.cc:260] T d5741b92cafb4d53987dbeeef66ccd56 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.737902 1192 ts_tablet_manager.cc:1434] T d5741b92cafb4d53987dbeeef66ccd56 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260616 19:52:02.739701 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ce0d37e91de4b4db94f535fbd3fcc94 consensus state has no leader
W20260616 19:52:02.742898 1732 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260616 19:52:02.742995 1732 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260616 19:52:02.743083 1732 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260616 19:52:02.743139 1732 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260616 19:52:02.750819 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2134c683f256462ca068a0acaf7f1a80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.751487 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2134c683f256462ca068a0acaf7f1a80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.754580 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 5a9befb557d84f3bb7781664cbf2f28f
I20260616 19:52:02.755395 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_90dd7bdb2d6943c5a3864e1a09318956"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.755971 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90dd7bdb2d6943c5a3864e1a09318956 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.756807 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a9befb557d84f3bb7781664cbf2f28f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.763358 1192 tablet_bootstrap.cc:492] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:02.763718 1732 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.189:43055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.189
--webserver_port=42593
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 16 Jun 2026 19:43:22 UTC on bdcb31816ec0
build id 12426
ASAN enabled
I20260616 19:52:02.765642 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 498) took 2295 ms. Trace:
I20260616 19:52:02.765851 1732 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260616 19:52:02.765780 1191 rpcz_store.cc:276] 0616 19:52:00.470087 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.470331 (+ 244us) service_pool.cc:224] Handling call
0616 19:52:02.332073 (+1861742us) ts_tablet_manager.cc:1151] Deleting tablet a93dd295602840319f72e7021ddfd61a
0616 19:52:02.332088 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.462242 (+130154us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x616000192754. stack: 00007f92671a0086 00007f926719fe40 00007f92661593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f92731d47e0 00007f9274520933 00007f92770e3ae7 00007f9277116bb4 00007f92770f75d0 00007f92770f735d 0000000000aa681c 00007f92671e5f6f 00007f92671e928b 00007f92671e9108
0616 19:52:02.542257 (+ 80015us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.637725 (+ 95468us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.765589 (+127864us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129067392,"tablet-delete.queue_time_us":1861581}
I20260616 19:52:02.766264 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 502) took 2140 ms. Trace:
I20260616 19:52:02.766376 1191 rpcz_store.cc:276] 0616 19:52:00.625437 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.625505 (+ 68us) service_pool.cc:224] Handling call
0616 19:52:02.766075 (+2140570us) ts_tablet_manager.cc:1151] Deleting tablet 899b5f53d3fd4e2ab7222555dcc120e2
0616 19:52:02.766085 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.766228 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2139940}
I20260616 19:52:02.766703 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 503) took 2141 ms. Trace:
I20260616 19:52:02.766816 1191 rpcz_store.cc:276] 0616 19:52:00.625569 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.626192 (+ 623us) service_pool.cc:224] Handling call
0616 19:52:02.766591 (+2140399us) ts_tablet_manager.cc:1151] Deleting tablet 731556662b62419dae76149b22469ebd
0616 19:52:02.766599 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.766675 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2086561}
I20260616 19:52:02.767086 1191 tablet_replica.cc:333] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:02.767287 1191 raft_consensus.cc:2243] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:02.767587 1191 raft_consensus.cc:2272] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:02.768162 1191 ts_tablet_manager.cc:1916] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:02.768241 1732 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260616 19:52:02.768740 1193 raft_consensus.cc:2243] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:02.769006 1193 pending_rounds.cc:70] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:02.769026 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet a93dd295602840319f72e7021ddfd61a (table default.Table_289acf4951fa4f4888dae7ce3ef0fb6e [id=ec0c3e3aef034429b5cb31a106143a3d]) successfully deleted
I20260616 19:52:02.769099 1193 pending_rounds.cc:77] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595483919495168 op_type: NO_OP noop_request { }
I20260616 19:52:02.769205 1193 raft_consensus.cc:2889] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:02.769315 1193 raft_consensus.cc:2272] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:02.769306 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 899b5f53d3fd4e2ab7222555dcc120e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 899b5f53d3fd4e2ab7222555dcc120e2 already in progress: creating tablet
W20260616 19:52:02.769536 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 731556662b62419dae76149b22469ebd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 731556662b62419dae76149b22469ebd already in progress: creating tablet
I20260616 19:52:02.770931 1198 tablet_bootstrap.cc:492] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:02.772763 1198 tablet_bootstrap.cc:654] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.776950 1700 raft_consensus.cc:2804] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:02.777187 1700 raft_consensus.cc:697] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:02.777486 1700 consensus_queue.cc:237] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:02.780694 719 leader_election.cc:304] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:02.781036 1815 raft_consensus.cc:2804] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:02.781123 1815 raft_consensus.cc:493] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:02.784345 1815 raft_consensus.cc:3060] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.785135 1191 ts_tablet_manager.cc:1929] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:02.785285 1191 log.cc:1199] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/2c31c8e977da4a70bca1beb00f364627
I20260616 19:52:02.785725 1191 ts_tablet_manager.cc:1950] T 2c31c8e977da4a70bca1beb00f364627 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:02.786568 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 514) took 2056 ms. Trace:
I20260616 19:52:02.786661 1191 rpcz_store.cc:276] 0616 19:52:00.729816 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.729939 (+ 123us) service_pool.cc:224] Handling call
0616 19:52:02.767022 (+2037083us) ts_tablet_manager.cc:1151] Deleting tablet 2c31c8e977da4a70bca1beb00f364627
0616 19:52:02.767030 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.773216 (+ 6186us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.783311 (+ 10095us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.786511 (+ 3200us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2036806}
I20260616 19:52:02.787057 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 2c31c8e977da4a70bca1beb00f364627 (table default.Table_9e98175df9ce48a59cb42b1e48cd7fba [id=cb4c50d05fdd4c0a85828222eeb0f06a]) successfully deleted
I20260616 19:52:02.787312 1192 tablet_bootstrap.cc:654] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.787315 1815 raft_consensus.cc:515] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.787812 1751 raft_consensus.cc:515] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.788043 1815 leader_election.cc:290] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:02.788542 1751 leader_election.cc:290] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:02.782594 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c166a93c88b45f799e14e10e802b5a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.790896 1193 ts_tablet_manager.cc:1916] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:02.787976 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a9befb557d84f3bb7781664cbf2f28f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:02.793591 1823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:52:02.793910 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 518) took 1943 ms. Trace:
I20260616 19:52:02.794059 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125dce4d32a416498b42a1b599355fd" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:02.794277 1060 raft_consensus.cc:3060] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.794546 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a9befb557d84f3bb7781664cbf2f28f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.796978 1060 raft_consensus.cc:2468] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:02.793931 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5741b92cafb4d53987dbeeef66ccd56" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:02.797778 1058 raft_consensus.cc:3060] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:02.800668 1824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:52:02.802871 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2e2432072a8f43cfa54ceabaaf6a7528" } new_table_name: "default.Table_d6a8e83a5dbb456b8b6c3124c83771ea" modify_external_catalogs: true
I20260616 19:52:02.804584 1058 raft_consensus.cc:2468] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:02.794020 1191 rpcz_store.cc:276] 0616 19:52:00.850082 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.850770 (+ 688us) service_pool.cc:224] Handling call
0616 19:52:02.793730 (+1942960us) ts_tablet_manager.cc:1151] Deleting tablet f293d557a9aa4ca4885aa917fe1565e4
0616 19:52:02.793740 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.793848 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1942700}
I20260616 19:52:02.806020 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 519) took 1955 ms. Trace:
I20260616 19:52:02.806200 1191 rpcz_store.cc:276] 0616 19:52:00.850200 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.851913 (+ 1713us) service_pool.cc:224] Handling call
0616 19:52:02.805747 (+1953834us) ts_tablet_manager.cc:1151] Deleting tablet b2e5e84b95c7429bb53dd616f118500a
0616 19:52:02.805762 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.805917 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1953564}
I20260616 19:52:02.807175 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 520) took 1834 ms. Trace:
W20260616 19:52:02.807523 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 3ce0d37e91de4b4db94f535fbd3fcc94 (table default.Table_fcd5b381e53d45478f45e2f78aaae323 [id=58d9f7c6431f47a7b5dd0b2785b6fffb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3ce0d37e91de4b4db94f535fbd3fcc94 consensus state has no leader
W20260616 19:52:02.807809 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet f293d557a9aa4ca4885aa917fe1565e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f293d557a9aa4ca4885aa917fe1565e4 already in progress: creating tablet
W20260616 19:52:02.808036 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet b2e5e84b95c7429bb53dd616f118500a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2e5e84b95c7429bb53dd616f118500a already in progress: creating tablet
I20260616 19:52:02.808056 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eab5bd3967c42e1b6b79558df742946 with delete_type TABLET_DATA_DELETED (replaced by tablet 65b0dc43b40649f29037f40d2ea9247e) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.808454 1191 rpcz_store.cc:276] 0616 19:52:00.972721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.974889 (+ 2168us) service_pool.cc:224] Handling call
0616 19:52:02.806888 (+1831999us) ts_tablet_manager.cc:1151] Deleting tablet 31592a5ffb04429c9315a4fd72308f28
0616 19:52:02.806897 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.807080 (+ 183us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1796350}
W20260616 19:52:02.809098 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf23aef677064e43bbba3ffba26f2719 consensus state has no leader
I20260616 19:52:02.809449 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_333a3cd8e7d247e7b113f715a2f14955" } modify_external_catalogs: true
I20260616 19:52:02.809635 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_333a3cd8e7d247e7b113f715a2f14955" } modify_external_catalogs: true
W20260616 19:52:02.810145 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f89a0c065a4a4fb7afa8cab29d78c2e5 consensus state has no leader
I20260616 19:52:02.812006 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 4bde746e334a4f59aded168c6b2bb348 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:02.812301 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 521) took 1798 ms. Trace:
I20260616 19:52:02.812480 1191 rpcz_store.cc:276] 0616 19:52:01.013395 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.021833 (+ 8438us) service_pool.cc:224] Handling call
0616 19:52:02.812147 (+1790314us) ts_tablet_manager.cc:1151] Deleting tablet b718514e4fbd4601afeb021ed35643e6
0616 19:52:02.812158 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.812266 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1789476}
I20260616 19:52:02.812951 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e4cc2f16ea18496ca63a4bf823ed95e9" } modify_external_catalogs: true
I20260616 19:52:02.813126 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e4cc2f16ea18496ca63a4bf823ed95e9" } modify_external_catalogs: true
I20260616 19:52:02.813797 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5669ec43b5604db88e68c905ddf440a2" } modify_external_catalogs: true
I20260616 19:52:02.813977 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5669ec43b5604db88e68c905ddf440a2" } modify_external_catalogs: true
I20260616 19:52:02.814162 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 522) took 1695 ms. Trace:
I20260616 19:52:02.814292 1191 rpcz_store.cc:276] 0616 19:52:01.118661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.118715 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:02.813591 (+1694876us) ts_tablet_manager.cc:1151] Deleting tablet 8c0a6191ad334400a319778fc4e559af
0616 19:52:02.813605 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.814040 (+ 435us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1694653}
I20260616 19:52:02.815572 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 523) took 1667 ms. Trace:
W20260616 19:52:02.815732 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 31592a5ffb04429c9315a4fd72308f28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31592a5ffb04429c9315a4fd72308f28 already in progress: creating tablet
I20260616 19:52:02.815721 1191 rpcz_store.cc:276] 0616 19:52:01.147638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.147702 (+ 64us) service_pool.cc:224] Handling call
0616 19:52:02.815414 (+1667712us) ts_tablet_manager.cc:1151] Deleting tablet fbe784716b3c4293bd4eddf57f6c9048
0616 19:52:02.815422 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.815521 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1667493}
W20260616 19:52:02.815958 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet b718514e4fbd4601afeb021ed35643e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b718514e4fbd4601afeb021ed35643e6 already in progress: creating tablet
W20260616 19:52:02.816184 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8c0a6191ad334400a319778fc4e559af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c0a6191ad334400a319778fc4e559af already in progress: creating tablet
I20260616 19:52:02.816447 1191 tablet_replica.cc:333] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:02.816424 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet fbe784716b3c4293bd4eddf57f6c9048 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbe784716b3c4293bd4eddf57f6c9048 already in progress: creating tablet
I20260616 19:52:02.822954 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5741b92cafb4d53987dbeeef66ccd56" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:02.823189 922 raft_consensus.cc:3060] T d5741b92cafb4d53987dbeeef66ccd56 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.825629 1191 raft_consensus.cc:2243] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:02.829330 1191 raft_consensus.cc:2272] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:02.830441 1191 ts_tablet_manager.cc:1916] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:02.820591 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125dce4d32a416498b42a1b599355fd" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:02.831264 921 raft_consensus.cc:3060] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.833977 921 raft_consensus.cc:2468] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:02.835265 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7955886341a94249afa849c51d34a0be consensus state has no leader
I20260616 19:52:02.837805 1719 raft_consensus.cc:493] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:02.837937 1719 raft_consensus.cc:515] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.838723 1719 leader_election.cc:290] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:02.841876 1198 tablet_bootstrap.cc:492] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:02.841863 922 raft_consensus.cc:2468] T d5741b92cafb4d53987dbeeef66ccd56 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:02.842156 1198 ts_tablet_manager.cc:1403] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.000s
I20260616 19:52:02.843097 1198 raft_consensus.cc:359] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.843410 1198 raft_consensus.cc:385] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:02.843549 1198 raft_consensus.cc:740] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:02.843717 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99740ab59f947aabcac88dc2bf2de86" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:02.843914 1198 consensus_queue.cc:260] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.844497 1198 ts_tablet_manager.cc:1434] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:02.845018 1198 tablet_bootstrap.cc:492] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:02.842098 719 leader_election.cc:304] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:02.847028 719 leader_election.cc:304] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:02.847177 1198 tablet_bootstrap.cc:654] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.847321 1815 raft_consensus.cc:2804] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:02.848768 1815 raft_consensus.cc:697] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:02.849074 1815 consensus_queue.cc:237] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.849156 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99740ab59f947aabcac88dc2bf2de86" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:02.849346 1058 raft_consensus.cc:2468] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:02.849795 858 leader_election.cc:304] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:02.850072 1719 raft_consensus.cc:2804] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:02.850178 1719 raft_consensus.cc:493] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:02.850255 1719 raft_consensus.cc:3060] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:02.852725 860 leader_election.cc:343] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:02.852738 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 12944efb54824dc4960db5d09c1a1684 with delete_type TABLET_DATA_DELETED (replaced by tablet ea0a7f80c5a34dbfabce579b6f574f93) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.853154 1720 consensus_queue.cc:1048] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:02.854130 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 3587c1ab487a424eb82f378ae081f514 with delete_type TABLET_DATA_DELETED (replaced by tablet 84ce7bf3e0004ffaa2c5e314fa69322c) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.856808 1719 raft_consensus.cc:515] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.868371 1191 ts_tablet_manager.cc:1929] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260616 19:52:02.861406 858 consensus_peers.cc:597] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 350453721d13427a946ac5c5ee7c62a0. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:02.865589 1192 tablet_bootstrap.cc:492] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:02.869778 1192 ts_tablet_manager.cc:1403] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.130s user 0.002s sys 0.002s
I20260616 19:52:02.870813 1192 raft_consensus.cc:359] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.870993 1192 raft_consensus.cc:385] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:02.871101 1192 raft_consensus.cc:740] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:02.871280 1191 log.cc:1199] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/39f52eebdc79460a9ff33191086e87c6
I20260616 19:52:02.871376 1192 consensus_queue.cc:260] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.872033 1191 ts_tablet_manager.cc:1950] T 39f52eebdc79460a9ff33191086e87c6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:02.872864 1192 ts_tablet_manager.cc:1434] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:02.874032 1192 tablet_bootstrap.cc:492] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:02.876524 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 524) took 1712 ms. Trace:
I20260616 19:52:02.877512 1191 rpcz_store.cc:276] 0616 19:52:01.163637 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.163704 (+ 67us) service_pool.cc:224] Handling call
0616 19:52:02.816368 (+1652664us) ts_tablet_manager.cc:1151] Deleting tablet 39f52eebdc79460a9ff33191086e87c6
0616 19:52:02.816377 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.834230 (+ 17853us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.868269 (+ 34039us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.876435 (+ 8166us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1652412}
I20260616 19:52:02.879650 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 39f52eebdc79460a9ff33191086e87c6 (table default.Table_2984957106b44cdc9ecd5a06e8edb7d3 [id=23f3d793560846b7a0701ec470588cbc]) successfully deleted
I20260616 19:52:02.879769 1191 tablet_replica.cc:333] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:02.879982 1191 raft_consensus.cc:2243] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:02.881071 1191 raft_consensus.cc:2272] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:02.882117 1191 ts_tablet_manager.cc:1916] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:02.885195 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet d5741b92cafb4d53987dbeeef66ccd56 (table default.Table_a5a8fee8fc214408ae98d4e88d6f66a5 [id=ee6ce577050e45c5b9b014d3827e5046]). Expected version 1 got 0
I20260616 19:52:02.888242 1719 leader_election.cc:290] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:02.888803 1831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:52:02.893620 888 tablet_service.cc:1558] Processing DeleteTablet for tablet eb024637294148c18b74bef47fb2fcce with delete_type TABLET_DATA_DELETED (replaced by tablet 64aa32856ca34743933931fb51f2bd7b) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.896299 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 47bbf21dc1d945ce8f5edd27cdf26817
I20260616 19:52:02.897378 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 47bbf21dc1d945ce8f5edd27cdf26817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.898226 888 tablet_service.cc:1511] Processing CreateTablet for tablet b0b4d05e770845e0aa8e6a30a86babe8 (DEFAULT_TABLE table=default.Table_f39fe2b06c8c47e3bd6617baa83fe439 [id=ddb85d15124240789d29d3b021acda02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.898634 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b4d05e770845e0aa8e6a30a86babe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.901356 890 tablet_service.cc:1511] Processing CreateTablet for tablet f872a8860a4b421483441d71814be4fc (DEFAULT_TABLE table=default.Table_7e558c6a3c4b44cc94a6ec89871cfa59 [id=945040d190f24222a62395a909f74bc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.901723 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f872a8860a4b421483441d71814be4fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.902484 1732 server_base.cc:1061] running on GCE node
I20260616 19:52:02.904053 1732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260616 19:52:02.904798 891 tablet_service.cc:1511] Processing CreateTablet for tablet f5c46a428ff44d26a5c49322087cdf7a (DEFAULT_TABLE table=default.Table_cef65e1f2a234a8498e16b9138776e71 [id=3b2dc653f81640c9a1968da13b4bda95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.905213 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c46a428ff44d26a5c49322087cdf7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.905179 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c917659aef8241b98ffa4caa9c7b96a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:02.906167 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c917659aef8241b98ffa4caa9c7b96a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.909358 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 47bbf21dc1d945ce8f5edd27cdf26817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.909421 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fb391d8a718646b0b47d996c2f98f46f" } modify_external_catalogs: true
I20260616 19:52:02.910084 1034 tablet_service.cc:1511] Processing CreateTablet for tablet b0b4d05e770845e0aa8e6a30a86babe8 (DEFAULT_TABLE table=default.Table_f39fe2b06c8c47e3bd6617baa83fe439 [id=ddb85d15124240789d29d3b021acda02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.910562 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b4d05e770845e0aa8e6a30a86babe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.912729 1751 raft_consensus.cc:2804] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:02.912765 1022 tablet_service.cc:1511] Processing CreateTablet for tablet f5c46a428ff44d26a5c49322087cdf7a (DEFAULT_TABLE table=default.Table_cef65e1f2a234a8498e16b9138776e71 [id=3b2dc653f81640c9a1968da13b4bda95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.912914 1751 raft_consensus.cc:697] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:02.913089 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c46a428ff44d26a5c49322087cdf7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.914279 1751 consensus_queue.cc:237] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.918967 1732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260616 19:52:02.909647 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fb391d8a718646b0b47d996c2f98f46f" } modify_external_catalogs: true
I20260616 19:52:02.919938 750 tablet_service.cc:1511] Processing CreateTablet for tablet f872a8860a4b421483441d71814be4fc (DEFAULT_TABLE table=default.Table_7e558c6a3c4b44cc94a6ec89871cfa59 [id=945040d190f24222a62395a909f74bc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.920413 1732 hybrid_clock.cc:648] HybridClock initialized: now 1781639522920289 us; error 119 us; skew 500 ppm
I20260616 19:52:02.917778 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7dafeb24a59948b28e26730194e29758
I20260616 19:52:02.920835 1030 tablet_service.cc:1511] Processing CreateTablet for tablet f872a8860a4b421483441d71814be4fc (DEFAULT_TABLE table=default.Table_7e558c6a3c4b44cc94a6ec89871cfa59 [id=945040d190f24222a62395a909f74bc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.921201 1732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260616 19:52:02.918020 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 90630f9e6f314c5d9589e673339f475a
I20260616 19:52:02.919508 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 4bde746e334a4f59aded168c6b2bb348
I20260616 19:52:02.925412 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f872a8860a4b421483441d71814be4fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.929494 460 catalog_manager.cc:6784] ReplaceTablet: tablet 4bde746e334a4f59aded168c6b2bb348 deleted and replaced by tablet 0e2a3f93685146e9a7bf2713cc71dcb6
I20260616 19:52:02.929961 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_acf6078226f644f8a0a87e37b73c6cb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.930045 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_186422b1f85f4034b1e8f7a7508dd5fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:02.931135 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 90630f9e6f314c5d9589e673339f475a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.931171 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bde746e334a4f59aded168c6b2bb348 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e2a3f93685146e9a7bf2713cc71dcb6) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:02.931501 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acf6078226f644f8a0a87e37b73c6cb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:02.931684 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_186422b1f85f4034b1e8f7a7508dd5fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:02.935475 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99740ab59f947aabcac88dc2bf2de86" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:02.936233 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dafeb24a59948b28e26730194e29758 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.878417 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99740ab59f947aabcac88dc2bf2de86" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:02.936928 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 47bbf21dc1d945ce8f5edd27cdf26817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.937350 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 90630f9e6f314c5d9589e673339f475a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.937494 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 90630f9e6f314c5d9589e673339f475a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.937887 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bde746e334a4f59aded168c6b2bb348 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e2a3f93685146e9a7bf2713cc71dcb6) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.938200 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f872a8860a4b421483441d71814be4fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:02.939611 860 leader_election.cc:343] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:02.940183 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc
I20260616 19:52:02.941179 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dafeb24a59948b28e26730194e29758 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:02.941395 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.942183 1058 raft_consensus.cc:3060] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:02.944106 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.944536 763 tablet_service.cc:1511] Processing CreateTablet for tablet f5c46a428ff44d26a5c49322087cdf7a (DEFAULT_TABLE table=default.Table_cef65e1f2a234a8498e16b9138776e71 [id=3b2dc653f81640c9a1968da13b4bda95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.945024 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c46a428ff44d26a5c49322087cdf7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.945688 1732 webserver.cc:533] Webserver started at http://127.0.105.189:42593/ using document root <none> and password file <none>
I20260616 19:52:02.946870 1732 fs_manager.cc:362] Metadata directory not provided
I20260616 19:52:02.947023 1732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260616 19:52:02.856412 1190 ts_tablet_manager.cc:1929] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:02.949699 1190 log.cc:1199] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/0da93e4052094862a44812990df1136a
I20260616 19:52:02.950107 1190 ts_tablet_manager.cc:1950] T 0da93e4052094862a44812990df1136a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:02.950474 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 446) took 3222 ms. Trace:
I20260616 19:52:02.950587 1190 rpcz_store.cc:276] 0616 19:51:59.727998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.728154 (+ 156us) service_pool.cc:224] Handling call
0616 19:52:02.730638 (+3002484us) ts_tablet_manager.cc:1151] Deleting tablet 0da93e4052094862a44812990df1136a
0616 19:52:02.730646 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.836131 (+105485us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.856343 (+ 20212us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:02.950425 (+ 94082us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3001622}
I20260616 19:52:02.951083 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 0da93e4052094862a44812990df1136a (table default.Table_fe763512a640490ebb25dca52b04788a [id=ad67f2c8f60f4c8c9b4ca2e57ffdb6f1]) successfully deleted
I20260616 19:52:02.951514 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 449) took 3209 ms. Trace:
I20260616 19:52:02.951650 1190 rpcz_store.cc:276] 0616 19:51:59.742002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.754985 (+ 12983us) service_pool.cc:224] Handling call
0616 19:52:02.951352 (+3196367us) ts_tablet_manager.cc:1151] Deleting tablet 19b9248b88434a6e9ef7a3d602eee70c
0616 19:52:02.951362 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.951465 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3196013}
W20260616 19:52:02.952071 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 19b9248b88434a6e9ef7a3d602eee70c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19b9248b88434a6e9ef7a3d602eee70c already in progress: creating tablet
I20260616 19:52:02.952493 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 450) took 3210 ms. Trace:
I20260616 19:52:02.952622 1190 rpcz_store.cc:276] 0616 19:51:59.742121 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.755944 (+ 13823us) service_pool.cc:224] Handling call
0616 19:52:02.952318 (+3196374us) ts_tablet_manager.cc:1151] Deleting tablet 5029a79e046a489aa9976eff948a3c5b
0616 19:52:02.952326 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.952414 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3196171}
W20260616 19:52:02.953048 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 5029a79e046a489aa9976eff948a3c5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5029a79e046a489aa9976eff948a3c5b already in progress: creating tablet
I20260616 19:52:02.953466 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 451) took 3197 ms. Trace:
I20260616 19:52:02.953594 1190 rpcz_store.cc:276] 0616 19:51:59.756398 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.756636 (+ 238us) service_pool.cc:224] Handling call
0616 19:52:02.953295 (+3196659us) ts_tablet_manager.cc:1151] Deleting tablet 647b1abeb3c14b11b9a5c62b67e83cf8
0616 19:52:02.953305 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.953420 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3196406}
I20260616 19:52:02.953632 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7e558c6a3c4b44cc94a6ec89871cfa59" } new_table_name: "default.Table_3f3995c8244446469858bbd49b97cc81" modify_external_catalogs: true
I20260616 19:52:02.953922 1058 raft_consensus.cc:2468] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
W20260616 19:52:02.954072 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 647b1abeb3c14b11b9a5c62b67e83cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 647b1abeb3c14b11b9a5c62b67e83cf8 already in progress: creating tablet
I20260616 19:52:02.954360 858 leader_election.cc:304] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:02.954429 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 452) took 3197 ms. Trace:
I20260616 19:52:02.954977 1720 raft_consensus.cc:2804] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:02.955111 1720 raft_consensus.cc:697] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:02.955363 1720 consensus_queue.cc:237] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:02.960522 764 tablet_service.cc:1511] Processing CreateTablet for tablet b0b4d05e770845e0aa8e6a30a86babe8 (DEFAULT_TABLE table=default.Table_f39fe2b06c8c47e3bd6617baa83fe439 [id=ddb85d15124240789d29d3b021acda02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.960655 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8a8ebba0148c494180484e421fa045e3" } modify_external_catalogs: true
I20260616 19:52:02.960839 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8a8ebba0148c494180484e421fa045e3" } modify_external_catalogs: true
I20260616 19:52:02.961102 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b4d05e770845e0aa8e6a30a86babe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.963033 1192 tablet_bootstrap.cc:654] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:02.968132 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dafeb24a59948b28e26730194e29758 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:02.971079 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f872a8860a4b421483441d71814be4fc consensus state has no leader
I20260616 19:52:02.974865 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 46faf1477a4b4c9994e556308647cad3
I20260616 19:52:02.976104 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 46faf1477a4b4c9994e556308647cad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:02.978096 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 46faf1477a4b4c9994e556308647cad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:02.978617 891 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfa92a1ce0448c1ba877319cdd4e9b5 (DEFAULT_TABLE table=default.Table_f03a1110ec2a465ab56428dfb9d56c3b [id=30595ed6744d4449b1f613cf8b07677c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.980497 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfa92a1ce0448c1ba877319cdd4e9b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.954505 1190 rpcz_store.cc:276] 0616 19:51:59.757132 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.757335 (+ 203us) service_pool.cc:224] Handling call
0616 19:52:02.954279 (+3196944us) ts_tablet_manager.cc:1151] Deleting tablet 335f7411fda84fada762345010a4339c
0616 19:52:02.954287 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.954370 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3196778}
W20260616 19:52:02.982652 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 335f7411fda84fada762345010a4339c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 335f7411fda84fada762345010a4339c already in progress: creating tablet
I20260616 19:52:02.982604 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfa92a1ce0448c1ba877319cdd4e9b5 (DEFAULT_TABLE table=default.Table_f03a1110ec2a465ab56428dfb9d56c3b [id=30595ed6744d4449b1f613cf8b07677c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:02.983021 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfa92a1ce0448c1ba877319cdd4e9b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:02.983197 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 453) took 3105 ms. Trace:
I20260616 19:52:02.983325 1190 rpcz_store.cc:276] 0616 19:51:59.877328 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.877402 (+ 74us) service_pool.cc:224] Handling call
0616 19:52:02.982955 (+3105553us) ts_tablet_manager.cc:1151] Deleting tablet b251bdf373574dffb04f9e2c837cfe78
0616 19:52:02.982963 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.983146 (+ 183us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3095184}
W20260616 19:52:02.983822 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet b251bdf373574dffb04f9e2c837cfe78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b251bdf373574dffb04f9e2c837cfe78 already in progress: creating tablet
I20260616 19:52:02.984241 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 454) took 3106 ms. Trace:
I20260616 19:52:02.991832 1190 rpcz_store.cc:276] 0616 19:51:59.877463 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:59.877668 (+ 205us) service_pool.cc:224] Handling call
0616 19:52:02.984100 (+3106432us) ts_tablet_manager.cc:1151] Deleting tablet efd5fecc6d444e5fba9103287c09542e
0616 19:52:02.984109 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.984189 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3096294}
W20260616 19:52:02.995110 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet efd5fecc6d444e5fba9103287c09542e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efd5fecc6d444e5fba9103287c09542e already in progress: creating tablet
I20260616 19:52:03.001682 1190 tablet_replica.cc:333] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:03.001938 1190 raft_consensus.cc:2243] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:03.002270 1190 pending_rounds.cc:70] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:52:03.002379 1190 pending_rounds.cc:77] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595473351266304 op_type: NO_OP noop_request { }
I20260616 19:52:03.003022 1190 raft_consensus.cc:2889] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:03.003208 1190 raft_consensus.cc:2272] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:03.004086 1190 ts_tablet_manager.cc:1916] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.005316 1193 ts_tablet_manager.cc:1929] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:03.005471 1193 log.cc:1199] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/a93dd295602840319f72e7021ddfd61a
I20260616 19:52:03.005932 1193 ts_tablet_manager.cc:1950] T a93dd295602840319f72e7021ddfd61a P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:03.006421 455 master_service.cc:960] ReplaceTablet: received request to replace tablet c3706f41b0e342a69f66c936173f2ae0 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:03.006857 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 542) took 1460 ms. Trace:
I20260616 19:52:03.006987 1193 rpcz_store.cc:276] 0616 19:52:01.546320 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.549675 (+ 3355us) service_pool.cc:224] Handling call
0616 19:52:02.699272 (+1149597us) ts_tablet_manager.cc:1151] Deleting tablet a93dd295602840319f72e7021ddfd61a
0616 19:52:02.700408 (+ 1136us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.994882 (+294474us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.005216 (+ 10334us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.006818 (+ 1602us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1149362}
I20260616 19:52:03.007390 1193 tablet_replica.cc:333] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:03.009720 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ef97cbfc987249e68055ac2866180927"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.010608 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef97cbfc987249e68055ac2866180927 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.011583 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b31b1a4576bc486c965cd83367a24953" } new_table_name: "default.Table_5a4cc9df094d43d29034469341f07b12" modify_external_catalogs: true
I20260616 19:52:03.014333 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a84e0dab565b459c96cdce84214af742" } new_table_name: "default.Table_53ef12c3964e47fea4557953dcbd32fa" modify_external_catalogs: true
I20260616 19:52:03.016777 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3c5805a9d6b24b91818b5059b19c8605"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:03.016973 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0d0fae5747a8441a9d7f5abd3f5c2687" } new_table_name: "default.Table_be6915b4199141b5991602c3322b004e" modify_external_catalogs: true
W20260616 19:52:03.017290 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c5805a9d6b24b91818b5059b19c8605 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.018350 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2da181f5cbc54988a562cad81caaf1c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.018802 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2da181f5cbc54988a562cad81caaf1c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.019891 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7e5013ac144c4491beee89e3e66a5972"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:03.020105 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet a93dd295602840319f72e7021ddfd61a (table default.Table_289acf4951fa4f4888dae7ce3ef0fb6e [id=ec0c3e3aef034429b5cb31a106143a3d]) successfully deleted
W20260616 19:52:03.020321 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e5013ac144c4491beee89e3e66a5972 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.021790 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5470eb7f79a44e4e9b789e43ca62f3d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.022190 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5470eb7f79a44e4e9b789e43ca62f3d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.024581 748 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfa92a1ce0448c1ba877319cdd4e9b5 (DEFAULT_TABLE table=default.Table_f03a1110ec2a465ab56428dfb9d56c3b [id=30595ed6744d4449b1f613cf8b07677c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.025101 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfa92a1ce0448c1ba877319cdd4e9b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.029266 749 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcb663cf2e443f1acd4b18280378729 (DEFAULT_TABLE table=default.Table_d32f04655f8b45cab54470ba15670dcc [id=095459e6b60d42bf88daa282ca12266e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.029668 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcb663cf2e443f1acd4b18280378729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.032770 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8acc4e02fca3408ca9996c98f732938f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.033221 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8acc4e02fca3408ca9996c98f732938f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.036846 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bde746e334a4f59aded168c6b2bb348 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e2a3f93685146e9a7bf2713cc71dcb6) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.037164 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.037439 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 46faf1477a4b4c9994e556308647cad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.040751 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcb663cf2e443f1acd4b18280378729 (DEFAULT_TABLE table=default.Table_d32f04655f8b45cab54470ba15670dcc [id=095459e6b60d42bf88daa282ca12266e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.041185 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcb663cf2e443f1acd4b18280378729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.055634 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c3706f41b0e342a69f66c936173f2ae0
I20260616 19:52:03.056198 455 catalog_manager.cc:6784] ReplaceTablet: tablet c3706f41b0e342a69f66c936173f2ae0 deleted and replaced by tablet d69db202af9e4d4f86a9d8d40e9fe3af
I20260616 19:52:03.056178 1845 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:03.056592 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e620d37af90643a49c022902197a8b38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.057149 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e620d37af90643a49c022902197a8b38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.060204 750 tablet_service.cc:1511] Processing CreateTablet for tablet c1f764066289453c8cc3b0157260f397 (DEFAULT_TABLE table=default.Table_a707b4fa17524ae8a9589674a12ed919 [id=a335dbf9f8104625a90445cab115e29c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.060807 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f764066289453c8cc3b0157260f397. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:03.063879 1196 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.624s user 0.004s sys 0.020s
W20260616 19:52:03.064060 1196 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.624s user 0.004s sys 0.020s
I20260616 19:52:03.071523 1196 tablet_bootstrap.cc:492] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:03.071797 1196 ts_tablet_manager.cc:1403] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.809s user 0.007s sys 0.020s
I20260616 19:52:03.072877 1196 raft_consensus.cc:359] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:03.074350 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2171eb55560f44dd91ad52e0b5b49408 consensus state has no leader
I20260616 19:52:03.074731 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_449f169e33f9407da529eb6b6fa2391b" } new_table_name: "default.Table_f05f097bf69a4898afcc750f4aa55d7f" modify_external_catalogs: true
I20260616 19:52:03.075557 453 catalog_manager.cc:5696] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:03.076121 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 3de0e62cfd33410490a0b460fd5f69e9 (table default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]). Expected version 2 got 0
I20260616 19:52:03.076444 1196 raft_consensus.cc:385] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.076591 1196 raft_consensus.cc:740] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.076829 1196 consensus_queue.cc:260] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.078353 1196 ts_tablet_manager.cc:1434] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260616 19:52:03.078375 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1cbe171dfa104821bccfb19e1a0f5d3a consensus state has no leader
I20260616 19:52:03.079455 1803 raft_consensus.cc:493] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:52:03.079502 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77386c95d63047c1a3b779e53f54d33d consensus state has no leader
I20260616 19:52:03.079622 1803 raft_consensus.cc:515] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.080394 1803 leader_election.cc:290] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:03.082053 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da51a682de41402cb537ab113f876a2d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:03.082720 996 leader_election.cc:343] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:03.073366 1193 raft_consensus.cc:2243] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:03.083643 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet c3706f41b0e342a69f66c936173f2ae0 with delete_type TABLET_DATA_DELETED (replaced by tablet d69db202af9e4d4f86a9d8d40e9fe3af) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.085830 1193 pending_rounds.cc:70] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:03.085975 1193 pending_rounds.cc:77] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595481851228160 op_type: NO_OP noop_request { }
I20260616 19:52:03.086150 1193 raft_consensus.cc:2889] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:03.087278 1193 raft_consensus.cc:2272] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:03.087896 749 tablet_service.cc:1511] Processing CreateTablet for tablet d6bb4ec9cc354cb1aabbfeb06817d7f0 (DEFAULT_TABLE table=default.Table_c122cc9356db42c7818089c702bd75a6 [id=722f21885eab4670bd81095d40a813c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.090021 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6bb4ec9cc354cb1aabbfeb06817d7f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:03.090134 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f89a0c065a4a4fb7afa8cab29d78c2e5 consensus state has no leader
I20260616 19:52:03.098250 748 tablet_service.cc:1511] Processing CreateTablet for tablet ae290d65419740259a1887849703ddef (DEFAULT_TABLE table=default.Table_0d3438f6bffd41d9b903bdd1ac90f560 [id=fa13ffbb22694a8aa1aa7dd9e4d05378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.098814 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae290d65419740259a1887849703ddef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.099046 1193 ts_tablet_manager.cc:1916] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.074501 763 tablet_service.cc:1558] Processing DeleteTablet for tablet c3706f41b0e342a69f66c936173f2ae0 with delete_type TABLET_DATA_DELETED (replaced by tablet d69db202af9e4d4f86a9d8d40e9fe3af) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.099696 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da51a682de41402cb537ab113f876a2d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:03.102437 890 tablet_service.cc:1511] Processing CreateTablet for tablet c1f764066289453c8cc3b0157260f397 (DEFAULT_TABLE table=default.Table_a707b4fa17524ae8a9589674a12ed919 [id=a335dbf9f8104625a90445cab115e29c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.102842 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f764066289453c8cc3b0157260f397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.103312 887 tablet_service.cc:1511] Processing CreateTablet for tablet d6bb4ec9cc354cb1aabbfeb06817d7f0 (DEFAULT_TABLE table=default.Table_c122cc9356db42c7818089c702bd75a6 [id=722f21885eab4670bd81095d40a813c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.104027 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_841219ea0cab496193e59d354a6ab57f" } modify_external_catalogs: true
I20260616 19:52:03.104198 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_841219ea0cab496193e59d354a6ab57f" } modify_external_catalogs: true
I20260616 19:52:03.105445 900 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcb663cf2e443f1acd4b18280378729 (DEFAULT_TABLE table=default.Table_d32f04655f8b45cab54470ba15670dcc [id=095459e6b60d42bf88daa282ca12266e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.108656 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6bb4ec9cc354cb1aabbfeb06817d7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.110908 1191 ts_tablet_manager.cc:1929] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:03.095834 453 catalog_manager.cc:5696] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } }
I20260616 19:52:03.111316 1193 ts_tablet_manager.cc:1929] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:03.111472 1193 log.cc:1199] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/350453721d13427a946ac5c5ee7c62a0
I20260616 19:52:03.111934 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet d5741b92cafb4d53987dbeeef66ccd56 (table default.Table_a5a8fee8fc214408ae98d4e88d6f66a5 [id=ee6ce577050e45c5b9b014d3827e5046]). Expected version 1 got 0
I20260616 19:52:03.113884 456 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_b70123afde084dac9b1dfd2fc95935c7 [id=46c822de2dc2471d847af2e018102efc] alter complete (version 3)
I20260616 19:52:03.116757 1193 ts_tablet_manager.cc:1950] T 350453721d13427a946ac5c5ee7c62a0 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:03.117586 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 543) took 1570 ms. Trace:
I20260616 19:52:03.117703 1193 rpcz_store.cc:276] 0616 19:52:01.546604 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.549965 (+ 3361us) service_pool.cc:224] Handling call
0616 19:52:03.007317 (+1457352us) ts_tablet_manager.cc:1151] Deleting tablet 350453721d13427a946ac5c5ee7c62a0
0616 19:52:03.007329 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.085706 (+ 78377us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x6160001b1054. stack: 00007f140f1b8086 00007f140f1b7e40 00007f140e1713ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f141b1ec7e0 00007f141c538933 00007f141f0fbae7 00007f141f12ebb4 00007f141f10f5d0 00007f141f10f35d 0000000000aa681c 00007f140f1fdf6f 00007f140f20128b 00007f140f201108
0616 19:52:03.107801 (+ 22095us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.111225 (+ 3424us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.117548 (+ 6323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150542720,"tablet-delete.queue_time_us":1457104}
I20260616 19:52:03.118244 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 350453721d13427a946ac5c5ee7c62a0 (table default.Table_955814ce18d044e2b9e30c0074b7a8b0 [id=baa5ee1fdc8f4fb785c49501ba1c8144]) successfully deleted
I20260616 19:52:03.118633 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 547) took 1420 ms. Trace:
I20260616 19:52:03.118733 1193 rpcz_store.cc:276] 0616 19:52:01.698410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.698696 (+ 286us) service_pool.cc:224] Handling call
0616 19:52:03.118480 (+1419784us) ts_tablet_manager.cc:1151] Deleting tablet 0ca03b6e81e546adada566607257369f
0616 19:52:03.118489 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.118595 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1418864}
W20260616 19:52:03.119144 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0ca03b6e81e546adada566607257369f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ca03b6e81e546adada566607257369f already in progress: creating tablet
I20260616 19:52:03.119469 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 549) took 1420 ms. Trace:
I20260616 19:52:03.119570 1193 rpcz_store.cc:276] 0616 19:52:01.698649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.698766 (+ 117us) service_pool.cc:224] Handling call
0616 19:52:03.119358 (+1420592us) ts_tablet_manager.cc:1151] Deleting tablet 90852e10a6804cb1bee075b0e9c0eeaf
0616 19:52:03.119367 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.119439 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1419535}
W20260616 19:52:03.119938 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 90852e10a6804cb1bee075b0e9c0eeaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90852e10a6804cb1bee075b0e9c0eeaf already in progress: creating tablet
I20260616 19:52:03.120270 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 548) took 1421 ms. Trace:
I20260616 19:52:03.120365 1193 rpcz_store.cc:276] 0616 19:52:01.698534 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.698747 (+ 213us) service_pool.cc:224] Handling call
0616 19:52:03.120150 (+1421403us) ts_tablet_manager.cc:1151] Deleting tablet e6530753b4184cfe972ae3a43f23d589
0616 19:52:03.120158 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.120241 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1419843}
W20260616 19:52:03.120915 860 consensus_peers.cc:597] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:03.121104 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet e6530753b4184cfe972ae3a43f23d589 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6530753b4184cfe972ae3a43f23d589 already in progress: creating tablet
I20260616 19:52:03.121443 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 546) took 1424 ms. Trace:
I20260616 19:52:03.121601 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c0f19c77783a4b53b160589b74dbd20d
I20260616 19:52:03.121551 1193 rpcz_store.cc:276] 0616 19:52:01.697362 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.699137 (+ 1775us) service_pool.cc:224] Handling call
0616 19:52:03.121323 (+1422186us) ts_tablet_manager.cc:1151] Deleting tablet 1a7b177800174706a985c11e5876b9d3
0616 19:52:03.121331 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.121409 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1420519}
I20260616 19:52:03.121822 1732 fs_manager.cc:714] Time spent opening directory manager: real 0.171s user 0.004s sys 0.039s
I20260616 19:52:03.122253 763 tablet_service.cc:1558] Processing DeleteTablet for tablet c0f19c77783a4b53b160589b74dbd20d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:03.122565 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1a7b177800174706a985c11e5876b9d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a7b177800174706a985c11e5876b9d3 already in progress: creating tablet
I20260616 19:52:03.122853 1193 tablet_replica.cc:333] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:03.123075 1193 raft_consensus.cc:2243] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:03.123314 1193 pending_rounds.cc:70] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:03.123392 1193 pending_rounds.cc:77] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595485862346752 op_type: NO_OP noop_request { }
I20260616 19:52:03.123503 1193 raft_consensus.cc:2889] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:03.123643 1193 raft_consensus.cc:2272] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:03.124938 1193 ts_tablet_manager.cc:1916] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.124953 1801 raft_consensus.cc:493] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.125106 1801 raft_consensus.cc:515] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.125679 888 tablet_service.cc:1558] Processing DeleteTablet for tablet c3706f41b0e342a69f66c936173f2ae0 with delete_type TABLET_DATA_DELETED (replaced by tablet d69db202af9e4d4f86a9d8d40e9fe3af) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.126458 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9d7e4f47840e4f26bc2ee3c1ae553a0c" } modify_external_catalogs: true
I20260616 19:52:03.126663 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9d7e4f47840e4f26bc2ee3c1ae553a0c" } modify_external_catalogs: true
I20260616 19:52:03.128113 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcb663cf2e443f1acd4b18280378729. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:03.130497 860 leader_election.cc:343] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: a93dd295602840319f72e7021ddfd61a
I20260616 19:52:03.130676 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_52ebd4cc32a242b6af90514f289aaffd" } modify_external_catalogs: true
I20260616 19:52:03.130892 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_52ebd4cc32a242b6af90514f289aaffd" } modify_external_catalogs: true
I20260616 19:52:03.131125 888 tablet_service.cc:1558] Processing DeleteTablet for tablet c0f19c77783a4b53b160589b74dbd20d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.127209 1801 leader_election.cc:290] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:03.134706 1193 ts_tablet_manager.cc:1929] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:03.134826 1193 log.cc:1199] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/8125dce4d32a416498b42a1b599355fd
I20260616 19:52:03.135226 1193 ts_tablet_manager.cc:1950] T 8125dce4d32a416498b42a1b599355fd P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:03.135979 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 551) took 1425 ms. Trace:
I20260616 19:52:03.136102 1193 rpcz_store.cc:276] 0616 19:52:01.710805 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.714682 (+ 3877us) service_pool.cc:224] Handling call
0616 19:52:03.122797 (+1408115us) ts_tablet_manager.cc:1151] Deleting tablet 8125dce4d32a416498b42a1b599355fd
0616 19:52:03.122804 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.130564 (+ 7760us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.134623 (+ 4059us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.135945 (+ 1322us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1407911}
I20260616 19:52:03.136556 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 8125dce4d32a416498b42a1b599355fd (table default.Table_7713a34d9f7e4031a42f66ee98382545 [id=6f77a88fd07a47cfbef0a061968dda5c]) successfully deleted
I20260616 19:52:03.136915 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 555) took 1394 ms. Trace:
I20260616 19:52:03.137051 1193 rpcz_store.cc:276] 0616 19:52:01.741947 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.742428 (+ 481us) service_pool.cc:224] Handling call
0616 19:52:03.136782 (+1394354us) ts_tablet_manager.cc:1151] Deleting tablet f54eef97f8db47449564b49be608902f
0616 19:52:03.136792 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.136886 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1380109}
W20260616 19:52:03.137562 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f54eef97f8db47449564b49be608902f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f54eef97f8db47449564b49be608902f already in progress: creating tablet
I20260616 19:52:03.137920 1193 tablet_replica.cc:333] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:03.138190 1193 raft_consensus.cc:2243] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:03.138543 1193 raft_consensus.cc:2272] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:03.139235 1193 ts_tablet_manager.cc:1916] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.146234 460 master_service.cc:960] ReplaceTablet: received request to replace tablet e1ab9d0ac7df4d549d52014a0ecd9d1a from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:03.112002 1034 tablet_service.cc:1511] Processing CreateTablet for tablet c1f764066289453c8cc3b0157260f397 (DEFAULT_TABLE table=default.Table_a707b4fa17524ae8a9589674a12ed919 [id=a335dbf9f8104625a90445cab115e29c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.147392 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f764066289453c8cc3b0157260f397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.112810 1030 tablet_service.cc:1511] Processing CreateTablet for tablet d6bb4ec9cc354cb1aabbfeb06817d7f0 (DEFAULT_TABLE table=default.Table_c122cc9356db42c7818089c702bd75a6 [id=722f21885eab4670bd81095d40a813c0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:03.121362 993 leader_election.cc:343] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:03.148656 993 leader_election.cc:304] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:03.148783 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6bb4ec9cc354cb1aabbfeb06817d7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.122421 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet c0f19c77783a4b53b160589b74dbd20d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.122937 1198 tablet_bootstrap.cc:492] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:03.154623 1198 ts_tablet_manager.cc:1403] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.310s user 0.012s sys 0.084s
I20260616 19:52:03.155712 1198 raft_consensus.cc:359] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.155959 1198 raft_consensus.cc:385] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.156062 1198 raft_consensus.cc:740] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.156304 1198 consensus_queue.cc:260] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.134582 1803 raft_consensus.cc:493] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.156849 1803 raft_consensus.cc:515] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.157737 1803 leader_election.cc:290] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:03.157928 1803 raft_consensus.cc:2749] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:03.164939 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3587c1ab487a424eb82f378ae081f514" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:03.165725 996 leader_election.cc:343] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:03.170307 1801 raft_consensus.cc:493] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.171478 1801 raft_consensus.cc:515] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.172490 1196 tablet_bootstrap.cc:492] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:03.173606 890 tablet_service.cc:1511] Processing CreateTablet for tablet ae290d65419740259a1887849703ddef (DEFAULT_TABLE table=default.Table_0d3438f6bffd41d9b903bdd1ac90f560 [id=fa13ffbb22694a8aa1aa7dd9e4d05378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.175001 1801 leader_election.cc:290] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:03.175704 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb024637294148c18b74bef47fb2fcce" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:03.175966 778 raft_consensus.cc:2468] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:03.176723 1196 tablet_bootstrap.cc:654] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.176743 860 leader_election.cc:304] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:03.174410 1191 log.cc:1199] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/8125dce4d32a416498b42a1b599355fd
I20260616 19:52:03.177917 1191 ts_tablet_manager.cc:1950] T 8125dce4d32a416498b42a1b599355fd P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:03.178805 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 525) took 2014 ms. Trace:
I20260616 19:52:03.178907 1191 rpcz_store.cc:276] 0616 19:52:01.164333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.164371 (+ 38us) service_pool.cc:224] Handling call
0616 19:52:02.879695 (+1715324us) ts_tablet_manager.cc:1151] Deleting tablet 8125dce4d32a416498b42a1b599355fd
0616 19:52:02.879706 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:02.979732 (+100026us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.110836 (+131104us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.178740 (+ 67904us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1715111}
I20260616 19:52:03.179373 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 526) took 1920 ms. Trace:
I20260616 19:52:03.179450 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 8125dce4d32a416498b42a1b599355fd (table default.Table_7713a34d9f7e4031a42f66ee98382545 [id=6f77a88fd07a47cfbef0a061968dda5c]) successfully deleted
I20260616 19:52:03.179473 1191 rpcz_store.cc:276] 0616 19:52:01.258701 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.258935 (+ 234us) service_pool.cc:224] Handling call
0616 19:52:03.179202 (+1920267us) ts_tablet_manager.cc:1151] Deleting tablet 9105320d5b36457d9dd74b553a44db2c
0616 19:52:03.179213 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.179326 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1920011}
I20260616 19:52:03.179823 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 527) took 1888 ms. Trace:
I20260616 19:52:03.179900 1191 rpcz_store.cc:276] 0616 19:52:01.291197 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.291278 (+ 81us) service_pool.cc:224] Handling call
0616 19:52:03.179687 (+1888409us) ts_tablet_manager.cc:1151] Deleting tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7
0616 19:52:03.179695 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.179769 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1888108}
W20260616 19:52:03.180059 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 9105320d5b36457d9dd74b553a44db2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9105320d5b36457d9dd74b553a44db2c already in progress: creating tablet
I20260616 19:52:03.180156 1191 tablet_replica.cc:333] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:03.180331 1191 raft_consensus.cc:2243] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:03.180562 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 already in progress: creating tablet
W20260616 19:52:03.180577 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 45321.5us
I20260616 19:52:03.182585 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5378b2a86ed9456e9da1b5af2bb92ce7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.183151 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5378b2a86ed9456e9da1b5af2bb92ce7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.182183 1801 raft_consensus.cc:2804] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:03.184252 1801 raft_consensus.cc:493] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:03.184700 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_63b7e3fef1bf4a09bf9ca314f19f5eec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.185108 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63b7e3fef1bf4a09bf9ca314f19f5eec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.186230 1193 ts_tablet_manager.cc:1929] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:03.186353 1193 log.cc:1199] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/59812b232848488b9894e8f8057e9def
I20260616 19:52:03.186806 1193 ts_tablet_manager.cc:1950] T 59812b232848488b9894e8f8057e9def P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:03.187724 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 545) took 1490 ms. Trace:
I20260616 19:52:03.187831 1193 rpcz_store.cc:276] 0616 19:52:01.697250 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.700110 (+ 2860us) service_pool.cc:224] Handling call
0616 19:52:03.137823 (+1437713us) ts_tablet_manager.cc:1151] Deleting tablet 59812b232848488b9894e8f8057e9def
0616 19:52:03.137839 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.143379 (+ 5540us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.186151 (+ 42772us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.187663 (+ 1512us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1185213}
I20260616 19:52:03.187925 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_92a53fd7dd1a4e9892c00c79c31c53f1" } new_table_name: "default.Table_ece3f5e58baa45dfb295c03ab6a85f01" modify_external_catalogs: true
I20260616 19:52:03.188369 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 59812b232848488b9894e8f8057e9def (table default.Table_191f8acd55ae4da9982a9fb3ec2d51cd [id=1beb7d130df7492ab9b834d005eba63a]) successfully deleted
I20260616 19:52:03.188864 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cf880b7d3c21448793fe88b254cf5a2c" } modify_external_catalogs: true
I20260616 19:52:03.189073 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cf880b7d3c21448793fe88b254cf5a2c" } modify_external_catalogs: true
I20260616 19:52:03.192066 1801 raft_consensus.cc:3060] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:03.194414 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 580) took 1016 ms. Trace:
I20260616 19:52:03.194538 1193 rpcz_store.cc:276] 0616 19:52:02.177724 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.195137 (+ 17413us) service_pool.cc:224] Handling call
0616 19:52:03.194216 (+999079us) ts_tablet_manager.cc:1151] Deleting tablet 9a354b06adc343ef94b295916d582b49
0616 19:52:03.194231 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.194350 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":943174}
I20260616 19:52:03.194695 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 64aa32856ca34743933931fb51f2bd7b
W20260616 19:52:03.195246 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 9a354b06adc343ef94b295916d582b49 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a354b06adc343ef94b295916d582b49 already in progress: creating tablet
I20260616 19:52:03.195784 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 64aa32856ca34743933931fb51f2bd7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.196925 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 64aa32856ca34743933931fb51f2bd7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:03.199405 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8c19c2e43a944893b86982bee1eb2f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c19c2e43a944893b86982bee1eb2f30 already in progress: creating tablet
I20260616 19:52:03.199952 1801 raft_consensus.cc:515] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:03.200629 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c239a24dbdc047f9beb2ed7e1492acfe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c239a24dbdc047f9beb2ed7e1492acfe already in progress: creating tablet
W20260616 19:52:03.201637 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 already in progress: creating tablet
I20260616 19:52:03.202018 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb024637294148c18b74bef47fb2fcce" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:03.202267 777 raft_consensus.cc:3060] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:03.205506 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f1a09d62e68148349b337c5075763672 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1a09d62e68148349b337c5075763672 already in progress: creating tablet
I20260616 19:52:03.206130 1193 tablet_replica.cc:333] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:03.206396 1193 raft_consensus.cc:2243] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:03.206794 1193 raft_consensus.cc:2272] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:03.207495 1193 ts_tablet_manager.cc:1916] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.208541 1196 tablet_bootstrap.cc:492] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:03.208745 1196 ts_tablet_manager.cc:1403] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.130s user 0.003s sys 0.007s
I20260616 19:52:03.209694 1196 raft_consensus.cc:359] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.209973 1196 raft_consensus.cc:385] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.210090 1196 raft_consensus.cc:740] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.210151 1852 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:03.210464 1196 consensus_queue.cc:260] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.211674 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_15f01a98a5844f30a111f3640753af1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:03.212249 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9d9c89216995430188b1eed4c6b26d1e
W20260616 19:52:03.212328 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15f01a98a5844f30a111f3640753af1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.213963 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d9c89216995430188b1eed4c6b26d1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.214663 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7e1dbf9e64af41fc9d18cf1267dad2ee" } modify_external_catalogs: true
I20260616 19:52:03.214965 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7e1dbf9e64af41fc9d18cf1267dad2ee" } modify_external_catalogs: true
I20260616 19:52:03.215030 1196 ts_tablet_manager.cc:1434] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260616 19:52:03.215423 1196 tablet_bootstrap.cc:492] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:03.217954 1196 tablet_bootstrap.cc:654] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.218475 1801 leader_election.cc:290] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:03.218950 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d9c89216995430188b1eed4c6b26d1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.225227 750 tablet_service.cc:1511] Processing CreateTablet for tablet 0b249e29f69943f287411783b84c6817 (DEFAULT_TABLE table=default.Table_838d3611ece94aee9524fc9a2d485353 [id=eb0ea3ba9ba04c76b890aac44b32c082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.225718 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b249e29f69943f287411783b84c6817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.227450 749 tablet_service.cc:1511] Processing CreateTablet for tablet 364efb99afe14132b7857f694ba3be2b (DEFAULT_TABLE table=default.Table_be7daca5af8f4b14b93e1f45984f985f [id=00a44c65a0ad4bfdb305e29bb6214303]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.227916 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 364efb99afe14132b7857f694ba3be2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.234242 887 tablet_service.cc:1511] Processing CreateTablet for tablet 0b249e29f69943f287411783b84c6817 (DEFAULT_TABLE table=default.Table_838d3611ece94aee9524fc9a2d485353 [id=eb0ea3ba9ba04c76b890aac44b32c082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.246352 777 raft_consensus.cc:2468] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:03.247181 748 tablet_service.cc:1511] Processing CreateTablet for tablet f5881fac8f6e45e7a4c5cff07aca8ce4 (DEFAULT_TABLE table=default.Table_fab90e4faa8a4f4ba8ef27e88ab0b680 [id=0cd0b656c6524fab831ab85d6c9f0e3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.247802 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5881fac8f6e45e7a4c5cff07aca8ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.249183 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet e1ab9d0ac7df4d549d52014a0ecd9d1a
I20260616 19:52:03.249768 460 catalog_manager.cc:6784] ReplaceTablet: tablet e1ab9d0ac7df4d549d52014a0ecd9d1a deleted and replaced by tablet 0dc52e26f5554d789addb5923a612070
I20260616 19:52:03.249912 750 tablet_service.cc:1558] Processing DeleteTablet for tablet e1ab9d0ac7df4d549d52014a0ecd9d1a with delete_type TABLET_DATA_DELETED (replaced by tablet 0dc52e26f5554d789addb5923a612070) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.251885 750 tablet_service.cc:1511] Processing CreateTablet for tablet cf1ab0a125cf46e9a1afc625297db7af (DEFAULT_TABLE table=default.Table_279bcff593544d69870123063bfb53b9 [id=1c4ce9c6d1f84de482187f96b67695cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.252552 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1ab0a125cf46e9a1afc625297db7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.252704 860 leader_election.cc:304] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:03.253701 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae290d65419740259a1887849703ddef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.255276 888 tablet_service.cc:1558] Processing DeleteTablet for tablet e1ab9d0ac7df4d549d52014a0ecd9d1a with delete_type TABLET_DATA_DELETED (replaced by tablet 0dc52e26f5554d789addb5923a612070) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.256070 1192 tablet_bootstrap.cc:492] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:03.256946 1801 raft_consensus.cc:2804] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:03.257424 893 tablet_service.cc:1511] Processing CreateTablet for tablet f5881fac8f6e45e7a4c5cff07aca8ce4 (DEFAULT_TABLE table=default.Table_fab90e4faa8a4f4ba8ef27e88ab0b680 [id=0cd0b656c6524fab831ab85d6c9f0e3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.258563 1801 raft_consensus.cc:697] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:03.258893 1801 consensus_queue.cc:237] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.259637 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b249e29f69943f287411783b84c6817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.262209 1191 raft_consensus.cc:2272] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:03.262789 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 364efb99afe14132b7857f694ba3be2b (DEFAULT_TABLE table=default.Table_be7daca5af8f4b14b93e1f45984f985f [id=00a44c65a0ad4bfdb305e29bb6214303]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.263489 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 0b249e29f69943f287411783b84c6817 (DEFAULT_TABLE table=default.Table_838d3611ece94aee9524fc9a2d485353 [id=eb0ea3ba9ba04c76b890aac44b32c082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.263648 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 364efb99afe14132b7857f694ba3be2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.263833 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b249e29f69943f287411783b84c6817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.263211 1032 tablet_service.cc:1511] Processing CreateTablet for tablet f5881fac8f6e45e7a4c5cff07aca8ce4 (DEFAULT_TABLE table=default.Table_fab90e4faa8a4f4ba8ef27e88ab0b680 [id=0cd0b656c6524fab831ab85d6c9f0e3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.264307 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5881fac8f6e45e7a4c5cff07aca8ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.262764 1803 raft_consensus.cc:493] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.264600 1803 raft_consensus.cc:515] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.265234 1803 leader_election.cc:290] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:03.262910 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet e1ab9d0ac7df4d549d52014a0ecd9d1a with delete_type TABLET_DATA_DELETED (replaced by tablet 0dc52e26f5554d789addb5923a612070) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.262943 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d9c89216995430188b1eed4c6b26d1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.263211 1039 tablet_service.cc:1511] Processing CreateTablet for tablet ae290d65419740259a1887849703ddef (DEFAULT_TABLE table=default.Table_0d3438f6bffd41d9b903bdd1ac90f560 [id=fa13ffbb22694a8aa1aa7dd9e4d05378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.268906 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 64aa32856ca34743933931fb51f2bd7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.268975 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae290d65419740259a1887849703ddef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.269120 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 15d6a025b9a248c5ab9422fe1c340f3e with delete_type TABLET_DATA_DELETED (replaced by tablet db750fc9641f492494fdb167de86f6df) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.272338 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 731473c9021a4522ae2dfecff22c60e6
I20260616 19:52:03.273463 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 731473c9021a4522ae2dfecff22c60e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:03.278328 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5c82b71969e4cbcb890d16e1cdd5348 consensus state has no leader
I20260616 19:52:03.279322 1033 tablet_service.cc:1511] Processing CreateTablet for tablet cf1ab0a125cf46e9a1afc625297db7af (DEFAULT_TABLE table=default.Table_279bcff593544d69870123063bfb53b9 [id=1c4ce9c6d1f84de482187f96b67695cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.279673 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 731473c9021a4522ae2dfecff22c60e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.280330 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b6a04b83dfdc40eda84e5090f4f315bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.280882 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6a04b83dfdc40eda84e5090f4f315bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:03.280879 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 159511us
I20260616 19:52:03.282053 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d2da0df1a65d4d588c4666b703fb9e3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.282552 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2da0df1a65d4d588c4666b703fb9e3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.283458 750 tablet_service.cc:1511] Processing CreateTablet for tablet 81618a3f43ad40fc8173e266cc106899 (DEFAULT_TABLE table=default.Table_98dfc128f98d405bb94b36098e43025f [id=06387be97c9c486ea549edbe384d0ce7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.283711 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44422ddb8ce45a48bb9aaeb6c209f21" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:03.283880 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81618a3f43ad40fc8173e266cc106899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.284019 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb024637294148c18b74bef47fb2fcce" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:03.284250 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_101fa88aedce4c9883f9cf7d0c2bb05c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.284818 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_101fa88aedce4c9883f9cf7d0c2bb05c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.286495 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9319f6312d3a460090760936118e8ec9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.286990 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9319f6312d3a460090760936118e8ec9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.288522 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f03a1110ec2a465ab56428dfb9d56c3b" } new_table_name: "default.Table_4003eb071717454ca2cc028a19cf074d" modify_external_catalogs: true
I20260616 19:52:03.286569 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_07eed597d0b3413ab7b4f848b24b9812"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:03.290283 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 81618a3f43ad40fc8173e266cc106899 (DEFAULT_TABLE table=default.Table_98dfc128f98d405bb94b36098e43025f [id=06387be97c9c486ea549edbe384d0ce7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:03.290506 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07eed597d0b3413ab7b4f848b24b9812 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.291115 749 tablet_service.cc:1511] Processing CreateTablet for tablet b18f270bdda4413d811e2a32ade37dd3 (DEFAULT_TABLE table=default.Table_b1e42d7ed6304430a453bb9184363f77 [id=e75a6e5e4f0047d9b398ce230b170131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.291486 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18f270bdda4413d811e2a32ade37dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.292900 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c090cf49c61e487a974d953ed1903db7
I20260616 19:52:03.293712 764 tablet_service.cc:1558] Processing DeleteTablet for tablet c090cf49c61e487a974d953ed1903db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.293968 1060 raft_consensus.cc:2468] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:03.293978 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44422ddb8ce45a48bb9aaeb6c209f21" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:03.294255 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb024637294148c18b74bef47fb2fcce" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:03.294436 1058 raft_consensus.cc:3060] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:03.294756 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet c090cf49c61e487a974d953ed1903db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.296342 764 tablet_service.cc:1558] Processing DeleteTablet for tablet eb024637294148c18b74bef47fb2fcce with delete_type TABLET_DATA_DELETED (replaced by tablet 64aa32856ca34743933931fb51f2bd7b) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.296689 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 8125dce4d32a416498b42a1b599355fd with delete_type TABLET_DATA_DELETED (replaced by tablet 9060de590fa84ea08dc7d39765bc9308) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.297119 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 350453721d13427a946ac5c5ee7c62a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:03.297861 993 leader_election.cc:343] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:03.298141 996 leader_election.cc:343] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:03.298588 996 leader_election.cc:304] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:03.298879 1191 ts_tablet_manager.cc:1916] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.298935 1803 raft_consensus.cc:2749] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:03.299504 1847 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260616 19:52:03.300099 858 leader_election.cc:343] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: a93dd295602840319f72e7021ddfd61a
I20260616 19:52:03.300335 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5881fac8f6e45e7a4c5cff07aca8ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.301069 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1ab0a125cf46e9a1afc625297db7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.301630 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81618a3f43ad40fc8173e266cc106899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.301802 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_68ba1310c9ab4ace8e8253f756863107"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.302335 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68ba1310c9ab4ace8e8253f756863107 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.305029 1032 tablet_service.cc:1511] Processing CreateTablet for tablet b18f270bdda4413d811e2a32ade37dd3 (DEFAULT_TABLE table=default.Table_b1e42d7ed6304430a453bb9184363f77 [id=e75a6e5e4f0047d9b398ce230b170131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.305027 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f836a17118c9405d96e7581590b7ec0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.305509 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f836a17118c9405d96e7581590b7ec0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.305449 749 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3ceee3ed9145f097bcb272eb896e66 (DEFAULT_TABLE table=default.Table_d3601aa415b44973be55e69c2ea3ee5e [id=e690ed0661ec4ceb82cd6fff82151b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.305685 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18f270bdda4413d811e2a32ade37dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.305842 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3ceee3ed9145f097bcb272eb896e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.306870 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6425c298b87c4b6ba30e2944f06792d8" } new_table_name: "default.Table_7a777a2aa2cd44d1b7f9db66e8367a32" modify_external_catalogs: true
I20260616 19:52:03.308223 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_64de4a339ae243949520501b01d8c41a" } new_table_name: "default.Table_e4c0822e542a470bbe5568007bdc9883" modify_external_catalogs: true
I20260616 19:52:03.313243 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3587c1ab487a424eb82f378ae081f514" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:03.314610 858 leader_election.cc:304] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:03.315534 891 tablet_service.cc:1511] Processing CreateTablet for tablet 364efb99afe14132b7857f694ba3be2b (DEFAULT_TABLE table=default.Table_be7daca5af8f4b14b93e1f45984f985f [id=00a44c65a0ad4bfdb305e29bb6214303]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.316905 1720 raft_consensus.cc:2749] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:03.317196 1196 tablet_bootstrap.cc:492] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:03.317389 1196 ts_tablet_manager.cc:1403] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.102s user 0.003s sys 0.000s
I20260616 19:52:03.318509 1196 raft_consensus.cc:359] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.318760 1196 raft_consensus.cc:385] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.318859 1196 raft_consensus.cc:740] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.319090 1196 consensus_queue.cc:260] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.320070 1196 ts_tablet_manager.cc:1434] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260616 19:52:03.320749 1196 tablet_bootstrap.cc:492] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:03.322770 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_31c35a01c5a3478992e6533efb32d555" } new_table_name: "default.Table_3bc2c54c225040748a5b58ee0f6c9f70" modify_external_catalogs: true
I20260616 19:52:03.323163 1192 ts_tablet_manager.cc:1403] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.383s user 0.008s sys 0.005s
I20260616 19:52:03.324050 1196 tablet_bootstrap.cc:654] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.326129 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f85a1250cf4542d0802dc876e5da7b25" } modify_external_catalogs: true
I20260616 19:52:03.326306 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f85a1250cf4542d0802dc876e5da7b25" } modify_external_catalogs: true
I20260616 19:52:03.326602 763 tablet_service.cc:1511] Processing CreateTablet for tablet d9f9cd8a901e41b0a92d7d37ed338ee9 (DEFAULT_TABLE table=default.Table_38a9745c06b24df1a9c2a5865aa12075 [id=522a3615be8349dd9db1f00a5dc5f400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.327001 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f9cd8a901e41b0a92d7d37ed338ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.328069 764 tablet_service.cc:1511] Processing CreateTablet for tablet 731473c9021a4522ae2dfecff22c60e6 (DEFAULT_TABLE table=default.Table_cf880b7d3c21448793fe88b254cf5a2c [id=942900e08d78416db72e7e0b4c9487fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.328512 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731473c9021a4522ae2dfecff22c60e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:03.338250 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2dfa92a1ce0448c1ba877319cdd4e9b5 consensus state has no leader
W20260616 19:52:03.349862 445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:43055, user_credentials={real_user=slave}} blocked reactor thread for 94120.5us
I20260616 19:52:03.350885 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 731473c9021a4522ae2dfecff22c60e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.351863 888 tablet_service.cc:1511] Processing CreateTablet for tablet cf1ab0a125cf46e9a1afc625297db7af (DEFAULT_TABLE table=default.Table_279bcff593544d69870123063bfb53b9 [id=1c4ce9c6d1f84de482187f96b67695cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.352746 1846 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:03.353228 885 tablet_service.cc:1511] Processing CreateTablet for tablet 81618a3f43ad40fc8173e266cc106899 (DEFAULT_TABLE table=default.Table_98dfc128f98d405bb94b36098e43025f [id=06387be97c9c486ea549edbe384d0ce7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.353866 903 tablet_service.cc:1558] Processing DeleteTablet for tablet c090cf49c61e487a974d953ed1903db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.355165 892 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3ceee3ed9145f097bcb272eb896e66 (DEFAULT_TABLE table=default.Table_d3601aa415b44973be55e69c2ea3ee5e [id=e690ed0661ec4ceb82cd6fff82151b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.355851 899 tablet_service.cc:1511] Processing CreateTablet for tablet d9f9cd8a901e41b0a92d7d37ed338ee9 (DEFAULT_TABLE table=default.Table_38a9745c06b24df1a9c2a5865aa12075 [id=522a3615be8349dd9db1f00a5dc5f400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.357378 893 tablet_service.cc:1511] Processing CreateTablet for tablet b18f270bdda4413d811e2a32ade37dd3 (DEFAULT_TABLE table=default.Table_b1e42d7ed6304430a453bb9184363f77 [id=e75a6e5e4f0047d9b398ce230b170131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.357726 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 364efb99afe14132b7857f694ba3be2b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:03.359131 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 43935.3us
I20260616 19:52:03.362740 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 39f52eebdc79460a9ff33191086e87c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e8160ad4cf74f16a586ae59291ce7d1) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.359351 904 tablet_service.cc:1511] Processing CreateTablet for tablet 731473c9021a4522ae2dfecff22c60e6 (DEFAULT_TABLE table=default.Table_cf880b7d3c21448793fe88b254cf5a2c [id=942900e08d78416db72e7e0b4c9487fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.365279 1732 fs_manager.cc:730] Time spent opening block manager: real 0.240s user 0.012s sys 0.024s
I20260616 19:52:03.365402 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1ab0a125cf46e9a1afc625297db7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.365502 1732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data,/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/wal
uuid: "2b8fb7a8523741a2b7a5e75d8b415be0"
format_stamp: "Formatted at 2026-06-16 19:51:47 on dist-test-slave-s7fg"
I20260616 19:52:03.366559 1732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260616 19:52:03.382843 750 tablet_service.cc:1558] Processing DeleteTablet for tablet b99740ab59f947aabcac88dc2bf2de86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.383980 456 master_service.cc:960] ReplaceTablet: received request to replace tablet e6530753b4184cfe972ae3a43f23d589 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:03.360411 1192 raft_consensus.cc:359] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.394349 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81618a3f43ad40fc8173e266cc106899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.395934 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f9cd8a901e41b0a92d7d37ed338ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.398048 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731473c9021a4522ae2dfecff22c60e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.399175 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_730210c795214b2bb698287fcbd1bde3" } modify_external_catalogs: true
I20260616 19:52:03.399394 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_730210c795214b2bb698287fcbd1bde3" } modify_external_catalogs: true
I20260616 19:52:03.399655 1192 raft_consensus.cc:385] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.399798 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3ceee3ed9145f097bcb272eb896e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.402509 1751 raft_consensus.cc:493] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.404517 1192 raft_consensus.cc:740] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.404923 1192 consensus_queue.cc:260] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.405433 1192 ts_tablet_manager.cc:1434] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.082s user 0.002s sys 0.000s
I20260616 19:52:03.405795 1192 tablet_bootstrap.cc:492] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:52:03.407124 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eed22bbef8ef479dad179b96ba850d26 consensus state has no leader
I20260616 19:52:03.407481 1192 tablet_bootstrap.cc:654] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.407604 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2e059efed3da48b9a516fd3905f6d298
W20260616 19:52:03.410171 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet daf86e5d5f2341c78705f78c02695c17 consensus state has no leader
W20260616 19:52:03.411041 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5b34d497f9334e94b06cc9245fca04ed consensus state has no leader
I20260616 19:52:03.413777 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2b7f591d97bc4571b294b06d990d4065
I20260616 19:52:03.415578 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b7f591d97bc4571b294b06d990d4065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.416355 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb" } modify_external_catalogs: true
I20260616 19:52:03.416548 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb" } modify_external_catalogs: true
I20260616 19:52:03.420842 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e059efed3da48b9a516fd3905f6d298 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.423869 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 6b0f5388a73143569012ed714e53a8be
I20260616 19:52:03.426403 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b0f5388a73143569012ed714e53a8be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:03.429706 993 leader_election.cc:343] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:03.430330 993 leader_election.cc:304] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:03.430684 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 116516us
I20260616 19:52:03.431035 1803 raft_consensus.cc:2749] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:03.432755 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18f270bdda4413d811e2a32ade37dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.455957 1198 ts_tablet_manager.cc:1434] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.301s user 0.040s sys 0.047s
I20260616 19:52:03.461113 1198 tablet_bootstrap.cc:492] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:03.463332 1198 tablet_bootstrap.cc:654] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.473790 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1c8339d31a3a4ba9b8678eee3e23edbd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.474387 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c8339d31a3a4ba9b8678eee3e23edbd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.476722 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_11151a450eb946fda594d28bd1e72fa5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.477248 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11151a450eb946fda594d28bd1e72fa5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.478335 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2b005a492d164f608d275c8e23da534a" } modify_external_catalogs: true
I20260616 19:52:03.478511 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2b005a492d164f608d275c8e23da534a" } modify_external_catalogs: true
I20260616 19:52:03.480595 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ea9b8ba668410bae016a008cf37910 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.481026 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_62b93909f63642cda25a0d17ce9b567c" } new_table_name: "default.Table_093bd1c50f834db49bf52da0c66fae6d" modify_external_catalogs: true
I20260616 19:52:03.483242 1058 raft_consensus.cc:2468] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:03.483829 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cce34f3008e44c63bd5961fdfe303d9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.484328 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cce34f3008e44c63bd5961fdfe303d9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.497175 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e4c0822e542a470bbe5568007bdc9883" } modify_external_catalogs: true
I20260616 19:52:03.497388 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e4c0822e542a470bbe5568007bdc9883" } modify_external_catalogs: true
I20260616 19:52:03.503242 1198 tablet_bootstrap.cc:492] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:03.503517 1198 ts_tablet_manager.cc:1403] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.003s
I20260616 19:52:03.504067 1190 ts_tablet_manager.cc:1929] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:03.504244 1190 log.cc:1199] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/d3645fc39d974bffa8fe52c62e1c7eff
I20260616 19:52:03.504731 1190 ts_tablet_manager.cc:1950] T d3645fc39d974bffa8fe52c62e1c7eff P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:03.504777 1198 raft_consensus.cc:359] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.505259 1198 raft_consensus.cc:385] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.505509 1198 raft_consensus.cc:740] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.506381 1198 consensus_queue.cc:260] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.507151 1198 ts_tablet_manager.cc:1434] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:03.508019 1198 tablet_bootstrap.cc:492] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:03.510051 1198 tablet_bootstrap.cc:654] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.511319 1751 raft_consensus.cc:515] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.513216 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b0f5388a73143569012ed714e53a8be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.513691 1751 leader_election.cc:290] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:03.513950 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e059efed3da48b9a516fd3905f6d298 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.514333 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b7f591d97bc4571b294b06d990d4065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.514981 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b0f5388a73143569012ed714e53a8be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.516763 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3ceee3ed9145f097bcb272eb896e66 (DEFAULT_TABLE table=default.Table_d3601aa415b44973be55e69c2ea3ee5e [id=e690ed0661ec4ceb82cd6fff82151b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.516965 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e059efed3da48b9a516fd3905f6d298 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.517089 1033 tablet_service.cc:1511] Processing CreateTablet for tablet d9f9cd8a901e41b0a92d7d37ed338ee9 (DEFAULT_TABLE table=default.Table_38a9745c06b24df1a9c2a5865aa12075 [id=522a3615be8349dd9db1f00a5dc5f400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.517236 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 731473c9021a4522ae2dfecff22c60e6 (DEFAULT_TABLE table=default.Table_cf880b7d3c21448793fe88b254cf5a2c [id=942900e08d78416db72e7e0b4c9487fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.518313 1192 tablet_bootstrap.cc:492] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:03.518471 1192 ts_tablet_manager.cc:1403] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.113s user 0.004s sys 0.000s
W20260616 19:52:03.519503 719 leader_election.cc:343] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 39f52eebdc79460a9ff33191086e87c6
I20260616 19:52:03.519234 1192 raft_consensus.cc:359] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.519778 1192 raft_consensus.cc:385] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.519902 1192 raft_consensus.cc:740] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.524613 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b7f591d97bc4571b294b06d990d4065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.526726 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_20d4a8dca77f48baab105824d595b6e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.527339 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20d4a8dca77f48baab105824d595b6e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.527635 1192 consensus_queue.cc:260] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.528111 1192 ts_tablet_manager.cc:1434] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260616 19:52:03.528558 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8dfce4bb3f8d42fba854b68e675edf41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.529068 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dfce4bb3f8d42fba854b68e675edf41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.530774 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f52eebdc79460a9ff33191086e87c6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:03.531013 922 raft_consensus.cc:2468] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:03.531126 1196 tablet_bootstrap.cc:492] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:03.531291 1196 ts_tablet_manager.cc:1403] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.211s user 0.017s sys 0.030s
I20260616 19:52:03.532675 1196 raft_consensus.cc:359] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.533004 1196 raft_consensus.cc:385] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.533136 1196 raft_consensus.cc:740] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.533408 1196 consensus_queue.cc:260] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.533946 718 leader_election.cc:304] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:03.534505 1751 raft_consensus.cc:2804] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:03.534612 1751 raft_consensus.cc:493] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:03.534736 1751 raft_consensus.cc:3060] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:03.535892 1196 ts_tablet_manager.cc:1434] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260616 19:52:03.537072 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 459) took 3508 ms. Trace:
I20260616 19:52:03.537204 1190 rpcz_store.cc:276] 0616 19:52:00.028426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.037098 (+ 8672us) service_pool.cc:224] Handling call
0616 19:52:02.995593 (+2958495us) ts_tablet_manager.cc:1151] Deleting tablet d3645fc39d974bffa8fe52c62e1c7eff
0616 19:52:02.995613 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.253943 (+258330us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.503990 (+250047us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.537003 (+ 33013us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2958309}
I20260616 19:52:03.537588 1751 raft_consensus.cc:515] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.537711 1196 tablet_bootstrap.cc:492] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:03.537703 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet d3645fc39d974bffa8fe52c62e1c7eff (table default.Table_8498a9716d0241898b3508012accd7e4 [id=684dd57c6c084da39a4046776066b1da]) successfully deleted
I20260616 19:52:03.538058 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 460) took 3492 ms. Trace:
I20260616 19:52:03.538144 1190 rpcz_store.cc:276] 0616 19:52:00.045915 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.046193 (+ 278us) service_pool.cc:224] Handling call
0616 19:52:03.537927 (+3491734us) ts_tablet_manager.cc:1151] Deleting tablet 7161894b9f9047fda9ed3f2180518a59
0616 19:52:03.537936 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.538011 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3491547}
W20260616 19:52:03.538555 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 7161894b9f9047fda9ed3f2180518a59 because the tablet was not found. No further retry: Not found: Tablet not found: 7161894b9f9047fda9ed3f2180518a59
I20260616 19:52:03.539276 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 469) took 3360 ms. Trace:
I20260616 19:52:03.539470 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3c74508bf28047af89a4cde7710e6e51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:03.539358 1190 rpcz_store.cc:276] 0616 19:52:00.178608 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.180515 (+ 1907us) service_pool.cc:224] Handling call
0616 19:52:03.538806 (+3358291us) ts_tablet_manager.cc:1151] Deleting tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b
0616 19:52:03.538817 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.539225 (+ 408us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3350281}
W20260616 19:52:03.539968 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c74508bf28047af89a4cde7710e6e51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.540613 893 tablet_service.cc:1511] Processing CreateTablet for tablet 839ab3389bd14d06b85072781860da6a (DEFAULT_TABLE table=default.Table_07eed597d0b3413ab7b4f848b24b9812 [id=c08b8e14bdfc4d5aa45846af5581ba2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.540989 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ab3389bd14d06b85072781860da6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.541095 1196 tablet_bootstrap.cc:654] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.541198 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e079f7ad5717469eb58807eb230fb2e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.541644 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e079f7ad5717469eb58807eb230fb2e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.544687 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 839ab3389bd14d06b85072781860da6a (DEFAULT_TABLE table=default.Table_07eed597d0b3413ab7b4f848b24b9812 [id=c08b8e14bdfc4d5aa45846af5581ba2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.545765 750 tablet_service.cc:1511] Processing CreateTablet for tablet 839ab3389bd14d06b85072781860da6a (DEFAULT_TABLE table=default.Table_07eed597d0b3413ab7b4f848b24b9812 [id=c08b8e14bdfc4d5aa45846af5581ba2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.546171 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ab3389bd14d06b85072781860da6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.547042 890 tablet_service.cc:1511] Processing CreateTablet for tablet 265a37409d8e4b1bb8ea20e3970b5f69 (DEFAULT_TABLE table=default.Table_9319f6312d3a460090760936118e8ec9 [id=744216b2a37f4ee4a64dbd2763843e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.547511 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265a37409d8e4b1bb8ea20e3970b5f69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.549455 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 265a37409d8e4b1bb8ea20e3970b5f69 (DEFAULT_TABLE table=default.Table_9319f6312d3a460090760936118e8ec9 [id=744216b2a37f4ee4a64dbd2763843e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.553319 1196 tablet_bootstrap.cc:492] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:03.553526 1196 ts_tablet_manager.cc:1403] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.001s
I20260616 19:52:03.553728 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f52eebdc79460a9ff33191086e87c6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:03.553961 922 raft_consensus.cc:3060] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:03.554505 1196 raft_consensus.cc:359] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.554721 749 tablet_service.cc:1511] Processing CreateTablet for tablet 265a37409d8e4b1bb8ea20e3970b5f69 (DEFAULT_TABLE table=default.Table_9319f6312d3a460090760936118e8ec9 [id=744216b2a37f4ee4a64dbd2763843e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.555253 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265a37409d8e4b1bb8ea20e3970b5f69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.554741 1196 raft_consensus.cc:385] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.555886 1196 raft_consensus.cc:740] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.556102 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d368ec65b624ea58f7b750097a78ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.556339 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2134c683f256462ca068a0acaf7f1a80" } new_table_name: "default.Table_2c2be2e62d114c318e2d9fe6b6f2421f" modify_external_catalogs: true
I20260616 19:52:03.557147 1192 tablet_bootstrap.cc:492] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:03.558149 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d4a2855b7dec4244a3fc52bdca7e7eb3
I20260616 19:52:03.556447 1196 consensus_queue.cc:260] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.557616 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d368ec65b624ea58f7b750097a78ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.559108 904 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a2855b7dec4244a3fc52bdca7e7eb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.560515 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a2855b7dec4244a3fc52bdca7e7eb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.561767 1196 ts_tablet_manager.cc:1434] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260616 19:52:03.562034 1196 tablet_bootstrap.cc:492] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:03.562825 1193 ts_tablet_manager.cc:1929] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260616 19:52:03.562986 1193 log.cc:1199] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/383589f0e211418bbdf5046ed90db410
I20260616 19:52:03.563429 1193 ts_tablet_manager.cc:1950] T 383589f0e211418bbdf5046ed90db410 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:03.564692 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 590) took 1014 ms. Trace:
I20260616 19:52:03.564810 1193 rpcz_store.cc:276] 0616 19:52:02.549822 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.549937 (+ 115us) service_pool.cc:224] Handling call
0616 19:52:03.206013 (+656076us) ts_tablet_manager.cc:1151] Deleting tablet 383589f0e211418bbdf5046ed90db410
0616 19:52:03.206023 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.251829 (+ 45806us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.562739 (+310910us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.564408 (+ 1669us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":644993}
I20260616 19:52:03.565222 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 593) took 1003 ms. Trace:
I20260616 19:52:03.565359 1193 rpcz_store.cc:276] 0616 19:52:02.562076 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.562149 (+ 73us) service_pool.cc:224] Handling call
0616 19:52:03.565056 (+1002907us) ts_tablet_manager.cc:1151] Deleting tablet e03e6a2614564eeeb8ec382b16f0ece1
0616 19:52:03.565065 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.565173 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":984187}
I20260616 19:52:03.565652 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ea9b8ba668410bae016a008cf37910 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.566119 748 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a2855b7dec4244a3fc52bdca7e7eb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.567997 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet daf86e5d5f2341c78705f78c02695c17
I20260616 19:52:03.569015 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet daf86e5d5f2341c78705f78c02695c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.569517 1198 tablet_bootstrap.cc:492] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:03.569715 1198 ts_tablet_manager.cc:1403] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.062s user 0.009s sys 0.000s
I20260616 19:52:03.570571 1198 raft_consensus.cc:359] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:03.570691 922 raft_consensus.cc:2468] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:03.570837 1198 raft_consensus.cc:385] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.570946 1198 raft_consensus.cc:740] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.571187 1198 consensus_queue.cc:260] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:03.571841 1198 ts_tablet_manager.cc:1434] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:03.572371 1198 tablet_bootstrap.cc:492] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:03.572628 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a2ad121bb76a403fa676e6a5abf130f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.573586 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2ad121bb76a403fa676e6a5abf130f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.574282 1198 tablet_bootstrap.cc:654] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.576893 1196 tablet_bootstrap.cc:654] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.577823 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_b1e42d7ed6304430a453bb9184363f77 [id=e75a6e5e4f0047d9b398ce230b170131]) successfully deleted
W20260616 19:52:03.578115 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet e03e6a2614564eeeb8ec382b16f0ece1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e03e6a2614564eeeb8ec382b16f0ece1 already in progress: creating tablet
I20260616 19:52:03.579316 1192 tablet_bootstrap.cc:654] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.577486 718 leader_election.cc:304] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:03.578878 748 tablet_service.cc:1558] Processing DeleteTablet for tablet daf86e5d5f2341c78705f78c02695c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.581019 1815 raft_consensus.cc:2804] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:03.583971 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3ceee3ed9145f097bcb272eb896e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.584615 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f9cd8a901e41b0a92d7d37ed338ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.585126 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731473c9021a4522ae2dfecff22c60e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.585553 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ffce2dc22e24d1684e6eae92c487cea with delete_type TABLET_DATA_DELETED (replaced by tablet 2374c740a25442debce55e9d5309f79e) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.585582 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265a37409d8e4b1bb8ea20e3970b5f69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.585915 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ab3389bd14d06b85072781860da6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.588622 1191 ts_tablet_manager.cc:1929] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:03.571403 891 tablet_service.cc:1558] Processing DeleteTablet for tablet daf86e5d5f2341c78705f78c02695c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.573177 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 470) took 3394 ms. Trace:
I20260616 19:52:03.594440 1190 rpcz_store.cc:276] 0616 19:52:00.178729 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.180542 (+ 1813us) service_pool.cc:224] Handling call
0616 19:52:03.573010 (+3392468us) ts_tablet_manager.cc:1151] Deleting tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd
0616 19:52:03.573021 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.573126 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3383862}
W20260616 19:52:03.595306 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd already in progress: creating tablet
I20260616 19:52:03.595901 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 468) took 3417 ms. Trace:
I20260616 19:52:03.596626 1190 rpcz_store.cc:276] 0616 19:52:00.178502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.180565 (+ 2063us) service_pool.cc:224] Handling call
0616 19:52:03.595692 (+3415127us) ts_tablet_manager.cc:1151] Deleting tablet 28cd1ad6e8744d33a2845e9f3dda4a7b
0616 19:52:03.595702 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.595841 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3406480}
W20260616 19:52:03.597609 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28cd1ad6e8744d33a2845e9f3dda4a7b already in progress: creating tablet
I20260616 19:52:03.598083 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 472) took 3394 ms. Trace:
I20260616 19:52:03.598513 1190 rpcz_store.cc:276] 0616 19:52:00.203720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.203758 (+ 38us) service_pool.cc:224] Handling call
0616 19:52:03.597931 (+3394173us) ts_tablet_manager.cc:1151] Deleting tablet 1142b61e40e6499e8244d71f2ad39b1e
0616 19:52:03.597940 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.598024 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3393964}
W20260616 19:52:03.599156 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 1142b61e40e6499e8244d71f2ad39b1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1142b61e40e6499e8244d71f2ad39b1e already in progress: creating tablet
I20260616 19:52:03.599611 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 471) took 3396 ms. Trace:
I20260616 19:52:03.600025 1190 rpcz_store.cc:276] 0616 19:52:00.203545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.203686 (+ 141us) service_pool.cc:224] Handling call
0616 19:52:03.599465 (+3395779us) ts_tablet_manager.cc:1151] Deleting tablet 1c35e4c8e9304e798c9031469877b70e
0616 19:52:03.599473 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.599552 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3393827}
I20260616 19:52:03.600545 1191 log.cc:1199] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/b99740ab59f947aabcac88dc2bf2de86
I20260616 19:52:03.600883 1190 tablet_replica.cc:333] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:03.601100 1190 raft_consensus.cc:2243] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:03.601289 1191 ts_tablet_manager.cc:1950] T b99740ab59f947aabcac88dc2bf2de86 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:03.601311 1190 raft_consensus.cc:2272] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:03.601858 1190 ts_tablet_manager.cc:1916] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.602417 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 528) took 2238 ms. Trace:
I20260616 19:52:03.602625 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_56c4bdfb8f804d10beeb4340c95e0cd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:03.602576 1191 rpcz_store.cc:276] 0616 19:52:01.364076 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.364437 (+ 361us) service_pool.cc:224] Handling call
0616 19:52:03.180081 (+1815644us) ts_tablet_manager.cc:1151] Deleting tablet b99740ab59f947aabcac88dc2bf2de86
0616 19:52:03.180088 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.495985 (+315897us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.585810 (+ 89825us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.602375 (+ 16565us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1815424}
I20260616 19:52:03.603310 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet b99740ab59f947aabcac88dc2bf2de86 (table default.Table_2e10c27b05e243a2a85134e81dc2a126 [id=d641d7d6fc004dc384ee5f82769bbfbc]) successfully deleted
I20260616 19:52:03.603387 1191 tablet_replica.cc:333] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:03.603557 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56c4bdfb8f804d10beeb4340c95e0cd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.603595 1191 raft_consensus.cc:2243] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:03.603745 1191 raft_consensus.cc:2272] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:03.605245 1815 raft_consensus.cc:697] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:03.605516 1872 raft_consensus.cc:493] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.605723 1872 raft_consensus.cc:515] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.607069 1872 leader_election.cc:290] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:03.605912 1815 consensus_queue.cc:237] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.607553 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ea9b8ba668410bae016a008cf37910" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:03.607771 922 raft_consensus.cc:2468] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:03.608702 718 leader_election.cc:304] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:03.609859 1751 leader_election.cc:290] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:03.610076 1751 raft_consensus.cc:2804] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:03.610106 1198 tablet_bootstrap.cc:492] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:03.610260 1751 raft_consensus.cc:493] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:03.610394 1751 raft_consensus.cc:3060] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:03.613538 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4b866c96bb9c475a8c4fafe10fe1e53a" } modify_external_catalogs: true
I20260616 19:52:03.613749 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4b866c96bb9c475a8c4fafe10fe1e53a" } modify_external_catalogs: true
I20260616 19:52:03.614153 1751 raft_consensus.cc:515] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.615089 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f4c478c0faaf444197285c44970b7d04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:03.615216 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ea9b8ba668410bae016a008cf37910" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:03.615386 922 raft_consensus.cc:3060] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:03.615422 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 592) took 1055 ms. Trace:
W20260616 19:52:03.615692 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4c478c0faaf444197285c44970b7d04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.615562 1193 rpcz_store.cc:276] 0616 19:52:02.559773 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.559835 (+ 62us) service_pool.cc:224] Handling call
0616 19:52:03.606032 (+1046197us) ts_tablet_manager.cc:1151] Deleting tablet fac9c314b1824e3297cf568ea0b14865
0616 19:52:03.606042 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.615376 (+ 9334us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1009284}
W20260616 19:52:03.616091 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet fac9c314b1824e3297cf568ea0b14865 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fac9c314b1824e3297cf568ea0b14865 already in progress: creating tablet
I20260616 19:52:03.616572 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 594) took 1040 ms. Trace:
I20260616 19:52:03.616710 1193 rpcz_store.cc:276] 0616 19:52:02.576613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.576664 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:03.616380 (+1039716us) ts_tablet_manager.cc:1151] Deleting tablet 79d686afeeed4729bd2069296aec82a1
0616 19:52:03.616394 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.616527 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1017449}
I20260616 19:52:03.616861 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_44bfcb23c9f046779ebc73bdcbc6f552" } new_table_name: "default.Table_4407a66f73c1400a9a55839383f5e385" modify_external_catalogs: true
W20260616 19:52:03.617157 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 79d686afeeed4729bd2069296aec82a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79d686afeeed4729bd2069296aec82a1 already in progress: creating tablet
I20260616 19:52:03.617424 1193 tablet_replica.cc:333] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:03.617609 1193 raft_consensus.cc:2243] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:03.618088 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_98dfc128f98d405bb94b36098e43025f" } new_table_name: "default.Table_8eed930436274d25b2c9fad44edb7229" modify_external_catalogs: true
I20260616 19:52:03.618247 1193 raft_consensus.cc:2272] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:03.618912 1193 ts_tablet_manager.cc:1916] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.619117 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_60ba0f6f88634456a3d4afc9f759c4a7" } modify_external_catalogs: true
I20260616 19:52:03.619189 922 raft_consensus.cc:2468] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:03.619289 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_60ba0f6f88634456a3d4afc9f759c4a7" } modify_external_catalogs: true
W20260616 19:52:03.619696 719 leader_election.cc:343] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 39f52eebdc79460a9ff33191086e87c6
I20260616 19:52:03.620296 1192 tablet_bootstrap.cc:492] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:03.620471 1192 ts_tablet_manager.cc:1403] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.063s user 0.000s sys 0.004s
I20260616 19:52:03.621644 1192 raft_consensus.cc:359] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.621707 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ea9b8ba668410bae016a008cf37910" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:03.621855 1192 raft_consensus.cc:385] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.621927 1192 raft_consensus.cc:740] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.623090 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4721681e12e54cae8311e14d084247db" } new_table_name: "default.Table_587bb493250b4187bd27457037ae32ab" modify_external_catalogs: true
I20260616 19:52:03.623160 718 leader_election.cc:304] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:03.623435 1874 raft_consensus.cc:2804] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:03.623580 1874 raft_consensus.cc:697] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:03.623863 1874 consensus_queue.cc:237] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.626157 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_45887a2d367d4294bce394b38dbe33ac" } modify_external_catalogs: true
I20260616 19:52:03.626307 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_45887a2d367d4294bce394b38dbe33ac" } modify_external_catalogs: true
I20260616 19:52:03.626451 1196 tablet_bootstrap.cc:492] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:03.626883 1196 ts_tablet_manager.cc:1403] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.065s user 0.000s sys 0.006s
I20260616 19:52:03.628531 1192 consensus_queue.cc:260] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.630508 1192 ts_tablet_manager.cc:1434] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260616 19:52:03.630508 1196 raft_consensus.cc:359] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.630687 1196 raft_consensus.cc:385] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.630760 1196 raft_consensus.cc:740] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.631842 1196 consensus_queue.cc:260] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.632589 1196 ts_tablet_manager.cc:1434] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260616 19:52:03.632898 1196 tablet_bootstrap.cc:492] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:03.630851 1192 tablet_bootstrap.cc:492] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:03.637348 1190 ts_tablet_manager.cc:1929] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:03.637526 1190 log.cc:1199] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/815d213bf1904353b4f0b2e2f8954db9
I20260616 19:52:03.637957 1190 ts_tablet_manager.cc:1950] T 815d213bf1904353b4f0b2e2f8954db9 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:03.638541 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 473) took 3417 ms. Trace:
I20260616 19:52:03.638674 1190 rpcz_store.cc:276] 0616 19:52:00.221094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.236526 (+ 15432us) service_pool.cc:224] Handling call
0616 19:52:03.600804 (+3364278us) ts_tablet_manager.cc:1151] Deleting tablet 815d213bf1904353b4f0b2e2f8954db9
0616 19:52:03.600813 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.612572 (+ 11759us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.637241 (+ 24669us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.638476 (+ 1235us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3364072}
I20260616 19:52:03.639166 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 815d213bf1904353b4f0b2e2f8954db9 (table default.Table_cb8601ac90d549099be33b639d901c21 [id=4819ad51aafb4dd4a283d2240306d7a5]) successfully deleted
I20260616 19:52:03.639631 1196 tablet_bootstrap.cc:654] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.642838 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 474) took 3374 ms. Trace:
I20260616 19:52:03.642961 1190 rpcz_store.cc:276] 0616 19:52:00.268741 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.268927 (+ 186us) service_pool.cc:224] Handling call
0616 19:52:03.639465 (+3370538us) ts_tablet_manager.cc:1151] Deleting tablet 83a199f25e5c4accba0acd1007fc73d1
0616 19:52:03.639477 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.642804 (+ 3327us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3370256}
W20260616 19:52:03.643455 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 83a199f25e5c4accba0acd1007fc73d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83a199f25e5c4accba0acd1007fc73d1 already in progress: creating tablet
I20260616 19:52:03.644726 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 475) took 3343 ms. Trace:
I20260616 19:52:03.644838 1190 rpcz_store.cc:276] 0616 19:52:00.300999 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.301078 (+ 79us) service_pool.cc:224] Handling call
0616 19:52:03.644571 (+3343493us) ts_tablet_manager.cc:1151] Deleting tablet 8f02d84ab7324b4c80875acf7f33199d
0616 19:52:03.644581 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.644685 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3343290}
W20260616 19:52:03.645248 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 8f02d84ab7324b4c80875acf7f33199d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f02d84ab7324b4c80875acf7f33199d already in progress: creating tablet
I20260616 19:52:03.645588 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 488) took 3186 ms. Trace:
I20260616 19:52:03.645721 1190 rpcz_store.cc:276] 0616 19:52:00.458828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.458884 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:03.645472 (+3186588us) ts_tablet_manager.cc:1151] Deleting tablet 269c1dea941c481fb6fd2e4d59c877c0
0616 19:52:03.645481 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.645558 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3122944}
I20260616 19:52:03.646522 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 489) took 3184 ms. Trace:
I20260616 19:52:03.646647 1190 rpcz_store.cc:276] 0616 19:52:00.461778 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.461829 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:03.646402 (+3184573us) ts_tablet_manager.cc:1151] Deleting tablet 482411d57f24459d8e7ed0eeb573234d
0616 19:52:03.646413 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.646493 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3123787}
W20260616 19:52:03.650805 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 41f2d259a31c4f4eaeceaba57fb978b2 consensus state has no leader
W20260616 19:52:03.651772 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce0963f38738468eb1518deadb3f119d consensus state has no leader
W20260616 19:52:03.653874 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 482411d57f24459d8e7ed0eeb573234d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 482411d57f24459d8e7ed0eeb573234d already in progress: creating tablet
I20260616 19:52:03.654304 1198 ts_tablet_manager.cc:1403] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260616 19:52:03.655237 1198 raft_consensus.cc:359] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:03.655441 1198 raft_consensus.cc:385] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.655529 1198 raft_consensus.cc:740] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.655793 1198 consensus_queue.cc:260] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:03.656049 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ea9b8ba668410bae016a008cf37910" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:03.656401 1058 raft_consensus.cc:2468] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:03.657037 1198 ts_tablet_manager.cc:1434] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:03.657666 1198 tablet_bootstrap.cc:492] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:03.659454 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ea0a7f80c5a34dbfabce579b6f574f93
I20260616 19:52:03.659509 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7e7f55f5946043108153b4c452a3d961
I20260616 19:52:03.659556 1198 tablet_bootstrap.cc:654] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:03.660291 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20b9e3626794464aa823724bee0a1682 consensus state has no leader
I20260616 19:52:03.660646 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet bcc5116ef5df4140a96f03c003337c68
W20260616 19:52:03.661418 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81618a3f43ad40fc8173e266cc106899 consensus state has no leader
I20260616 19:52:03.662751 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e7f55f5946043108153b4c452a3d961 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.663077 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0a7f80c5a34dbfabce579b6f574f93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.663282 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet bcc5116ef5df4140a96f03c003337c68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.663774 1191 ts_tablet_manager.cc:1916] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.667749 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet bfff9d60bb7e4a86b14687b581b45efe with delete_type TABLET_DATA_DELETED (replaced by tablet 0b362fa598a54632880faa42a9224ffd) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.669512 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 490) took 3206 ms. Trace:
I20260616 19:52:03.671175 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 0d4634afc3364221b4fdfcd3ce108a60 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:03.674459 1190 rpcz_store.cc:276] 0616 19:52:00.463077 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.463141 (+ 64us) service_pool.cc:224] Handling call
0616 19:52:03.669318 (+3206177us) ts_tablet_manager.cc:1151] Deleting tablet a817b1d4c7b640db8894bc801878caae
0616 19:52:03.669329 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.669464 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3146598}
I20260616 19:52:03.676573 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 491) took 3210 ms. Trace:
I20260616 19:52:03.676903 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 5cdab77ddde941bbafc23c90f45270ef (DEFAULT_TABLE table=default.Table_101fa88aedce4c9883f9cf7d0c2bb05c [id=dde7f48b7ef941eda25403c9615a89fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.677366 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cdab77ddde941bbafc23c90f45270ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.678325 1190 rpcz_store.cc:276] 0616 19:52:00.465966 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.466181 (+ 215us) service_pool.cc:224] Handling call
0616 19:52:03.676414 (+3210233us) ts_tablet_manager.cc:1151] Deleting tablet 3c90eb04585c4fa992435d11015ffec7
0616 19:52:03.676425 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.676552 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3153642}
I20260616 19:52:03.679580 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 492) took 3213 ms. Trace:
I20260616 19:52:03.684844 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0d4634afc3364221b4fdfcd3ce108a60
I20260616 19:52:03.685372 453 catalog_manager.cc:6784] ReplaceTablet: tablet 0d4634afc3364221b4fdfcd3ce108a60 deleted and replaced by tablet c2ca1a0a4c684d27bde1a09cf2d77c87
I20260616 19:52:03.686893 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_163e2e0482594a22a6d411bd422c52fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.687666 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_163e2e0482594a22a6d411bd422c52fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.688259 1190 rpcz_store.cc:276] 0616 19:52:00.466128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.466356 (+ 228us) service_pool.cc:224] Handling call
0616 19:52:03.679446 (+3213090us) ts_tablet_manager.cc:1151] Deleting tablet 93c940bd14a040ddba5ea058e732bf0c
0616 19:52:03.679455 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.679565 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3156630}
I20260616 19:52:03.688798 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 496) took 3096 ms. Trace:
I20260616 19:52:03.689193 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d4634afc3364221b4fdfcd3ce108a60 with delete_type TABLET_DATA_DELETED (replaced by tablet c2ca1a0a4c684d27bde1a09cf2d77c87) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.691206 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0dd5a3fc9a394487bb5d9412ccfe0bac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.691795 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0dd5a3fc9a394487bb5d9412ccfe0bac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.688882 1190 rpcz_store.cc:276] 0616 19:52:00.592122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.592336 (+ 214us) service_pool.cc:224] Handling call
0616 19:52:03.688670 (+3096334us) ts_tablet_manager.cc:1151] Deleting tablet 899b5f53d3fd4e2ab7222555dcc120e2
0616 19:52:03.688680 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.688781 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77240,"tablet-delete.queue_time_us":3096040}
I20260616 19:52:03.695286 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 497) took 3103 ms. Trace:
I20260616 19:52:03.695380 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a707b4fa17524ae8a9589674a12ed919" } new_table_name: "default.Table_098e82fdaef54977aef12a519459c5ee" modify_external_catalogs: true
I20260616 19:52:03.700143 750 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0a7f80c5a34dbfabce579b6f574f93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.700063 1751 leader_election.cc:290] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:03.701416 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e7f55f5946043108153b4c452a3d961 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:03.702447 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a817b1d4c7b640db8894bc801878caae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a817b1d4c7b640db8894bc801878caae already in progress: creating tablet
I20260616 19:52:03.703351 763 tablet_service.cc:1511] Processing CreateTablet for tablet 5cdab77ddde941bbafc23c90f45270ef (DEFAULT_TABLE table=default.Table_101fa88aedce4c9883f9cf7d0c2bb05c [id=dde7f48b7ef941eda25403c9615a89fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.703790 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cdab77ddde941bbafc23c90f45270ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.704497 754 tablet_service.cc:1511] Processing CreateTablet for tablet 7bab084824a84c218ef69a18971e4b47 (DEFAULT_TABLE table=default.Table_d2da0df1a65d4d588c4666b703fb9e3b [id=ecc705d631b74143b650371f8818cad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.704881 764 tablet_service.cc:1558] Processing DeleteTablet for tablet bcc5116ef5df4140a96f03c003337c68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.705071 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d4634afc3364221b4fdfcd3ce108a60 with delete_type TABLET_DATA_DELETED (replaced by tablet c2ca1a0a4c684d27bde1a09cf2d77c87) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.705317 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bab084824a84c218ef69a18971e4b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.705916 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_40dee65f767b4e60b64e2befd004e90b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.706459 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40dee65f767b4e60b64e2befd004e90b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.708032 1193 ts_tablet_manager.cc:1929] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260616 19:52:03.709389 1193 log.cc:1199] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/ab33d99d857145dfbda54ff2f7464486
W20260616 19:52:03.709852 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 3c90eb04585c4fa992435d11015ffec7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c90eb04585c4fa992435d11015ffec7 already in progress: creating tablet
I20260616 19:52:03.710836 758 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf5611e97e14eb1bf8515532f3a43be (DEFAULT_TABLE table=default.Table_63b7e3fef1bf4a09bf9ca314f19f5eec [id=68589eff2f1744bc852ad918771b70b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.711177 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf5611e97e14eb1bf8515532f3a43be. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:03.712297 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c1f764066289453c8cc3b0157260f397 consensus state has no leader
W20260616 19:52:03.712366 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 93c940bd14a040ddba5ea058e732bf0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93c940bd14a040ddba5ea058e732bf0c already in progress: creating tablet
W20260616 19:52:03.712976 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 899b5f53d3fd4e2ab7222555dcc120e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 899b5f53d3fd4e2ab7222555dcc120e2 already in progress: creating tablet
I20260616 19:52:03.713259 764 tablet_service.cc:1511] Processing CreateTablet for tablet 6677452bd2ce4ba5a07fdf67e9529830 (DEFAULT_TABLE table=default.Table_5378b2a86ed9456e9da1b5af2bb92ce7 [id=ee7e3661024344febff98463c8e5eb62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.713749 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6677452bd2ce4ba5a07fdf67e9529830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.715966 1849 raft_consensus.cc:493] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.716142 1849 raft_consensus.cc:515] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.717837 1849 leader_election.cc:290] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:03.720638 1846 tablet.cc:1724] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:03.700217 1192 tablet_bootstrap.cc:654] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.713531 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e7f55f5946043108153b4c452a3d961 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.717195 1190 rpcz_store.cc:276] 0616 19:52:00.592281 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.592642 (+ 361us) service_pool.cc:224] Handling call
0616 19:52:03.695142 (+3102500us) ts_tablet_manager.cc:1151] Deleting tablet 731556662b62419dae76149b22469ebd
0616 19:52:03.695152 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.695268 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77160,"tablet-delete.queue_time_us":3102352}
I20260616 19:52:03.723402 1190 tablet_replica.cc:333] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:03.723592 1190 raft_consensus.cc:2243] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:03.723762 1190 raft_consensus.cc:2272] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:03.724537 1190 ts_tablet_manager.cc:1916] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.728263 1849 raft_consensus.cc:493] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.729187 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eab5bd3967c42e1b6b79558df742946" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:03.731467 1192 tablet_bootstrap.cc:492] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:03.731588 1192 ts_tablet_manager.cc:1403] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.101s user 0.003s sys 0.002s
I20260616 19:52:03.732231 1192 raft_consensus.cc:359] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.732372 1192 raft_consensus.cc:385] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.732419 1192 raft_consensus.cc:740] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.732627 1192 consensus_queue.cc:260] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.732731 1732 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260616 19:52:03.737957 1192 ts_tablet_manager.cc:1434] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260616 19:52:03.738251 1192 tablet_bootstrap.cc:492] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:03.741230 1751 raft_consensus.cc:493] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.741420 1193 ts_tablet_manager.cc:1950] T ab33d99d857145dfbda54ff2f7464486 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:03.741422 1751 raft_consensus.cc:515] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.742305 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 599) took 1143 ms. Trace:
I20260616 19:52:03.742408 1193 rpcz_store.cc:276] 0616 19:52:02.598837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.598964 (+ 127us) service_pool.cc:224] Handling call
0616 19:52:03.617366 (+1018402us) ts_tablet_manager.cc:1151] Deleting tablet ab33d99d857145dfbda54ff2f7464486
0616 19:52:03.617375 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.698483 (+ 81108us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.707939 (+ 9456us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.742244 (+ 34305us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1014247}
I20260616 19:52:03.744231 1192 tablet_bootstrap.cc:654] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.746034 1190 ts_tablet_manager.cc:1929] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:03.746135 1190 log.cc:1199] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/2c31c8e977da4a70bca1beb00f364627
I20260616 19:52:03.746482 1190 ts_tablet_manager.cc:1950] T 2c31c8e977da4a70bca1beb00f364627 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:03.746815 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 508) took 2865 ms. Trace:
I20260616 19:52:03.746908 1732 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260616 19:52:03.746884 1190 rpcz_store.cc:276] 0616 19:52:00.881023 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.917124 (+ 36101us) service_pool.cc:224] Handling call
0616 19:52:03.723356 (+2806232us) ts_tablet_manager.cc:1151] Deleting tablet 2c31c8e977da4a70bca1beb00f364627
0616 19:52:03.723365 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.727967 (+ 4602us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.745976 (+ 18009us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.746798 (+ 822us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2775131}
I20260616 19:52:03.747052 748 tablet_service.cc:1511] Processing CreateTablet for tablet 01d862f2ce2e4051bcbc71ba8f24846e (DEFAULT_TABLE table=default.Table_e620d37af90643a49c022902197a8b38 [id=85447ee8daef47269202c72ff15fc29f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.747310 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 512) took 2857 ms. Trace:
I20260616 19:52:03.747258 1732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260616 19:52:03.747381 1190 rpcz_store.cc:276] 0616 19:52:00.889428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.997471 (+108043us) service_pool.cc:224] Handling call
0616 19:52:03.747157 (+2749686us) ts_tablet_manager.cc:1151] Deleting tablet f293d557a9aa4ca4885aa917fe1565e4
0616 19:52:03.747168 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.747294 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2739573}
I20260616 19:52:03.747691 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 513) took 2858 ms. Trace:
I20260616 19:52:03.747681 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eab5bd3967c42e1b6b79558df742946" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:03.747766 1190 rpcz_store.cc:276] 0616 19:52:00.889500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:00.998645 (+109145us) service_pool.cc:224] Handling call
0616 19:52:03.747598 (+2748953us) ts_tablet_manager.cc:1151] Deleting tablet b2e5e84b95c7429bb53dd616f118500a
0616 19:52:03.747606 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.747678 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2737614}
I20260616 19:52:03.748029 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 514) took 2789 ms. Trace:
I20260616 19:52:03.748090 1190 rpcz_store.cc:276] 0616 19:52:00.958598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.001210 (+ 42612us) service_pool.cc:224] Handling call
0616 19:52:03.747946 (+2746736us) ts_tablet_manager.cc:1151] Deleting tablet 31592a5ffb04429c9315a4fd72308f28
0616 19:52:03.747953 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.748015 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2735494}
I20260616 19:52:03.748400 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 515) took 2771 ms. Trace:
I20260616 19:52:03.748540 1190 rpcz_store.cc:276] 0616 19:52:00.976636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.006139 (+ 29503us) service_pool.cc:224] Handling call
0616 19:52:03.748291 (+2742152us) ts_tablet_manager.cc:1151] Deleting tablet b718514e4fbd4601afeb021ed35643e6
0616 19:52:03.748300 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.748380 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2718589}
I20260616 19:52:03.748811 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 516) took 2603 ms. Trace:
I20260616 19:52:03.748864 1190 rpcz_store.cc:276] 0616 19:52:01.145694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.146430 (+ 736us) service_pool.cc:224] Handling call
0616 19:52:03.748711 (+2602281us) ts_tablet_manager.cc:1151] Deleting tablet 8c0a6191ad334400a319778fc4e559af
0616 19:52:03.748718 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.748797 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2596516}
I20260616 19:52:03.749168 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 517) took 2574 ms. Trace:
I20260616 19:52:03.749254 1190 rpcz_store.cc:276] 0616 19:52:01.174322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.174376 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:03.749071 (+2574695us) ts_tablet_manager.cc:1151] Deleting tablet fbe784716b3c4293bd4eddf57f6c9048
0616 19:52:03.749082 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.749154 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2569359}
I20260616 19:52:03.750841 1852 tablet.cc:1724] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:03.749528 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 518) took 2475 ms. Trace:
I20260616 19:52:03.751667 1190 rpcz_store.cc:276] 0616 19:52:01.274463 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.274535 (+ 72us) service_pool.cc:224] Handling call
0616 19:52:03.749425 (+2474890us) ts_tablet_manager.cc:1151] Deleting tablet 9105320d5b36457d9dd74b553a44db2c
0616 19:52:03.749434 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.749501 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2474078}
I20260616 19:52:03.751595 777 raft_consensus.cc:2468] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:03.752779 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eab5bd3967c42e1b6b79558df742946 with delete_type TABLET_DATA_DELETED (replaced by tablet 65b0dc43b40649f29037f40d2ea9247e) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:03.752782 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 519) took 2427 ms. Trace:
I20260616 19:52:03.752879 1190 rpcz_store.cc:276] 0616 19:52:01.325596 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.325655 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:03.751906 (+2426251us) ts_tablet_manager.cc:1151] Deleting tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7
0616 19:52:03.751914 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.752759 (+ 845us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2423472}
I20260616 19:52:03.753193 1190 tablet_replica.cc:333] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:03.753341 1190 raft_consensus.cc:2243] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:03.753612 1190 pending_rounds.cc:70] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:52:03.753679 1190 pending_rounds.cc:77] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595479417380864 op_type: NO_OP noop_request { }
I20260616 19:52:03.753806 1190 raft_consensus.cc:2889] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:03.753898 1190 raft_consensus.cc:2272] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:03.756074 1190 ts_tablet_manager.cc:1916] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.756505 750 tablet_service.cc:1511] Processing CreateTablet for tablet a101a14942104b85a0a224c87c0212cd (DEFAULT_TABLE table=default.Table_7e5013ac144c4491beee89e3e66a5972 [id=7d55e7a7a6a04392bee59bae4b46cf1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.759636 1192 tablet_bootstrap.cc:492] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:03.759639 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d862f2ce2e4051bcbc71ba8f24846e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.759783 1192 ts_tablet_manager.cc:1403] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.002s
I20260616 19:52:03.760648 1192 raft_consensus.cc:359] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.760844 1192 raft_consensus.cc:385] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.760839 1751 leader_election.cc:290] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:03.760900 1192 raft_consensus.cc:740] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.761107 1192 consensus_queue.cc:260] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.761534 890 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0a7f80c5a34dbfabce579b6f574f93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.761657 893 tablet_service.cc:1558] Processing DeleteTablet for tablet bcc5116ef5df4140a96f03c003337c68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.761926 1192 ts_tablet_manager.cc:1434] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:03.761966 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 10fc1d2ecaa746bab980a708dd8eb93a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.762218 1192 tablet_bootstrap.cc:492] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:03.762424 893 tablet_service.cc:1511] Processing CreateTablet for tablet 5cdab77ddde941bbafc23c90f45270ef (DEFAULT_TABLE table=default.Table_101fa88aedce4c9883f9cf7d0c2bb05c [id=dde7f48b7ef941eda25403c9615a89fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.762933 890 tablet_service.cc:1511] Processing CreateTablet for tablet 7bab084824a84c218ef69a18971e4b47 (DEFAULT_TABLE table=default.Table_d2da0df1a65d4d588c4666b703fb9e3b [id=ecc705d631b74143b650371f8818cad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.763396 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d4634afc3364221b4fdfcd3ce108a60 with delete_type TABLET_DATA_DELETED (replaced by tablet c2ca1a0a4c684d27bde1a09cf2d77c87) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.763599 1192 tablet_bootstrap.cc:654] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:03.763789 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 600) took 1157 ms. Trace:
I20260616 19:52:03.764181 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cdab77ddde941bbafc23c90f45270ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.764657 759 tablet_service.cc:1511] Processing CreateTablet for tablet 35d79d86fc0a4594a4c6696bc4a30403 (DEFAULT_TABLE table=default.Table_8acc4e02fca3408ca9996c98f732938f [id=02c4f54c02c54566b9922088688902e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.764628 1193 rpcz_store.cc:276] 0616 19:52:02.602811 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.603166 (+ 355us) service_pool.cc:224] Handling call
0616 19:52:03.759702 (+1156536us) ts_tablet_manager.cc:1151] Deleting tablet 2d05c86bca9343a2bc8c5709e1c49647
0616 19:52:03.759712 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.759815 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1156345}
I20260616 19:52:03.765543 765 tablet_service.cc:1511] Processing CreateTablet for tablet 451ef03db89043cbbed12a2a48a16adb (DEFAULT_TABLE table=default.Table_5470eb7f79a44e4e9b789e43ca62f3d6 [id=66ab3cdf9f7c4c0e966e1f94ee2c3516]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.766042 749 tablet_service.cc:1511] Processing CreateTablet for tablet 30f47e639195478f9cda4ab8f8b33798 (DEFAULT_TABLE table=default.Table_3c5805a9d6b24b91818b5059b19c8605 [id=00f40c8dc6df483eb4bfe985a6c681e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.766655 1751 consensus_queue.cc:1048] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260616 19:52:03.768103 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a101a14942104b85a0a224c87c0212cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.769447 753 tablet_service.cc:1511] Processing CreateTablet for tablet 33a6a46041464e93811b0c573db19f43 (DEFAULT_TABLE table=default.Table_acf6078226f644f8a0a87e37b73c6cb6 [id=3009ee31846f41cf8a489a729ec3d406]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.769760 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 601) took 1064 ms. Trace:
I20260616 19:52:03.769773 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8839050ed0db4c7da35e13c3b40639b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:03.769894 1193 rpcz_store.cc:276] 0616 19:52:02.700197 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.700389 (+ 192us) service_pool.cc:224] Handling call
0616 19:52:03.764899 (+1064510us) ts_tablet_manager.cc:1151] Deleting tablet 0c166a93c88b45f799e14e10e802b5a0
0616 19:52:03.764914 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.765028 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":974471}
I20260616 19:52:03.770052 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_30c975e6226e45f88f761eeaca5fe355" } modify_external_catalogs: true
I20260616 19:52:03.770246 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_038f0c4973c84b4aad0b7a3ecba38d8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.770380 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8839050ed0db4c7da35e13c3b40639b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.770429 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_de1f064302a244b8af570852afb898e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.770686 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_038f0c4973c84b4aad0b7a3ecba38d8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:03.770998 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de1f064302a244b8af570852afb898e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.771816 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_776442a4731046708d16acd8c5bde21e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:03.772243 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_30c975e6226e45f88f761eeaca5fe355" } modify_external_catalogs: true
W20260616 19:52:03.772545 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_776442a4731046708d16acd8c5bde21e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.773125 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bab084824a84c218ef69a18971e4b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.777818 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451ef03db89043cbbed12a2a48a16adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.780037 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a6a46041464e93811b0c573db19f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.785686 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf5611e97e14eb1bf8515532f3a43be (DEFAULT_TABLE table=default.Table_63b7e3fef1bf4a09bf9ca314f19f5eec [id=68589eff2f1744bc852ad918771b70b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.786144 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf5611e97e14eb1bf8515532f3a43be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.792100 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 7bab084824a84c218ef69a18971e4b47 (DEFAULT_TABLE table=default.Table_d2da0df1a65d4d588c4666b703fb9e3b [id=ecc705d631b74143b650371f8818cad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.792838 1191 ts_tablet_manager.cc:1929] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:03.795903 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_66491a1a28a6487194eaf8e06bd30094" } modify_external_catalogs: true
I20260616 19:52:03.796113 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_66491a1a28a6487194eaf8e06bd30094" } modify_external_catalogs: true
I20260616 19:52:03.799271 1037 tablet_service.cc:1511] Processing CreateTablet for tablet d6707acac4ee4283b138fb44e4e82ce5 (DEFAULT_TABLE table=default.Table_15f01a98a5844f30a111f3640753af1d [id=cbb4373000fd49ebb362881b96a247a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.800732 761 tablet_service.cc:1511] Processing CreateTablet for tablet fd020407d4f8470e99045206ca16c6d2 (DEFAULT_TABLE table=default.Table_c917659aef8241b98ffa4caa9c7b96a5 [id=a09e60b6ece848f8b254ed384e98abaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.801221 891 tablet_service.cc:1511] Processing CreateTablet for tablet 6677452bd2ce4ba5a07fdf67e9529830 (DEFAULT_TABLE table=default.Table_5378b2a86ed9456e9da1b5af2bb92ce7 [id=ee7e3661024344febff98463c8e5eb62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.801826 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6677452bd2ce4ba5a07fdf67e9529830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.803076 887 tablet_service.cc:1511] Processing CreateTablet for tablet 01d862f2ce2e4051bcbc71ba8f24846e (DEFAULT_TABLE table=default.Table_e620d37af90643a49c022902197a8b38 [id=85447ee8daef47269202c72ff15fc29f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.803061 1036 tablet_service.cc:1511] Processing CreateTablet for tablet fd020407d4f8470e99045206ca16c6d2 (DEFAULT_TABLE table=default.Table_c917659aef8241b98ffa4caa9c7b96a5 [id=a09e60b6ece848f8b254ed384e98abaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.803647 1040 tablet_service.cc:1511] Processing CreateTablet for tablet f92e45da793440d59439c715e8e50249 (DEFAULT_TABLE table=default.Table_186422b1f85f4034b1e8f7a7508dd5fa [id=8f881847ce5a42958693867bf6026b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.803773 904 tablet_service.cc:1511] Processing CreateTablet for tablet a101a14942104b85a0a224c87c0212cd (DEFAULT_TABLE table=default.Table_7e5013ac144c4491beee89e3e66a5972 [id=7d55e7a7a6a04392bee59bae4b46cf1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.804067 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 33a6a46041464e93811b0c573db19f43 (DEFAULT_TABLE table=default.Table_acf6078226f644f8a0a87e37b73c6cb6 [id=3009ee31846f41cf8a489a729ec3d406]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.804345 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 30f47e639195478f9cda4ab8f8b33798 (DEFAULT_TABLE table=default.Table_3c5805a9d6b24b91818b5059b19c8605 [id=00f40c8dc6df483eb4bfe985a6c681e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.804432 899 tablet_service.cc:1511] Processing CreateTablet for tablet 451ef03db89043cbbed12a2a48a16adb (DEFAULT_TABLE table=default.Table_5470eb7f79a44e4e9b789e43ca62f3d6 [id=66ab3cdf9f7c4c0e966e1f94ee2c3516]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.805115 885 tablet_service.cc:1511] Processing CreateTablet for tablet 35d79d86fc0a4594a4c6696bc4a30403 (DEFAULT_TABLE table=default.Table_8acc4e02fca3408ca9996c98f732938f [id=02c4f54c02c54566b9922088688902e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.805434 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d79d86fc0a4594a4c6696bc4a30403. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:03.806002 993 leader_election.cc:343] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:03.806100 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451ef03db89043cbbed12a2a48a16adb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:03.806151 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 76263us
I20260616 19:52:03.806557 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a101a14942104b85a0a224c87c0212cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.806967 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d862f2ce2e4051bcbc71ba8f24846e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.807127 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf5611e97e14eb1bf8515532f3a43be (DEFAULT_TABLE table=default.Table_63b7e3fef1bf4a09bf9ca314f19f5eec [id=68589eff2f1744bc852ad918771b70b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.807610 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 6677452bd2ce4ba5a07fdf67e9529830 (DEFAULT_TABLE table=default.Table_5378b2a86ed9456e9da1b5af2bb92ce7 [id=ee7e3661024344febff98463c8e5eb62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.807931 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 01d862f2ce2e4051bcbc71ba8f24846e (DEFAULT_TABLE table=default.Table_e620d37af90643a49c022902197a8b38 [id=85447ee8daef47269202c72ff15fc29f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.808203 1849 raft_consensus.cc:515] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.809242 1034 tablet_service.cc:1511] Processing CreateTablet for tablet a101a14942104b85a0a224c87c0212cd (DEFAULT_TABLE table=default.Table_7e5013ac144c4491beee89e3e66a5972 [id=7d55e7a7a6a04392bee59bae4b46cf1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.810258 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 35d79d86fc0a4594a4c6696bc4a30403 (DEFAULT_TABLE table=default.Table_8acc4e02fca3408ca9996c98f732938f [id=02c4f54c02c54566b9922088688902e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.810616 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 451ef03db89043cbbed12a2a48a16adb (DEFAULT_TABLE table=default.Table_5470eb7f79a44e4e9b789e43ca62f3d6 [id=66ab3cdf9f7c4c0e966e1f94ee2c3516]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.814244 1848 raft_consensus.cc:493] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.814391 1848 raft_consensus.cc:515] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:03.815374 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf73c4c1133405bb46df19c0559ab92" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:03.815790 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7ac5b6be55944bdfb12db675442b1f1d
W20260616 19:52:03.819104 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet c1f764066289453c8cc3b0157260f397 (table default.Table_098e82fdaef54977aef12a519459c5ee [id=a335dbf9f8104625a90445cab115e29c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c1f764066289453c8cc3b0157260f397 consensus state has no leader
I20260616 19:52:03.819109 1848 leader_election.cc:290] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:03.819500 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 1f97b0a0e70e4fb2b318ffbbcb0ed790 (DEFAULT_TABLE table=default.Table_90dd7bdb2d6943c5a3864e1a09318956 [id=d65edabb0a6d4e4993571e661fba01cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.819881 1849 leader_election.cc:290] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:03.824857 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 802d30c340494490896c8da33d110708 from {username='slave'} at 127.0.0.1:41696
W20260616 19:52:03.826186 993 leader_election.cc:343] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:03.827016 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ffce2dc22e24d1684e6eae92c487cea" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:03.830426 993 leader_election.cc:343] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:03.830797 453 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_093bd1c50f834db49bf52da0c66fae6d [id=87e3217093844e81ac448e2e9d8fa3ec] alter complete (version 2)
I20260616 19:52:03.835773 1190 ts_tablet_manager.cc:1929] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:03.836688 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ac5b6be55944bdfb12db675442b1f1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.838195 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 3a889b7dea504e8192d1c81a79a975dd (DEFAULT_TABLE table=default.Table_e7113aa5e6074bba96617bb94cd588a2 [id=c2950800f7144d0481facf082aefc762]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.838968 1035 tablet_service.cc:1511] Processing CreateTablet for tablet ea0a7f80c5a34dbfabce579b6f574f93 (DEFAULT_TABLE table=default.Table_45887a2d367d4294bce394b38dbe33ac [id=10ba0af63bcc4e46a6053933ffd539db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.842586 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c5657b6b56af4b8f8eff1fa18836df9b
I20260616 19:52:03.844925 1190 log.cc:1199] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/f2c392b2fecd483d9da12e30e37f27ad
I20260616 19:52:03.845425 1190 ts_tablet_manager.cc:1950] T f2c392b2fecd483d9da12e30e37f27ad P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:03.845930 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 527) took 2354 ms. Trace:
I20260616 19:52:03.851078 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 802d30c340494490896c8da33d110708
I20260616 19:52:03.851572 456 catalog_manager.cc:6784] ReplaceTablet: tablet 802d30c340494490896c8da33d110708 deleted and replaced by tablet c5047956478f488dbb4734bbaa138c00
I20260616 19:52:03.852561 1190 rpcz_store.cc:276] 0616 19:52:01.491035 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.493313 (+ 2278us) service_pool.cc:224] Handling call
0616 19:52:03.753142 (+2259829us) ts_tablet_manager.cc:1151] Deleting tablet f2c392b2fecd483d9da12e30e37f27ad
0616 19:52:03.753154 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.764938 (+ 11784us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.835713 (+ 70775us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.845915 (+ 10202us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2259618}
I20260616 19:52:03.853098 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a2ad121bb76a403fa676e6a5abf130f5" } new_table_name: "default.Table_2b28350a70084f499b0daec3a38ff4ea" modify_external_catalogs: true
I20260616 19:52:03.852919 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 3587c1ab487a424eb82f378ae081f514 with delete_type TABLET_DATA_DELETED (replaced by tablet 84ce7bf3e0004ffaa2c5e314fa69322c) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.856058 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 529) took 2364 ms. Trace:
I20260616 19:52:03.860982 457 master_service.cc:960] ReplaceTablet: received request to replace tablet d686190fb6a34ab18cc4799197765f1b from {username='slave'} at 127.0.0.1:41696
W20260616 19:52:03.861799 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a846bb4ae214011b2c9bb7202db6fdc has no consensus state
I20260616 19:52:03.862736 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cbfdcfcea0e346d18b7a18e411c66dc1" } new_table_name: "default.Table_3bee557dbc924f6b982089749d9abe7b" modify_external_catalogs: true
I20260616 19:52:03.863075 1028 tablet_service.cc:1511] Processing CreateTablet for tablet bb9509607ee04d7bb3b412f539af21ce (DEFAULT_TABLE table=default.Table_7aeeccc151924d7f9851b501e784bde7 [id=be0dbbc4069e497cb897b53038577f21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.863456 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_495e54f09f034a1f9d0ca6c0bdd4cf4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:03.863660 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f3c7d323882642c7a655b043d3b19e48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.864003 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_495e54f09f034a1f9d0ca6c0bdd4cf4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:03.864220 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3c7d323882642c7a655b043d3b19e48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.865537 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3e975395a7f54cc6bda4ad65f522a3c2" } modify_external_catalogs: true
I20260616 19:52:03.865733 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3e975395a7f54cc6bda4ad65f522a3c2" } modify_external_catalogs: true
I20260616 19:52:03.866366 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5470eb7f79a44e4e9b789e43ca62f3d6" } modify_external_catalogs: true
I20260616 19:52:03.866530 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5470eb7f79a44e4e9b789e43ca62f3d6" } modify_external_catalogs: true
I20260616 19:52:03.867208 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_dae68b113ed343b4879c83b8554c55f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.867775 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dae68b113ed343b4879c83b8554c55f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.869053 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9a33444036b544e8a6d5d5c743ebc5a7" } modify_external_catalogs: true
I20260616 19:52:03.869256 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9a33444036b544e8a6d5d5c743ebc5a7" } modify_external_catalogs: true
I20260616 19:52:03.855535 904 tablet_service.cc:1511] Processing CreateTablet for tablet 33a6a46041464e93811b0c573db19f43 (DEFAULT_TABLE table=default.Table_acf6078226f644f8a0a87e37b73c6cb6 [id=3009ee31846f41cf8a489a729ec3d406]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.869854 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a6a46041464e93811b0c573db19f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.870033 887 tablet_service.cc:1511] Processing CreateTablet for tablet f92e45da793440d59439c715e8e50249 (DEFAULT_TABLE table=default.Table_186422b1f85f4034b1e8f7a7508dd5fa [id=8f881847ce5a42958693867bf6026b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.870501 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7b912aaf74bb4b23a2cd06c0e5a64873" } new_table_name: "default.Table_c814e66f4bcc4f49bc9858bae34ed4df" modify_external_catalogs: true
I20260616 19:52:03.870790 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92e45da793440d59439c715e8e50249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.854380 885 tablet_service.cc:1511] Processing CreateTablet for tablet 30f47e639195478f9cda4ab8f8b33798 (DEFAULT_TABLE table=default.Table_3c5805a9d6b24b91818b5059b19c8605 [id=00f40c8dc6df483eb4bfe985a6c681e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.872176 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f47e639195478f9cda4ab8f8b33798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.877322 1190 rpcz_store.cc:276] 0616 19:52:01.491266 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.493620 (+ 2354us) service_pool.cc:224] Handling call
0616 19:52:03.855940 (+2362320us) ts_tablet_manager.cc:1151] Deleting tablet bc2006e262cc4bbb9b291a5bf52653cd
0616 19:52:03.855951 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.856043 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2362144}
I20260616 19:52:03.877978 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 526) took 2388 ms. Trace:
I20260616 19:52:03.878243 1190 rpcz_store.cc:276] 0616 19:52:01.489949 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.490049 (+ 100us) service_pool.cc:224] Handling call
0616 19:52:03.877852 (+2387803us) ts_tablet_manager.cc:1151] Deleting tablet 08db2c1398b946c180d81b88504c1d9c
0616 19:52:03.877863 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.877961 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2380196}
I20260616 19:52:03.878757 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 528) took 2387 ms. Trace:
I20260616 19:52:03.882720 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 4a81c733ac4c4eec9eebf5c73fff851b (DEFAULT_TABLE table=default.Table_06cfa94be6934d30830e13d6af1ba8a1 [id=6729ba1b59b245e185dd2bf77236a20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.882863 458 master_service.cc:960] ReplaceTablet: received request to replace tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:03.883342 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 81f881fd3ad244f9afd70b4b99d9384d (DEFAULT_TABLE table=default.Table_2da181f5cbc54988a562cad81caaf1c0 [id=adb4c641390f4e52a4b461489ef9e51a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.884385 1719 raft_consensus.cc:493] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.887739 1719 raft_consensus.cc:515] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.888377 1719 leader_election.cc:290] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:03.888907 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6222db09d4cd987cbdf70e4d40f70" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:03.888872 1190 rpcz_store.cc:276] 0616 19:52:01.491161 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.493555 (+ 2394us) service_pool.cc:224] Handling call
0616 19:52:03.878665 (+2385110us) ts_tablet_manager.cc:1151] Deleting tablet 915267e7ff3c439385a861dfb954b852
0616 19:52:03.878673 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.878743 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2376887}
I20260616 19:52:03.889142 1060 raft_consensus.cc:2468] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:03.889402 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 536) took 2333 ms. Trace:
I20260616 19:52:03.889465 1190 rpcz_store.cc:276] 0616 19:52:01.555644 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.556159 (+ 515us) service_pool.cc:224] Handling call
0616 19:52:03.889286 (+2333127us) ts_tablet_manager.cc:1151] Deleting tablet f13d175adfe540b39fd55004a11c9aad
0616 19:52:03.889299 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.889389 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2328599}
I20260616 19:52:03.889657 858 leader_election.cc:304] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:03.889719 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 535) took 2340 ms. Trace:
I20260616 19:52:03.889894 1719 raft_consensus.cc:2804] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:03.889943 1719 raft_consensus.cc:493] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:03.889994 1719 raft_consensus.cc:3060] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:03.892947 1719 raft_consensus.cc:515] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.893699 1719 leader_election.cc:290] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:03.894166 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6222db09d4cd987cbdf70e4d40f70" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:03.894543 1191 log.cc:1199] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/eb024637294148c18b74bef47fb2fcce
I20260616 19:52:03.894892 1060 raft_consensus.cc:3060] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:03.895805 1191 ts_tablet_manager.cc:1950] T eb024637294148c18b74bef47fb2fcce P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:03.889777 1190 rpcz_store.cc:276] 0616 19:52:01.548797 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.548884 (+ 87us) service_pool.cc:224] Handling call
0616 19:52:03.889637 (+2340753us) ts_tablet_manager.cc:1151] Deleting tablet 61189a715da140a6833801681bbd5ef4
0616 19:52:03.889645 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.889707 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2323206}
I20260616 19:52:03.896167 1190 tablet_replica.cc:333] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:03.896332 1190 raft_consensus.cc:2243] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:03.896507 1190 raft_consensus.cc:2272] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:03.896996 1190 ts_tablet_manager.cc:1916] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.898079 1060 raft_consensus.cc:2468] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:03.898329 1025 tablet_service.cc:1511] Processing CreateTablet for tablet ce0963f38738468eb1518deadb3f119d (DEFAULT_TABLE table=default.Table_2c2be2e62d114c318e2d9fe6b6f2421f [id=7246d1b3c155431fa46c4624e274e5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.898803 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 1dfcb523e24548108a6e927b3a1a6711 (DEFAULT_TABLE table=default.Table_b6a04b83dfdc40eda84e5090f4f315bd [id=a5775d76226646c9a57e01423c4d9ec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.899080 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 529) took 2532 ms. Trace:
I20260616 19:52:03.899178 1191 rpcz_store.cc:276] 0616 19:52:01.364232 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.364705 (+ 473us) service_pool.cc:224] Handling call
0616 19:52:03.603316 (+2238611us) ts_tablet_manager.cc:1151] Deleting tablet eb024637294148c18b74bef47fb2fcce
0616 19:52:03.603328 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.762619 (+159291us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.792765 (+ 30146us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.896625 (+103860us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2238465}
I20260616 19:52:03.899631 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 534) took 2489 ms. Trace:
I20260616 19:52:03.899878 1849 raft_consensus.cc:493] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.899989 1849 raft_consensus.cc:515] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.900759 1849 leader_election.cc:290] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:03.900916 1849 raft_consensus.cc:493] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:03.901151 1849 raft_consensus.cc:515] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:03.902130 1849 leader_election.cc:290] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:03.899755 1191 rpcz_store.cc:276] 0616 19:52:01.410003 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.410075 (+ 72us) service_pool.cc:224] Handling call
0616 19:52:03.899468 (+2489393us) ts_tablet_manager.cc:1151] Deleting tablet 08db2c1398b946c180d81b88504c1d9c
0616 19:52:03.899477 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.899569 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2489101}
I20260616 19:52:03.905020 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 535) took 2491 ms. Trace:
I20260616 19:52:03.905251 1191 rpcz_store.cc:276] 0616 19:52:01.412936 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.413140 (+ 204us) service_pool.cc:224] Handling call
0616 19:52:03.904395 (+2491255us) ts_tablet_manager.cc:1151] Deleting tablet 915267e7ff3c439385a861dfb954b852
0616 19:52:03.904403 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.904796 (+ 393us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2491039}
I20260616 19:52:03.906322 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5483e05ad83f4ba9b3cf2bdee5b7d7fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.906917 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5483e05ad83f4ba9b3cf2bdee5b7d7fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.906842 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 536) took 2488 ms. Trace:
I20260616 19:52:03.907078 1191 rpcz_store.cc:276] 0616 19:52:01.418000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.418095 (+ 95us) service_pool.cc:224] Handling call
0616 19:52:03.905755 (+2487660us) ts_tablet_manager.cc:1151] Deleting tablet bc2006e262cc4bbb9b291a5bf52653cd
0616 19:52:03.905992 (+ 237us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.906431 (+ 439us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2487444}
I20260616 19:52:03.908517 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 544) took 2393 ms. Trace:
W20260616 19:52:03.910179 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd52351082274a4aa12cac468d9a512d consensus state has no leader
I20260616 19:52:03.910574 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bab084824a84c218ef69a18971e4b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.910791 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0963f38738468eb1518deadb3f119d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.912539 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9509607ee04d7bb3b412f539af21ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.914614 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e320a0e61e09447aa8206a307dd2c425"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.915784 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e320a0e61e09447aa8206a307dd2c425 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.916651 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a81c733ac4c4eec9eebf5c73fff851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.916843 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6677452bd2ce4ba5a07fdf67e9529830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.918740 458 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 3de0e62cfd33410490a0b460fd5f69e9 (table default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]). Expected version 2 got 0
I20260616 19:52:03.920230 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d1c9326d48f345f4b4b368dad96e1369" } new_table_name: "default.Table_7df49770c7714ce0a900effba2931b9e" modify_external_catalogs: true
I20260616 19:52:03.920604 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a889b7dea504e8192d1c81a79a975dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.920816 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f881fd3ad244f9afd70b4b99d9384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.909159 1191 rpcz_store.cc:276] 0616 19:52:01.514458 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.524954 (+ 10496us) service_pool.cc:224] Handling call
0616 19:52:03.908077 (+2383123us) ts_tablet_manager.cc:1151] Deleting tablet 61189a715da140a6833801681bbd5ef4
0616 19:52:03.908089 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.908316 (+ 227us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2380752}
I20260616 19:52:03.921017 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0a7f80c5a34dbfabce579b6f574f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.921295 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d79d86fc0a4594a4c6696bc4a30403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.921499 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92e45da793440d59439c715e8e50249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.924592 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451ef03db89043cbbed12a2a48a16adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.899974 858 leader_election.cc:304] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:03.924827 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f47e639195478f9cda4ab8f8b33798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.902311 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d6a025b9a248c5ab9422fe1c340f3e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:03.925035 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfcb523e24548108a6e927b3a1a6711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.902977 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfff9d60bb7e4a86b14687b581b45efe" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:03.925817 993 leader_election.cc:343] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:03.926024 993 leader_election.cc:343] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:03.926221 1719 raft_consensus.cc:2804] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:03.926461 1719 raft_consensus.cc:697] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:03.926731 1719 consensus_queue.cc:237] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:03.928689 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf5611e97e14eb1bf8515532f3a43be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.932646 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f97b0a0e70e4fb2b318ffbbcb0ed790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.935653 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 29712de1da8b47098aad2b962390f790 (DEFAULT_TABLE table=default.Table_ef97cbfc987249e68055ac2866180927 [id=eee29c7f286c40b88749d162e759d2ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.936189 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 352ca272888f4dd2ab1a8127bb8c2b6e
I20260616 19:52:03.936414 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29712de1da8b47098aad2b962390f790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.936604 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd020407d4f8470e99045206ca16c6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.938771 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c152425c57194fcfb3477de6f8beb86a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.939747 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c152425c57194fcfb3477de6f8beb86a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.943045 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 733f4f262ed64a01a5f5f4c68ba37872 (DEFAULT_TABLE table=default.Table_f67b3d225b1640d8abebc117046112d3 [id=733d9a39b333408682f8d25cbd313840]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.943662 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733f4f262ed64a01a5f5f4c68ba37872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.946529 1025 tablet_service.cc:1511] Processing CreateTablet for tablet d69db202af9e4d4f86a9d8d40e9fe3af (DEFAULT_TABLE table=default.Table_5c350aaa51a946fdb5ae09ea14521686 [id=1e981f1a41514a5283fb6f650cab0c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.946933 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d69db202af9e4d4f86a9d8d40e9fe3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.947079 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 451ef03db89043cbbed12a2a48a16adb
I20260616 19:52:03.949345 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a101a14942104b85a0a224c87c0212cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.950809 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a6a46041464e93811b0c573db19f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.951545 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d862f2ce2e4051bcbc71ba8f24846e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.952064 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6707acac4ee4283b138fb44e4e82ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.952900 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2a3f93685146e9a7bf2713cc71dcb6 (DEFAULT_TABLE table=default.Table_9bdaebf159a743c09c4c8a5b3e57c61d [id=3c3db4dc67514942909aacccd43c4f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.953506 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 545) took 2416 ms. Trace:
I20260616 19:52:03.953672 1191 rpcz_store.cc:276] 0616 19:52:01.536850 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.536904 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:03.953350 (+2416446us) ts_tablet_manager.cc:1151] Deleting tablet f13d175adfe540b39fd55004a11c9aad
0616 19:52:03.953357 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.953463 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2416101}
I20260616 19:52:03.954324 1191 tablet_replica.cc:333] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:03.954589 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 08db2c1398b946c180d81b88504c1d9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08db2c1398b946c180d81b88504c1d9c already in progress: creating tablet
I20260616 19:52:03.954799 1191 raft_consensus.cc:2243] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:03.954988 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 915267e7ff3c439385a861dfb954b852 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 915267e7ff3c439385a861dfb954b852 already in progress: creating tablet
W20260616 19:52:03.955252 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet bc2006e262cc4bbb9b291a5bf52653cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc2006e262cc4bbb9b291a5bf52653cd already in progress: creating tablet
I20260616 19:52:03.955299 1191 raft_consensus.cc:2272] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:03.955489 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 61189a715da140a6833801681bbd5ef4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61189a715da140a6833801681bbd5ef4 already in progress: creating tablet
W20260616 19:52:03.956239 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet f13d175adfe540b39fd55004a11c9aad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f13d175adfe540b39fd55004a11c9aad already in progress: creating tablet
I20260616 19:52:03.956516 1191 ts_tablet_manager.cc:1916] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:03.958263 904 tablet_service.cc:1511] Processing CreateTablet for tablet fd020407d4f8470e99045206ca16c6d2 (DEFAULT_TABLE table=default.Table_c917659aef8241b98ffa4caa9c7b96a5 [id=a09e60b6ece848f8b254ed384e98abaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.958636 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd020407d4f8470e99045206ca16c6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.869477 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3d63e27afea44f98a435cca600a9c873" } new_table_name: "default.Table_16508a5420d3488088367681d9b55f03" modify_external_catalogs: true
I20260616 19:52:03.966226 1198 tablet_bootstrap.cc:492] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:03.969579 1190 ts_tablet_manager.cc:1929] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:03.974606 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d686190fb6a34ab18cc4799197765f1b
I20260616 19:52:03.975158 457 catalog_manager.cc:6784] ReplaceTablet: tablet d686190fb6a34ab18cc4799197765f1b deleted and replaced by tablet 3d44aed473e44e2eaa0d166f164c9309
I20260616 19:52:03.979943 1198 ts_tablet_manager.cc:1403] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.322s user 0.008s sys 0.007s
I20260616 19:52:03.984019 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_453f5cc67bd947608ab2945126f31076"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.984619 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_453f5cc67bd947608ab2945126f31076 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.985347 1198 raft_consensus.cc:359] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:03.985819 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_048d35b467534cb1880946049256223f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.986285 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_048d35b467534cb1880946049256223f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.990039 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_fd2877e9bb114ec3ac154536733fe899"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:03.990507 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd2877e9bb114ec3ac154536733fe899 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:03.989889 1198 raft_consensus.cc:385] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:03.991508 1198 raft_consensus.cc:740] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:03.993291 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0a406124a8d34e578ba94fab2a873a55
I20260616 19:52:03.993921 1198 consensus_queue.cc:260] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:03.996042 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 733f956d45d84506bfb666832a9aaedf (DEFAULT_TABLE table=default.Table_5a1b414e058f427e9bb10ce0b4b789bd [id=ed0aab1bc453416384c60e115390849b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:03.997591 719 leader_election.cc:343] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: b99740ab59f947aabcac88dc2bf2de86
I20260616 19:52:03.999883 746 tablet_service.cc:1511] Processing CreateTablet for tablet f92e45da793440d59439c715e8e50249 (DEFAULT_TABLE table=default.Table_186422b1f85f4034b1e8f7a7508dd5fa [id=8f881847ce5a42958693867bf6026b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.000284 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d79d86fc0a4594a4c6696bc4a30403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.003755 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733f956d45d84506bfb666832a9aaedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.005000 452 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 9c77fd138ce9463b8f2d6f4182a56559 (table default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17]). Expected version 1 got 0
I20260616 19:52:04.007159 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8edbc6ccbac744a6892039a2c31f4372"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.008116 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8edbc6ccbac744a6892039a2c31f4372 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:04.011250 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4faa62f03c2a4588a776883dc54d0426 consensus state has no leader
I20260616 19:52:04.017354 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a406124a8d34e578ba94fab2a873a55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.971203 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 4481d9d481ee45449ac332ff19c06a54 (DEFAULT_TABLE table=default.Table_609f08c548144b62a7533ccf6f2d5219 [id=eacde9a7051d4229b9d7e623e06c03e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.974332 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 802d30c340494490896c8da33d110708 with delete_type TABLET_DATA_DELETED (replaced by tablet c5047956478f488dbb4734bbaa138c00) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.976784 1021 tablet_service.cc:1511] Processing CreateTablet for tablet a555ad9f529943558a5ef6ea5c99851d (DEFAULT_TABLE table=default.Table_d1c9326d48f345f4b4b368dad96e1369 [id=b43cf67000634f37b223b775f3578899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.018561 454 master_service.cc:960] ReplaceTablet: received request to replace tablet c6be4a4739464be7b246a54b7a33adaf from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:04.018896 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a555ad9f529943558a5ef6ea5c99851d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.971109 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc52e26f5554d789addb5923a612070 (DEFAULT_TABLE table=default.Table_7b1eed4af94f4d9497213d6a3bc40ddc [id=e8d609624264417786b2a623ba317a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.020783 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc52e26f5554d789addb5923a612070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.973052 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet c5657b6b56af4b8f8eff1fa18836df9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.998572 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 352ca272888f4dd2ab1a8127bb8c2b6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:03.999933 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet d686190fb6a34ab18cc4799197765f1b with delete_type TABLET_DATA_DELETED (replaced by tablet 3d44aed473e44e2eaa0d166f164c9309) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:04.000068 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 451ef03db89043cbbed12a2a48a16adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:04.000728 1198 ts_tablet_manager.cc:1434] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260616 19:52:04.024384 1198 tablet_bootstrap.cc:492] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:03.988255 1029 tablet_service.cc:1511] Processing CreateTablet for tablet de16c3feb7374077bc9817c703e5127c (DEFAULT_TABLE table=default.Table_c11b3c4a27ad4ff4859736ff527242ee [id=ac8166b3bff9407fb068402c593409ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.025079 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de16c3feb7374077bc9817c703e5127c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.027840 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d2da0df1a65d4d588c4666b703fb9e3b" } modify_external_catalogs: true
I20260616 19:52:04.027923 1198 tablet_bootstrap.cc:654] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:04.028021 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d2da0df1a65d4d588c4666b703fb9e3b" } modify_external_catalogs: true
I20260616 19:52:04.037073 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4481d9d481ee45449ac332ff19c06a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.974620 899 tablet_service.cc:1511] Processing CreateTablet for tablet d6707acac4ee4283b138fb44e4e82ce5 (DEFAULT_TABLE table=default.Table_15f01a98a5844f30a111f3640753af1d [id=cbb4373000fd49ebb362881b96a247a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.038614 1874 raft_consensus.cc:493] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:04.038842 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6707acac4ee4283b138fb44e4e82ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:03.975318 891 tablet_service.cc:1511] Processing CreateTablet for tablet 1f97b0a0e70e4fb2b318ffbbcb0ed790 (DEFAULT_TABLE table=default.Table_90dd7bdb2d6943c5a3864e1a09318956 [id=d65edabb0a6d4e4993571e661fba01cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.975389 888 tablet_service.cc:1511] Processing CreateTablet for tablet 3a889b7dea504e8192d1c81a79a975dd (DEFAULT_TABLE table=default.Table_e7113aa5e6074bba96617bb94cd588a2 [id=c2950800f7144d0481facf082aefc762]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.975514 890 tablet_service.cc:1558] Processing DeleteTablet for tablet fdc6222db09d4cd987cbdf70e4d40f70 with delete_type TABLET_DATA_DELETED (replaced by tablet d5c82b71969e4cbcb890d16e1cdd5348) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.039620 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a889b7dea504e8192d1c81a79a975dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.039536 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 802d30c340494490896c8da33d110708 with delete_type TABLET_DATA_DELETED (replaced by tablet c5047956478f488dbb4734bbaa138c00) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.975723 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ac5b6be55944bdfb12db675442b1f1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:03.975965 893 tablet_service.cc:1511] Processing CreateTablet for tablet 1dfcb523e24548108a6e927b3a1a6711 (DEFAULT_TABLE table=default.Table_b6a04b83dfdc40eda84e5090f4f315bd [id=a5775d76226646c9a57e01423c4d9ec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.039951 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfcb523e24548108a6e927b3a1a6711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.040040 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 602) took 1003 ms. Trace:
I20260616 19:52:04.041651 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2a3f93685146e9a7bf2713cc71dcb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.042662 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92e45da793440d59439c715e8e50249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.042946 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f47e639195478f9cda4ab8f8b33798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.044661 892 tablet_service.cc:1511] Processing CreateTablet for tablet de16c3feb7374077bc9817c703e5127c (DEFAULT_TABLE table=default.Table_c11b3c4a27ad4ff4859736ff527242ee [id=ac8166b3bff9407fb068402c593409ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.976079 900 tablet_service.cc:1511] Processing CreateTablet for tablet ea0a7f80c5a34dbfabce579b6f574f93 (DEFAULT_TABLE table=default.Table_45887a2d367d4294bce394b38dbe33ac [id=10ba0af63bcc4e46a6053933ffd539db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.976619 903 tablet_service.cc:1511] Processing CreateTablet for tablet ce0963f38738468eb1518deadb3f119d (DEFAULT_TABLE table=default.Table_2c2be2e62d114c318e2d9fe6b6f2421f [id=7246d1b3c155431fa46c4624e274e5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.977229 901 tablet_service.cc:1511] Processing CreateTablet for tablet bb9509607ee04d7bb3b412f539af21ce (DEFAULT_TABLE table=default.Table_7aeeccc151924d7f9851b501e784bde7 [id=be0dbbc4069e497cb897b53038577f21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.045275 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99740ab59f947aabcac88dc2bf2de86" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:03.978216 894 tablet_service.cc:1511] Processing CreateTablet for tablet 4a81c733ac4c4eec9eebf5c73fff851b (DEFAULT_TABLE table=default.Table_06cfa94be6934d30830e13d6af1ba8a1 [id=6729ba1b59b245e185dd2bf77236a20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.978835 896 tablet_service.cc:1511] Processing CreateTablet for tablet 81f881fd3ad244f9afd70b4b99d9384d (DEFAULT_TABLE table=default.Table_2da181f5cbc54988a562cad81caaf1c0 [id=adb4c641390f4e52a4b461489ef9e51a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.979501 886 tablet_service.cc:1511] Processing CreateTablet for tablet 29712de1da8b47098aad2b962390f790 (DEFAULT_TABLE table=default.Table_ef97cbfc987249e68055ac2866180927 [id=eee29c7f286c40b88749d162e759d2ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.980083 898 tablet_service.cc:1511] Processing CreateTablet for tablet 733f4f262ed64a01a5f5f4c68ba37872 (DEFAULT_TABLE table=default.Table_f67b3d225b1640d8abebc117046112d3 [id=733d9a39b333408682f8d25cbd313840]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.980710 895 tablet_service.cc:1511] Processing CreateTablet for tablet d69db202af9e4d4f86a9d8d40e9fe3af (DEFAULT_TABLE table=default.Table_5c350aaa51a946fdb5ae09ea14521686 [id=1e981f1a41514a5283fb6f650cab0c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.981274 897 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2a3f93685146e9a7bf2713cc71dcb6 (DEFAULT_TABLE table=default.Table_9bdaebf159a743c09c4c8a5b3e57c61d [id=3c3db4dc67514942909aacccd43c4f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.981843 902 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc52e26f5554d789addb5923a612070 (DEFAULT_TABLE table=default.Table_7b1eed4af94f4d9497213d6a3bc40ddc [id=e8d609624264417786b2a623ba317a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:03.982437 889 tablet_service.cc:1511] Processing CreateTablet for tablet 4481d9d481ee45449ac332ff19c06a54 (DEFAULT_TABLE table=default.Table_609f08c548144b62a7533ccf6f2d5219 [id=eacde9a7051d4229b9d7e623e06c03e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.044678 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f97b0a0e70e4fb2b318ffbbcb0ed790. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:04.046295 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 731556662b62419dae76149b22469ebd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 731556662b62419dae76149b22469ebd already in progress: creating tablet
I20260616 19:52:04.047006 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 2c31c8e977da4a70bca1beb00f364627 (table default.Table_9e98175df9ce48a59cb42b1e48cd7fba [id=cb4c50d05fdd4c0a85828222eeb0f06a]) successfully deleted
W20260616 19:52:04.047412 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet f293d557a9aa4ca4885aa917fe1565e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f293d557a9aa4ca4885aa917fe1565e4 already in progress: creating tablet
W20260616 19:52:04.047780 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet b2e5e84b95c7429bb53dd616f118500a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2e5e84b95c7429bb53dd616f118500a already in progress: creating tablet
W20260616 19:52:04.048084 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 31592a5ffb04429c9315a4fd72308f28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31592a5ffb04429c9315a4fd72308f28 already in progress: creating tablet
W20260616 19:52:04.048441 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet b718514e4fbd4601afeb021ed35643e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b718514e4fbd4601afeb021ed35643e6 already in progress: creating tablet
I20260616 19:52:04.048565 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0a7f80c5a34dbfabce579b6f574f93. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:04.048800 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 8c0a6191ad334400a319778fc4e559af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c0a6191ad334400a319778fc4e559af already in progress: creating tablet
W20260616 19:52:04.049139 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet fbe784716b3c4293bd4eddf57f6c9048 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbe784716b3c4293bd4eddf57f6c9048 already in progress: creating tablet
W20260616 19:52:04.049450 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 9105320d5b36457d9dd74b553a44db2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9105320d5b36457d9dd74b553a44db2c already in progress: creating tablet
W20260616 19:52:04.049855 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 already in progress: creating tablet
I20260616 19:52:04.051965 1192 tablet_bootstrap.cc:492] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:04.052151 1192 ts_tablet_manager.cc:1403] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.290s user 0.006s sys 0.010s
I20260616 19:52:04.052274 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet f2c392b2fecd483d9da12e30e37f27ad (table default.Table_ce91ab4603cc400d94cf6e1fcfe99048 [id=e05ed7086cba4c24b2a2d5968338a743]) successfully deleted
I20260616 19:52:04.052825 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0963f38738468eb1518deadb3f119d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.052893 1192 raft_consensus.cc:359] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.053022 1192 raft_consensus.cc:385] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.053071 1192 raft_consensus.cc:740] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
W20260616 19:52:04.053232 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet bc2006e262cc4bbb9b291a5bf52653cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc2006e262cc4bbb9b291a5bf52653cd already in progress: creating tablet
I20260616 19:52:04.053274 1192 consensus_queue.cc:260] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.057237 890 tablet_service.cc:1511] Processing CreateTablet for tablet 733f956d45d84506bfb666832a9aaedf (DEFAULT_TABLE table=default.Table_5a1b414e058f427e9bb10ce0b4b789bd [id=ed0aab1bc453416384c60e115390849b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.057873 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9509607ee04d7bb3b412f539af21ce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:04.056628 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 196388us
I20260616 19:52:04.057729 1193 rpcz_store.cc:276] 0616 19:52:02.789683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.841148 (+ 51465us) service_pool.cc:224] Handling call
0616 19:52:03.781480 (+940332us) ts_tablet_manager.cc:1151] Deleting tablet 12944efb54824dc4960db5d09c1a1684
0616 19:52:03.781490 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.792789 (+ 11299us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":928591}
I20260616 19:52:04.059317 904 tablet_service.cc:1511] Processing CreateTablet for tablet a555ad9f529943558a5ef6ea5c99851d (DEFAULT_TABLE table=default.Table_d1c9326d48f345f4b4b368dad96e1369 [id=b43cf67000634f37b223b775f3578899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.059643 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a555ad9f529943558a5ef6ea5c99851d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.060352 1192 ts_tablet_manager.cc:1434] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260616 19:52:04.060629 1192 tablet_bootstrap.cc:492] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:04.060652 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a81c733ac4c4eec9eebf5c73fff851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.060750 1190 log.cc:1199] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/59812b232848488b9894e8f8057e9def
I20260616 19:52:04.061527 1190 ts_tablet_manager.cc:1950] T 59812b232848488b9894e8f8057e9def P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:04.061785 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 538) took 2385 ms. Trace:
I20260616 19:52:04.061846 1190 rpcz_store.cc:276] 0616 19:52:01.676112 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.678880 (+ 2768us) service_pool.cc:224] Handling call
0616 19:52:03.896124 (+2217244us) ts_tablet_manager.cc:1151] Deleting tablet 59812b232848488b9894e8f8057e9def
0616 19:52:03.896133 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:03.965895 (+ 69762us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:03.969514 (+ 3619us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.061772 (+ 92258us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2181370}
I20260616 19:52:04.063679 1192 tablet_bootstrap.cc:654] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:04.063603 755 tablet_service.cc:1511] Processing CreateTablet for tablet 1dfcb523e24548108a6e927b3a1a6711 (DEFAULT_TABLE table=default.Table_b6a04b83dfdc40eda84e5090f4f315bd [id=a5775d76226646c9a57e01423c4d9ec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.064752 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f881fd3ad244f9afd70b4b99d9384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.067754 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6222db09d4cd987cbdf70e4d40f70" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:04.067800 1874 raft_consensus.cc:515] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:04.068287 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a555ad9f529943558a5ef6ea5c99851d consensus state has no leader
I20260616 19:52:04.068514 1874 leader_election.cc:290] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:04.068689 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29712de1da8b47098aad2b962390f790. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:04.070137 860 consensus_peers.cc:597] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab33d99d857145dfbda54ff2f7464486. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:04.070384 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f72430c53c2c4cd6920a8fafb2020444" } modify_external_catalogs: true
W20260616 19:52:04.070436 860 leader_election.cc:343] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.070576 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f72430c53c2c4cd6920a8fafb2020444" } modify_external_catalogs: true
I20260616 19:52:04.071338 753 tablet_service.cc:1511] Processing CreateTablet for tablet 3a889b7dea504e8192d1c81a79a975dd (DEFAULT_TABLE table=default.Table_e7113aa5e6074bba96617bb94cd588a2 [id=c2950800f7144d0481facf082aefc762]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.072722 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733f4f262ed64a01a5f5f4c68ba37872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.073477 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd020407d4f8470e99045206ca16c6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.076691 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d69db202af9e4d4f86a9d8d40e9fe3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.078799 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d368ec65b624ea58f7b750097a78ede" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:04.037815 885 tablet_service.cc:1558] Processing DeleteTablet for tablet c5657b6b56af4b8f8eff1fa18836df9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.080883 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 352ca272888f4dd2ab1a8127bb8c2b6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.080669 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2a3f93685146e9a7bf2713cc71dcb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.081030 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 451ef03db89043cbbed12a2a48a16adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.081141 885 tablet_service.cc:1558] Processing DeleteTablet for tablet d686190fb6a34ab18cc4799197765f1b with delete_type TABLET_DATA_DELETED (replaced by tablet 3d44aed473e44e2eaa0d166f164c9309) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.081254 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a406124a8d34e578ba94fab2a873a55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.082427 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733f956d45d84506bfb666832a9aaedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.084584 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4481d9d481ee45449ac332ff19c06a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.090256 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2046c3a7f01d4a9ca807fe953a4bf57e" } new_table_name: "default.Table_3293f1ac192b412095d4fd8a55739f1f" modify_external_catalogs: true
I20260616 19:52:04.090797 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc52e26f5554d789addb5923a612070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.092432 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 542) took 2376 ms. Trace:
I20260616 19:52:04.092536 1190 rpcz_store.cc:276] 0616 19:52:01.716201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.716614 (+ 413us) service_pool.cc:224] Handling call
0616 19:52:04.062064 (+2345450us) ts_tablet_manager.cc:1151] Deleting tablet 90852e10a6804cb1bee075b0e9c0eeaf
0616 19:52:04.062072 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.092413 (+ 30341us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2341161}
I20260616 19:52:04.092864 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 540) took 2376 ms. Trace:
I20260616 19:52:04.092921 1190 rpcz_store.cc:276] 0616 19:52:01.716040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.716639 (+ 599us) service_pool.cc:224] Handling call
0616 19:52:04.092765 (+2376126us) ts_tablet_manager.cc:1151] Deleting tablet 0ca03b6e81e546adada566607257369f
0616 19:52:04.092773 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.092852 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2371723}
I20260616 19:52:04.093183 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 541) took 2377 ms. Trace:
I20260616 19:52:04.093246 1190 rpcz_store.cc:276] 0616 19:52:01.716122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.716679 (+ 557us) service_pool.cc:224] Handling call
0616 19:52:04.093091 (+2376412us) ts_tablet_manager.cc:1151] Deleting tablet e6530753b4184cfe972ae3a43f23d589
0616 19:52:04.093098 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.093171 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2368711}
I20260616 19:52:04.093545 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 539) took 2377 ms. Trace:
I20260616 19:52:04.093601 1190 rpcz_store.cc:276] 0616 19:52:01.715935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.716715 (+ 780us) service_pool.cc:224] Handling call
0616 19:52:04.093441 (+2376726us) ts_tablet_manager.cc:1151] Deleting tablet 1a7b177800174706a985c11e5876b9d3
0616 19:52:04.093450 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.093529 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2365732}
I20260616 19:52:04.093817 1190 tablet_replica.cc:333] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:04.093962 1190 raft_consensus.cc:2243] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:04.094085 1190 raft_consensus.cc:2272] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:04.094537 1190 ts_tablet_manager.cc:1916] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:04.097993 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de16c3feb7374077bc9817c703e5127c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:04.098011 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76d73be228664063822c41cbefafcab8 consensus state has no leader
I20260616 19:52:04.100402 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2f33e989c99c495d985aab8a0552fea3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.101034 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f33e989c99c495d985aab8a0552fea3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:04.111611 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 08db2c1398b946c180d81b88504c1d9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08db2c1398b946c180d81b88504c1d9c already in progress: creating tablet
I20260616 19:52:04.111615 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6317cff18ebf41fea539a7699abd46df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.111990 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 915267e7ff3c439385a861dfb954b852 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 915267e7ff3c439385a861dfb954b852 already in progress: creating tablet
W20260616 19:52:04.112224 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet f13d175adfe540b39fd55004a11c9aad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f13d175adfe540b39fd55004a11c9aad already in progress: creating tablet
W20260616 19:52:04.112385 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6317cff18ebf41fea539a7699abd46df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:04.112587 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 61189a715da140a6833801681bbd5ef4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61189a715da140a6833801681bbd5ef4 already in progress: creating tablet
I20260616 19:52:04.112793 764 tablet_service.cc:1511] Processing CreateTablet for tablet d6707acac4ee4283b138fb44e4e82ce5 (DEFAULT_TABLE table=default.Table_15f01a98a5844f30a111f3640753af1d [id=cbb4373000fd49ebb362881b96a247a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.118104 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 59812b232848488b9894e8f8057e9def (table default.Table_191f8acd55ae4da9982a9fb3ec2d51cd [id=1beb7d130df7492ab9b834d005eba63a]) successfully deleted
W20260616 19:52:04.020702 858 consensus_peers.cc:597] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b99740ab59f947aabcac88dc2bf2de86. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:04.120939 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 100269us
W20260616 19:52:04.121855 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 90852e10a6804cb1bee075b0e9c0eeaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90852e10a6804cb1bee075b0e9c0eeaf already in progress: creating tablet
W20260616 19:52:04.125672 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 0ca03b6e81e546adada566607257369f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ca03b6e81e546adada566607257369f already in progress: creating tablet
W20260616 19:52:04.126856 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet e6530753b4184cfe972ae3a43f23d589 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6530753b4184cfe972ae3a43f23d589 already in progress: creating tablet
W20260616 19:52:04.127619 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 1a7b177800174706a985c11e5876b9d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a7b177800174706a985c11e5876b9d3 already in progress: creating tablet
I20260616 19:52:04.131770 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d368ec65b624ea58f7b750097a78ede" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:04.131987 922 raft_consensus.cc:2468] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:04.135596 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e507611d620b4d9aa713d673c64bd815" } new_table_name: "default.Table_42ed075e04034abab84e6fff949a448e" modify_external_catalogs: true
I20260616 19:52:04.138252 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_74f3d2b26e0d4319b73c964c2eaf9204" } modify_external_catalogs: true
I20260616 19:52:04.138440 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_74f3d2b26e0d4319b73c964c2eaf9204" } modify_external_catalogs: true
I20260616 19:52:04.141409 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 99b211692aca478bb40f0f2c3f50ca44 with delete_type TABLET_DATA_DELETED (replaced by tablet 44493f0ffd064249a28628cf24895395) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.151710 1892 tablet.cc:1724] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260616 19:52:04.153367 719 leader_election.cc:343] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: Tablet not RUNNING: STOPPED
I20260616 19:52:04.153839 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ac5b6be55944bdfb12db675442b1f1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.154170 718 leader_election.cc:304] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:04.154867 1198 tablet_bootstrap.cc:492] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:04.156601 1198 ts_tablet_manager.cc:1403] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.131s user 0.007s sys 0.004s
W20260616 19:52:04.157733 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 73239.5us
I20260616 19:52:04.157887 1196 tablet_bootstrap.cc:492] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:04.157892 1191 ts_tablet_manager.cc:1929] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:04.157783 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 604) took 1144 ms. Trace:
I20260616 19:52:04.158026 1191 log.cc:1199] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/1d368ec65b624ea58f7b750097a78ede
I20260616 19:52:04.159206 1191 ts_tablet_manager.cc:1950] T 1d368ec65b624ea58f7b750097a78ede P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:04.159991 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 547) took 2531 ms. Trace:
I20260616 19:52:04.160856 1196 ts_tablet_manager.cc:1403] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.525s user 0.011s sys 0.008s
I20260616 19:52:04.160784 1193 rpcz_store.cc:276] 0616 19:52:02.917002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.920363 (+ 3361us) service_pool.cc:224] Handling call
0616 19:52:04.059389 (+1139026us) ts_tablet_manager.cc:1151] Deleting tablet 47bbf21dc1d945ce8f5edd27cdf26817
0616 19:52:04.059399 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.061666 (+ 2267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1122318}
I20260616 19:52:04.161159 751 tablet_service.cc:1511] Processing CreateTablet for tablet 4a81c733ac4c4eec9eebf5c73fff851b (DEFAULT_TABLE table=default.Table_06cfa94be6934d30830e13d6af1ba8a1 [id=6729ba1b59b245e185dd2bf77236a20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.170430 1191 rpcz_store.cc:276] 0616 19:52:01.628730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.630997 (+ 2267us) service_pool.cc:224] Handling call
0616 19:52:03.954196 (+2323199us) ts_tablet_manager.cc:1151] Deleting tablet 1d368ec65b624ea58f7b750097a78ede
0616 19:52:03.954205 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.097511 (+143306us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.155916 (+ 58405us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.159959 (+ 4043us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2322927}
I20260616 19:52:04.170898 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 1d368ec65b624ea58f7b750097a78ede (table default.Table_e2ea805b6664428787f4a70953fd22ea [id=0745df538b5e4be8b0ba20653abe53ae]) successfully deleted
I20260616 19:52:04.171226 1191 tablet_replica.cc:333] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:04.171427 1198 raft_consensus.cc:359] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.171627 1191 raft_consensus.cc:2243] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:04.172348 1191 raft_consensus.cc:2272] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:04.161062 760 tablet_service.cc:1511] Processing CreateTablet for tablet 29712de1da8b47098aad2b962390f790 (DEFAULT_TABLE table=default.Table_ef97cbfc987249e68055ac2866180927 [id=eee29c7f286c40b88749d162e759d2ad]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:04.174096 858 consensus_peers.cc:597] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb024637294148c18b74bef47fb2fcce. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:04.175746 757 tablet_service.cc:1511] Processing CreateTablet for tablet ea0a7f80c5a34dbfabce579b6f574f93 (DEFAULT_TABLE table=default.Table_45887a2d367d4294bce394b38dbe33ac [id=10ba0af63bcc4e46a6053933ffd539db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.176371 1192 tablet_bootstrap.cc:492] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:04.176529 1192 ts_tablet_manager.cc:1403] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.116s user 0.003s sys 0.000s
I20260616 19:52:04.177237 1192 raft_consensus.cc:359] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.177423 1192 raft_consensus.cc:385] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.177481 1192 raft_consensus.cc:740] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:04.177742 1192 consensus_queue.cc:260] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.178232 1192 ts_tablet_manager.cc:1434] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:04.178692 1192 tablet_bootstrap.cc:492] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:04.188086 1192 tablet_bootstrap.cc:654] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:04.193467 784 raft_consensus.cc:3060] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.195474 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c6be4a4739464be7b246a54b7a33adaf
I20260616 19:52:04.196147 454 catalog_manager.cc:6784] ReplaceTablet: tablet c6be4a4739464be7b246a54b7a33adaf deleted and replaced by tablet aee589880bac4eff98fa6edd32c0b92d
I20260616 19:52:04.196451 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_63b7e3fef1bf4a09bf9ca314f19f5eec" } modify_external_catalogs: true
I20260616 19:52:04.196648 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_63b7e3fef1bf4a09bf9ca314f19f5eec" } modify_external_catalogs: true
I20260616 19:52:04.201198 1198 raft_consensus.cc:385] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.201385 1198 raft_consensus.cc:740] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:04.208904 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d2b3bbc4adb0492a87cd9226cf6a3c8f
I20260616 19:52:04.209857 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9a016ce4f9ae4cec8cd633eb68a288bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.210534 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a016ce4f9ae4cec8cd633eb68a288bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.211549 1874 consensus_queue.cc:1048] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.132s
I20260616 19:52:04.212375 762 tablet_service.cc:1511] Processing CreateTablet for tablet bb9509607ee04d7bb3b412f539af21ce (DEFAULT_TABLE table=default.Table_7aeeccc151924d7f9851b501e784bde7 [id=be0dbbc4069e497cb897b53038577f21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.212625 892 tablet_service.cc:1558] Processing DeleteTablet for tablet d2b3bbc4adb0492a87cd9226cf6a3c8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.213492 752 tablet_service.cc:1511] Processing CreateTablet for tablet 1f97b0a0e70e4fb2b318ffbbcb0ed790 (DEFAULT_TABLE table=default.Table_90dd7bdb2d6943c5a3864e1a09318956 [id=d65edabb0a6d4e4993571e661fba01cd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:04.217708 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9484090f92e48e3869d777f55f5cd17 consensus state has no leader
I20260616 19:52:04.218120 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7fce2ed3c7c848d0934500fec50d1198" } modify_external_catalogs: true
I20260616 19:52:04.218303 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7fce2ed3c7c848d0934500fec50d1198" } modify_external_catalogs: true
I20260616 19:52:04.219081 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b70123afde084dac9b1dfd2fc95935c7" } new_table_name: "default.Table_dc32eb83877c44ef9915af11d1e1a1b0" modify_external_catalogs: true
I20260616 19:52:04.221505 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfcb523e24548108a6e927b3a1a6711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.221753 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0a7f80c5a34dbfabce579b6f574f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.221840 747 tablet_service.cc:1511] Processing CreateTablet for tablet ce0963f38738468eb1518deadb3f119d (DEFAULT_TABLE table=default.Table_2c2be2e62d114c318e2d9fe6b6f2421f [id=7246d1b3c155431fa46c4624e274e5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.222114 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6222db09d4cd987cbdf70e4d40f70" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:04.222924 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6707acac4ee4283b138fb44e4e82ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.192016 1190 ts_tablet_manager.cc:1929] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:04.224655 750 tablet_service.cc:1511] Processing CreateTablet for tablet 733f4f262ed64a01a5f5f4c68ba37872 (DEFAULT_TABLE table=default.Table_f67b3d225b1640d8abebc117046112d3 [id=733d9a39b333408682f8d25cbd313840]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.224797 1190 log.cc:1199] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/662e2d573bd7489a81697c17393ce088
W20260616 19:52:04.224901 718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 45375.9us
I20260616 19:52:04.225162 1190 ts_tablet_manager.cc:1950] T 662e2d573bd7489a81697c17393ce088 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:04.225811 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 544) took 2497 ms. Trace:
I20260616 19:52:04.225792 718 leader_election.cc:304] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
W20260616 19:52:04.226338 860 leader_election.cc:343] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.226346 1190 rpcz_store.cc:276] 0616 19:52:01.728101 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.728642 (+ 541us) service_pool.cc:224] Handling call
0616 19:52:04.093783 (+2365141us) ts_tablet_manager.cc:1151] Deleting tablet 662e2d573bd7489a81697c17393ce088
0616 19:52:04.093790 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.189206 (+ 95416us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.191970 (+ 2764us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.225759 (+ 33789us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2362963}
I20260616 19:52:04.226703 1872 consensus_queue.cc:1048] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:04.197000 904 tablet_service.cc:1558] Processing DeleteTablet for tablet c6be4a4739464be7b246a54b7a33adaf with delete_type TABLET_DATA_DELETED (replaced by tablet aee589880bac4eff98fa6edd32c0b92d) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.227190 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 548) took 2486 ms. Trace:
I20260616 19:52:04.227229 1872 consensus_queue.cc:1048] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:04.227276 1190 rpcz_store.cc:276] 0616 19:52:01.740804 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.740856 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:04.227027 (+2486171us) ts_tablet_manager.cc:1151] Deleting tablet f54eef97f8db47449564b49be608902f
0616 19:52:04.227036 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.227131 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2485884}
I20260616 19:52:04.227540 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a889b7dea504e8192d1c81a79a975dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.227608 1872 raft_consensus.cc:2804] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:04.227712 1872 raft_consensus.cc:493] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:04.227811 1872 raft_consensus.cc:3060] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.228235 1190 tablet_replica.cc:333] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:04.228423 1190 raft_consensus.cc:2243] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:04.228797 1190 raft_consensus.cc:2272] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:04.228821 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 662e2d573bd7489a81697c17393ce088 (table default.Table_11377e6262de467fbd54d3ab881b4362 [id=543aa36f72844ba182c88e2510bfe65c]) successfully deleted
W20260616 19:52:04.229189 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet f54eef97f8db47449564b49be608902f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f54eef97f8db47449564b49be608902f already in progress: creating tablet
I20260616 19:52:04.238095 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8f2d9ccc00284b5faaed69198782b56c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.238684 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f2d9ccc00284b5faaed69198782b56c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:04.243530 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 65164c1907674ddd968e1acf0aee40e1 consensus state has no leader
I20260616 19:52:04.243881 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0d460c8772ab439ebbdb0ac62f94dd34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.249519 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d460c8772ab439ebbdb0ac62f94dd34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.250322 756 tablet_service.cc:1511] Processing CreateTablet for tablet 81f881fd3ad244f9afd70b4b99d9384d (DEFAULT_TABLE table=default.Table_2da181f5cbc54988a562cad81caaf1c0 [id=adb4c641390f4e52a4b461489ef9e51a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.256181 754 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2a3f93685146e9a7bf2713cc71dcb6 (DEFAULT_TABLE table=default.Table_9bdaebf159a743c09c4c8a5b3e57c61d [id=3c3db4dc67514942909aacccd43c4f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.263818 748 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc52e26f5554d789addb5923a612070 (DEFAULT_TABLE table=default.Table_7b1eed4af94f4d9497213d6a3bc40ddc [id=e8d609624264417786b2a623ba317a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.265694 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet c6be4a4739464be7b246a54b7a33adaf with delete_type TABLET_DATA_DELETED (replaced by tablet aee589880bac4eff98fa6edd32c0b92d) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:04.265985 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet d2b3bbc4adb0492a87cd9226cf6a3c8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:04.266222 1198 consensus_queue.cc:260] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.271514 753 tablet_service.cc:1558] Processing DeleteTablet for tablet c5657b6b56af4b8f8eff1fa18836df9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.271727 1198 ts_tablet_manager.cc:1434] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.115s user 0.003s sys 0.000s
I20260616 19:52:04.279796 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b1e42d7ed6304430a453bb9184363f77" } new_table_name: "default.Table_2febac8b65d54418b702b4b5bb9e31c5" modify_external_catalogs: true
I20260616 19:52:04.284806 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a81c733ac4c4eec9eebf5c73fff851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.285519 1190 ts_tablet_manager.cc:1916] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:04.287340 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ffce2dc22e24d1684e6eae92c487cea" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:04.287647 996 leader_election.cc:304] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:04.288070 1849 raft_consensus.cc:2804] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:04.288163 1849 raft_consensus.cc:493] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:04.288257 1849 raft_consensus.cc:3060] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.291492 1849 raft_consensus.cc:515] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.288672 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet ab33d99d857145dfbda54ff2f7464486 (table default.Table_0a6adf1d7e5244debb4424a25d63a45d [id=122f88b500c0425e833926b349605d6f]) successfully deleted
W20260616 19:52:04.292541 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2d05c86bca9343a2bc8c5709e1c49647 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d05c86bca9343a2bc8c5709e1c49647 already in progress: creating tablet
W20260616 19:52:04.292784 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0c166a93c88b45f799e14e10e802b5a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c166a93c88b45f799e14e10e802b5a0 already in progress: creating tablet
I20260616 19:52:04.292779 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eab5bd3967c42e1b6b79558df742946" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:04.292975 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 5a9befb557d84f3bb7781664cbf2f28f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a9befb557d84f3bb7781664cbf2f28f already in progress: creating tablet
I20260616 19:52:04.293071 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8e27f502e29d48349a01906652f67eb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.293540 993 leader_election.cc:343] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:04.293601 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 47bbf21dc1d945ce8f5edd27cdf26817 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47bbf21dc1d945ce8f5edd27cdf26817 already in progress: creating tablet
W20260616 19:52:04.293697 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e27f502e29d48349a01906652f67eb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.294422 1849 leader_election.cc:290] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:04.296204 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 609) took 1246 ms. Trace:
I20260616 19:52:04.301054 763 tablet_service.cc:1511] Processing CreateTablet for tablet d69db202af9e4d4f86a9d8d40e9fe3af (DEFAULT_TABLE table=default.Table_5c350aaa51a946fdb5ae09ea14521686 [id=1e981f1a41514a5283fb6f650cab0c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.302408 1196 raft_consensus.cc:359] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.302489 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2365f5983f194955a1a82ebcca715137" } new_table_name: "default.Table_64c96e45a8124b5ea619d8662ef34ed2" modify_external_catalogs: true
I20260616 19:52:04.302632 1196 raft_consensus.cc:385] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.300999 1193 rpcz_store.cc:276] 0616 19:52:02.937332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.937428 (+ 96us) service_pool.cc:224] Handling call
0616 19:52:04.161080 (+1223652us) ts_tablet_manager.cc:1151] Deleting tablet 90630f9e6f314c5d9589e673339f475a
0616 19:52:04.161091 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.183516 (+ 22425us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1223472}
I20260616 19:52:04.303287 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733f4f262ed64a01a5f5f4c68ba37872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.302410 1872 raft_consensus.cc:515] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.304108 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0963f38738468eb1518deadb3f119d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.304118 1196 raft_consensus.cc:740] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
W20260616 19:52:04.305644 719 leader_election.cc:343] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 1d368ec65b624ea58f7b750097a78ede
I20260616 19:52:04.309523 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 802d30c340494490896c8da33d110708 with delete_type TABLET_DATA_DELETED (replaced by tablet c5047956478f488dbb4734bbaa138c00) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.309559 1196 consensus_queue.cc:260] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.312404 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf73c4c1133405bb46df19c0559ab92" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:04.312350 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_45f727fb97db43d3bdbf9b1046001a45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.312920 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45f727fb97db43d3bdbf9b1046001a45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.312924 1872 leader_election.cc:290] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:04.313089 1751 raft_consensus.cc:2749] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:04.315969 758 tablet_service.cc:1511] Processing CreateTablet for tablet de16c3feb7374077bc9817c703e5127c (DEFAULT_TABLE table=default.Table_c11b3c4a27ad4ff4859736ff527242ee [id=ac8166b3bff9407fb068402c593409ed]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:04.319070 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b18f270bdda4413d811e2a32ade37dd3 consensus state has no leader
I20260616 19:52:04.324865 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc52e26f5554d789addb5923a612070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.325986 753 tablet_service.cc:1511] Processing CreateTablet for tablet a555ad9f529943558a5ef6ea5c99851d (DEFAULT_TABLE table=default.Table_d1c9326d48f345f4b4b368dad96e1369 [id=b43cf67000634f37b223b775f3578899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.326690 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d6a025b9a248c5ab9422fe1c340f3e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:04.327282 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 608) took 1371 ms. Trace:
I20260616 19:52:04.327384 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f881fd3ad244f9afd70b4b99d9384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.327415 1193 rpcz_store.cc:276] 0616 19:52:02.937198 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.939009 (+ 1811us) service_pool.cc:224] Handling call
0616 19:52:04.302970 (+1363961us) ts_tablet_manager.cc:1151] Deleting tablet 7dafeb24a59948b28e26730194e29758
0616 19:52:04.302980 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.308982 (+ 6002us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1361645}
I20260616 19:52:04.329584 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d69db202af9e4d4f86a9d8d40e9fe3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.330313 784 raft_consensus.cc:2468] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:04.330327 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de16c3feb7374077bc9817c703e5127c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.331557 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfff9d60bb7e4a86b14687b581b45efe" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:04.332525 996 leader_election.cc:343] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.332763 996 leader_election.cc:304] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:04.333066 1849 raft_consensus.cc:2749] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:04.333274 996 leader_election.cc:343] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.333379 996 leader_election.cc:304] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:04.333425 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 90630f9e6f314c5d9589e673339f475a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90630f9e6f314c5d9589e673339f475a already in progress: creating tablet
I20260616 19:52:04.333501 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9509607ee04d7bb3b412f539af21ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.333739 996 leader_election.cc:304] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:04.333786 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 7dafeb24a59948b28e26730194e29758 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dafeb24a59948b28e26730194e29758 already in progress: creating tablet
I20260616 19:52:04.333772 1849 raft_consensus.cc:2749] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:04.333935 1849 raft_consensus.cc:2804] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:04.333999 1849 raft_consensus.cc:493] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260616 19:52:04.334056 996 leader_election.cc:343] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.334069 1849 raft_consensus.cc:3060] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.334146 996 leader_election.cc:304] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:04.334470 1848 raft_consensus.cc:2749] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:04.336687 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eab5bd3967c42e1b6b79558df742946" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:04.337756 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 610) took 1382 ms. Trace:
I20260616 19:52:04.337867 1193 rpcz_store.cc:276] 0616 19:52:03.018972 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.036760 (+ 17788us) service_pool.cc:224] Handling call
0616 19:52:04.327674 (+1290914us) ts_tablet_manager.cc:1151] Deleting tablet 4bde746e334a4f59aded168c6b2bb348
0616 19:52:04.327683 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.327963 (+ 280us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1290685}
W20260616 19:52:04.339388 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 4bde746e334a4f59aded168c6b2bb348 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bde746e334a4f59aded168c6b2bb348 already in progress: creating tablet
I20260616 19:52:04.339380 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_02bf2860f6fb4632b760335e3f6319c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.340184 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02bf2860f6fb4632b760335e3f6319c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.341542 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 352ca272888f4dd2ab1a8127bb8c2b6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.341951 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3e6b6285a6f540d3aaabe694ab55e84e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.343039 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e6b6285a6f540d3aaabe694ab55e84e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:04.348826 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e88de49e07a4467d9698d71c321c16f5 consensus state has no leader
I20260616 19:52:04.351509 761 tablet_service.cc:1558] Processing DeleteTablet for tablet d686190fb6a34ab18cc4799197765f1b with delete_type TABLET_DATA_DELETED (replaced by tablet 3d44aed473e44e2eaa0d166f164c9309) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.351740 757 tablet_service.cc:1511] Processing CreateTablet for tablet 733f956d45d84506bfb666832a9aaedf (DEFAULT_TABLE table=default.Table_5a1b414e058f427e9bb10ce0b4b789bd [id=ed0aab1bc453416384c60e115390849b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.352734 746 tablet_service.cc:1558] Processing DeleteTablet for tablet c6be4a4739464be7b246a54b7a33adaf with delete_type TABLET_DATA_DELETED (replaced by tablet aee589880bac4eff98fa6edd32c0b92d) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.353787 755 tablet_service.cc:1558] Processing DeleteTablet for tablet d2b3bbc4adb0492a87cd9226cf6a3c8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.354024 765 tablet_service.cc:1511] Processing CreateTablet for tablet 4481d9d481ee45449ac332ff19c06a54 (DEFAULT_TABLE table=default.Table_609f08c548144b62a7533ccf6f2d5219 [id=eacde9a7051d4229b9d7e623e06c03e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.354804 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 611) took 1320 ms. Trace:
I20260616 19:52:04.354913 1193 rpcz_store.cc:276] 0616 19:52:03.019744 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.037079 (+ 17335us) service_pool.cc:224] Handling call
0616 19:52:04.338110 (+1301031us) ts_tablet_manager.cc:1151] Deleting tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc
0616 19:52:04.338119 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.340175 (+ 2056us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1300841}
I20260616 19:52:04.355710 778 raft_consensus.cc:3060] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.356031 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29712de1da8b47098aad2b962390f790. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:04.356263 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc already in progress: creating tablet
I20260616 19:52:04.359368 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a406124a8d34e578ba94fab2a873a55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.359426 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 612) took 1339 ms. Trace:
I20260616 19:52:04.359557 1193 rpcz_store.cc:276] 0616 19:52:03.019863 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.037357 (+ 17494us) service_pool.cc:224] Handling call
0616 19:52:04.355158 (+1317801us) ts_tablet_manager.cc:1151] Deleting tablet 46faf1477a4b4c9994e556308647cad3
0616 19:52:04.355173 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.359175 (+ 4002us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1317611}
W20260616 19:52:04.360450 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 46faf1477a4b4c9994e556308647cad3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46faf1477a4b4c9994e556308647cad3 already in progress: creating tablet
I20260616 19:52:04.360922 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 451ef03db89043cbbed12a2a48a16adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.361070 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 616) took 1303 ms. Trace:
I20260616 19:52:04.361215 1193 rpcz_store.cc:276] 0616 19:52:03.056406 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.074408 (+ 18002us) service_pool.cc:224] Handling call
0616 19:52:04.359911 (+1285503us) ts_tablet_manager.cc:1151] Deleting tablet c3706f41b0e342a69f66c936173f2ae0
0616 19:52:04.359921 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.360008 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1260472}
I20260616 19:52:04.361768 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f97b0a0e70e4fb2b318ffbbcb0ed790. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:04.362727 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c3706f41b0e342a69f66c936173f2ae0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3706f41b0e342a69f66c936173f2ae0 already in progress: creating tablet
I20260616 19:52:04.363370 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 620) took 1240 ms. Trace:
I20260616 19:52:04.363515 1193 rpcz_store.cc:276] 0616 19:52:03.122131 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.122183 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:04.361939 (+1239756us) ts_tablet_manager.cc:1151] Deleting tablet c0f19c77783a4b53b160589b74dbd20d
0616 19:52:04.361948 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.362368 (+ 420us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1239576}
W20260616 19:52:04.364717 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c0f19c77783a4b53b160589b74dbd20d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0f19c77783a4b53b160589b74dbd20d already in progress: creating tablet
I20260616 19:52:04.273229 1198 tablet_bootstrap.cc:492] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:04.367821 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2a3f93685146e9a7bf2713cc71dcb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.367900 1892 tablet.cc:1724] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:04.369210 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a555ad9f529943558a5ef6ea5c99851d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.369549 1198 tablet_bootstrap.cc:654] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:04.370369 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733f956d45d84506bfb666832a9aaedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.370467 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 621) took 1171 ms. Trace:
I20260616 19:52:04.370564 1193 rpcz_store.cc:276] 0616 19:52:03.195643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.195705 (+ 62us) service_pool.cc:224] Handling call
0616 19:52:04.364295 (+1168590us) ts_tablet_manager.cc:1151] Deleting tablet 64aa32856ca34743933931fb51f2bd7b
0616 19:52:04.364304 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.367132 (+ 2828us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1168367}
I20260616 19:52:04.370990 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 622) took 1157 ms. Trace:
I20260616 19:52:04.371093 1193 rpcz_store.cc:276] 0616 19:52:03.213791 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.213853 (+ 62us) service_pool.cc:224] Handling call
0616 19:52:04.370820 (+1156967us) ts_tablet_manager.cc:1151] Deleting tablet 9d9c89216995430188b1eed4c6b26d1e
0616 19:52:04.370829 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.370930 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1156698}
W20260616 19:52:04.372130 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 64aa32856ca34743933931fb51f2bd7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64aa32856ca34743933931fb51f2bd7b already in progress: creating tablet
W20260616 19:52:04.372496 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 9d9c89216995430188b1eed4c6b26d1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d9c89216995430188b1eed4c6b26d1e already in progress: creating tablet
I20260616 19:52:04.375705 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 626) took 1122 ms. Trace:
I20260616 19:52:04.375849 1193 rpcz_store.cc:276] 0616 19:52:03.249757 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.249829 (+ 72us) service_pool.cc:224] Handling call
0616 19:52:04.371333 (+1121504us) ts_tablet_manager.cc:1151] Deleting tablet e1ab9d0ac7df4d549d52014a0ecd9d1a
0616 19:52:04.371341 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.371788 (+ 447us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1120797}
I20260616 19:52:04.376344 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 628) took 1103 ms. Trace:
I20260616 19:52:04.376530 1193 rpcz_store.cc:276] 0616 19:52:03.272987 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.279539 (+ 6552us) service_pool.cc:224] Handling call
0616 19:52:04.376202 (+1096663us) ts_tablet_manager.cc:1151] Deleting tablet 731473c9021a4522ae2dfecff22c60e6
0616 19:52:04.376211 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.376293 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1096393}
I20260616 19:52:04.377009 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 631) took 1083 ms. Trace:
W20260616 19:52:04.377658 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet e1ab9d0ac7df4d549d52014a0ecd9d1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1ab9d0ac7df4d549d52014a0ecd9d1a already in progress: creating tablet
W20260616 19:52:04.377976 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 731473c9021a4522ae2dfecff22c60e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 731473c9021a4522ae2dfecff22c60e6 already in progress: creating tablet
W20260616 19:52:04.380134 718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 128009us
I20260616 19:52:04.380651 1719 consensus_queue.cc:1048] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:04.388296 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_25fdb3a9609849db808152f62bb0c6bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.389073 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25fdb3a9609849db808152f62bb0c6bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.390107 1719 raft_consensus.cc:493] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:04.390277 1719 raft_consensus.cc:515] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.391063 1719 leader_election.cc:290] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:04.391983 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4481d9d481ee45449ac332ff19c06a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.392001 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b211692aca478bb40f0f2c3f50ca44" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:04.392200 1057 raft_consensus.cc:2468] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:04.392588 858 leader_election.cc:304] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:04.393123 1719 raft_consensus.cc:2804] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:04.393237 1719 raft_consensus.cc:493] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:04.393311 1719 raft_consensus.cc:3060] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.395921 1719 raft_consensus.cc:515] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.396831 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b211692aca478bb40f0f2c3f50ca44" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:04.397038 1057 raft_consensus.cc:3060] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.397795 1913 tablet.cc:1724] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:04.400104 1057 raft_consensus.cc:2468] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:04.401244 858 leader_election.cc:304] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:04.401539 1857 raft_consensus.cc:2804] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:04.401670 1857 raft_consensus.cc:697] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:04.401932 1857 consensus_queue.cc:237] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.410168 1719 leader_election.cc:290] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:04.411882 778 raft_consensus.cc:2468] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:04.412815 996 leader_election.cc:304] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:04.413381 1848 raft_consensus.cc:2804] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:04.413506 1848 raft_consensus.cc:697] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:04.413741 1848 consensus_queue.cc:237] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.416714 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b6f1fb47223d447fb0c0eed0f8b52102" } modify_external_catalogs: true
I20260616 19:52:04.416914 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b6f1fb47223d447fb0c0eed0f8b52102" } modify_external_catalogs: true
I20260616 19:52:04.377139 1193 rpcz_store.cc:276] 0616 19:52:03.293568 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.293623 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:04.376876 (+1083253us) ts_tablet_manager.cc:1151] Deleting tablet c090cf49c61e487a974d953ed1903db7
0616 19:52:04.376884 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.376959 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1083035}
W20260616 19:52:04.419322 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c090cf49c61e487a974d953ed1903db7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c090cf49c61e487a974d953ed1903db7 already in progress: creating tablet
I20260616 19:52:04.419986 1849 raft_consensus.cc:515] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.421155 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf73c4c1133405bb46df19c0559ab92" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:04.421397 921 raft_consensus.cc:3060] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.423975 921 raft_consensus.cc:2468] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:04.424477 993 leader_election.cc:304] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:04.424782 1848 raft_consensus.cc:2804] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:04.424887 1848 raft_consensus.cc:697] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:04.425100 1848 consensus_queue.cc:237] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.425786 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1f18a5bb72304b31829f26b9096e8a35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:04.426290 1719 consensus_queue.cc:1048] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:04.426390 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f18a5bb72304b31829f26b9096e8a35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.427989 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d368ec65b624ea58f7b750097a78ede" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:04.428066 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8a1c5003a0044581ad712e93bff911e2" } new_table_name: "default.Table_9b3d704ef85c4307b3e1566686499acc" modify_external_catalogs: true
I20260616 19:52:04.428191 922 raft_consensus.cc:3060] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.430884 922 raft_consensus.cc:2468] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:04.434473 1190 ts_tablet_manager.cc:1929] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:04.434501 1849 leader_election.cc:290] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:04.434592 1190 log.cc:1199] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/350453721d13427a946ac5c5ee7c62a0
I20260616 19:52:04.434985 1190 ts_tablet_manager.cc:1950] T 350453721d13427a946ac5c5ee7c62a0 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:04.435300 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 552) took 2650 ms. Trace:
I20260616 19:52:04.436510 1193 tablet_replica.cc:333] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:04.437727 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf73c4c1133405bb46df19c0559ab92" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:04.438031 778 raft_consensus.cc:3060] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.441653 1193 raft_consensus.cc:2243] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:04.441951 1193 raft_consensus.cc:2272] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:04.442569 1193 ts_tablet_manager.cc:1916] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:04.443588 1719 raft_consensus.cc:493] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:04.444850 1719 raft_consensus.cc:515] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.446002 1719 leader_election.cc:290] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:04.445955 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fc1d2ecaa746bab980a708dd8eb93a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:04.446139 1057 raft_consensus.cc:2468] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:04.446738 858 leader_election.cc:304] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:04.448626 1719 raft_consensus.cc:2804] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:04.448772 1719 raft_consensus.cc:493] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:04.449503 1719 raft_consensus.cc:3060] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.449411 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bb0a1663e7b242c98ca76882ce400564"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.450172 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb0a1663e7b242c98ca76882ce400564 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.453323 1719 raft_consensus.cc:515] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.454551 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fc1d2ecaa746bab980a708dd8eb93a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:04.454733 1057 raft_consensus.cc:3060] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.457516 1057 raft_consensus.cc:2468] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
W20260616 19:52:04.457691 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88246ba54ff543cb8effb3b96019a2b8 consensus state has no leader
I20260616 19:52:04.457942 858 leader_election.cc:304] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:04.458250 1801 raft_consensus.cc:2804] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:04.463397 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_776442a4731046708d16acd8c5bde21e" } new_table_name: "default.Table_2cbd7a4dd0864da7869f2c63357919ff" modify_external_catalogs: true
I20260616 19:52:04.463937 1849 raft_consensus.cc:493] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:04.464059 1849 raft_consensus.cc:515] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:04.466040 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c77fd138ce9463b8f2d6f4182a56559" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:04.466536 993 leader_election.cc:343] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.435411 1190 rpcz_store.cc:276] 0616 19:52:01.785126 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.786717 (+ 1591us) service_pool.cc:224] Handling call
0616 19:52:04.228157 (+2441440us) ts_tablet_manager.cc:1151] Deleting tablet 350453721d13427a946ac5c5ee7c62a0
0616 19:52:04.228166 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.379542 (+151376us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.434376 (+ 54834us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.435261 (+ 885us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2441189}
I20260616 19:52:04.468632 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c77fd138ce9463b8f2d6f4182a56559" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:04.468955 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 350453721d13427a946ac5c5ee7c62a0 (table default.Table_955814ce18d044e2b9e30c0074b7a8b0 [id=baa5ee1fdc8f4fb785c49501ba1c8144]) successfully deleted
W20260616 19:52:04.469352 996 leader_election.cc:343] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.469460 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 575) took 2404 ms. Trace:
I20260616 19:52:04.469470 996 leader_election.cc:304] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:04.469561 1190 rpcz_store.cc:276] 0616 19:52:02.064711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.064964 (+ 253us) service_pool.cc:224] Handling call
0616 19:52:04.469333 (+2404369us) ts_tablet_manager.cc:1151] Deleting tablet 9a354b06adc343ef94b295916d582b49
0616 19:52:04.469343 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.469429 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2389428}
W20260616 19:52:04.469947 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 9a354b06adc343ef94b295916d582b49 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a354b06adc343ef94b295916d582b49 already in progress: creating tablet
I20260616 19:52:04.470249 1912 raft_consensus.cc:2749] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:04.471200 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 581) took 2203 ms. Trace:
I20260616 19:52:04.471341 1190 rpcz_store.cc:276] 0616 19:52:02.267674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.267739 (+ 65us) service_pool.cc:224] Handling call
0616 19:52:04.471050 (+2203311us) ts_tablet_manager.cc:1151] Deleting tablet 8c19c2e43a944893b86982bee1eb2f30
0616 19:52:04.471062 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.471154 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2185099}
W20260616 19:52:04.471520 719 consensus_peers.cc:597] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39f52eebdc79460a9ff33191086e87c6. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:04.471797 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 8c19c2e43a944893b86982bee1eb2f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c19c2e43a944893b86982bee1eb2f30 already in progress: creating tablet
I20260616 19:52:04.474609 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 582) took 2135 ms. Trace:
I20260616 19:52:04.474670 1849 leader_election.cc:290] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:04.477949 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b211692aca478bb40f0f2c3f50ca44" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:04.475449 778 raft_consensus.cc:2468] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:04.483253 1198 tablet_bootstrap.cc:492] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:04.483433 1198 ts_tablet_manager.cc:1403] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.210s user 0.003s sys 0.000s
I20260616 19:52:04.484402 1198 raft_consensus.cc:359] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.484668 1198 raft_consensus.cc:385] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.484791 1198 raft_consensus.cc:740] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:04.485118 1198 consensus_queue.cc:260] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.486196 453 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 9c77fd138ce9463b8f2d6f4182a56559 (table default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17]). Expected version 1 got 0
I20260616 19:52:04.486773 1198 ts_tablet_manager.cc:1434] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:04.488169 1198 tablet_bootstrap.cc:492] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:04.490916 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b211692aca478bb40f0f2c3f50ca44" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:04.492902 1196 ts_tablet_manager.cc:1434] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.310s user 0.000s sys 0.011s
I20260616 19:52:04.494493 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e94cdf0ca4c248db85b1926ff560febf (DEFAULT_TABLE table=default.Table_495e54f09f034a1f9d0ca6c0bdd4cf4b [id=87cb7a7418684110907a2837499645c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.494843 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e94cdf0ca4c248db85b1926ff560febf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.495105 751 tablet_service.cc:1511] Processing CreateTablet for tablet 574927dc3a804b059e71630c133dcbea (DEFAULT_TABLE table=default.Table_776442a4731046708d16acd8c5bde21e [id=4bd89abefd794cb4ae6d7fe1263a1410]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.495437 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574927dc3a804b059e71630c133dcbea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.496923 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fc1d2ecaa746bab980a708dd8eb93a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:04.498004 718 leader_election.cc:304] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:04.498239 762 tablet_service.cc:1511] Processing CreateTablet for tablet 35edd1c620054fa7966da5d0dd3f3326 (DEFAULT_TABLE table=default.Table_038f0c4973c84b4aad0b7a3ecba38d8e [id=20597533eeb14a8795c42a983eab5268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.499536 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8eed930436274d25b2c9fad44edb7229" } new_table_name: "default.Table_a4f840ab91814287af6012eba99963ff" modify_external_catalogs: true
I20260616 19:52:04.500276 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 35edd1c620054fa7966da5d0dd3f3326 (DEFAULT_TABLE table=default.Table_038f0c4973c84b4aad0b7a3ecba38d8e [id=20597533eeb14a8795c42a983eab5268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.500669 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35edd1c620054fa7966da5d0dd3f3326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.501030 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c278603497a14856bb053d15d26c6bf0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.501634 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c278603497a14856bb053d15d26c6bf0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.503156 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4bebbb5f40cf47028a0a1d3ba5749584"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.503695 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bebbb5f40cf47028a0a1d3ba5749584 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.504266 1874 raft_consensus.cc:2804] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:04.504959 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 574927dc3a804b059e71630c133dcbea (DEFAULT_TABLE table=default.Table_776442a4731046708d16acd8c5bde21e [id=4bd89abefd794cb4ae6d7fe1263a1410]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.505292 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574927dc3a804b059e71630c133dcbea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.492720 904 tablet_service.cc:1511] Processing CreateTablet for tablet e94cdf0ca4c248db85b1926ff560febf (DEFAULT_TABLE table=default.Table_495e54f09f034a1f9d0ca6c0bdd4cf4b [id=87cb7a7418684110907a2837499645c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.495893 892 tablet_service.cc:1511] Processing CreateTablet for tablet 574927dc3a804b059e71630c133dcbea (DEFAULT_TABLE table=default.Table_776442a4731046708d16acd8c5bde21e [id=4bd89abefd794cb4ae6d7fe1263a1410]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.498330 895 tablet_service.cc:1511] Processing CreateTablet for tablet 35edd1c620054fa7966da5d0dd3f3326 (DEFAULT_TABLE table=default.Table_038f0c4973c84b4aad0b7a3ecba38d8e [id=20597533eeb14a8795c42a983eab5268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.506565 1190 rpcz_store.cc:276] 0616 19:52:02.339350 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.340291 (+ 941us) service_pool.cc:224] Handling call
0616 19:52:04.474463 (+2134172us) ts_tablet_manager.cc:1151] Deleting tablet c239a24dbdc047f9beb2ed7e1492acfe
0616 19:52:04.474475 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.474562 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2110621}
W20260616 19:52:04.509042 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c239a24dbdc047f9beb2ed7e1492acfe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c239a24dbdc047f9beb2ed7e1492acfe already in progress: creating tablet
I20260616 19:52:04.509477 763 tablet_service.cc:1511] Processing CreateTablet for tablet e94cdf0ca4c248db85b1926ff560febf (DEFAULT_TABLE table=default.Table_495e54f09f034a1f9d0ca6c0bdd4cf4b [id=87cb7a7418684110907a2837499645c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.509914 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35edd1c620054fa7966da5d0dd3f3326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.510569 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e94cdf0ca4c248db85b1926ff560febf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.512452 1874 raft_consensus.cc:697] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:04.512517 893 tablet_service.cc:1511] Processing CreateTablet for tablet 608c26854fdf4dcd8cec2604d23a0dec (DEFAULT_TABLE table=default.Table_40dee65f767b4e60b64e2befd004e90b [id=3aeec180c30846f7b578c74379650200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.512177 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 583) took 2093 ms. Trace:
I20260616 19:52:04.513005 1874 consensus_queue.cc:237] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.513634 1191 ts_tablet_manager.cc:1916] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:04.522807 1198 tablet_bootstrap.cc:654] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:04.524519 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d089eb0b17fc4358968ddd4d6675fc6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.525146 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d089eb0b17fc4358968ddd4d6675fc6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.524802 754 tablet_service.cc:1511] Processing CreateTablet for tablet 608c26854fdf4dcd8cec2604d23a0dec (DEFAULT_TABLE table=default.Table_40dee65f767b4e60b64e2befd004e90b [id=3aeec180c30846f7b578c74379650200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.525904 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608c26854fdf4dcd8cec2604d23a0dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.513307 1190 rpcz_store.cc:276] 0616 19:52:02.417917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.417971 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:04.510337 (+2092366us) ts_tablet_manager.cc:1151] Deleting tablet f1a09d62e68148349b337c5075763672
0616 19:52:04.510510 (+ 173us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.511491 (+ 981us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2091872}
W20260616 19:52:04.527863 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet f1a09d62e68148349b337c5075763672 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1a09d62e68148349b337c5075763672 already in progress: creating tablet
I20260616 19:52:04.529690 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 608c26854fdf4dcd8cec2604d23a0dec (DEFAULT_TABLE table=default.Table_40dee65f767b4e60b64e2befd004e90b [id=3aeec180c30846f7b578c74379650200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.530514 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608c26854fdf4dcd8cec2604d23a0dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.530473 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 584) took 2111 ms. Trace:
I20260616 19:52:04.532840 1190 rpcz_store.cc:276] 0616 19:52:02.418699 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.418759 (+ 60us) service_pool.cc:224] Handling call
0616 19:52:04.529031 (+2110272us) ts_tablet_manager.cc:1151] Deleting tablet 5e68e2c6caff4ac38aa52b8b29f5ace6
0616 19:52:04.529042 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.529942 (+ 900us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2109524}
W20260616 19:52:04.537115 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 already in progress: creating tablet
I20260616 19:52:04.539294 900 tablet_service.cc:1511] Processing CreateTablet for tablet ce114bf2907945889f8f1050d63d3965 (DEFAULT_TABLE table=default.Table_163e2e0482594a22a6d411bd422c52fa [id=3bf7265d6d3a4be698aab8dd64ec9652]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.539413 1190 tablet_replica.cc:333] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
W20260616 19:52:04.545058 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 574927dc3a804b059e71630c133dcbea consensus state has no leader
I20260616 19:52:04.549108 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_048d35b467534cb1880946049256223f" } new_table_name: "default.Table_f23ea74ac0fe43bebde78acffb4c1a04" modify_external_catalogs: true
I20260616 19:52:04.552646 1193 ts_tablet_manager.cc:1929] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:04.552969 1193 log.cc:1199] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/eb024637294148c18b74bef47fb2fcce
I20260616 19:52:04.553470 1193 ts_tablet_manager.cc:1950] T eb024637294148c18b74bef47fb2fcce P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:04.553965 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 632) took 1257 ms. Trace:
I20260616 19:52:04.553892 1190 raft_consensus.cc:2243] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:04.554659 1193 rpcz_store.cc:276] 0616 19:52:03.296224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.296273 (+ 49us) service_pool.cc:224] Handling call
0616 19:52:04.419603 (+1123330us) ts_tablet_manager.cc:1151] Deleting tablet eb024637294148c18b74bef47fb2fcce
0616 19:52:04.419614 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.445785 (+ 26171us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.552548 (+106763us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.553933 (+ 1385us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1123122}
I20260616 19:52:04.556073 1190 raft_consensus.cc:2272] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:04.563601 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet eb024637294148c18b74bef47fb2fcce (table default.Table_9d7e4f47840e4f26bc2ee3c1ae553a0c [id=fb8670837a3f4c7086c4f112b7319a38]) successfully deleted
I20260616 19:52:04.564147 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 633) took 1267 ms. Trace:
I20260616 19:52:04.566287 1193 rpcz_store.cc:276] 0616 19:52:03.296519 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.296586 (+ 67us) service_pool.cc:224] Handling call
0616 19:52:04.564012 (+1267426us) ts_tablet_manager.cc:1151] Deleting tablet 8125dce4d32a416498b42a1b599355fd
0616 19:52:04.564023 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.564111 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1267148}
I20260616 19:52:04.567006 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0b362fa598a54632880faa42a9224ffd
W20260616 19:52:04.567307 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8125dce4d32a416498b42a1b599355fd because the tablet was not found. No further retry: Not found: Tablet not found: 8125dce4d32a416498b42a1b599355fd
I20260616 19:52:04.568063 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b362fa598a54632880faa42a9224ffd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.568701 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 634) took 1271 ms. Trace:
I20260616 19:52:04.568971 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b362fa598a54632880faa42a9224ffd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:04.569128 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b362fa598a54632880faa42a9224ffd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.569320 1193 rpcz_store.cc:276] 0616 19:52:03.296959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.297021 (+ 62us) service_pool.cc:224] Handling call
0616 19:52:04.568579 (+1271558us) ts_tablet_manager.cc:1151] Deleting tablet 350453721d13427a946ac5c5ee7c62a0
0616 19:52:04.568589 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.568668 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1271343}
I20260616 19:52:04.569514 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ce114bf2907945889f8f1050d63d3965 (DEFAULT_TABLE table=default.Table_163e2e0482594a22a6d411bd422c52fa [id=3bf7265d6d3a4be698aab8dd64ec9652]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.570039 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce114bf2907945889f8f1050d63d3965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.570281 1193 tablet_replica.cc:333] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:52:04.572359 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 350453721d13427a946ac5c5ee7c62a0 because the tablet was not found. No further retry: Not found: Tablet not found: 350453721d13427a946ac5c5ee7c62a0
I20260616 19:52:04.572913 1801 raft_consensus.cc:697] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:04.559949 750 tablet_service.cc:1511] Processing CreateTablet for tablet 3a846bb4ae214011b2c9bb7202db6fdc (DEFAULT_TABLE table=default.Table_2b28350a70084f499b0daec3a38ff4ea [id=fb8ee63895094ea2a1ebf103c0d43c1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.573252 1193 raft_consensus.cc:2243] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:04.573678 1801 consensus_queue.cc:237] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.573614 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a846bb4ae214011b2c9bb7202db6fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.574168 1193 pending_rounds.cc:70] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:04.574927 1193 pending_rounds.cc:77] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595488698101760 op_type: NO_OP noop_request { }
I20260616 19:52:04.575459 1193 raft_consensus.cc:2889] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:04.576005 1193 raft_consensus.cc:2272] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:04.577351 1193 ts_tablet_manager.cc:1916] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:04.582770 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 3de0e62cfd33410490a0b460fd5f69e9 (table default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]). Expected version 2 got 0
I20260616 19:52:04.578568 757 tablet_service.cc:1511] Processing CreateTablet for tablet ce114bf2907945889f8f1050d63d3965 (DEFAULT_TABLE table=default.Table_163e2e0482594a22a6d411bd422c52fa [id=3bf7265d6d3a4be698aab8dd64ec9652]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.583671 459 catalog_manager.cc:5696] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131). New cstate: current_term: 1 leader_uuid: "61c874fef3684d10a272a9c7f280e0e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:04.580364 1196 tablet_bootstrap.cc:492] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:04.584549 1892 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:52:04.584440 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 5b34d497f9334e94b06cc9245fca04ed (table default.Table_7a777a2aa2cd44d1b7f9db66e8367a32 [id=6db44bdac0784e08b52a4db869edb3d3]). Expected version 1 got 0
I20260616 19:52:04.585412 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet d5741b92cafb4d53987dbeeef66ccd56 (table default.Table_a5a8fee8fc214408ae98d4e88d6f66a5 [id=ee6ce577050e45c5b9b014d3827e5046]). Expected version 1 got 0
I20260616 19:52:04.586627 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce114bf2907945889f8f1050d63d3965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.586632 1908 consensus_queue.cc:1048] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260616 19:52:04.588724 1913 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:52:04.596923 1190 ts_tablet_manager.cc:1916] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:04.606985 894 tablet_service.cc:1511] Processing CreateTablet for tablet 3a846bb4ae214011b2c9bb7202db6fdc (DEFAULT_TABLE table=default.Table_2b28350a70084f499b0daec3a38ff4ea [id=fb8ee63895094ea2a1ebf103c0d43c1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.609222 1719 leader_election.cc:290] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:04.609475 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e94cdf0ca4c248db85b1926ff560febf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.615213 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce114bf2907945889f8f1050d63d3965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.616513 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608c26854fdf4dcd8cec2604d23a0dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.617712 1196 tablet_bootstrap.cc:654] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:04.618674 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 135517us
W20260616 19:52:04.619942 860 consensus_peers.cc:597] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:04.620605 860 leader_election.cc:343] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:04.621546 860 leader_election.cc:343] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.622941 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35edd1c620054fa7966da5d0dd3f3326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.623180 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fc1d2ecaa746bab980a708dd8eb93a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:04.628104 1198 tablet_bootstrap.cc:492] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:04.628369 1198 ts_tablet_manager.cc:1403] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.140s user 0.005s sys 0.011s
I20260616 19:52:04.630206 1198 raft_consensus.cc:359] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.630865 1198 raft_consensus.cc:385] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.638140 1198 raft_consensus.cc:740] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
W20260616 19:52:04.639195 860 leader_election.cc:343] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.640331 1198 consensus_queue.cc:260] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.642778 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574927dc3a804b059e71630c133dcbea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.646502 1198 ts_tablet_manager.cc:1434] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260616 19:52:04.647365 754 tablet_service.cc:1511] Processing CreateTablet for tablet a20701ab3a5d43df92c471bd6013ac6c (DEFAULT_TABLE table=default.Table_8dfce4bb3f8d42fba854b68e675edf41 [id=8f80d945298f4753b1ab8de3ed95cf41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.648878 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 3a846bb4ae214011b2c9bb7202db6fdc (DEFAULT_TABLE table=default.Table_2b28350a70084f499b0daec3a38ff4ea [id=fb8ee63895094ea2a1ebf103c0d43c1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.649235 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a846bb4ae214011b2c9bb7202db6fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.649837 1198 tablet_bootstrap.cc:492] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:04.655071 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1d825bcf365f424fb99a10afe3e96501
I20260616 19:52:04.655377 1198 tablet_bootstrap.cc:654] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:04.657042 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d825bcf365f424fb99a10afe3e96501 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:04.665704 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d825bcf365f424fb99a10afe3e96501 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.667511 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a846bb4ae214011b2c9bb7202db6fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.671422 896 tablet_service.cc:1511] Processing CreateTablet for tablet 40124cee94a445ed9175132d4e0c86d8 (DEFAULT_TABLE table=default.Table_11151a450eb946fda594d28bd1e72fa5 [id=edbc3019bd594d8db8e5241c47ee045a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.674976 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40124cee94a445ed9175132d4e0c86d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.675828 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7bab084824a84c218ef69a18971e4b47
I20260616 19:52:04.676910 762 tablet_service.cc:1511] Processing CreateTablet for tablet 40124cee94a445ed9175132d4e0c86d8 (DEFAULT_TABLE table=default.Table_11151a450eb946fda594d28bd1e72fa5 [id=edbc3019bd594d8db8e5241c47ee045a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.677330 1852 tablet.cc:1724] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:04.677809 898 tablet_service.cc:1511] Processing CreateTablet for tablet a20701ab3a5d43df92c471bd6013ac6c (DEFAULT_TABLE table=default.Table_8dfce4bb3f8d42fba854b68e675edf41 [id=8f80d945298f4753b1ab8de3ed95cf41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.678412 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d825bcf365f424fb99a10afe3e96501 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.679275 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bab084824a84c218ef69a18971e4b47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.680397 1801 raft_consensus.cc:493] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:04.680653 1801 raft_consensus.cc:515] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:04.681648 860 leader_election.cc:343] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.681875 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bab084824a84c218ef69a18971e4b47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.687636 763 tablet_service.cc:1511] Processing CreateTablet for tablet d8328eb44d434c249b38ec513375364a (DEFAULT_TABLE table=default.Table_68ba1310c9ab4ace8e8253f756863107 [id=f7f4df2be30c46cdb72f086adb508fdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.691970 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8cf5611e97e14eb1bf8515532f3a43be
I20260616 19:52:04.696504 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 8cf5611e97e14eb1bf8515532f3a43be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:04.697317 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_95dafd1b9c504c39a6ac9b0282d48afc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:04.698913 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20701ab3a5d43df92c471bd6013ac6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:04.697885 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95dafd1b9c504c39a6ac9b0282d48afc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.700441 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8328eb44d434c249b38ec513375364a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.705305 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20701ab3a5d43df92c471bd6013ac6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.710173 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40124cee94a445ed9175132d4e0c86d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.710279 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 8cf5611e97e14eb1bf8515532f3a43be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.715003 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a2904f2e00314858899a760b84950e1f
I20260616 19:52:04.717391 757 tablet_service.cc:1511] Processing CreateTablet for tablet c5047956478f488dbb4734bbaa138c00 (DEFAULT_TABLE table=default.Table_368e4b7684c64cdcb5a8ac4665e649d2 [id=cb3eb4838e8a48108a44c7940a73765e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.718043 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5047956478f488dbb4734bbaa138c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.724255 1193 ts_tablet_manager.cc:1929] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:04.724396 1193 log.cc:1199] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/39f52eebdc79460a9ff33191086e87c6
I20260616 19:52:04.730283 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dd8ccdd722484ba5b6d855c64e825279" } new_table_name: "default.Table_f1bb97d3ca244915b45c1f1d931cc97e" modify_external_catalogs: true
I20260616 19:52:04.679049 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bab084824a84c218ef69a18971e4b47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:04.669682 1031 tablet_service.cc:1511] Processing CreateTablet for tablet a20701ab3a5d43df92c471bd6013ac6c (DEFAULT_TABLE table=default.Table_8dfce4bb3f8d42fba854b68e675edf41 [id=8f80d945298f4753b1ab8de3ed95cf41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.693614 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 8cf5611e97e14eb1bf8515532f3a43be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:04.709376 1029 tablet_service.cc:1511] Processing CreateTablet for tablet d8328eb44d434c249b38ec513375364a (DEFAULT_TABLE table=default.Table_68ba1310c9ab4ace8e8253f756863107 [id=f7f4df2be30c46cdb72f086adb508fdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.716234 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet a2904f2e00314858899a760b84950e1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:04.707170 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3587c1ab487a424eb82f378ae081f514" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:04.734760 1060 raft_consensus.cc:2468] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:04.687690 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 40124cee94a445ed9175132d4e0c86d8 (DEFAULT_TABLE table=default.Table_11151a450eb946fda594d28bd1e72fa5 [id=edbc3019bd594d8db8e5241c47ee045a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.710812 1191 ts_tablet_manager.cc:1929] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:04.736310 1191 log.cc:1199] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/36ea9b8ba668410bae016a008cf37910
I20260616 19:52:04.737551 1191 ts_tablet_manager.cc:1950] T 36ea9b8ba668410bae016a008cf37910 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:04.738252 858 leader_election.cc:304] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:04.738644 1925 raft_consensus.cc:2804] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:04.738734 1925 raft_consensus.cc:493] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:04.738824 1925 raft_consensus.cc:3060] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.742908 750 tablet_service.cc:1558] Processing DeleteTablet for tablet a2904f2e00314858899a760b84950e1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:04.755947 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81618a3f43ad40fc8173e266cc106899 consensus state has no leader
I20260616 19:52:04.760870 1925 raft_consensus.cc:515] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.761955 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3587c1ab487a424eb82f378ae081f514" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:04.762152 1060 raft_consensus.cc:3060] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:04.763932 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3587c1ab487a424eb82f378ae081f514" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:04.764739 1852 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:52:04.764988 1925 leader_election.cc:290] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:04.765618 1060 raft_consensus.cc:2468] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:04.769071 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3587c1ab487a424eb82f378ae081f514" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:04.769533 860 leader_election.cc:343] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.766129 858 leader_election.cc:304] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:04.770758 1801 leader_election.cc:290] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:04.770759 860 leader_election.cc:343] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.771423 1719 raft_consensus.cc:2804] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:04.771543 1719 raft_consensus.cc:697] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:04.771488 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2b676b8a786c46af8c7a3413082b686a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:04.771821 1719 consensus_queue.cc:237] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:04.772601 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b676b8a786c46af8c7a3413082b686a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.734057 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20701ab3a5d43df92c471bd6013ac6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.774801 1032 tablet_service.cc:1511] Processing CreateTablet for tablet c5047956478f488dbb4734bbaa138c00 (DEFAULT_TABLE table=default.Table_368e4b7684c64cdcb5a8ac4665e649d2 [id=cb3eb4838e8a48108a44c7940a73765e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.775131 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8328eb44d434c249b38ec513375364a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.775358 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5047956478f488dbb4734bbaa138c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.783753 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40124cee94a445ed9175132d4e0c86d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.784309 1193 ts_tablet_manager.cc:1950] T 39f52eebdc79460a9ff33191086e87c6 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:04.785928 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 638) took 1424 ms. Trace:
I20260616 19:52:04.787812 1892 tablet.cc:1724] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:04.796546 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 548) took 3160 ms. Trace:
I20260616 19:52:04.802668 1192 tablet_bootstrap.cc:492] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:04.803548 1191 rpcz_store.cc:276] 0616 19:52:01.635870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.636062 (+ 192us) service_pool.cc:224] Handling call
0616 19:52:04.171166 (+2535104us) ts_tablet_manager.cc:1151] Deleting tablet 36ea9b8ba668410bae016a008cf37910
0616 19:52:04.171176 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.670350 (+499174us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.710759 (+ 40409us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.796517 (+ 85758us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2534866}
I20260616 19:52:04.798123 750 tablet_service.cc:1511] Processing CreateTablet for tablet 09b2bf2ff1004853a39522a0b0608290 (DEFAULT_TABLE table=default.Table_e079f7ad5717469eb58807eb230fb2e9 [id=f02e37a5e8ce4d3f8b7a2502aa595b36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.808151 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 5029a79e046a489aa9976eff948a3c5b from {username='slave'} at 127.0.0.1:41696
W20260616 19:52:04.799597 719 consensus_peers.cc:597] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36ea9b8ba668410bae016a008cf37910. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:04.808706 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b2bf2ff1004853a39522a0b0608290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.814206 1192 ts_tablet_manager.cc:1403] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.636s user 0.015s sys 0.013s
I20260616 19:52:04.807714 1852 tablet.cc:1724] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:04.815007 1192 raft_consensus.cc:359] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.815178 1192 raft_consensus.cc:385] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.815230 1192 raft_consensus.cc:740] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:04.815834 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_832624f84ba445c8aeaad59da359a54d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.816385 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_832624f84ba445c8aeaad59da359a54d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.818445 1193 rpcz_store.cc:276] 0616 19:52:03.361344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.362641 (+ 1297us) service_pool.cc:224] Handling call
0616 19:52:04.570218 (+1207577us) ts_tablet_manager.cc:1151] Deleting tablet 39f52eebdc79460a9ff33191086e87c6
0616 19:52:04.570227 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.698848 (+128621us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.724155 (+ 25307us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.785889 (+ 61734us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1207011}
I20260616 19:52:04.820083 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 09b2bf2ff1004853a39522a0b0608290 (DEFAULT_TABLE table=default.Table_e079f7ad5717469eb58807eb230fb2e9 [id=f02e37a5e8ce4d3f8b7a2502aa595b36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.821467 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 36ea9b8ba668410bae016a008cf37910 (table default.Table_78964cf02d6e4b94be59a534e00ada50 [id=7ba83bcdb62c4bc9804589f54ddb86d8]) successfully deleted
I20260616 19:52:04.821437 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 39f52eebdc79460a9ff33191086e87c6 (table default.Table_2984957106b44cdc9ecd5a06e8edb7d3 [id=23f3d793560846b7a0701ec470588cbc]) successfully deleted
I20260616 19:52:04.822043 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b2bf2ff1004853a39522a0b0608290. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:04.823335 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 81618a3f43ad40fc8173e266cc106899 (table default.Table_a4f840ab91814287af6012eba99963ff [id=06387be97c9c486ea549edbe384d0ce7], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 81618a3f43ad40fc8173e266cc106899 consensus state has no leader
I20260616 19:52:04.823958 1193 tablet_replica.cc:333] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:04.824321 1193 raft_consensus.cc:2243] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:04.827690 1191 tablet_replica.cc:333] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:04.828047 1191 raft_consensus.cc:2243] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:04.828409 1193 raft_consensus.cc:2272] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:04.829540 762 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9066a57e784356aa27cfcac75c3bd2 (DEFAULT_TABLE table=default.Table_f4c478c0faaf444197285c44970b7d04 [id=98ab698d300145e3b97da60874d9a8cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.829962 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9066a57e784356aa27cfcac75c3bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.830394 1193 ts_tablet_manager.cc:1916] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:04.838467 762 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6add7925294880a5a20eb3d189d1ee (DEFAULT_TABLE table=default.Table_cce34f3008e44c63bd5961fdfe303d9a [id=92b7c44eefd745358f2439ac97450216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.838943 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6add7925294880a5a20eb3d189d1ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.844664 750 tablet_service.cc:1511] Processing CreateTablet for tablet c937acc521eb438ea1b89f134caea19d (DEFAULT_TABLE table=default.Table_8839050ed0db4c7da35e13c3b40639b0 [id=181c8bd4388e4ef89d9cfd9e10caa6fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.845211 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c937acc521eb438ea1b89f134caea19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.825362 1196 tablet_bootstrap.cc:492] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:04.853329 1196 ts_tablet_manager.cc:1403] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.360s user 0.004s sys 0.013s
I20260616 19:52:04.854244 1196 raft_consensus.cc:359] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.854458 1196 raft_consensus.cc:385] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.854547 1196 raft_consensus.cc:740] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:04.854776 1196 consensus_queue.cc:260] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:04.855257 860 consensus_peers.cc:597] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:04.828153 1198 tablet_bootstrap.cc:492] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:04.838008 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9066a57e784356aa27cfcac75c3bd2 (DEFAULT_TABLE table=default.Table_f4c478c0faaf444197285c44970b7d04 [id=98ab698d300145e3b97da60874d9a8cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.859558 1198 ts_tablet_manager.cc:1403] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.210s user 0.037s sys 0.028s
I20260616 19:52:04.859791 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9066a57e784356aa27cfcac75c3bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.860596 1198 raft_consensus.cc:359] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.860813 1198 raft_consensus.cc:385] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.860877 1198 raft_consensus.cc:740] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:04.861135 1198 consensus_queue.cc:260] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.861292 1192 consensus_queue.cc:260] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.861809 1198 ts_tablet_manager.cc:1434] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:04.862167 1198 tablet_bootstrap.cc:492] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:04.842159 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6add7925294880a5a20eb3d189d1ee (DEFAULT_TABLE table=default.Table_cce34f3008e44c63bd5961fdfe303d9a [id=92b7c44eefd745358f2439ac97450216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.863511 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6add7925294880a5a20eb3d189d1ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.864041 1198 tablet_bootstrap.cc:654] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:04.844275 1036 tablet_service.cc:1511] Processing CreateTablet for tablet c937acc521eb438ea1b89f134caea19d (DEFAULT_TABLE table=default.Table_8839050ed0db4c7da35e13c3b40639b0 [id=181c8bd4388e4ef89d9cfd9e10caa6fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.866657 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c937acc521eb438ea1b89f134caea19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.869004 1191 raft_consensus.cc:2272] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:04.869647 1191 ts_tablet_manager.cc:1916] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:04.872100 1192 ts_tablet_manager.cc:1434] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.058s user 0.001s sys 0.001s
I20260616 19:52:04.873019 1192 tablet_bootstrap.cc:492] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:04.876407 1190 ts_tablet_manager.cc:1929] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:04.880826 1193 ts_tablet_manager.cc:1929] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:04.880995 1193 log.cc:1199] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/b99740ab59f947aabcac88dc2bf2de86
I20260616 19:52:04.885475 1193 ts_tablet_manager.cc:1950] T b99740ab59f947aabcac88dc2bf2de86 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:04.887192 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 639) took 1524 ms. Trace:
W20260616 19:52:04.887405 445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.189:43055: connect: Connection refused (error 111) [suppressed 9 similar messages]
I20260616 19:52:04.887741 1193 rpcz_store.cc:276] 0616 19:52:03.362257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.382711 (+ 20454us) service_pool.cc:224] Handling call
0616 19:52:04.821297 (+1438586us) ts_tablet_manager.cc:1151] Deleting tablet b99740ab59f947aabcac88dc2bf2de86
0616 19:52:04.821311 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.848644 (+ 27333us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.880755 (+ 32111us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.887140 (+ 6385us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1438168}
I20260616 19:52:04.889240 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet b99740ab59f947aabcac88dc2bf2de86 (table default.Table_2e10c27b05e243a2a85134e81dc2a126 [id=d641d7d6fc004dc384ee5f82769bbfbc]) successfully deleted
I20260616 19:52:04.881489 1196 ts_tablet_manager.cc:1434] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260616 19:52:04.889853 1196 tablet_bootstrap.cc:492] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:04.891520 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 640) took 1379 ms. Trace:
I20260616 19:52:04.891722 1190 log.cc:1199] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/a93dd295602840319f72e7021ddfd61a
I20260616 19:52:04.892066 1190 ts_tablet_manager.cc:1950] T a93dd295602840319f72e7021ddfd61a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:04.892390 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 585) took 2421 ms. Trace:
I20260616 19:52:04.896008 1198 tablet_bootstrap.cc:492] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:04.896148 1198 ts_tablet_manager.cc:1403] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.000s
I20260616 19:52:04.897105 1198 raft_consensus.cc:359] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.897266 1198 raft_consensus.cc:385] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.897322 1198 raft_consensus.cc:740] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:04.897516 1198 consensus_queue.cc:260] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.900035 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 01dea6525ab34ee68fc8d8ff5d7d8da9 (DEFAULT_TABLE table=default.Table_20d4a8dca77f48baab105824d595b6e1 [id=75ca255ec1dd4565ba3fe3ac6e8e667a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.900484 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01dea6525ab34ee68fc8d8ff5d7d8da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.902783 1198 ts_tablet_manager.cc:1434] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260616 19:52:04.903071 1198 tablet_bootstrap.cc:492] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:04.904662 1198 tablet_bootstrap.cc:654] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:04.907737 1025 tablet_service.cc:1511] Processing CreateTablet for tablet e90ea4190d3a42ac8082cd6869588490 (DEFAULT_TABLE table=default.Table_1c8339d31a3a4ba9b8678eee3e23edbd [id=cffd115a37db4c9185cf6561e200bf19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.908227 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90ea4190d3a42ac8082cd6869588490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.908594 1190 rpcz_store.cc:276] 0616 19:52:02.470604 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.470656 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:04.538283 (+2067627us) ts_tablet_manager.cc:1151] Deleting tablet a93dd295602840319f72e7021ddfd61a
0616 19:52:04.538550 (+ 267us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.830300 (+291750us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.876339 (+ 46039us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:04.892375 (+ 16036us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2067147}
I20260616 19:52:04.909006 1190 tablet_replica.cc:333] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:04.909219 1190 raft_consensus.cc:2243] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:04.909406 1190 raft_consensus.cc:2272] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:04.909989 1190 ts_tablet_manager.cc:1916] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:04.911796 1848 raft_consensus.cc:493] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:04.883082 1192 tablet_bootstrap.cc:654] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:04.911916 1848 raft_consensus.cc:515] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.912631 1848 leader_election.cc:290] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:04.912943 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e4e52fae124d4085b15e143e98a7e4" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:04.913403 993 leader_election.cc:343] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:04.891613 1196 tablet_bootstrap.cc:654] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:04.891660 1193 rpcz_store.cc:276] 0616 19:52:03.511713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.512159 (+ 446us) service_pool.cc:224] Handling call
0616 19:52:04.889599 (+1377440us) ts_tablet_manager.cc:1151] Deleting tablet 2e059efed3da48b9a516fd3905f6d298
0616 19:52:04.889605 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.891457 (+ 1852us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1375517}
W20260616 19:52:04.918118 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2e059efed3da48b9a516fd3905f6d298 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e059efed3da48b9a516fd3905f6d298 already in progress: creating tablet
I20260616 19:52:04.923192 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_72c384e8d0904f978c889c73573b63d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.923780 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72c384e8d0904f978c889c73573b63d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.924638 1193 tablet_replica.cc:333] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:04.924876 1193 raft_consensus.cc:2243] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:04.925196 1193 raft_consensus.cc:2272] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:04.928959 1193 ts_tablet_manager.cc:1916] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:04.929199 1719 consensus_queue.cc:1048] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:04.929842 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2616b90e3ece41088782b3f8ad9e081a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.930485 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2616b90e3ece41088782b3f8ad9e081a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.913419 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e4e52fae124d4085b15e143e98a7e4" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:04.900456 754 tablet_service.cc:1511] Processing CreateTablet for tablet e90ea4190d3a42ac8082cd6869588490 (DEFAULT_TABLE table=default.Table_1c8339d31a3a4ba9b8678eee3e23edbd [id=cffd115a37db4c9185cf6561e200bf19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.934093 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90ea4190d3a42ac8082cd6869588490. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:04.935104 445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:43055, user_credentials={real_user=slave}} blocked reactor thread for 47720.3us
W20260616 19:52:04.936874 445 consensus_peers.cc:597] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 -> Peer 2b8fb7a8523741a2b7a5e75d8b415be0 (127.0.105.189:43055): Couldn't send request to peer 2b8fb7a8523741a2b7a5e75d8b415be0. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.189:43055: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260616 19:52:04.901268 750 tablet_service.cc:1511] Processing CreateTablet for tablet 01dea6525ab34ee68fc8d8ff5d7d8da9 (DEFAULT_TABLE table=default.Table_20d4a8dca77f48baab105824d595b6e1 [id=75ca255ec1dd4565ba3fe3ac6e8e667a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.942723 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01dea6525ab34ee68fc8d8ff5d7d8da9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:04.945967 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3decbe39deb84d1a85c3a9773fcbf5be has no consensus state
I20260616 19:52:04.951434 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f5b9a0c493de47c389206c834de0c093"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:04.952068 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5b9a0c493de47c389206c834de0c093 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:04.959699 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet d5741b92cafb4d53987dbeeef66ccd56 (table default.Table_a5a8fee8fc214408ae98d4e88d6f66a5 [id=ee6ce577050e45c5b9b014d3827e5046]). Expected version 1 got 0
I20260616 19:52:04.959933 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 3de0e62cfd33410490a0b460fd5f69e9 (table default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]). Expected version 2 got 0
I20260616 19:52:04.960856 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet d5741b92cafb4d53987dbeeef66ccd56 (table default.Table_a5a8fee8fc214408ae98d4e88d6f66a5 [id=ee6ce577050e45c5b9b014d3827e5046]). Expected version 1 got 0
I20260616 19:52:04.961391 1192 tablet_bootstrap.cc:492] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:04.961562 1192 ts_tablet_manager.cc:1403] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.003s
I20260616 19:52:04.962292 1192 raft_consensus.cc:359] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.962457 1192 raft_consensus.cc:385] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.962524 1192 raft_consensus.cc:740] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:04.962718 1192 consensus_queue.cc:260] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.963311 1192 ts_tablet_manager.cc:1434] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:04.965961 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 9cfc21527ae64c86992dddc95035d34f (DEFAULT_TABLE table=default.Table_de1f064302a244b8af570852afb898e5 [id=9dc63d3175604dd79ee0c19bfa9f1472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.966391 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 990ea67ce4664c27857a15bac92d0d42 (DEFAULT_TABLE table=default.Table_0dd5a3fc9a394487bb5d9412ccfe0bac [id=c6057af61908458b84013fc2637376a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.967244 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 97f78879bc38457bbd06593c03aac6ce (DEFAULT_TABLE table=default.Table_56c4bdfb8f804d10beeb4340c95e0cd8 [id=ad93a464d0a64193b3840ff34412aed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.967433 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5483e05ad83f4ba9b3cf2bdee5b7d7fc" } new_table_name: "default.Table_9bb35be45c3b476a94e956aa287bc3a0" modify_external_catalogs: true
I20260616 19:52:04.969242 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2701b6a10f2f4ca5826afb7ad87303e3 (DEFAULT_TABLE table=default.Table_3c74508bf28047af89a4cde7710e6e51 [id=81ce7e10ca3f4318bfb50e25f449fd2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.969552 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 15d5db407c264ed1b718a7cece511b2f (DEFAULT_TABLE table=default.Table_f836a17118c9405d96e7581590b7ec0a [id=d286549394944ad99506ba3539abe265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.972170 1022 tablet_service.cc:1511] Processing CreateTablet for tablet c2ca1a0a4c684d27bde1a09cf2d77c87 (DEFAULT_TABLE table=default.Table_fd6b8678fea647c791ab6cdd5765f37e [id=6f55ed77e4b5436e8faa63d8dded8b79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.976740 894 tablet_service.cc:1511] Processing CreateTablet for tablet d8328eb44d434c249b38ec513375364a (DEFAULT_TABLE table=default.Table_68ba1310c9ab4ace8e8253f756863107 [id=f7f4df2be30c46cdb72f086adb508fdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.977239 1198 tablet_bootstrap.cc:492] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:04.977223 896 tablet_service.cc:1558] Processing DeleteTablet for tablet a2904f2e00314858899a760b84950e1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:04.977352 1198 ts_tablet_manager.cc:1403] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.074s user 0.009s sys 0.005s
I20260616 19:52:04.977809 896 tablet_service.cc:1511] Processing CreateTablet for tablet c5047956478f488dbb4734bbaa138c00 (DEFAULT_TABLE table=default.Table_368e4b7684c64cdcb5a8ac4665e649d2 [id=cb3eb4838e8a48108a44c7940a73765e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.978308 898 tablet_service.cc:1511] Processing CreateTablet for tablet 09b2bf2ff1004853a39522a0b0608290 (DEFAULT_TABLE table=default.Table_e079f7ad5717469eb58807eb230fb2e9 [id=f02e37a5e8ce4d3f8b7a2502aa595b36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.978856 904 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9066a57e784356aa27cfcac75c3bd2 (DEFAULT_TABLE table=default.Table_f4c478c0faaf444197285c44970b7d04 [id=98ab698d300145e3b97da60874d9a8cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.979187 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2701b6a10f2f4ca5826afb7ad87303e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.979664 893 tablet_service.cc:1511] Processing CreateTablet for tablet c937acc521eb438ea1b89f134caea19d (DEFAULT_TABLE table=default.Table_8839050ed0db4c7da35e13c3b40639b0 [id=181c8bd4388e4ef89d9cfd9e10caa6fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.980031 895 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6add7925294880a5a20eb3d189d1ee (DEFAULT_TABLE table=default.Table_cce34f3008e44c63bd5961fdfe303d9a [id=92b7c44eefd745358f2439ac97450216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.980412 454 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet d5741b92cafb4d53987dbeeef66ccd56 (table default.Table_a5a8fee8fc214408ae98d4e88d6f66a5 [id=ee6ce577050e45c5b9b014d3827e5046]). Expected version 1 got 0
I20260616 19:52:04.980412 892 tablet_service.cc:1511] Processing CreateTablet for tablet 01dea6525ab34ee68fc8d8ff5d7d8da9 (DEFAULT_TABLE table=default.Table_20d4a8dca77f48baab105824d595b6e1 [id=75ca255ec1dd4565ba3fe3ac6e8e667a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.981002 900 tablet_service.cc:1511] Processing CreateTablet for tablet e90ea4190d3a42ac8082cd6869588490 (DEFAULT_TABLE table=default.Table_1c8339d31a3a4ba9b8678eee3e23edbd [id=cffd115a37db4c9185cf6561e200bf19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.981151 454 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 3de0e62cfd33410490a0b460fd5f69e9 (table default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]). Expected version 2 got 0
I20260616 19:52:04.981458 886 tablet_service.cc:1511] Processing CreateTablet for tablet 9cfc21527ae64c86992dddc95035d34f (DEFAULT_TABLE table=default.Table_de1f064302a244b8af570852afb898e5 [id=9dc63d3175604dd79ee0c19bfa9f1472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.981899 903 tablet_service.cc:1511] Processing CreateTablet for tablet 990ea67ce4664c27857a15bac92d0d42 (DEFAULT_TABLE table=default.Table_0dd5a3fc9a394487bb5d9412ccfe0bac [id=c6057af61908458b84013fc2637376a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.982390 897 tablet_service.cc:1511] Processing CreateTablet for tablet 97f78879bc38457bbd06593c03aac6ce (DEFAULT_TABLE table=default.Table_56c4bdfb8f804d10beeb4340c95e0cd8 [id=ad93a464d0a64193b3840ff34412aed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.982653 887 tablet_service.cc:1511] Processing CreateTablet for tablet c2ca1a0a4c684d27bde1a09cf2d77c87 (DEFAULT_TABLE table=default.Table_fd6b8678fea647c791ab6cdd5765f37e [id=6f55ed77e4b5436e8faa63d8dded8b79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.982812 901 tablet_service.cc:1511] Processing CreateTablet for tablet 2701b6a10f2f4ca5826afb7ad87303e3 (DEFAULT_TABLE table=default.Table_3c74508bf28047af89a4cde7710e6e51 [id=81ce7e10ca3f4318bfb50e25f449fd2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.983201 891 tablet_service.cc:1511] Processing CreateTablet for tablet 15d5db407c264ed1b718a7cece511b2f (DEFAULT_TABLE table=default.Table_f836a17118c9405d96e7581590b7ec0a [id=d286549394944ad99506ba3539abe265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:04.986646 1198 raft_consensus.cc:359] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.986850 1198 raft_consensus.cc:385] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.986912 1198 raft_consensus.cc:740] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:04.987157 1198 consensus_queue.cc:260] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.987692 1198 ts_tablet_manager.cc:1434] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:04.987951 1198 tablet_bootstrap.cc:492] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:04.988418 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d5db407c264ed1b718a7cece511b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.989691 1198 tablet_bootstrap.cc:654] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:04.990913 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d5db407c264ed1b718a7cece511b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.991263 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6add7925294880a5a20eb3d189d1ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.992862 1196 tablet_bootstrap.cc:492] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:04.992998 1196 ts_tablet_manager.cc:1403] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.002s
I20260616 19:52:04.993846 1196 raft_consensus.cc:359] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.994025 1196 raft_consensus.cc:385] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:04.994083 1196 raft_consensus.cc:740] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:04.994319 1196 consensus_queue.cc:260] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:04.996219 1192 tablet_bootstrap.cc:492] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:04.997704 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cfc21527ae64c86992dddc95035d34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:04.996833 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 990ea67ce4664c27857a15bac92d0d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.000557 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9066a57e784356aa27cfcac75c3bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.000680 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 990ea67ce4664c27857a15bac92d0d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.000815 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c937acc521eb438ea1b89f134caea19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.004693 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f78879bc38457bbd06593c03aac6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.006924 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b2bf2ff1004853a39522a0b0608290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.008052 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8328eb44d434c249b38ec513375364a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.010175 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ca1a0a4c684d27bde1a09cf2d77c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.012198 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ca1a0a4c684d27bde1a09cf2d77c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.012645 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5047956478f488dbb4734bbaa138c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.012704 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f78879bc38457bbd06593c03aac6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.016687 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90ea4190d3a42ac8082cd6869588490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.017045 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2701b6a10f2f4ca5826afb7ad87303e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.017241 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cfc21527ae64c86992dddc95035d34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.024585 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01dea6525ab34ee68fc8d8ff5d7d8da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.033021 1848 raft_consensus.cc:493] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.033135 1191 ts_tablet_manager.cc:1929] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:05.033224 1191 log.cc:1199] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/10fc1d2ecaa746bab980a708dd8eb93a
I20260616 19:52:05.033170 1848 raft_consensus.cc:515] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.033512 1191 ts_tablet_manager.cc:1950] T 10fc1d2ecaa746bab980a708dd8eb93a P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.033923 1848 leader_election.cc:290] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.034948 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc181171b134de2b946376f468aec72" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:05.035465 993 leader_election.cc:343] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.038451 1198 tablet_bootstrap.cc:492] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:05.038587 1198 ts_tablet_manager.cc:1403] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.051s user 0.009s sys 0.013s
I20260616 19:52:05.039295 1198 raft_consensus.cc:359] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.039454 1198 raft_consensus.cc:385] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.039518 1198 raft_consensus.cc:740] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.039753 1198 consensus_queue.cc:260] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:05.039938 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aee589880bac4eff98fa6edd32c0b92d has no consensus state
I20260616 19:52:05.040247 1198 ts_tablet_manager.cc:1434] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:05.040547 1198 tablet_bootstrap.cc:492] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:05.044370 1198 tablet_bootstrap.cc:654] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.044370 1192 tablet_bootstrap.cc:654] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.052599 1196 ts_tablet_manager.cc:1434] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.060s user 0.002s sys 0.000s
I20260616 19:52:05.057245 1196 tablet_bootstrap.cc:492] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:05.058184 1198 tablet_bootstrap.cc:492] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:05.058331 1198 ts_tablet_manager.cc:1403] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.001s
I20260616 19:52:05.059089 1198 raft_consensus.cc:359] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.059242 1198 raft_consensus.cc:385] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.059319 1198 raft_consensus.cc:740] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.059557 1198 consensus_queue.cc:260] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.060148 1198 ts_tablet_manager.cc:1434] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:05.060389 1198 tablet_bootstrap.cc:492] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:05.062474 1198 tablet_bootstrap.cc:654] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.073638 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet a93dd295602840319f72e7021ddfd61a (table default.Table_289acf4951fa4f4888dae7ce3ef0fb6e [id=ec0c3e3aef034429b5cb31a106143a3d]) successfully deleted
I20260616 19:52:05.075956 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bb0a1663e7b242c98ca76882ce400564" } new_table_name: "default.Table_ade4b72bce6242fa8ca2ee0f2fb16abf" modify_external_catalogs: true
I20260616 19:52:05.077349 1198 tablet_bootstrap.cc:492] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:05.077499 1198 ts_tablet_manager.cc:1403] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260616 19:52:05.078275 1198 raft_consensus.cc:359] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.078431 1198 raft_consensus.cc:385] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.078491 1198 raft_consensus.cc:740] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.078730 1198 consensus_queue.cc:260] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.079344 1198 ts_tablet_manager.cc:1434] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:05.079589 1198 tablet_bootstrap.cc:492] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:05.081828 1198 tablet_bootstrap.cc:654] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.083011 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d32f04655f8b45cab54470ba15670dcc" } modify_external_catalogs: true
I20260616 19:52:05.083220 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d32f04655f8b45cab54470ba15670dcc" } modify_external_catalogs: true
I20260616 19:52:05.083859 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_186422b1f85f4034b1e8f7a7508dd5fa" } modify_external_catalogs: true
I20260616 19:52:05.084038 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_186422b1f85f4034b1e8f7a7508dd5fa" } modify_external_catalogs: true
I20260616 19:52:05.085625 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_57b175e9c4084995aa9e67705af7098e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:05.086210 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57b175e9c4084995aa9e67705af7098e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:05.088661 996 leader_election.cc:343] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.088822 996 leader_election.cc:304] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.089069 1848 raft_consensus.cc:2749] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.090124 1196 tablet_bootstrap.cc:654] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.090598 1198 tablet_bootstrap.cc:492] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:05.090734 1198 ts_tablet_manager.cc:1403] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.004s
I20260616 19:52:05.091442 1198 raft_consensus.cc:359] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.091625 1198 raft_consensus.cc:385] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.091691 1198 raft_consensus.cc:740] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.092391 1198 consensus_queue.cc:260] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.093082 1198 ts_tablet_manager.cc:1434] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:05.095000 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 549) took 3459 ms. Trace:
I20260616 19:52:05.095412 1191 rpcz_store.cc:276] 0616 19:52:01.636002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.636332 (+ 330us) service_pool.cc:224] Handling call
0616 19:52:04.827625 (+3191293us) ts_tablet_manager.cc:1151] Deleting tablet 10fc1d2ecaa746bab980a708dd8eb93a
0616 19:52:04.827636 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.984454 (+156818us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.033086 (+ 48632us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.094979 (+ 61893us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3184297}
I20260616 19:52:05.095355 1198 tablet_bootstrap.cc:492] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:05.096237 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 13e4e52fae124d4085b15e143e98a7e4 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:05.096601 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 10fc1d2ecaa746bab980a708dd8eb93a (table default.Table_61b32c8d9ca6461c8f3edd6bf27c79bc [id=8196a6bddad24186971f3213f68e4cfd]) successfully deleted
I20260616 19:52:05.096698 1193 ts_tablet_manager.cc:1929] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:05.097271 1193 log.cc:1199] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/2b7f591d97bc4571b294b06d990d4065
I20260616 19:52:05.097939 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ece3f5e58baa45dfb295c03ab6a85f01" } modify_external_catalogs: true
I20260616 19:52:05.098170 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ece3f5e58baa45dfb295c03ab6a85f01" } modify_external_catalogs: true
I20260616 19:52:05.098696 1193 ts_tablet_manager.cc:1950] T 2b7f591d97bc4571b294b06d990d4065 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:05.100008 1190 ts_tablet_manager.cc:1929] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260616 19:52:05.100405 1198 tablet_bootstrap.cc:654] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.100627 1190 log.cc:1199] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/383589f0e211418bbdf5046ed90db410
I20260616 19:52:05.101323 1191 tablet_replica.cc:333] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:05.101785 1191 raft_consensus.cc:2243] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.101987 1191 raft_consensus.cc:2272] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.102978 1191 ts_tablet_manager.cc:1916] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.106503 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f7a7857183304cac8a4969045913a3d5" } modify_external_catalogs: true
I20260616 19:52:05.106709 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f7a7857183304cac8a4969045913a3d5" } modify_external_catalogs: true
I20260616 19:52:05.117414 1191 ts_tablet_manager.cc:1929] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:05.118520 459 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_6955250583bf4c3cbff20316dfa5d1a7 [id=8c7791625cfd4d39ad0dff83be1c7089] alter complete (version 1)
I20260616 19:52:05.122103 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2da181f5cbc54988a562cad81caaf1c0" } modify_external_catalogs: true
I20260616 19:52:05.122334 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2da181f5cbc54988a562cad81caaf1c0" } modify_external_catalogs: true
I20260616 19:52:05.122910 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_48f9006fbde142939710d3c240a45bee" } new_table_name: "default.Table_0a5bcecfaf9d4794b794e4e405fcc02f" modify_external_catalogs: true
I20260616 19:52:05.124171 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 13e4e52fae124d4085b15e143e98a7e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.125535 1198 tablet_bootstrap.cc:492] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:05.128333 1198 ts_tablet_manager.cc:1403] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.001s
I20260616 19:52:05.128497 1191 log.cc:1199] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/fdc6222db09d4cd987cbdf70e4d40f70
I20260616 19:52:05.128974 1191 ts_tablet_manager.cc:1950] T fdc6222db09d4cd987cbdf70e4d40f70 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.129208 1198 raft_consensus.cc:359] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.129372 1198 raft_consensus.cc:385] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.129426 1198 raft_consensus.cc:740] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.129628 1198 consensus_queue.cc:260] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.129846 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 550) took 3479 ms. Trace:
I20260616 19:52:05.129931 1191 rpcz_store.cc:276] 0616 19:52:01.650665 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.650717 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:05.101282 (+3450565us) ts_tablet_manager.cc:1151] Deleting tablet fdc6222db09d4cd987cbdf70e4d40f70
0616 19:52:05.101290 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.110055 (+ 8765us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.117342 (+ 7287us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.129827 (+ 12485us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3450344}
I20260616 19:52:05.130115 1198 ts_tablet_manager.cc:1434] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:05.130396 1198 tablet_bootstrap.cc:492] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:05.130730 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet fdc6222db09d4cd987cbdf70e4d40f70 (table default.Table_ece3f5e58baa45dfb295c03ab6a85f01 [id=d5fe1c6faa0d446ca84e71bbdfb4018d]) successfully deleted
I20260616 19:52:05.132160 1198 tablet_bootstrap.cc:654] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.132692 1849 raft_consensus.cc:493] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.132814 1849 raft_consensus.cc:515] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:05.132928 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6396397965c44e07850a6cc42cefab09 has no consensus state
I20260616 19:52:05.133462 1849 leader_election.cc:290] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.130402 1191 tablet_replica.cc:333] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:05.099536 1196 tablet_bootstrap.cc:492] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:05.136629 1191 raft_consensus.cc:2243] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.136801 1196 ts_tablet_manager.cc:1403] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.082s user 0.003s sys 0.000s
I20260616 19:52:05.137012 1191 raft_consensus.cc:2272] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.137509 1196 raft_consensus.cc:359] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.137687 1196 raft_consensus.cc:385] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.137748 1196 raft_consensus.cc:740] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.137658 1191 ts_tablet_manager.cc:1916] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.137981 1196 consensus_queue.cc:260] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.144896 1190 ts_tablet_manager.cc:1950] T 383589f0e211418bbdf5046ed90db410 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:05.145282 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 586) took 2651 ms. Trace:
I20260616 19:52:05.134380 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4adff6e41148b8b54e969ea2eb7a91" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:05.145910 993 leader_election.cc:343] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.146694 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 641) took 1633 ms. Trace:
I20260616 19:52:05.146842 1193 rpcz_store.cc:276] 0616 19:52:03.513712 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.513853 (+ 141us) service_pool.cc:224] Handling call
0616 19:52:04.924581 (+1410728us) ts_tablet_manager.cc:1151] Deleting tablet 2b7f591d97bc4571b294b06d990d4065
0616 19:52:04.924592 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.973399 (+ 48807us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.096601 (+123202us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.146672 (+ 50071us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1410119}
I20260616 19:52:05.147321 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 642) took 1633 ms. Trace:
I20260616 19:52:05.147432 1193 rpcz_store.cc:276] 0616 19:52:03.514249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.514887 (+ 638us) service_pool.cc:224] Handling call
0616 19:52:05.147203 (+1632316us) ts_tablet_manager.cc:1151] Deleting tablet 6b0f5388a73143569012ed714e53a8be
0616 19:52:05.147213 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.147307 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1632097}
I20260616 19:52:05.147786 1193 tablet_replica.cc:333] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:05.151101 1198 tablet_bootstrap.cc:492] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:05.151305 1198 ts_tablet_manager.cc:1403] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.010s
I20260616 19:52:05.152117 1198 raft_consensus.cc:359] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.152349 1198 raft_consensus.cc:385] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.152441 1198 raft_consensus.cc:740] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.152504 1190 rpcz_store.cc:276] 0616 19:52:02.494102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.494161 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:04.908956 (+2414795us) ts_tablet_manager.cc:1151] Deleting tablet 383589f0e211418bbdf5046ed90db410
0616 19:52:04.908967 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:04.970077 (+ 61110us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.097777 (+127700us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.145266 (+ 47489us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2412998}
I20260616 19:52:05.152763 1198 consensus_queue.cc:260] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.152951 1190 tablet_replica.cc:333] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:05.153339 1198 ts_tablet_manager.cc:1434] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:05.154258 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_2febac8b65d54418b702b4b5bb9e31c5 [id=e75a6e5e4f0047d9b398ce230b170131]) successfully deleted
I20260616 19:52:05.154866 1190 raft_consensus.cc:2243] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.155354 1198 tablet_bootstrap.cc:492] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:05.156968 1192 tablet_bootstrap.cc:492] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:05.157187 1192 ts_tablet_manager.cc:1403] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.161s user 0.002s sys 0.002s
I20260616 19:52:05.158072 1198 tablet_bootstrap.cc:654] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.158988 1196 ts_tablet_manager.cc:1434] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260616 19:52:05.159615 1196 tablet_bootstrap.cc:492] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:05.159601 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 214e65957e554adba068dcd99d57cc45 has no consensus state
I20260616 19:52:05.161283 1191 ts_tablet_manager.cc:1929] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:05.161393 1191 log.cc:1199] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/59812b232848488b9894e8f8057e9def
I20260616 19:52:05.161449 1196 tablet_bootstrap.cc:654] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.161828 1191 ts_tablet_manager.cc:1950] T 59812b232848488b9894e8f8057e9def P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.162176 1192 raft_consensus.cc:359] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.162314 1193 raft_consensus.cc:2243] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:05.162575 1193 pending_rounds.cc:70] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:05.162629 1193 pending_rounds.cc:77] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595492407676928 op_type: NO_OP noop_request { }
I20260616 19:52:05.162629 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 551) took 3489 ms. Trace:
I20260616 19:52:05.162726 1193 raft_consensus.cc:2889] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:05.162801 1193 raft_consensus.cc:2272] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.162732 1191 rpcz_store.cc:276] 0616 19:52:01.673234 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.673290 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:05.130354 (+3457064us) ts_tablet_manager.cc:1151] Deleting tablet 59812b232848488b9894e8f8057e9def
0616 19:52:05.130364 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.142046 (+ 11682us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.161229 (+ 19183us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.162608 (+ 1379us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3455620}
I20260616 19:52:05.162907 1192 raft_consensus.cc:385] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.163214 1192 raft_consensus.cc:740] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.163337 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 59812b232848488b9894e8f8057e9def (table default.Table_191f8acd55ae4da9982a9fb3ec2d51cd [id=1beb7d130df7492ab9b834d005eba63a]) successfully deleted
I20260616 19:52:05.163754 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 552) took 3469 ms. Trace:
I20260616 19:52:05.163784 1192 consensus_queue.cc:260] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.163869 1191 rpcz_store.cc:276] 0616 19:52:01.694207 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.694275 (+ 68us) service_pool.cc:224] Handling call
0616 19:52:05.163623 (+3469348us) ts_tablet_manager.cc:1151] Deleting tablet 1a7b177800174706a985c11e5876b9d3
0616 19:52:05.163633 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.163735 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3469112}
W20260616 19:52:05.164601 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 1a7b177800174706a985c11e5876b9d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a7b177800174706a985c11e5876b9d3 already in progress: creating tablet
I20260616 19:52:05.165036 1193 ts_tablet_manager.cc:1916] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.165068 1192 ts_tablet_manager.cc:1434] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260616 19:52:05.165778 1192 tablet_bootstrap.cc:492] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:05.166455 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc181171b134de2b946376f468aec72" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.168079 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4adff6e41148b8b54e969ea2eb7a91" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.168592 750 tablet_service.cc:1558] Processing DeleteTablet for tablet b99740ab59f947aabcac88dc2bf2de86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.168972 754 tablet_service.cc:1511] Processing CreateTablet for tablet 990ea67ce4664c27857a15bac92d0d42 (DEFAULT_TABLE table=default.Table_0dd5a3fc9a394487bb5d9412ccfe0bac [id=c6057af61908458b84013fc2637376a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.169381 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 990ea67ce4664c27857a15bac92d0d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.169477 757 tablet_service.cc:1511] Processing CreateTablet for tablet 2701b6a10f2f4ca5826afb7ad87303e3 (DEFAULT_TABLE table=default.Table_3c74508bf28047af89a4cde7710e6e51 [id=81ce7e10ca3f4318bfb50e25f449fd2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.169864 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2701b6a10f2f4ca5826afb7ad87303e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.170341 762 tablet_service.cc:1511] Processing CreateTablet for tablet 9cfc21527ae64c86992dddc95035d34f (DEFAULT_TABLE table=default.Table_de1f064302a244b8af570852afb898e5 [id=9dc63d3175604dd79ee0c19bfa9f1472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.170691 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cfc21527ae64c86992dddc95035d34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.169001 763 tablet_service.cc:1511] Processing CreateTablet for tablet 97f78879bc38457bbd06593c03aac6ce (DEFAULT_TABLE table=default.Table_56c4bdfb8f804d10beeb4340c95e0cd8 [id=ad93a464d0a64193b3840ff34412aed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.172742 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f78879bc38457bbd06593c03aac6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.172731 751 tablet_service.cc:1511] Processing CreateTablet for tablet 15d5db407c264ed1b718a7cece511b2f (DEFAULT_TABLE table=default.Table_f836a17118c9405d96e7581590b7ec0a [id=d286549394944ad99506ba3539abe265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.173054 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d5db407c264ed1b718a7cece511b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.175889 765 tablet_service.cc:1511] Processing CreateTablet for tablet c2ca1a0a4c684d27bde1a09cf2d77c87 (DEFAULT_TABLE table=default.Table_fd6b8678fea647c791ab6cdd5765f37e [id=6f55ed77e4b5436e8faa63d8dded8b79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.176327 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]) successfully deleted
I20260616 19:52:05.176542 1849 raft_consensus.cc:493] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.176739 1849 raft_consensus.cc:515] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:05.176873 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 6b0f5388a73143569012ed714e53a8be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b0f5388a73143569012ed714e53a8be already in progress: creating tablet
W20260616 19:52:05.177291 996 leader_election.cc:343] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.177443 996 leader_election.cc:304] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.177511 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 553) took 3469 ms. Trace:
I20260616 19:52:05.177639 1191 rpcz_store.cc:276] 0616 19:52:01.695859 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.695913 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:05.165397 (+3469484us) ts_tablet_manager.cc:1151] Deleting tablet 0ca03b6e81e546adada566607257369f
0616 19:52:05.165406 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.165494 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3469279}
I20260616 19:52:05.177989 1848 raft_consensus.cc:2749] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.177448 1849 leader_election.cc:290] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.178231 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 554) took 3481 ms. Trace:
W20260616 19:52:05.178951 996 leader_election.cc:343] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.178844 1191 rpcz_store.cc:276] 0616 19:52:01.696438 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.696515 (+ 77us) service_pool.cc:224] Handling call
0616 19:52:05.177917 (+3481402us) ts_tablet_manager.cc:1151] Deleting tablet e6530753b4184cfe972ae3a43f23d589
0616 19:52:05.177931 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.178163 (+ 232us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3481202}
I20260616 19:52:05.179101 996 leader_election.cc:304] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.179390 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 555) took 3481 ms. Trace:
W20260616 19:52:05.179636 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0ca03b6e81e546adada566607257369f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ca03b6e81e546adada566607257369f already in progress: creating tablet
W20260616 19:52:05.179900 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet e6530753b4184cfe972ae3a43f23d589 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6530753b4184cfe972ae3a43f23d589 already in progress: creating tablet
I20260616 19:52:05.181391 452 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet d5741b92cafb4d53987dbeeef66ccd56 (table default.Table_a5a8fee8fc214408ae98d4e88d6f66a5 [id=ee6ce577050e45c5b9b014d3827e5046]). Expected version 1 got 0
I20260616 19:52:05.181384 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c664f0386549d6867c407526ee45a0" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:05.181717 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c664f0386549d6867c407526ee45a0" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.182538 452 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 3de0e62cfd33410490a0b460fd5f69e9 (table default.Table_60319baa28b942b29f5c6ec9005c162e [id=c7d1624942fb42aa95ad085062052262]). Expected version 2 got 0
I20260616 19:52:05.185688 1192 tablet_bootstrap.cc:654] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.187170 1190 raft_consensus.cc:2272] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.187909 1190 ts_tablet_manager.cc:1916] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.194216 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f92e45da793440d59439c715e8e50249
I20260616 19:52:05.195014 900 tablet_service.cc:1558] Processing DeleteTablet for tablet f92e45da793440d59439c715e8e50249 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:05.195326 750 tablet_service.cc:1558] Processing DeleteTablet for tablet f92e45da793440d59439c715e8e50249 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.196717 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1e12d129fff34ad8a4ab1f3d33c356b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:05.197350 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e12d129fff34ad8a4ab1f3d33c356b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:05.202577 1196 tablet_bootstrap.cc:492] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:05.202739 1196 ts_tablet_manager.cc:1403] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.004s
I20260616 19:52:05.205006 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ca1a0a4c684d27bde1a09cf2d77c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.206166 1193 ts_tablet_manager.cc:1929] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:05.206257 1193 log.cc:1199] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/1d368ec65b624ea58f7b750097a78ede
I20260616 19:52:05.206651 1193 ts_tablet_manager.cc:1950] T 1d368ec65b624ea58f7b750097a78ede P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:05.206604 1196 raft_consensus.cc:359] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.206760 1196 raft_consensus.cc:385] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.206810 1196 raft_consensus.cc:740] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.206996 1196 consensus_queue.cc:260] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.207383 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 644) took 1653 ms. Trace:
I20260616 19:52:05.207458 1196 ts_tablet_manager.cc:1434] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260616 19:52:05.209661 1196 tablet_bootstrap.cc:492] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:05.211505 1196 tablet_bootstrap.cc:654] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.219247 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 7955886341a94249afa849c51d34a0be from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:05.224619 1849 raft_consensus.cc:2749] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.224813 1191 rpcz_store.cc:276] 0616 19:52:01.697843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.697890 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:05.179185 (+3481295us) ts_tablet_manager.cc:1151] Deleting tablet 90852e10a6804cb1bee075b0e9c0eeaf
0616 19:52:05.179198 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.179315 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3481111}
W20260616 19:52:05.225879 993 leader_election.cc:343] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:05.226079 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 44207.4us
I20260616 19:52:05.227358 1801 raft_consensus.cc:493] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.227492 1801 raft_consensus.cc:515] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.231781 1801 leader_election.cc:290] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.232800 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eab5bd3967c42e1b6b79558df742946" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.233153 782 raft_consensus.cc:2393] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
W20260616 19:52:05.233462 996 leader_election.cc:343] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.236676 1849 consensus_queue.cc:1048] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260616 19:52:05.239030 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eab5bd3967c42e1b6b79558df742946" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:05.239467 996 leader_election.cc:304] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.240279 858 leader_election.cc:304] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:05.240901 1801 raft_consensus.cc:3060] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.246428 1801 raft_consensus.cc:2749] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.246727 1190 ts_tablet_manager.cc:1929] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:05.247875 1196 tablet_bootstrap.cc:492] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:05.248116 1196 ts_tablet_manager.cc:1403] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.002s
I20260616 19:52:05.249099 1196 raft_consensus.cc:359] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.249379 1196 raft_consensus.cc:385] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.249488 1196 raft_consensus.cc:740] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
W20260616 19:52:05.249617 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 56641.3us
I20260616 19:52:05.249856 1196 consensus_queue.cc:260] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.250361 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet f92e45da793440d59439c715e8e50249 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:05.250694 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 90852e10a6804cb1bee075b0e9c0eeaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90852e10a6804cb1bee075b0e9c0eeaf already in progress: creating tablet
I20260616 19:52:05.250934 1848 raft_consensus.cc:2749] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.251140 1848 consensus_queue.cc:1048] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:05.256557 1196 ts_tablet_manager.cc:1434] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260616 19:52:05.259755 1196 tablet_bootstrap.cc:492] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:05.207464 1193 rpcz_store.cc:276] 0616 19:52:03.554253 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.557493 (+ 3240us) service_pool.cc:224] Handling call
0616 19:52:05.147737 (+1590244us) ts_tablet_manager.cc:1151] Deleting tablet 1d368ec65b624ea58f7b750097a78ede
0616 19:52:05.147748 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.175129 (+ 27381us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.206117 (+ 30988us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.207365 (+ 1248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8424,"tablet-delete.queue_time_us":1588987}
I20260616 19:52:05.263625 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 1d368ec65b624ea58f7b750097a78ede (table default.Table_e2ea805b6664428787f4a70953fd22ea [id=0745df538b5e4be8b0ba20653abe53ae]) successfully deleted
I20260616 19:52:05.266896 1193 tablet_replica.cc:333] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:05.267109 1193 raft_consensus.cc:2243] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:05.267427 1193 raft_consensus.cc:2272] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.269754 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 559) took 3476 ms. Trace:
I20260616 19:52:05.270337 1196 tablet_bootstrap.cc:654] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.270735 1191 rpcz_store.cc:276] 0616 19:52:01.758088 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:01.758490 (+ 402us) service_pool.cc:224] Handling call
0616 19:52:05.225467 (+3466977us) ts_tablet_manager.cc:1151] Deleting tablet f54eef97f8db47449564b49be608902f
0616 19:52:05.225478 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.234112 (+ 8634us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3466742}
I20260616 19:52:05.253046 1192 tablet_bootstrap.cc:492] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:05.271368 1192 ts_tablet_manager.cc:1403] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.106s user 0.014s sys 0.003s
W20260616 19:52:05.271816 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet f54eef97f8db47449564b49be608902f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f54eef97f8db47449564b49be608902f already in progress: creating tablet
I20260616 19:52:05.272222 1191 tablet_replica.cc:333] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:05.272212 1192 raft_consensus.cc:359] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.272397 1192 raft_consensus.cc:385] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.272405 1191 raft_consensus.cc:2243] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.272450 1192 raft_consensus.cc:740] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.272589 1191 raft_consensus.cc:2272] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.272694 1192 consensus_queue.cc:260] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.273243 1192 ts_tablet_manager.cc:1434] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:52:05.273532 1192 tablet_bootstrap.cc:492] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:05.275826 1801 raft_consensus.cc:493] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.275959 1801 raft_consensus.cc:515] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.276540 1192 tablet_bootstrap.cc:654] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.276563 1801 leader_election.cc:290] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.277091 1198 tablet_bootstrap.cc:492] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:05.277174 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d6a025b9a248c5ab9422fe1c340f3e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.277271 1198 ts_tablet_manager.cc:1403] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.122s user 0.012s sys 0.006s
I20260616 19:52:05.278175 1198 raft_consensus.cc:359] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.278419 1198 raft_consensus.cc:385] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.278508 1198 raft_consensus.cc:740] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
W20260616 19:52:05.278760 860 leader_election.cc:343] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.278832 1198 consensus_queue.cc:260] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.279364 1198 ts_tablet_manager.cc:1434] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:05.275658 1191 ts_tablet_manager.cc:1916] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.279806 1198 tablet_bootstrap.cc:492] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:05.281276 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d6a025b9a248c5ab9422fe1c340f3e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:05.281587 1060 raft_consensus.cc:2468] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:05.282003 1198 tablet_bootstrap.cc:654] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.282017 858 leader_election.cc:304] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:05.282558 1801 raft_consensus.cc:2804] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:05.282653 1801 raft_consensus.cc:493] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:05.282752 1801 raft_consensus.cc:3060] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.283847 1192 tablet_bootstrap.cc:492] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:05.283949 1192 ts_tablet_manager.cc:1403] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.001s
I20260616 19:52:05.284602 1192 raft_consensus.cc:359] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.284740 1192 raft_consensus.cc:385] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.284782 1192 raft_consensus.cc:740] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.284992 1192 consensus_queue.cc:260] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.285463 1801 raft_consensus.cc:515] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.285595 1192 ts_tablet_manager.cc:1434] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:05.285825 1192 tablet_bootstrap.cc:492] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:05.277364 1190 log.cc:1199] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/8125dce4d32a416498b42a1b599355fd
I20260616 19:52:05.288865 1190 ts_tablet_manager.cc:1950] T 8125dce4d32a416498b42a1b599355fd P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:05.290472 1192 tablet_bootstrap.cc:654] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.292447 1198 tablet_bootstrap.cc:492] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:05.293304 1198 ts_tablet_manager.cc:1403] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.001s
I20260616 19:52:05.293720 1193 ts_tablet_manager.cc:1916] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:05.294111 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb771d17bd034199a1d615a6e98ba196 consensus state has no leader
I20260616 19:52:05.294610 1198 raft_consensus.cc:359] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.294579 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5bdf4f6d0abf4415bd063f13e2c112e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:05.294778 1198 raft_consensus.cc:385] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.294864 1198 raft_consensus.cc:740] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.295063 1198 consensus_queue.cc:260] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:05.295228 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5bdf4f6d0abf4415bd063f13e2c112e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:05.297004 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b5ec74e27eec4acdb0c7bb63e4b0f610"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:05.297250 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 587) took 2786 ms. Trace:
I20260616 19:52:05.297330 1190 rpcz_store.cc:276] 0616 19:52:02.510395 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.510451 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:05.152901 (+2642450us) ts_tablet_manager.cc:1151] Deleting tablet 8125dce4d32a416498b42a1b599355fd
0616 19:52:05.152914 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.201575 (+ 48661us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.246657 (+ 45082us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.297227 (+ 50570us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2642196}
I20260616 19:52:05.297600 1801 leader_election.cc:290] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:05.297693 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5ec74e27eec4acdb0c7bb63e4b0f610 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:05.297775 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 8125dce4d32a416498b42a1b599355fd (table default.Table_7713a34d9f7e4031a42f66ee98382545 [id=6f77a88fd07a47cfbef0a061968dda5c]) successfully deleted
I20260616 19:52:05.298931 1190 tablet_replica.cc:333] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:05.299142 1190 raft_consensus.cc:2243] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:05.299487 1190 raft_consensus.cc:2272] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.301901 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d6a025b9a248c5ab9422fe1c340f3e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:05.302516 860 leader_election.cc:343] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.303144 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d6a025b9a248c5ab9422fe1c340f3e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:05.303438 1060 raft_consensus.cc:3060] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.310943 1848 consensus_queue.cc:1048] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260616 19:52:05.311600 1848 raft_consensus.cc:493] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:05.314328 1848 raft_consensus.cc:515] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:05.314452 1190 ts_tablet_manager.cc:1916] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.314976 1848 leader_election.cc:290] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:05.315269 1198 ts_tablet_manager.cc:1434] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260616 19:52:05.315626 1908 raft_consensus.cc:493] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.315758 1908 raft_consensus.cc:515] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:05.315965 993 leader_election.cc:343] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: 383589f0e211418bbdf5046ed90db410
I20260616 19:52:05.316413 1908 leader_election.cc:290] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:05.317529 1192 tablet_bootstrap.cc:492] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:05.317523 1848 raft_consensus.cc:493] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.317642 1192 ts_tablet_manager.cc:1403] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260616 19:52:05.317684 1848 raft_consensus.cc:515] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.317972 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3587c1ab487a424eb82f378ae081f514" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:05.318306 1848 leader_election.cc:290] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.318413 1192 raft_consensus.cc:359] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.318559 1192 raft_consensus.cc:385] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.318606 1192 raft_consensus.cc:740] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.318797 1192 consensus_queue.cc:260] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.319177 1198 tablet_bootstrap.cc:492] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:05.321177 1198 tablet_bootstrap.cc:654] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.323015 2004 raft_consensus.cc:493] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.323177 2004 raft_consensus.cc:515] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.323786 2004 leader_election.cc:290] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.338101 1060 raft_consensus.cc:2468] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:05.339031 460 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 5b34d497f9334e94b06cc9245fca04ed (table default.Table_7a777a2aa2cd44d1b7f9db66e8367a32 [id=6db44bdac0784e08b52a4db869edb3d3]). Expected version 1 got 0
I20260616 19:52:05.339465 460 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 4d3f47e767764032ae5a06e34e2de248 (table default.Table_1516f5dc3b2b4de48c2c4076d1cb1205 [id=af4aada43ecf46b8bacf0d9d1388e92e]). Expected version 1 got 0
I20260616 19:52:05.344022 1196 tablet_bootstrap.cc:492] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:05.344209 1196 ts_tablet_manager.cc:1403] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.085s user 0.005s sys 0.000s
I20260616 19:52:05.344949 765 tablet_service.cc:1511] Processing CreateTablet for tablet 3d2b9af0d4e847df8901a5bd4b5002bc (DEFAULT_TABLE table=default.Table_d089eb0b17fc4358968ddd4d6675fc6b [id=85216da3e0a84b3294317c2c791a6d2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.345450 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2b9af0d4e847df8901a5bd4b5002bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.346239 1191 ts_tablet_manager.cc:1929] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:05.346377 1191 log.cc:1199] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/99b211692aca478bb40f0f2c3f50ca44
I20260616 19:52:05.346764 1191 ts_tablet_manager.cc:1950] T 99b211692aca478bb40f0f2c3f50ca44 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.347594 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 584) took 3344 ms. Trace:
I20260616 19:52:05.347716 1191 rpcz_store.cc:276] 0616 19:52:02.003129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.004001 (+ 872us) service_pool.cc:224] Handling call
0616 19:52:05.272131 (+3268130us) ts_tablet_manager.cc:1151] Deleting tablet 99b211692aca478bb40f0f2c3f50ca44
0616 19:52:05.272141 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.334986 (+ 62845us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.346144 (+ 11158us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.347547 (+ 1403us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3242049}
I20260616 19:52:05.348155 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 585) took 3302 ms. Trace:
I20260616 19:52:05.348258 1191 rpcz_store.cc:276] 0616 19:52:02.047583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.047665 (+ 82us) service_pool.cc:224] Handling call
0616 19:52:05.347994 (+3300329us) ts_tablet_manager.cc:1151] Deleting tablet 9a354b06adc343ef94b295916d582b49
0616 19:52:05.348004 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.348111 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3286410}
I20260616 19:52:05.348639 454 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_dc32eb83877c44ef9915af11d1e1a1b0 [id=46c822de2dc2471d847af2e018102efc] alter complete (version 4)
I20260616 19:52:05.349953 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a170db3d27fd40c1b74deab29e9a033f" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.350152 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b34d497f9334e94b06cc9245fca04ed" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:05.350700 996 leader_election.cc:343] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:05.350898 996 leader_election.cc:343] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.351125 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3587c1ab487a424eb82f378ae081f514" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:05.351203 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 99b211692aca478bb40f0f2c3f50ca44 (table default.Table_718b661372f441feb171907daff44e2d [id=a5404ca6c40f44b8b881ef582d703fd5]) successfully deleted
I20260616 19:52:05.351334 1060 raft_consensus.cc:2393] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
W20260616 19:52:05.351511 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 9a354b06adc343ef94b295916d582b49 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a354b06adc343ef94b295916d582b49 already in progress: creating tablet
I20260616 19:52:05.351804 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 593) took 3064 ms. Trace:
I20260616 19:52:05.351908 1191 rpcz_store.cc:276] 0616 19:52:02.286957 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.287221 (+ 264us) service_pool.cc:224] Handling call
0616 19:52:05.351672 (+3064451us) ts_tablet_manager.cc:1151] Deleting tablet c239a24dbdc047f9beb2ed7e1492acfe
0616 19:52:05.351681 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.351775 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3048101}
I20260616 19:52:05.352352 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 592) took 3067 ms. Trace:
I20260616 19:52:05.352501 1191 rpcz_store.cc:276] 0616 19:52:02.284875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.286368 (+ 1493us) service_pool.cc:224] Handling call
0616 19:52:05.352217 (+3065849us) ts_tablet_manager.cc:1151] Deleting tablet 8c19c2e43a944893b86982bee1eb2f30
0616 19:52:05.352225 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.352326 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3033752}
I20260616 19:52:05.352941 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 594) took 3011 ms. Trace:
I20260616 19:52:05.353046 1191 rpcz_store.cc:276] 0616 19:52:02.341280 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.341337 (+ 57us) service_pool.cc:224] Handling call
0616 19:52:05.352825 (+3011488us) ts_tablet_manager.cc:1151] Deleting tablet f1a09d62e68148349b337c5075763672
0616 19:52:05.352833 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.352912 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3011272}
I20260616 19:52:05.353451 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 595) took 2963 ms. Trace:
I20260616 19:52:05.353554 1191 rpcz_store.cc:276] 0616 19:52:02.389603 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.390540 (+ 937us) service_pool.cc:224] Handling call
0616 19:52:05.353339 (+2962799us) ts_tablet_manager.cc:1151] Deleting tablet 5e68e2c6caff4ac38aa52b8b29f5ace6
0616 19:52:05.353347 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.353416 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2929961}
I20260616 19:52:05.353927 1191 tablet_replica.cc:333] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:05.354132 1191 raft_consensus.cc:2243] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.354316 1191 raft_consensus.cc:2272] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.354252 719 leader_election.cc:304] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.354866 1191 ts_tablet_manager.cc:1916] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.355633 1193 ts_tablet_manager.cc:1929] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:05.355720 1193 log.cc:1199] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/36ea9b8ba668410bae016a008cf37910
I20260616 19:52:05.356076 1193 ts_tablet_manager.cc:1950] T 36ea9b8ba668410bae016a008cf37910 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:52:05.358043 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c239a24dbdc047f9beb2ed7e1492acfe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c239a24dbdc047f9beb2ed7e1492acfe already in progress: creating tablet
I20260616 19:52:05.320209 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a170db3d27fd40c1b74deab29e9a033f" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:05.358350 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8c19c2e43a944893b86982bee1eb2f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c19c2e43a944893b86982bee1eb2f30 already in progress: creating tablet
I20260616 19:52:05.325650 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b34d497f9334e94b06cc9245fca04ed" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:05.358584 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet f1a09d62e68148349b337c5075763672 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1a09d62e68148349b337c5075763672 already in progress: creating tablet
I20260616 19:52:05.338487 858 leader_election.cc:304] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
W20260616 19:52:05.358846 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 already in progress: creating tablet
W20260616 19:52:05.359297 993 leader_election.cc:343] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.359453 993 leader_election.cc:304] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:05.359862 993 leader_election.cc:343] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.360005 993 leader_election.cc:304] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.360251 2003 raft_consensus.cc:2749] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.360497 1801 raft_consensus.cc:2804] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:05.360512 2003 raft_consensus.cc:2749] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.360617 1801 raft_consensus.cc:697] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:05.360873 1801 consensus_queue.cc:237] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.361429 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d368ec65b624ea58f7b750097a78ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.361635 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 3587c1ab487a424eb82f378ae081f514 with delete_type TABLET_DATA_DELETED (replaced by tablet 84ce7bf3e0004ffaa2c5e314fa69322c) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.361768 1191 ts_tablet_manager.cc:1929] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260616 19:52:05.362110 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b7f591d97bc4571b294b06d990d4065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.361904 1191 log.cc:1199] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/383589f0e211418bbdf5046ed90db410
W20260616 19:52:05.362157 996 leader_election.cc:343] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 383589f0e211418bbdf5046ed90db410
I20260616 19:52:05.362360 996 leader_election.cc:304] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:05.362633 996 raft_consensus.cc:2686] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:52:05.362811 1191 ts_tablet_manager.cc:1950] T 383589f0e211418bbdf5046ed90db410 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.363965 1908 raft_consensus.cc:3060] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.368073 2008 raft_consensus.cc:493] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.368283 2008 raft_consensus.cc:515] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.368985 900 tablet_service.cc:1511] Processing CreateTablet for tablet 3d2b9af0d4e847df8901a5bd4b5002bc (DEFAULT_TABLE table=default.Table_d089eb0b17fc4358968ddd4d6675fc6b [id=85216da3e0a84b3294317c2c791a6d2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.369302 1192 ts_tablet_manager.cc:1434] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.052s user 0.001s sys 0.001s
I20260616 19:52:05.369787 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfff9d60bb7e4a86b14687b581b45efe" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:05.369973 924 raft_consensus.cc:2468] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:05.370422 718 leader_election.cc:304] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:05.370532 1196 raft_consensus.cc:359] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.370713 1196 raft_consensus.cc:385] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.370769 1196 raft_consensus.cc:740] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.370958 1196 consensus_queue.cc:260] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.369576 1192 tablet_bootstrap.cc:492] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:05.374826 2010 raft_consensus.cc:2804] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:05.375415 895 tablet_service.cc:1511] Processing CreateTablet for tablet 32ce369f4db042a5841003e4ea1fcc69 (DEFAULT_TABLE table=default.Table_c278603497a14856bb053d15d26c6bf0 [id=f163c85bbc3d44a98a7f55b517296d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.375840 2010 raft_consensus.cc:493] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:05.376230 2010 raft_consensus.cc:3060] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.377360 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 3d2b9af0d4e847df8901a5bd4b5002bc (DEFAULT_TABLE table=default.Table_d089eb0b17fc4358968ddd4d6675fc6b [id=85216da3e0a84b3294317c2c791a6d2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.377847 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2b9af0d4e847df8901a5bd4b5002bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.380785 1196 ts_tablet_manager.cc:1434] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
I20260616 19:52:05.380771 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 32ce369f4db042a5841003e4ea1fcc69 (DEFAULT_TABLE table=default.Table_c278603497a14856bb053d15d26c6bf0 [id=f163c85bbc3d44a98a7f55b517296d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.381217 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ce369f4db042a5841003e4ea1fcc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.358213 1190 ts_tablet_manager.cc:1929] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:05.384399 2008 leader_election.cc:290] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:05.385993 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 647) took 1820 ms. Trace:
I20260616 19:52:05.386076 1193 rpcz_store.cc:276] 0616 19:52:03.565504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.565561 (+ 57us) service_pool.cc:224] Handling call
0616 19:52:05.266841 (+1701280us) ts_tablet_manager.cc:1151] Deleting tablet 36ea9b8ba668410bae016a008cf37910
0616 19:52:05.266853 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.348452 (+ 81599us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.355587 (+ 7135us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.385972 (+ 30385us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22,"tablet-delete.queue_time_us":1701050}
I20260616 19:52:05.386296 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfff9d60bb7e4a86b14687b581b45efe" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:05.386463 1060 raft_consensus.cc:2468] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:05.386713 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 646) took 1821 ms. Trace:
I20260616 19:52:05.386868 1193 rpcz_store.cc:276] 0616 19:52:03.565365 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.566025 (+ 660us) service_pool.cc:224] Handling call
0616 19:52:05.386447 (+1820422us) ts_tablet_manager.cc:1151] Deleting tablet d4a2855b7dec4244a3fc52bdca7e7eb3
0616 19:52:05.386581 (+ 134us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.386695 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1820209}
I20260616 19:52:05.387285 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 648) took 1808 ms. Trace:
I20260616 19:52:05.387434 1196 tablet_bootstrap.cc:492] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:05.389212 1196 tablet_bootstrap.cc:654] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.385639 1190 log.cc:1199] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/b99740ab59f947aabcac88dc2bf2de86
I20260616 19:52:05.387418 1193 rpcz_store.cc:276] 0616 19:52:03.578722 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.578803 (+ 81us) service_pool.cc:224] Handling call
0616 19:52:05.387177 (+1808374us) ts_tablet_manager.cc:1151] Deleting tablet daf86e5d5f2341c78705f78c02695c17
0616 19:52:05.387186 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.387267 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1806264}
I20260616 19:52:05.391341 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2b9af0d4e847df8901a5bd4b5002bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.392992 1192 tablet_bootstrap.cc:654] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.393815 751 tablet_service.cc:1511] Processing CreateTablet for tablet 32ce369f4db042a5841003e4ea1fcc69 (DEFAULT_TABLE table=default.Table_c278603497a14856bb053d15d26c6bf0 [id=f163c85bbc3d44a98a7f55b517296d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.393958 763 tablet_service.cc:1511] Processing CreateTablet for tablet 214e65957e554adba068dcd99d57cc45 (DEFAULT_TABLE table=default.Table_ade4b72bce6242fa8ca2ee0f2fb16abf [id=f1246a9f55ee4e79acbc9c353d528fe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.394135 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ce369f4db042a5841003e4ea1fcc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.394411 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214e65957e554adba068dcd99d57cc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.396708 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ce369f4db042a5841003e4ea1fcc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.397156 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 36ea9b8ba668410bae016a008cf37910 (table default.Table_78964cf02d6e4b94be59a534e00ada50 [id=7ba83bcdb62c4bc9804589f54ddb86d8]) successfully deleted
W20260616 19:52:05.397490 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d4a2855b7dec4244a3fc52bdca7e7eb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4a2855b7dec4244a3fc52bdca7e7eb3 already in progress: creating tablet
W20260616 19:52:05.397723 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet daf86e5d5f2341c78705f78c02695c17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daf86e5d5f2341c78705f78c02695c17 already in progress: creating tablet
I20260616 19:52:05.398391 1849 consensus_queue.cc:1048] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260616 19:52:05.403780 1190 ts_tablet_manager.cc:1950] T b99740ab59f947aabcac88dc2bf2de86 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:05.404131 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 589) took 2880 ms. Trace:
I20260616 19:52:05.404294 1190 rpcz_store.cc:276] 0616 19:52:02.523825 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.523876 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:05.298850 (+2774974us) ts_tablet_manager.cc:1151] Deleting tablet b99740ab59f947aabcac88dc2bf2de86
0616 19:52:05.298887 (+ 37us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.351258 (+ 52371us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.358146 (+ 6888us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.404119 (+ 45973us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2774746}
I20260616 19:52:05.405047 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 591) took 2877 ms. Trace:
I20260616 19:52:05.405122 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet b99740ab59f947aabcac88dc2bf2de86 (table default.Table_2e10c27b05e243a2a85134e81dc2a126 [id=d641d7d6fc004dc384ee5f82769bbfbc]) successfully deleted
I20260616 19:52:05.405165 1190 rpcz_store.cc:276] 0616 19:52:02.527179 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.527233 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:05.404941 (+2877708us) ts_tablet_manager.cc:1151] Deleting tablet e03e6a2614564eeeb8ec382b16f0ece1
0616 19:52:05.404949 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.405032 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2877543}
I20260616 19:52:05.405457 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 590) took 2878 ms. Trace:
I20260616 19:52:05.405510 1190 rpcz_store.cc:276] 0616 19:52:02.527025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.527429 (+ 404us) service_pool.cc:224] Handling call
0616 19:52:05.405377 (+2877948us) ts_tablet_manager.cc:1151] Deleting tablet fac9c314b1824e3297cf568ea0b14865
0616 19:52:05.405384 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.405445 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2877786}
I20260616 19:52:05.405798 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 592) took 2877 ms. Trace:
W20260616 19:52:05.405821 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet e03e6a2614564eeeb8ec382b16f0ece1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e03e6a2614564eeeb8ec382b16f0ece1 already in progress: creating tablet
I20260616 19:52:05.405905 1190 rpcz_store.cc:276] 0616 19:52:02.527940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.527987 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:05.405723 (+2877736us) ts_tablet_manager.cc:1151] Deleting tablet 79d686afeeed4729bd2069296aec82a1
0616 19:52:05.405730 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.405786 (+ 56us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2877536}
I20260616 19:52:05.406109 1190 tablet_replica.cc:333] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:05.406275 1190 raft_consensus.cc:2243] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:05.406553 1190 raft_consensus.cc:2272] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:05.406544 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet fac9c314b1824e3297cf568ea0b14865 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fac9c314b1824e3297cf568ea0b14865 already in progress: creating tablet
W20260616 19:52:05.406795 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 79d686afeeed4729bd2069296aec82a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79d686afeeed4729bd2069296aec82a1 already in progress: creating tablet
I20260616 19:52:05.407028 1190 ts_tablet_manager.cc:1916] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.407616 900 tablet_service.cc:1511] Processing CreateTablet for tablet 214e65957e554adba068dcd99d57cc45 (DEFAULT_TABLE table=default.Table_ade4b72bce6242fa8ca2ee0f2fb16abf [id=f1246a9f55ee4e79acbc9c353d528fe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.407666 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 214e65957e554adba068dcd99d57cc45 (DEFAULT_TABLE table=default.Table_ade4b72bce6242fa8ca2ee0f2fb16abf [id=f1246a9f55ee4e79acbc9c353d528fe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.407989 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214e65957e554adba068dcd99d57cc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.408114 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214e65957e554adba068dcd99d57cc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.411855 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 649) took 1725 ms. Trace:
I20260616 19:52:05.411958 1193 rpcz_store.cc:276] 0616 19:52:03.686015 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.686110 (+ 95us) service_pool.cc:224] Handling call
0616 19:52:05.411687 (+1725577us) ts_tablet_manager.cc:1151] Deleting tablet ea0a7f80c5a34dbfabce579b6f574f93
0616 19:52:05.411700 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.411832 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1690800}
W20260616 19:52:05.412446 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet ea0a7f80c5a34dbfabce579b6f574f93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea0a7f80c5a34dbfabce579b6f574f93 already in progress: creating tablet
I20260616 19:52:05.412940 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 650) took 1722 ms. Trace:
I20260616 19:52:05.413019 1193 rpcz_store.cc:276] 0616 19:52:03.690188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.690866 (+ 678us) service_pool.cc:224] Handling call
0616 19:52:05.412831 (+1721965us) ts_tablet_manager.cc:1151] Deleting tablet 7e7f55f5946043108153b4c452a3d961
0616 19:52:05.412842 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.412923 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1711293}
W20260616 19:52:05.413440 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 7e7f55f5946043108153b4c452a3d961 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e7f55f5946043108153b4c452a3d961 already in progress: creating tablet
I20260616 19:52:05.414144 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 651) took 1716 ms. Trace:
I20260616 19:52:05.414243 1908 raft_consensus.cc:2749] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.414237 1193 rpcz_store.cc:276] 0616 19:52:03.698021 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.700031 (+ 2010us) service_pool.cc:224] Handling call
0616 19:52:05.414045 (+1714014us) ts_tablet_manager.cc:1151] Deleting tablet bcc5116ef5df4140a96f03c003337c68
0616 19:52:05.414053 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.414129 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1709067}
W20260616 19:52:05.414867 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet bcc5116ef5df4140a96f03c003337c68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcc5116ef5df4140a96f03c003337c68 already in progress: creating tablet
I20260616 19:52:05.415179 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 654) took 1716 ms. Trace:
I20260616 19:52:05.415262 1193 rpcz_store.cc:276] 0616 19:52:03.698385 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.699693 (+ 1308us) service_pool.cc:224] Handling call
0616 19:52:05.415078 (+1715385us) ts_tablet_manager.cc:1151] Deleting tablet 0d4634afc3364221b4fdfcd3ce108a60
0616 19:52:05.415086 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.415163 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1709883}
W20260616 19:52:05.415673 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0d4634afc3364221b4fdfcd3ce108a60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d4634afc3364221b4fdfcd3ce108a60 already in progress: creating tablet
I20260616 19:52:05.416041 1193 tablet_replica.cc:333] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:05.418359 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 596) took 2922 ms. Trace:
I20260616 19:52:05.418509 1191 rpcz_store.cc:276] 0616 19:52:02.495911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.496066 (+ 155us) service_pool.cc:224] Handling call
0616 19:52:05.353864 (+2857798us) ts_tablet_manager.cc:1151] Deleting tablet 383589f0e211418bbdf5046ed90db410
0616 19:52:05.353872 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.358231 (+ 4359us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.361282 (+ 3051us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.418337 (+ 57055us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2810964}
I20260616 19:52:05.420110 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 599) took 2888 ms. Trace:
I20260616 19:52:05.420241 1191 rpcz_store.cc:276] 0616 19:52:02.531869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.532178 (+ 309us) service_pool.cc:224] Handling call
0616 19:52:05.419997 (+2887819us) ts_tablet_manager.cc:1151] Deleting tablet 79d686afeeed4729bd2069296aec82a1
0616 19:52:05.420006 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.420091 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2876873}
I20260616 19:52:05.420276 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 383589f0e211418bbdf5046ed90db410 (table default.Table_2febac8b65d54418b702b4b5bb9e31c5 [id=e75a6e5e4f0047d9b398ce230b170131]) successfully deleted
I20260616 19:52:05.420747 1191 tablet_replica.cc:333] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:05.420979 1191 raft_consensus.cc:2243] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.421166 1191 raft_consensus.cc:2272] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.421743 1191 ts_tablet_manager.cc:1916] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.424530 1192 tablet_bootstrap.cc:492] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:05.424722 1192 ts_tablet_manager.cc:1403] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.003s
I20260616 19:52:05.425529 1192 raft_consensus.cc:359] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.425871 1192 raft_consensus.cc:385] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.425963 1192 raft_consensus.cc:740] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.426260 1192 consensus_queue.cc:260] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.427466 1191 ts_tablet_manager.cc:1929] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:05.427609 1191 log.cc:1199] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/c44422ddb8ce45a48bb9aaeb6c209f21
I20260616 19:52:05.428001 1191 ts_tablet_manager.cc:1950] T c44422ddb8ce45a48bb9aaeb6c209f21 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
W20260616 19:52:05.429005 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 79d686afeeed4729bd2069296aec82a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79d686afeeed4729bd2069296aec82a1 already in progress: creating tablet
I20260616 19:52:05.429689 1192 ts_tablet_manager.cc:1434] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260616 19:52:05.432529 1192 tablet_bootstrap.cc:492] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:05.434561 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 602) took 2877 ms. Trace:
I20260616 19:52:05.434711 1191 rpcz_store.cc:276] 0616 19:52:02.557211 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.557258 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:05.420703 (+2863445us) ts_tablet_manager.cc:1151] Deleting tablet c44422ddb8ce45a48bb9aaeb6c209f21
0616 19:52:05.420713 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.424853 (+ 4140us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.427424 (+ 2571us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.434540 (+ 7116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2863181}
I20260616 19:52:05.435253 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet c44422ddb8ce45a48bb9aaeb6c209f21 (table default.Table_a70aca898ad449b481395f5ffc808a22 [id=ac53389fae904a0ea6ddcb9e82000d78]) successfully deleted
I20260616 19:52:05.435345 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 597) took 2906 ms. Trace:
I20260616 19:52:05.435549 1191 rpcz_store.cc:276] 0616 19:52:02.529402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.543223 (+ 13821us) service_pool.cc:224] Handling call
0616 19:52:05.435226 (+2892003us) ts_tablet_manager.cc:1151] Deleting tablet e03e6a2614564eeeb8ec382b16f0ece1
0616 19:52:05.435236 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.435328 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2874542}
I20260616 19:52:05.436094 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 598) took 2904 ms. Trace:
I20260616 19:52:05.436223 1191 rpcz_store.cc:276] 0616 19:52:02.531738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.545302 (+ 13564us) service_pool.cc:224] Handling call
0616 19:52:05.435998 (+2890696us) ts_tablet_manager.cc:1151] Deleting tablet fac9c314b1824e3297cf568ea0b14865
0616 19:52:05.436007 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.436078 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2856376}
I20260616 19:52:05.436712 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 606) took 2853 ms. Trace:
I20260616 19:52:05.436828 1191 rpcz_store.cc:276] 0616 19:52:02.583346 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.583402 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:05.436610 (+2853208us) ts_tablet_manager.cc:1151] Deleting tablet 2d05c86bca9343a2bc8c5709e1c49647
0616 19:52:05.436618 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.436687 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2852974}
W20260616 19:52:05.436954 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet e03e6a2614564eeeb8ec382b16f0ece1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e03e6a2614564eeeb8ec382b16f0ece1 already in progress: creating tablet
W20260616 19:52:05.437273 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet fac9c314b1824e3297cf568ea0b14865 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fac9c314b1824e3297cf568ea0b14865 already in progress: creating tablet
I20260616 19:52:05.437322 1191 tablet_replica.cc:333] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:05.437537 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2d05c86bca9343a2bc8c5709e1c49647 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d05c86bca9343a2bc8c5709e1c49647 already in progress: creating tablet
I20260616 19:52:05.437582 1191 raft_consensus.cc:2243] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.437849 1191 raft_consensus.cc:2272] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.438026 1192 tablet_bootstrap.cc:654] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.438895 1191 ts_tablet_manager.cc:1916] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.445817 750 tablet_service.cc:1511] Processing CreateTablet for tablet f176111bc2a7494da5e17986963a2c5c (DEFAULT_TABLE table=default.Table_1f18a5bb72304b31829f26b9096e8a35 [id=91d0bfc24f54440da08ed1642b5590e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.446337 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f176111bc2a7494da5e17986963a2c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.446329 1191 ts_tablet_manager.cc:1929] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260616 19:52:05.446416 1191 log.cc:1199] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/ab33d99d857145dfbda54ff2f7464486
I20260616 19:52:05.446748 1191 ts_tablet_manager.cc:1950] T ab33d99d857145dfbda54ff2f7464486 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.447487 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 605) took 2864 ms. Trace:
I20260616 19:52:05.447564 1191 rpcz_store.cc:276] 0616 19:52:02.583210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.584011 (+ 801us) service_pool.cc:224] Handling call
0616 19:52:05.437277 (+2853266us) ts_tablet_manager.cc:1151] Deleting tablet ab33d99d857145dfbda54ff2f7464486
0616 19:52:05.437289 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.441957 (+ 4668us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.446283 (+ 4326us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.447468 (+ 1185us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2853082}
I20260616 19:52:05.448009 1191 tablet_replica.cc:333] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:05.448161 1191 raft_consensus.cc:2243] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.448292 1191 raft_consensus.cc:2272] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.448819 1191 ts_tablet_manager.cc:1916] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.453030 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet ab33d99d857145dfbda54ff2f7464486 (table default.Table_0a6adf1d7e5244debb4424a25d63a45d [id=122f88b500c0425e833926b349605d6f]) successfully deleted
I20260616 19:52:05.454721 1190 ts_tablet_manager.cc:1929] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260616 19:52:05.454885 1191 ts_tablet_manager.cc:1929] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:05.454744 2010 raft_consensus.cc:515] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.455082 1191 log.cc:1199] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/da51a682de41402cb537ab113f876a2d
I20260616 19:52:05.456204 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfff9d60bb7e4a86b14687b581b45efe" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:05.456387 1060 raft_consensus.cc:3060] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.457854 762 tablet_service.cc:1511] Processing CreateTablet for tablet 00ba17a832dc4eb2a672d1eb246dd5b3 (DEFAULT_TABLE table=default.Table_02bf2860f6fb4632b760335e3f6319c3 [id=8ff675bd289a4b97812031c0ab57aa5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.458333 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ba17a832dc4eb2a672d1eb246dd5b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.456637 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfff9d60bb7e4a86b14687b581b45efe" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:05.458788 924 raft_consensus.cc:3060] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.458848 1060 raft_consensus.cc:2468] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:05.459311 900 tablet_service.cc:1511] Processing CreateTablet for tablet f176111bc2a7494da5e17986963a2c5c (DEFAULT_TABLE table=default.Table_1f18a5bb72304b31829f26b9096e8a35 [id=91d0bfc24f54440da08ed1642b5590e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.459658 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f176111bc2a7494da5e17986963a2c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.461434 924 raft_consensus.cc:2468] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:05.461862 1190 log.cc:1199] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/ab33d99d857145dfbda54ff2f7464486
I20260616 19:52:05.461897 718 leader_election.cc:304] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:05.462196 1908 raft_consensus.cc:2804] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:05.462234 1190 ts_tablet_manager.cc:1950] T ab33d99d857145dfbda54ff2f7464486 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:05.462320 1908 raft_consensus.cc:697] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:05.462536 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 596) took 2881 ms. Trace:
I20260616 19:52:05.462599 1908 consensus_queue.cc:237] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.462630 1190 rpcz_store.cc:276] 0616 19:52:02.581483 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.581679 (+ 196us) service_pool.cc:224] Handling call
0616 19:52:05.406077 (+2824398us) ts_tablet_manager.cc:1151] Deleting tablet ab33d99d857145dfbda54ff2f7464486
0616 19:52:05.406084 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.434467 (+ 28383us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.454666 (+ 20199us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.462497 (+ 7831us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2824167}
I20260616 19:52:05.463106 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet ab33d99d857145dfbda54ff2f7464486 (table default.Table_0a6adf1d7e5244debb4424a25d63a45d [id=122f88b500c0425e833926b349605d6f]) successfully deleted
I20260616 19:52:05.466157 1021 tablet_service.cc:1511] Processing CreateTablet for tablet f176111bc2a7494da5e17986963a2c5c (DEFAULT_TABLE table=default.Table_1f18a5bb72304b31829f26b9096e8a35 [id=91d0bfc24f54440da08ed1642b5590e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.466514 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f176111bc2a7494da5e17986963a2c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.468112 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 597) took 2886 ms. Trace:
I20260616 19:52:05.468864 1190 rpcz_store.cc:276] 0616 19:52:02.581625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.581947 (+ 322us) service_pool.cc:224] Handling call
0616 19:52:05.467974 (+2886027us) ts_tablet_manager.cc:1151] Deleting tablet 2d05c86bca9343a2bc8c5709e1c49647
0616 19:52:05.467984 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.468077 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2885851}
W20260616 19:52:05.469818 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 2d05c86bca9343a2bc8c5709e1c49647 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d05c86bca9343a2bc8c5709e1c49647 already in progress: creating tablet
I20260616 19:52:05.470337 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 600) took 2769 ms. Trace:
I20260616 19:52:05.472182 1190 rpcz_store.cc:276] 0616 19:52:02.700808 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.700856 (+ 48us) service_pool.cc:224] Handling call
0616 19:52:05.470219 (+2769363us) ts_tablet_manager.cc:1151] Deleting tablet 0c166a93c88b45f799e14e10e802b5a0
0616 19:52:05.470228 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.470304 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2769177}
I20260616 19:52:05.472493 1801 raft_consensus.cc:493] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.472908 1801 raft_consensus.cc:515] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.473528 1801 leader_election.cc:290] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.474236 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da51a682de41402cb537ab113f876a2d" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.474336 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da51a682de41402cb537ab113f876a2d" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:52:05.474754 858 leader_election.cc:343] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: Tablet not RUNNING: STOPPED
W20260616 19:52:05.474854 860 leader_election.cc:343] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.474941 858 leader_election.cc:304] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:05.475361 1191 ts_tablet_manager.cc:1950] T da51a682de41402cb537ab113f876a2d P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.475648 1801 raft_consensus.cc:2749] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.475845 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 608) took 2815 ms. Trace:
I20260616 19:52:05.475973 1191 rpcz_store.cc:276] 0616 19:52:02.660220 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.660287 (+ 67us) service_pool.cc:224] Handling call
0616 19:52:05.447964 (+2787677us) ts_tablet_manager.cc:1151] Deleting tablet da51a682de41402cb537ab113f876a2d
0616 19:52:05.447975 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.451947 (+ 3972us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.454840 (+ 2893us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.475829 (+ 20989us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2787419}
I20260616 19:52:05.476397 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet da51a682de41402cb537ab113f876a2d (table default.Table_10a5c35013c14fe1b8d9d1c77589d321 [id=c53bc843f4974b08965984db1910d6d5]) successfully deleted
I20260616 19:52:05.476538 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 609) took 2760 ms. Trace:
I20260616 19:52:05.476675 1191 rpcz_store.cc:276] 0616 19:52:02.715746 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.715801 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:05.476409 (+2760608us) ts_tablet_manager.cc:1151] Deleting tablet 0c166a93c88b45f799e14e10e802b5a0
0616 19:52:05.476417 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.476521 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2760314}
W20260616 19:52:05.476774 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 0c166a93c88b45f799e14e10e802b5a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c166a93c88b45f799e14e10e802b5a0 already in progress: creating tablet
I20260616 19:52:05.477252 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 610) took 2761 ms. Trace:
I20260616 19:52:05.477365 1191 rpcz_store.cc:276] 0616 19:52:02.716272 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.716328 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:05.477150 (+2760822us) ts_tablet_manager.cc:1151] Deleting tablet 12944efb54824dc4960db5d09c1a1684
0616 19:52:05.477160 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.477235 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2760621}
I20260616 19:52:05.477970 784 raft_consensus.cc:3060] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:05.477931 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0c166a93c88b45f799e14e10e802b5a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c166a93c88b45f799e14e10e802b5a0 already in progress: creating tablet
I20260616 19:52:05.478039 900 tablet_service.cc:1511] Processing CreateTablet for tablet 00ba17a832dc4eb2a672d1eb246dd5b3 (DEFAULT_TABLE table=default.Table_02bf2860f6fb4632b760335e3f6319c3 [id=8ff675bd289a4b97812031c0ab57aa5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.478735 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ba17a832dc4eb2a672d1eb246dd5b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.479261 2010 leader_election.cc:290] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:05.481789 1801 consensus_queue.cc:1048] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:05.482833 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 00ba17a832dc4eb2a672d1eb246dd5b3 (DEFAULT_TABLE table=default.Table_02bf2860f6fb4632b760335e3f6319c3 [id=8ff675bd289a4b97812031c0ab57aa5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.483289 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ba17a832dc4eb2a672d1eb246dd5b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:05.486564 858 consensus_peers.cc:597] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99b211692aca478bb40f0f2c3f50ca44. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:05.485512 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 611) took 2728 ms. Trace:
I20260616 19:52:05.486845 1191 rpcz_store.cc:276] 0616 19:52:02.756672 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.756727 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:05.485384 (+2728657us) ts_tablet_manager.cc:1151] Deleting tablet 5a9befb557d84f3bb7781664cbf2f28f
0616 19:52:05.485396 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.485493 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2720818}
I20260616 19:52:05.487495 1191 tablet_replica.cc:333] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:05.487483 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 5a9befb557d84f3bb7781664cbf2f28f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a9befb557d84f3bb7781664cbf2f28f already in progress: creating tablet
I20260616 19:52:05.487823 1191 raft_consensus.cc:2243] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:05.488036 750 tablet_service.cc:1511] Processing CreateTablet for tablet 63bb0e724ba04f79809850febc966c66 (DEFAULT_TABLE table=default.Table_45f727fb97db43d3bdbf9b1046001a45 [id=8e9bb037176e401bb84e6f46749c3050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.488605 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63bb0e724ba04f79809850febc966c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.488729 1191 raft_consensus.cc:2272] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.493876 1191 ts_tablet_manager.cc:1916] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.498559 1190 tablet_replica.cc:333] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:05.500293 1190 raft_consensus.cc:2243] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.501077 1190 raft_consensus.cc:2272] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.502241 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1f18a5bb72304b31829f26b9096e8a35" } new_table_name: "default.Table_5d133f84e3184006a927183e55a5d2ed" modify_external_catalogs: true
I20260616 19:52:05.505219 1190 ts_tablet_manager.cc:1916] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.506148 1191 ts_tablet_manager.cc:1929] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:05.514008 1191 log.cc:1199] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/8eab5bd3967c42e1b6b79558df742946
I20260616 19:52:05.514595 1191 ts_tablet_manager.cc:1950] T 8eab5bd3967c42e1b6b79558df742946 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.516229 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 612) took 2708 ms. Trace:
I20260616 19:52:05.517160 1191 rpcz_store.cc:276] 0616 19:52:02.807908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.807963 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:05.487436 (+2679473us) ts_tablet_manager.cc:1151] Deleting tablet 8eab5bd3967c42e1b6b79558df742946
0616 19:52:05.487449 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.503276 (+ 15827us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.506098 (+ 2822us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.516209 (+ 10111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2679079}
I20260616 19:52:05.517978 1191 tablet_replica.cc:333] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:05.518268 1191 raft_consensus.cc:2243] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.518455 1191 raft_consensus.cc:2272] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.519061 1191 ts_tablet_manager.cc:1916] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.523335 900 tablet_service.cc:1511] Processing CreateTablet for tablet 63bb0e724ba04f79809850febc966c66 (DEFAULT_TABLE table=default.Table_45f727fb97db43d3bdbf9b1046001a45 [id=8e9bb037176e401bb84e6f46749c3050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.524011 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63bb0e724ba04f79809850febc966c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.524820 1191 ts_tablet_manager.cc:1929] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:05.524974 1191 log.cc:1199] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/3587c1ab487a424eb82f378ae081f514
I20260616 19:52:05.525305 1191 ts_tablet_manager.cc:1950] T 3587c1ab487a424eb82f378ae081f514 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.526086 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 613) took 2672 ms. Trace:
I20260616 19:52:05.526223 1191 rpcz_store.cc:276] 0616 19:52:02.854004 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.854056 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:05.517923 (+2663867us) ts_tablet_manager.cc:1151] Deleting tablet 3587c1ab487a424eb82f378ae081f514
0616 19:52:05.517934 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.522068 (+ 4134us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.524776 (+ 2708us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.526066 (+ 1290us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2663674}
I20260616 19:52:05.527269 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 614) took 2617 ms. Trace:
I20260616 19:52:05.527407 1191 rpcz_store.cc:276] 0616 19:52:02.909176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.909237 (+ 61us) service_pool.cc:224] Handling call
0616 19:52:05.526756 (+2617519us) ts_tablet_manager.cc:1151] Deleting tablet 47bbf21dc1d945ce8f5edd27cdf26817
0616 19:52:05.526766 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.526860 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2617257}
I20260616 19:52:05.527925 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 618) took 2595 ms. Trace:
I20260616 19:52:05.528046 1191 rpcz_store.cc:276] 0616 19:52:02.932588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.932700 (+ 112us) service_pool.cc:224] Handling call
0616 19:52:05.527826 (+2595126us) ts_tablet_manager.cc:1151] Deleting tablet 7dafeb24a59948b28e26730194e29758
0616 19:52:05.527836 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.527909 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2591452}
I20260616 19:52:05.528537 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 619) took 2593 ms. Trace:
I20260616 19:52:05.528663 1191 rpcz_store.cc:276] 0616 19:52:02.935122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.935223 (+ 101us) service_pool.cc:224] Handling call
0616 19:52:05.528424 (+2593201us) ts_tablet_manager.cc:1151] Deleting tablet 90630f9e6f314c5d9589e673339f475a
0616 19:52:05.528433 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.528521 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2590965}
I20260616 19:52:05.529138 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 620) took 2591 ms. Trace:
I20260616 19:52:05.529261 1191 rpcz_store.cc:276] 0616 19:52:02.937633 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.937825 (+ 192us) service_pool.cc:224] Handling call
0616 19:52:05.529053 (+2591228us) ts_tablet_manager.cc:1151] Deleting tablet 4bde746e334a4f59aded168c6b2bb348
0616 19:52:05.529061 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.529124 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2591061}
I20260616 19:52:05.529723 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 621) took 2585 ms. Trace:
I20260616 19:52:05.529848 1191 rpcz_store.cc:276] 0616 19:52:02.943827 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.943875 (+ 48us) service_pool.cc:224] Handling call
0616 19:52:05.529610 (+2585735us) ts_tablet_manager.cc:1151] Deleting tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc
0616 19:52:05.529618 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.529708 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2585392}
I20260616 19:52:05.530282 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 622) took 2554 ms. Trace:
I20260616 19:52:05.530397 1191 rpcz_store.cc:276] 0616 19:52:02.975941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.975996 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:05.530198 (+2554202us) ts_tablet_manager.cc:1151] Deleting tablet 46faf1477a4b4c9994e556308647cad3
0616 19:52:05.530207 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.530270 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2553959}
I20260616 19:52:05.530838 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 625) took 2471 ms. Trace:
I20260616 19:52:05.530953 1191 rpcz_store.cc:276] 0616 19:52:03.059152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.083568 (+ 24416us) service_pool.cc:224] Handling call
0616 19:52:05.530755 (+2447187us) ts_tablet_manager.cc:1151] Deleting tablet c3706f41b0e342a69f66c936173f2ae0
0616 19:52:05.530763 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.530826 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2446983}
I20260616 19:52:05.531378 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 628) took 2409 ms. Trace:
I20260616 19:52:05.531493 1191 rpcz_store.cc:276] 0616 19:52:03.122269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.122325 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:05.531293 (+2408968us) ts_tablet_manager.cc:1151] Deleting tablet c0f19c77783a4b53b160589b74dbd20d
0616 19:52:05.531301 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.531365 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2376788}
I20260616 19:52:05.531944 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 635) took 2269 ms. Trace:
I20260616 19:52:05.532058 1191 rpcz_store.cc:276] 0616 19:52:03.262575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.262826 (+ 251us) service_pool.cc:224] Handling call
0616 19:52:05.531860 (+2269034us) ts_tablet_manager.cc:1151] Deleting tablet e1ab9d0ac7df4d549d52014a0ecd9d1a
0616 19:52:05.531868 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.531931 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2263313}
I20260616 19:52:05.532516 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 631) took 2270 ms. Trace:
I20260616 19:52:05.532656 1191 rpcz_store.cc:276] 0616 19:52:03.262138 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.262878 (+ 740us) service_pool.cc:224] Handling call
0616 19:52:05.532407 (+2269529us) ts_tablet_manager.cc:1151] Deleting tablet 9d9c89216995430188b1eed4c6b26d1e
0616 19:52:05.532416 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.532498 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2263802}
I20260616 19:52:05.533241 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 630) took 2271 ms. Trace:
I20260616 19:52:05.533375 1191 rpcz_store.cc:276] 0616 19:52:03.262020 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.268815 (+ 6795us) service_pool.cc:224] Handling call
0616 19:52:05.533133 (+2264318us) ts_tablet_manager.cc:1151] Deleting tablet 64aa32856ca34743933931fb51f2bd7b
0616 19:52:05.533144 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.533225 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2264108}
I20260616 19:52:05.533506 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 8eab5bd3967c42e1b6b79558df742946 (table default.Table_8fff86d5c2344e2fb59db9872ee90b74 [id=06f5d602dcec42a884b5eb53f9d0a27c]) successfully deleted
I20260616 19:52:05.533819 1191 tablet_replica.cc:333] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:05.533854 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 3587c1ab487a424eb82f378ae081f514 (table default.Table_9fe1afa2ee854800ab19aac1fb4c6048 [id=4f2b128cff5248f98e3506bb72a39391]) successfully deleted
W20260616 19:52:05.534269 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 47bbf21dc1d945ce8f5edd27cdf26817 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47bbf21dc1d945ce8f5edd27cdf26817 already in progress: creating tablet
W20260616 19:52:05.534520 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 7dafeb24a59948b28e26730194e29758 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dafeb24a59948b28e26730194e29758 already in progress: creating tablet
I20260616 19:52:05.534777 1191 raft_consensus.cc:2243] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.535015 1191 raft_consensus.cc:2272] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:05.535086 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 90630f9e6f314c5d9589e673339f475a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90630f9e6f314c5d9589e673339f475a already in progress: creating tablet
W20260616 19:52:05.535343 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 4bde746e334a4f59aded168c6b2bb348 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bde746e334a4f59aded168c6b2bb348 already in progress: creating tablet
W20260616 19:52:05.535660 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc already in progress: creating tablet
I20260616 19:52:05.535677 1191 ts_tablet_manager.cc:1916] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:05.535890 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 46faf1477a4b4c9994e556308647cad3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46faf1477a4b4c9994e556308647cad3 already in progress: creating tablet
W20260616 19:52:05.539613 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c3706f41b0e342a69f66c936173f2ae0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3706f41b0e342a69f66c936173f2ae0 already in progress: creating tablet
W20260616 19:52:05.539951 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c0f19c77783a4b53b160589b74dbd20d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0f19c77783a4b53b160589b74dbd20d already in progress: creating tablet
I20260616 19:52:05.541517 1908 raft_consensus.cc:493] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.541704 1908 raft_consensus.cc:515] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.542395 1908 leader_election.cc:290] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:05.542394 1191 ts_tablet_manager.cc:1929] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:05.543170 1191 log.cc:1199] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/15d6a025b9a248c5ab9422fe1c340f3e
W20260616 19:52:05.543123 719 leader_election.cc:343] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: fdc6222db09d4cd987cbdf70e4d40f70
I20260616 19:52:05.543084 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6222db09d4cd987cbdf70e4d40f70" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:05.543701 718 leader_election.cc:304] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.544094 1908 raft_consensus.cc:2749] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:05.545189 858 consensus_peers.cc:597] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10fc1d2ecaa746bab980a708dd8eb93a. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:05.543540 1191 ts_tablet_manager.cc:1950] T 15d6a025b9a248c5ab9422fe1c340f3e P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.546277 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 629) took 2284 ms. Trace:
I20260616 19:52:05.546402 1191 rpcz_store.cc:276] 0616 19:52:03.261763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.269056 (+ 7293us) service_pool.cc:224] Handling call
0616 19:52:05.533776 (+2264720us) ts_tablet_manager.cc:1151] Deleting tablet 15d6a025b9a248c5ab9422fe1c340f3e
0616 19:52:05.533784 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.538798 (+ 5014us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.542344 (+ 3546us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.546261 (+ 3917us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2264565}
I20260616 19:52:05.546945 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 637) took 2273 ms. Trace:
I20260616 19:52:05.547060 1191 rpcz_store.cc:276] 0616 19:52:03.273324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.273378 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:05.546848 (+2273470us) ts_tablet_manager.cc:1151] Deleting tablet 731473c9021a4522ae2dfecff22c60e6
0616 19:52:05.546857 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.546932 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2273189}
I20260616 19:52:05.547477 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 640) took 2253 ms. Trace:
I20260616 19:52:05.547581 1191 rpcz_store.cc:276] 0616 19:52:03.294441 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.294689 (+ 248us) service_pool.cc:224] Handling call
0616 19:52:05.547397 (+2252708us) ts_tablet_manager.cc:1151] Deleting tablet c090cf49c61e487a974d953ed1903db7
0616 19:52:05.547405 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.547466 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2252542}
I20260616 19:52:05.547984 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 647) took 2036 ms. Trace:
I20260616 19:52:05.548087 1191 rpcz_store.cc:276] 0616 19:52:03.511680 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.511739 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:05.547905 (+2036166us) ts_tablet_manager.cc:1151] Deleting tablet 6b0f5388a73143569012ed714e53a8be
0616 19:52:05.547913 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.547973 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2034564}
I20260616 19:52:05.548498 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 645) took 2037 ms. Trace:
I20260616 19:52:05.548650 1191 rpcz_store.cc:276] 0616 19:52:03.511493 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.512190 (+ 697us) service_pool.cc:224] Handling call
0616 19:52:05.548400 (+2036210us) ts_tablet_manager.cc:1151] Deleting tablet 2e059efed3da48b9a516fd3905f6d298
0616 19:52:05.548407 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.548484 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2031330}
I20260616 19:52:05.549247 1191 tablet_replica.cc:333] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:05.549527 1191 raft_consensus.cc:2243] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.549778 1191 raft_consensus.cc:2272] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.550552 1191 ts_tablet_manager.cc:1916] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.551309 763 tablet_service.cc:1511] Processing CreateTablet for tablet d98f5876fa234d1bb2dfcc2e24c85d4a (DEFAULT_TABLE table=default.Table_8e27f502e29d48349a01906652f67eb0 [id=e33379384da34accb103c1f3be9ea54c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.551859 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d98f5876fa234d1bb2dfcc2e24c85d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.556008 1190 ts_tablet_manager.cc:1929] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:05.557286 1191 ts_tablet_manager.cc:1929] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:05.557395 1191 log.cc:1199] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/2b7f591d97bc4571b294b06d990d4065
I20260616 19:52:05.557615 1190 log.cc:1199] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/39f52eebdc79460a9ff33191086e87c6
I20260616 19:52:05.557794 1191 ts_tablet_manager.cc:1950] T 2b7f591d97bc4571b294b06d990d4065 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.558429 1190 ts_tablet_manager.cc:1950] T 39f52eebdc79460a9ff33191086e87c6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:05.558804 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 646) took 2047 ms. Trace:
I20260616 19:52:05.558889 1191 rpcz_store.cc:276] 0616 19:52:03.511585 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.524525 (+ 12940us) service_pool.cc:224] Handling call
0616 19:52:05.549197 (+2024672us) ts_tablet_manager.cc:1151] Deleting tablet 2b7f591d97bc4571b294b06d990d4065
0616 19:52:05.549206 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.553936 (+ 4730us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.557242 (+ 3306us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.558779 (+ 1537us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2021788}
I20260616 19:52:05.559868 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 650) took 1999 ms. Trace:
I20260616 19:52:05.559954 1191 rpcz_store.cc:276] 0616 19:52:03.560158 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.560415 (+ 257us) service_pool.cc:224] Handling call
0616 19:52:05.559752 (+1999337us) ts_tablet_manager.cc:1151] Deleting tablet d4a2855b7dec4244a3fc52bdca7e7eb3
0616 19:52:05.559761 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.559852 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1999100}
I20260616 19:52:05.560518 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 651) took 1991 ms. Trace:
I20260616 19:52:05.560616 1191 rpcz_store.cc:276] 0616 19:52:03.568881 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.568932 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:05.560330 (+1991398us) ts_tablet_manager.cc:1151] Deleting tablet daf86e5d5f2341c78705f78c02695c17
0616 19:52:05.560342 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.560497 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1991189}
I20260616 19:52:05.561250 1191 tablet_replica.cc:333] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:05.561542 1191 raft_consensus.cc:2243] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.559437 900 tablet_service.cc:1511] Processing CreateTablet for tablet d98f5876fa234d1bb2dfcc2e24c85d4a (DEFAULT_TABLE table=default.Table_8e27f502e29d48349a01906652f67eb0 [id=e33379384da34accb103c1f3be9ea54c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.562783 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d98f5876fa234d1bb2dfcc2e24c85d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.565054 1191 raft_consensus.cc:2272] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.565166 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 599) took 2864 ms. Trace:
I20260616 19:52:05.565277 1190 rpcz_store.cc:276] 0616 19:52:02.700639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.700686 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:05.498492 (+2797806us) ts_tablet_manager.cc:1151] Deleting tablet 39f52eebdc79460a9ff33191086e87c6
0616 19:52:05.498501 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.537007 (+ 38506us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.555924 (+ 18917us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.565125 (+ 9201us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2797342}
I20260616 19:52:05.565642 1191 ts_tablet_manager.cc:1916] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.565702 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 601) took 2853 ms. Trace:
I20260616 19:52:05.565780 1190 rpcz_store.cc:276] 0616 19:52:02.711861 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.711915 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:05.565556 (+2853641us) ts_tablet_manager.cc:1151] Deleting tablet 12944efb54824dc4960db5d09c1a1684
0616 19:52:05.565564 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.565655 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2853302}
I20260616 19:52:05.566129 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 602) took 2789 ms. Trace:
I20260616 19:52:05.566275 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 39f52eebdc79460a9ff33191086e87c6 (table default.Table_2984957106b44cdc9ecd5a06e8edb7d3 [id=23f3d793560846b7a0701ec470588cbc]) successfully deleted
I20260616 19:52:05.566449 1190 rpcz_store.cc:276] 0616 19:52:02.776781 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.776847 (+ 66us) service_pool.cc:224] Handling call
0616 19:52:05.566003 (+2789156us) ts_tablet_manager.cc:1151] Deleting tablet 5a9befb557d84f3bb7781664cbf2f28f
0616 19:52:05.566014 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.566088 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2773816}
I20260616 19:52:05.566738 1190 tablet_replica.cc:333] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:05.566928 1190 raft_consensus.cc:2243] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:05.567251 1190 pending_rounds.cc:70] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:52:05.567317 1190 pending_rounds.cc:77] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595487271141376 op_type: NO_OP noop_request { }
I20260616 19:52:05.567427 1190 raft_consensus.cc:2889] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260616 19:52:05.567284 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet e1ab9d0ac7df4d549d52014a0ecd9d1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1ab9d0ac7df4d549d52014a0ecd9d1a already in progress: creating tablet
I20260616 19:52:05.567523 1190 raft_consensus.cc:2272] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:05.567803 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 9d9c89216995430188b1eed4c6b26d1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d9c89216995430188b1eed4c6b26d1e already in progress: creating tablet
W20260616 19:52:05.568437 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 64aa32856ca34743933931fb51f2bd7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64aa32856ca34743933931fb51f2bd7b already in progress: creating tablet
I20260616 19:52:05.568753 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 15d6a025b9a248c5ab9422fe1c340f3e (table default.Table_3536b19bb5a945fe82c917a32a72747f [id=4f3dc165f3d84700856eebc8f3243acf]) successfully deleted
W20260616 19:52:05.569085 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 731473c9021a4522ae2dfecff22c60e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 731473c9021a4522ae2dfecff22c60e6 already in progress: creating tablet
W20260616 19:52:05.569469 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c090cf49c61e487a974d953ed1903db7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c090cf49c61e487a974d953ed1903db7 already in progress: creating tablet
W20260616 19:52:05.569797 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 6b0f5388a73143569012ed714e53a8be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b0f5388a73143569012ed714e53a8be already in progress: creating tablet
W20260616 19:52:05.570101 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2e059efed3da48b9a516fd3905f6d298 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e059efed3da48b9a516fd3905f6d298 already in progress: creating tablet
I20260616 19:52:05.570390 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]) successfully deleted
W20260616 19:52:05.570667 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d4a2855b7dec4244a3fc52bdca7e7eb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4a2855b7dec4244a3fc52bdca7e7eb3 already in progress: creating tablet
W20260616 19:52:05.571156 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet daf86e5d5f2341c78705f78c02695c17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daf86e5d5f2341c78705f78c02695c17 already in progress: creating tablet
I20260616 19:52:05.574905 1191 ts_tablet_manager.cc:1929] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:05.575011 1191 log.cc:1199] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/4ffce2dc22e24d1684e6eae92c487cea
I20260616 19:52:05.575294 1191 ts_tablet_manager.cc:1950] T 4ffce2dc22e24d1684e6eae92c487cea P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.575977 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 652) took 1990 ms. Trace:
I20260616 19:52:05.576061 1191 rpcz_store.cc:276] 0616 19:52:03.585212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.585447 (+ 235us) service_pool.cc:224] Handling call
0616 19:52:05.561200 (+1975753us) ts_tablet_manager.cc:1151] Deleting tablet 4ffce2dc22e24d1684e6eae92c487cea
0616 19:52:05.561212 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.571761 (+ 10549us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.574853 (+ 3092us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.575959 (+ 1106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1975486}
I20260616 19:52:05.576752 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 654) took 1916 ms. Trace:
I20260616 19:52:05.576851 1191 rpcz_store.cc:276] 0616 19:52:03.660609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.662680 (+ 2071us) service_pool.cc:224] Handling call
0616 19:52:05.576614 (+1913934us) ts_tablet_manager.cc:1151] Deleting tablet 7e7f55f5946043108153b4c452a3d961
0616 19:52:05.576624 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.576733 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1913740}
I20260616 19:52:05.577353 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 653) took 1917 ms. Trace:
I20260616 19:52:05.577440 1191 rpcz_store.cc:276] 0616 19:52:03.660395 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.663010 (+ 2615us) service_pool.cc:224] Handling call
0616 19:52:05.577242 (+1914232us) ts_tablet_manager.cc:1151] Deleting tablet ea0a7f80c5a34dbfabce579b6f574f93
0616 19:52:05.577253 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.577336 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1914042}
I20260616 19:52:05.578485 1190 ts_tablet_manager.cc:1916] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.580885 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 655) took 1918 ms. Trace:
I20260616 19:52:05.580997 1191 rpcz_store.cc:276] 0616 19:52:03.662619 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.663229 (+ 610us) service_pool.cc:224] Handling call
0616 19:52:05.580752 (+1917523us) ts_tablet_manager.cc:1151] Deleting tablet bcc5116ef5df4140a96f03c003337c68
0616 19:52:05.580765 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.580866 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1917362}
I20260616 19:52:05.581449 1191 tablet_replica.cc:333] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:05.581686 1191 raft_consensus.cc:2243] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.581876 1191 raft_consensus.cc:2272] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.582491 1191 ts_tablet_manager.cc:1916] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.585043 1193 raft_consensus.cc:2243] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.585456 1193 raft_consensus.cc:2272] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.588091 1196 tablet_bootstrap.cc:492] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:05.588248 1196 ts_tablet_manager.cc:1403] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.201s user 0.020s sys 0.006s
I20260616 19:52:05.591787 1196 raft_consensus.cc:359] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.591964 1196 raft_consensus.cc:385] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.592007 1196 raft_consensus.cc:740] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.595445 1196 consensus_queue.cc:260] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.596005 765 tablet_service.cc:1511] Processing CreateTablet for tablet d428cbc3b40e4f36a3ec338070e3d550 (DEFAULT_TABLE table=default.Table_8f2d9ccc00284b5faaed69198782b56c [id=79077920c93743a4aafef01a47f7a085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.596603 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d428cbc3b40e4f36a3ec338070e3d550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.597044 1191 ts_tablet_manager.cc:1929] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:05.597254 1191 log.cc:1199] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/bfff9d60bb7e4a86b14687b581b45efe
I20260616 19:52:05.598542 1191 ts_tablet_manager.cc:1950] T bfff9d60bb7e4a86b14687b581b45efe P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.601130 1196 ts_tablet_manager.cc:1434] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260616 19:52:05.602053 1193 ts_tablet_manager.cc:1916] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.602675 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 656) took 1936 ms. Trace:
I20260616 19:52:05.602762 1191 rpcz_store.cc:276] 0616 19:52:03.666712 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.667658 (+ 946us) service_pool.cc:224] Handling call
0616 19:52:05.581395 (+1913737us) ts_tablet_manager.cc:1151] Deleting tablet bfff9d60bb7e4a86b14687b581b45efe
0616 19:52:05.581407 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.585582 (+ 4175us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.596945 (+ 11363us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.602656 (+ 5711us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1913525}
I20260616 19:52:05.603262 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 658) took 1916 ms. Trace:
I20260616 19:52:05.603331 1191 rpcz_store.cc:276] 0616 19:52:03.686505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.689093 (+ 2588us) service_pool.cc:224] Handling call
0616 19:52:05.603142 (+1914049us) ts_tablet_manager.cc:1151] Deleting tablet 0d4634afc3364221b4fdfcd3ce108a60
0616 19:52:05.603152 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.603247 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1913765}
I20260616 19:52:05.605278 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 674) took 1770 ms. Trace:
I20260616 19:52:05.605355 1191 rpcz_store.cc:276] 0616 19:52:03.835221 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.835267 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:05.605169 (+1769902us) ts_tablet_manager.cc:1151] Deleting tablet 7ac5b6be55944bdfb12db675442b1f1d
0616 19:52:05.605178 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.605260 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1768333}
I20260616 19:52:05.605805 1196 tablet_bootstrap.cc:492] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:05.605782 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 694) took 1610 ms. Trace:
I20260616 19:52:05.605851 1191 rpcz_store.cc:276] 0616 19:52:03.995328 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.017256 (+ 21928us) service_pool.cc:224] Handling call
0616 19:52:05.605667 (+1588411us) ts_tablet_manager.cc:1151] Deleting tablet 0a406124a8d34e578ba94fab2a873a55
0616 19:52:05.605676 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.605764 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1588128}
I20260616 19:52:05.606233 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 687) took 1722 ms. Trace:
I20260616 19:52:05.606299 1191 rpcz_store.cc:276] 0616 19:52:03.883381 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.974252 (+ 90871us) service_pool.cc:224] Handling call
0616 19:52:05.606143 (+1631891us) ts_tablet_manager.cc:1151] Deleting tablet 802d30c340494490896c8da33d110708
0616 19:52:05.606151 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.606219 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1587850}
I20260616 19:52:05.606679 1191 tablet_replica.cc:333] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:05.606864 1191 raft_consensus.cc:2243] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:05.607385 1191 raft_consensus.cc:2272] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.608214 1198 tablet_bootstrap.cc:492] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:05.608233 1191 ts_tablet_manager.cc:1916] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.608367 1198 ts_tablet_manager.cc:1403] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.289s user 0.019s sys 0.089s
I20260616 19:52:05.609299 1198 raft_consensus.cc:359] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.609475 1198 raft_consensus.cc:385] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.609532 1198 raft_consensus.cc:740] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.609762 1198 consensus_queue.cc:260] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.610486 1193 ts_tablet_manager.cc:1929] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:05.610636 1193 log.cc:1199] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/8eab5bd3967c42e1b6b79558df742946
I20260616 19:52:05.611675 1190 ts_tablet_manager.cc:1929] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:05.611809 1190 log.cc:1199] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/eb024637294148c18b74bef47fb2fcce
I20260616 19:52:05.612156 1190 ts_tablet_manager.cc:1950] T eb024637294148c18b74bef47fb2fcce P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:05.612705 1198 ts_tablet_manager.cc:1434] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260616 19:52:05.612845 1193 ts_tablet_manager.cc:1950] T 8eab5bd3967c42e1b6b79558df742946 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:05.613034 1198 tablet_bootstrap.cc:492] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:05.613483 1923 raft_consensus.cc:493] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.613639 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 658) took 1869 ms. Trace:
I20260616 19:52:05.613626 1923 raft_consensus.cc:515] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.613704 1193 rpcz_store.cc:276] 0616 19:52:03.744215 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.744427 (+ 212us) service_pool.cc:224] Handling call
0616 19:52:05.415999 (+1671572us) ts_tablet_manager.cc:1151] Deleting tablet 8eab5bd3967c42e1b6b79558df742946
0616 19:52:05.416007 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.585342 (+169335us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x616000133f54. stack: 00007f140f1b8086 00007f140f1b7e40 00007f140e1713ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f141b1ec7e0 00007f141c538933 00007f141f0fbae7 00007f141f12ebb4 00007f141f10f5d0 00007f141f10f35d 0000000000aa681c 00007f140f1fdf6f 00007f140f20128b 00007f140f201108
0616 19:52:05.605446 (+ 20104us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.610435 (+ 4989us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.613617 (+ 3182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388214656,"tablet-delete.queue_time_us":1663092}
I20260616 19:52:05.614287 1923 leader_election.cc:290] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.614504 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 670) took 1550 ms. Trace:
I20260616 19:52:05.614645 1198 tablet_bootstrap.cc:654] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.614581 1193 rpcz_store.cc:276] 0616 19:52:04.063633 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.063739 (+ 106us) service_pool.cc:224] Handling call
0616 19:52:05.613987 (+1550248us) ts_tablet_manager.cc:1151] Deleting tablet 7ac5b6be55944bdfb12db675442b1f1d
0616 19:52:05.613996 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.614484 (+ 488us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1460002}
I20260616 19:52:05.614843 1193 tablet_replica.cc:333] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:05.615016 1193 raft_consensus.cc:2243] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.615178 1193 raft_consensus.cc:2272] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.615768 1193 ts_tablet_manager.cc:1916] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:05.618448 858 leader_election.cc:343] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: c44422ddb8ce45a48bb9aaeb6c209f21
I20260616 19:52:05.619346 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44422ddb8ce45a48bb9aaeb6c209f21" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.619539 784 raft_consensus.cc:2468] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:05.619941 860 leader_election.cc:304] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:05.621124 1923 raft_consensus.cc:2804] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:05.621227 1923 raft_consensus.cc:493] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:05.621330 1923 raft_consensus.cc:3060] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.621747 1192 tablet_bootstrap.cc:492] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:05.621886 1192 ts_tablet_manager.cc:1403] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.192s user 0.020s sys 0.001s
I20260616 19:52:05.622663 1192 raft_consensus.cc:359] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.622817 1192 raft_consensus.cc:385] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.622881 1192 raft_consensus.cc:740] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.623138 1192 consensus_queue.cc:260] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.623914 1192 ts_tablet_manager.cc:1434] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:05.624444 1192 tablet_bootstrap.cc:492] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:05.626204 1192 tablet_bootstrap.cc:654] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.627166 1196 tablet_bootstrap.cc:654] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.627313 1849 raft_consensus.cc:493] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.627795 1849 raft_consensus.cc:515] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.628350 1849 leader_election.cc:290] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.628938 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a754c728b5408eb47f91de93554ec5" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:05.629411 996 leader_election.cc:343] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.631157 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a754c728b5408eb47f91de93554ec5" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:05.631652 993 leader_election.cc:343] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.631757 993 leader_election.cc:304] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.632056 1849 raft_consensus.cc:2749] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.633404 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 604) took 2740 ms. Trace:
I20260616 19:52:05.633502 1190 rpcz_store.cc:276] 0616 19:52:02.893400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.893461 (+ 61us) service_pool.cc:224] Handling call
0616 19:52:05.566677 (+2673216us) ts_tablet_manager.cc:1151] Deleting tablet eb024637294148c18b74bef47fb2fcce
0616 19:52:05.566685 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.604122 (+ 37437us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.611597 (+ 7475us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.633357 (+ 21760us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2672909}
I20260616 19:52:05.636821 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 605) took 2739 ms. Trace:
I20260616 19:52:05.636911 1190 rpcz_store.cc:276] 0616 19:52:02.897260 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.897313 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:05.636676 (+2739363us) ts_tablet_manager.cc:1151] Deleting tablet 47bbf21dc1d945ce8f5edd27cdf26817
0616 19:52:05.636690 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.636777 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2739170}
I20260616 19:52:05.638347 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 610) took 2707 ms. Trace:
I20260616 19:52:05.638434 1190 rpcz_store.cc:276] 0616 19:52:02.930913 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.931033 (+ 120us) service_pool.cc:224] Handling call
0616 19:52:05.638225 (+2707192us) ts_tablet_manager.cc:1151] Deleting tablet 90630f9e6f314c5d9589e673339f475a
0616 19:52:05.638233 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.638307 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2706939}
I20260616 19:52:05.639025 1923 raft_consensus.cc:515] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.639349 1193 ts_tablet_manager.cc:1929] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:05.639446 1193 log.cc:1199] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/c5657b6b56af4b8f8eff1fa18836df9b
I20260616 19:52:05.639802 1193 ts_tablet_manager.cc:1950] T c5657b6b56af4b8f8eff1fa18836df9b P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:05.640352 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44422ddb8ce45a48bb9aaeb6c209f21" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:05.640566 784 raft_consensus.cc:3060] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.641333 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 611) took 2710 ms. Trace:
I20260616 19:52:05.641412 1190 rpcz_store.cc:276] 0616 19:52:02.931054 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.931098 (+ 44us) service_pool.cc:224] Handling call
0616 19:52:05.641211 (+2710113us) ts_tablet_manager.cc:1151] Deleting tablet 4bde746e334a4f59aded168c6b2bb348
0616 19:52:05.641219 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.641302 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2709864}
I20260616 19:52:05.642547 1923 leader_election.cc:290] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:05.643217 858 leader_election.cc:343] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: c44422ddb8ce45a48bb9aaeb6c209f21
I20260616 19:52:05.646036 784 raft_consensus.cc:2468] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:05.646497 860 leader_election.cc:304] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:05.647255 1923 raft_consensus.cc:2804] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:05.647385 1923 raft_consensus.cc:697] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:05.647636 1923 consensus_queue.cc:237] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.648940 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 612) took 2707 ms. Trace:
I20260616 19:52:05.649591 1190 rpcz_store.cc:276] 0616 19:52:02.941245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.941297 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:05.648810 (+2707513us) ts_tablet_manager.cc:1151] Deleting tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc
0616 19:52:05.648821 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.648906 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2707294}
I20260616 19:52:05.650617 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 609) took 2721 ms. Trace:
I20260616 19:52:05.651233 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 682) took 1464 ms. Trace:
I20260616 19:52:05.651482 1190 rpcz_store.cc:276] 0616 19:52:02.929012 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.968034 (+ 39022us) service_pool.cc:224] Handling call
0616 19:52:05.650512 (+2682478us) ts_tablet_manager.cc:1151] Deleting tablet 7dafeb24a59948b28e26730194e29758
0616 19:52:05.650521 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.650587 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2682198}
I20260616 19:52:05.652168 1193 rpcz_store.cc:276] 0616 19:52:04.194484 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.271376 (+ 76892us) service_pool.cc:224] Handling call
0616 19:52:05.614801 (+1343425us) ts_tablet_manager.cc:1151] Deleting tablet c5657b6b56af4b8f8eff1fa18836df9b
0616 19:52:05.614810 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.618552 (+ 3742us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.639295 (+ 20743us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.651212 (+ 11917us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1342971}
I20260616 19:52:05.652768 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 613) took 2676 ms. Trace:
I20260616 19:52:05.653952 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 683) took 1445 ms. Trace:
I20260616 19:52:05.655494 1191 ts_tablet_manager.cc:1929] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:05.655616 1191 log.cc:1199] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/c5657b6b56af4b8f8eff1fa18836df9b
I20260616 19:52:05.655956 1191 ts_tablet_manager.cc:1950] T c5657b6b56af4b8f8eff1fa18836df9b P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:05.656090 1198 tablet_bootstrap.cc:492] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:05.656208 1198 ts_tablet_manager.cc:1403] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.005s
I20260616 19:52:05.656910 1198 raft_consensus.cc:359] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.657061 1198 raft_consensus.cc:385] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.657109 1198 raft_consensus.cc:740] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.657299 1198 consensus_queue.cc:260] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.654251 1190 rpcz_store.cc:276] 0616 19:52:02.975941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:02.977994 (+ 2053us) service_pool.cc:224] Handling call
0616 19:52:05.652627 (+2674633us) ts_tablet_manager.cc:1151] Deleting tablet 46faf1477a4b4c9994e556308647cad3
0616 19:52:05.652640 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.652730 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2674315}
I20260616 19:52:05.657971 1193 rpcz_store.cc:276] 0616 19:52:04.208347 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.287454 (+ 79107us) service_pool.cc:224] Handling call
0616 19:52:05.653826 (+1366372us) ts_tablet_manager.cc:1151] Deleting tablet 802d30c340494490896c8da33d110708
0616 19:52:05.653836 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.653934 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1344155}
I20260616 19:52:05.658433 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 616) took 2575 ms. Trace:
I20260616 19:52:05.658860 1190 rpcz_store.cc:276] 0616 19:52:03.083080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.083502 (+ 422us) service_pool.cc:224] Handling call
0616 19:52:05.658315 (+2574813us) ts_tablet_manager.cc:1151] Deleting tablet c3706f41b0e342a69f66c936173f2ae0
0616 19:52:05.658324 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.658396 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2532515}
I20260616 19:52:05.659185 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 687) took 1373 ms. Trace:
W20260616 19:52:05.659512 858 consensus_peers.cc:597] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3587c1ab487a424eb82f378ae081f514. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:05.659669 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 619) took 2531 ms. Trace:
I20260616 19:52:05.659750 1190 rpcz_store.cc:276] 0616 19:52:03.128460 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.128579 (+ 119us) service_pool.cc:224] Handling call
0616 19:52:05.659535 (+2530956us) ts_tablet_manager.cc:1151] Deleting tablet c0f19c77783a4b53b160589b74dbd20d
0616 19:52:05.659544 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.659634 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2528286}
I20260616 19:52:05.660040 1193 rpcz_store.cc:276] 0616 19:52:04.285915 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.340314 (+ 54399us) service_pool.cc:224] Handling call
0616 19:52:05.658777 (+1318463us) ts_tablet_manager.cc:1151] Deleting tablet 352ca272888f4dd2ab1a8127bb8c2b6e
0616 19:52:05.658786 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.659168 (+ 382us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1317065}
I20260616 19:52:05.660549 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 689) took 1374 ms. Trace:
I20260616 19:52:05.660614 1193 rpcz_store.cc:276] 0616 19:52:04.286067 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.345718 (+ 59651us) service_pool.cc:224] Handling call
0616 19:52:05.660423 (+1314705us) ts_tablet_manager.cc:1151] Deleting tablet d686190fb6a34ab18cc4799197765f1b
0616 19:52:05.660432 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.660534 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308773}
I20260616 19:52:05.661342 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 691) took 1375 ms. Trace:
I20260616 19:52:05.661422 1193 rpcz_store.cc:276] 0616 19:52:04.286255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.347553 (+ 61298us) service_pool.cc:224] Handling call
0616 19:52:05.661235 (+1313682us) ts_tablet_manager.cc:1151] Deleting tablet c6be4a4739464be7b246a54b7a33adaf
0616 19:52:05.661244 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.661323 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308355}
I20260616 19:52:05.661070 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 621) took 2465 ms. Trace:
I20260616 19:52:05.661796 1190 rpcz_store.cc:276] 0616 19:52:03.195639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.195695 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:05.660949 (+2465254us) ts_tablet_manager.cc:1151] Deleting tablet 64aa32856ca34743933931fb51f2bd7b
0616 19:52:05.660958 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.661031 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2463887}
I20260616 19:52:05.662336 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 622) took 2443 ms. Trace:
I20260616 19:52:05.662433 1190 rpcz_store.cc:276] 0616 19:52:03.218410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.218697 (+ 287us) service_pool.cc:224] Handling call
0616 19:52:05.662204 (+2443507us) ts_tablet_manager.cc:1151] Deleting tablet 9d9c89216995430188b1eed4c6b26d1e
0616 19:52:05.662215 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.662297 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2443059}
I20260616 19:52:05.662879 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 692) took 1376 ms. Trace:
I20260616 19:52:05.662952 1193 rpcz_store.cc:276] 0616 19:52:04.286330 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.351651 (+ 65321us) service_pool.cc:224] Handling call
0616 19:52:05.662776 (+1311125us) ts_tablet_manager.cc:1151] Deleting tablet d2b3bbc4adb0492a87cd9226cf6a3c8f
0616 19:52:05.662785 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.662863 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308793}
I20260616 19:52:05.663426 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 625) took 2408 ms. Trace:
I20260616 19:52:05.663509 1190 rpcz_store.cc:276] 0616 19:52:03.254591 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.254834 (+ 243us) service_pool.cc:224] Handling call
0616 19:52:05.663307 (+2408473us) ts_tablet_manager.cc:1151] Deleting tablet e1ab9d0ac7df4d549d52014a0ecd9d1a
0616 19:52:05.663316 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.663394 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2407884}
W20260616 19:52:05.570851 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 5a9befb557d84f3bb7781664cbf2f28f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a9befb557d84f3bb7781664cbf2f28f already in progress: creating tablet
I20260616 19:52:05.617724 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 8eab5bd3967c42e1b6b79558df742946 (table default.Table_8fff86d5c2344e2fb59db9872ee90b74 [id=06f5d602dcec42a884b5eb53f9d0a27c]) successfully deleted
I20260616 19:52:05.663932 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 690) took 1377 ms. Trace:
I20260616 19:52:05.617856 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5e42f2150dc84948b1f40371bee61202"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:05.631350 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7955886341a94249afa849c51d34a0be
I20260616 19:52:05.663996 1193 rpcz_store.cc:276] 0616 19:52:04.286171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.346039 (+ 59868us) service_pool.cc:224] Handling call
0616 19:52:05.663837 (+1317798us) ts_tablet_manager.cc:1151] Deleting tablet 0a406124a8d34e578ba94fab2a873a55
0616 19:52:05.663846 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.663916 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1304323}
I20260616 19:52:05.664683 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 688) took 1378 ms. Trace:
I20260616 19:52:05.664764 1193 rpcz_store.cc:276] 0616 19:52:04.285989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.341734 (+ 55745us) service_pool.cc:224] Handling call
0616 19:52:05.664581 (+1322847us) ts_tablet_manager.cc:1151] Deleting tablet 451ef03db89043cbbed12a2a48a16adb
0616 19:52:05.664592 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.664666 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1303534}
I20260616 19:52:05.664951 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 627) took 2313 ms. Trace:
I20260616 19:52:05.665045 1190 rpcz_store.cc:276] 0616 19:52:03.350705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.350784 (+ 79us) service_pool.cc:224] Handling call
0616 19:52:05.664357 (+2313573us) ts_tablet_manager.cc:1151] Deleting tablet 731473c9021a4522ae2dfecff22c60e6
0616 19:52:05.664367 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.664446 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2313322}
I20260616 19:52:05.660180 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 686) took 1776 ms. Trace:
I20260616 19:52:05.661641 1198 ts_tablet_manager.cc:1434] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260616 19:52:05.665865 1198 tablet_bootstrap.cc:492] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:05.665959 1196 tablet_bootstrap.cc:492] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:05.666229 1196 ts_tablet_manager.cc:1403] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.060s user 0.006s sys 0.001s
I20260616 19:52:05.665537 1191 rpcz_store.cc:276] 0616 19:52:03.883270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.972981 (+ 89711us) service_pool.cc:224] Handling call
0616 19:52:05.606632 (+1633651us) ts_tablet_manager.cc:1151] Deleting tablet c5657b6b56af4b8f8eff1fa18836df9b
0616 19:52:05.606643 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.649775 (+ 43132us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.655438 (+ 5663us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.660162 (+ 4724us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1584070}
I20260616 19:52:05.666996 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 691) took 1711 ms. Trace:
I20260616 19:52:05.667079 1191 rpcz_store.cc:276] 0616 19:52:03.955073 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.998233 (+ 43160us) service_pool.cc:224] Handling call
0616 19:52:05.666886 (+1668653us) ts_tablet_manager.cc:1151] Deleting tablet 352ca272888f4dd2ab1a8127bb8c2b6e
0616 19:52:05.666895 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.666980 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38,"tablet-delete.queue_time_us":1644270}
I20260616 19:52:05.667184 1196 raft_consensus.cc:359] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.667495 1196 raft_consensus.cc:385] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.667613 1196 raft_consensus.cc:740] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.667686 1198 tablet_bootstrap.cc:654] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.667882 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 693) took 1689 ms. Trace:
I20260616 19:52:05.667929 1196 consensus_queue.cc:260] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.668037 1191 rpcz_store.cc:276] 0616 19:52:03.977890 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.999378 (+ 21488us) service_pool.cc:224] Handling call
0616 19:52:05.667586 (+1668208us) ts_tablet_manager.cc:1151] Deleting tablet d686190fb6a34ab18cc4799197765f1b
0616 19:52:05.667610 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.667789 (+ 179us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1644787}
I20260616 19:52:05.669376 1923 raft_consensus.cc:493] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.669639 1923 raft_consensus.cc:515] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.670677 1196 ts_tablet_manager.cc:1434] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260616 19:52:05.670986 1196 tablet_bootstrap.cc:492] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:05.672627 448 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 55134.9us
I20260616 19:52:05.672825 1196 tablet_bootstrap.cc:654] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:05.673000 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 7ac5b6be55944bdfb12db675442b1f1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ac5b6be55944bdfb12db675442b1f1d already in progress: creating tablet
I20260616 19:52:05.673233 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet c5657b6b56af4b8f8eff1fa18836df9b (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]) successfully deleted
W20260616 19:52:05.673439 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 802d30c340494490896c8da33d110708 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 802d30c340494490896c8da33d110708 already in progress: creating tablet
I20260616 19:52:05.673463 1923 leader_election.cc:290] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:05.673614 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 352ca272888f4dd2ab1a8127bb8c2b6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 352ca272888f4dd2ab1a8127bb8c2b6e already in progress: creating tablet
I20260616 19:52:05.673695 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 630) took 2319 ms. Trace:
W20260616 19:52:05.673803 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d686190fb6a34ab18cc4799197765f1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d686190fb6a34ab18cc4799197765f1b already in progress: creating tablet
I20260616 19:52:05.673816 1190 rpcz_store.cc:276] 0616 19:52:03.353731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.353778 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:05.665384 (+2311606us) ts_tablet_manager.cc:1151] Deleting tablet c090cf49c61e487a974d953ed1903db7
0616 19:52:05.665392 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.673650 (+ 8258us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2303841}
W20260616 19:52:05.673971 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c6be4a4739464be7b246a54b7a33adaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6be4a4739464be7b246a54b7a33adaf already in progress: creating tablet
W20260616 19:52:05.674168 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d2b3bbc4adb0492a87cd9226cf6a3c8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2b3bbc4adb0492a87cd9226cf6a3c8f already in progress: creating tablet
W20260616 19:52:05.674330 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0a406124a8d34e578ba94fab2a873a55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a406124a8d34e578ba94fab2a873a55 already in progress: creating tablet
W20260616 19:52:05.674508 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 451ef03db89043cbbed12a2a48a16adb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 451ef03db89043cbbed12a2a48a16adb already in progress: creating tablet
I20260616 19:52:05.674485 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4adff6e41148b8b54e969ea2eb7a91" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.672502 1849 raft_consensus.cc:493] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.674474 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 699) took 1106 ms. Trace:
I20260616 19:52:05.674703 1849 raft_consensus.cc:515] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.675323 1849 leader_election.cc:290] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.675595 754 tablet_service.cc:1511] Processing CreateTablet for tablet fe39df8bd431402ba646f632939eba3a (DEFAULT_TABLE table=default.Table_fd2877e9bb114ec3ac154536733fe899 [id=e8d71c73e6234a2aa771f143b262fe94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.675776 762 tablet_service.cc:1511] Processing CreateTablet for tablet 964384a661834a6e9ffaa4724a0ee3be (DEFAULT_TABLE table=default.Table_9a016ce4f9ae4cec8cd633eb68a288bc [id=34123c70308b4225b63a577022611c32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.675949 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe39df8bd431402ba646f632939eba3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:05.676141 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e42f2150dc84948b1f40371bee61202 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:05.676239 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964384a661834a6e9ffaa4724a0ee3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.676410 757 tablet_service.cc:1511] Processing CreateTablet for tablet ba092edcdecf485e96a392b3ea79b01a (DEFAULT_TABLE table=default.Table_453f5cc67bd947608ab2945126f31076 [id=e38f0b17a146473090e35286db1154d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.676792 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba092edcdecf485e96a392b3ea79b01a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.674048 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4adff6e41148b8b54e969ea2eb7a91" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:05.677522 1060 raft_consensus.cc:2468] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:05.678038 858 leader_election.cc:304] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:05.678220 455 catalog_manager.cc:6784] ReplaceTablet: tablet 7955886341a94249afa849c51d34a0be deleted and replaced by tablet 6c227e5c37c54323bc5e1338dbc9fd33
I20260616 19:52:05.678543 455 master_service.cc:960] ReplaceTablet: received request to replace tablet d2b3bbc4adb0492a87cd9226cf6a3c8f from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:05.678629 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e91c377ae66441268351cd3592aa9dbc" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:05.679041 996 leader_election.cc:343] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.679203 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9dacb90aa08e434d99c33e3a4f49fbe3" } new_table_name: "default.Table_3dfb87e923144c1d804da28dbf9ec55a" modify_external_catalogs: true
I20260616 19:52:05.680326 1801 raft_consensus.cc:2804] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:05.680411 1801 raft_consensus.cc:493] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:05.680516 1801 raft_consensus.cc:3060] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:05.680969 860 leader_election.cc:343] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.682883 1801 raft_consensus.cc:515] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.683447 1801 leader_election.cc:290] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.684116 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4adff6e41148b8b54e969ea2eb7a91" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:05.684316 1060 raft_consensus.cc:3060] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.674784 1193 rpcz_store.cc:276] 0616 19:52:04.567897 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.567966 (+ 69us) service_pool.cc:224] Handling call
0616 19:52:05.674374 (+1106408us) ts_tablet_manager.cc:1151] Deleting tablet 0b362fa598a54632880faa42a9224ffd
0616 19:52:05.674383 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.674461 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1106168}
I20260616 19:52:05.685776 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 701) took 1020 ms. Trace:
I20260616 19:52:05.685864 1193 rpcz_store.cc:276] 0616 19:52:04.664875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.665324 (+ 449us) service_pool.cc:224] Handling call
0616 19:52:05.685621 (+1020297us) ts_tablet_manager.cc:1151] Deleting tablet 1d825bcf365f424fb99a10afe3e96501
0616 19:52:05.685630 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.685740 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1006948}
I20260616 19:52:05.686297 1190 tablet_replica.cc:333] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:05.686471 1190 raft_consensus.cc:2243] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.686590 1190 pending_rounds.cc:70] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:52:05.686625 1190 pending_rounds.cc:77] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7297595493054824448 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "2b7f591d97bc4571b294b06d990d4065" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_730210c795214b2bb698287fcbd1bde3" dest_uuid: "7245e7dab0ec474a876537be514c8767" new_extra_config { } }
I20260616 19:52:05.686993 1190 raft_consensus.cc:2272] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.687819 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e91c377ae66441268351cd3592aa9dbc" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:05.688865 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 704) took 1007 ms. Trace:
I20260616 19:52:05.688951 1193 rpcz_store.cc:276] 0616 19:52:04.681295 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.681366 (+ 71us) service_pool.cc:224] Handling call
0616 19:52:05.688722 (+1007356us) ts_tablet_manager.cc:1151] Deleting tablet 7bab084824a84c218ef69a18971e4b47
0616 19:52:05.688731 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.688810 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1006724}
W20260616 19:52:05.689853 445 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 122599us
I20260616 19:52:05.691680 1849 raft_consensus.cc:493] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.691833 1849 raft_consensus.cc:515] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.692070 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 7955886341a94249afa849c51d34a0be with delete_type TABLET_DATA_DELETED (replaced by tablet 6c227e5c37c54323bc5e1338dbc9fd33) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.692800 900 tablet_service.cc:1511] Processing CreateTablet for tablet d428cbc3b40e4f36a3ec338070e3d550 (DEFAULT_TABLE table=default.Table_8f2d9ccc00284b5faaed69198782b56c [id=79077920c93743a4aafef01a47f7a085]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:05.693017 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 47bbf21dc1d945ce8f5edd27cdf26817 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47bbf21dc1d945ce8f5edd27cdf26817 already in progress: creating tablet
I20260616 19:52:05.693104 895 tablet_service.cc:1511] Processing CreateTablet for tablet 964384a661834a6e9ffaa4724a0ee3be (DEFAULT_TABLE table=default.Table_9a016ce4f9ae4cec8cd633eb68a288bc [id=34123c70308b4225b63a577022611c32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.693239 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d428cbc3b40e4f36a3ec338070e3d550. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:05.693269 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 90630f9e6f314c5d9589e673339f475a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90630f9e6f314c5d9589e673339f475a already in progress: creating tablet
I20260616 19:52:05.693295 892 tablet_service.cc:1511] Processing CreateTablet for tablet ba092edcdecf485e96a392b3ea79b01a (DEFAULT_TABLE table=default.Table_453f5cc67bd947608ab2945126f31076 [id=e38f0b17a146473090e35286db1154d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.693441 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964384a661834a6e9ffaa4724a0ee3be. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:05.693475 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 4bde746e334a4f59aded168c6b2bb348 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bde746e334a4f59aded168c6b2bb348 already in progress: creating tablet
W20260616 19:52:05.693670 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc already in progress: creating tablet
I20260616 19:52:05.693817 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba092edcdecf485e96a392b3ea79b01a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:05.693885 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 7dafeb24a59948b28e26730194e29758 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dafeb24a59948b28e26730194e29758 already in progress: creating tablet
W20260616 19:52:05.694077 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 46faf1477a4b4c9994e556308647cad3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46faf1477a4b4c9994e556308647cad3 already in progress: creating tablet
W20260616 19:52:05.694262 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c3706f41b0e342a69f66c936173f2ae0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3706f41b0e342a69f66c936173f2ae0 already in progress: creating tablet
W20260616 19:52:05.694416 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c0f19c77783a4b53b160589b74dbd20d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0f19c77783a4b53b160589b74dbd20d already in progress: creating tablet
W20260616 19:52:05.694597 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 64aa32856ca34743933931fb51f2bd7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64aa32856ca34743933931fb51f2bd7b already in progress: creating tablet
W20260616 19:52:05.691205 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0b362fa598a54632880faa42a9224ffd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b362fa598a54632880faa42a9224ffd already in progress: creating tablet
W20260616 19:52:05.695048 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1d825bcf365f424fb99a10afe3e96501 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d825bcf365f424fb99a10afe3e96501 already in progress: creating tablet
W20260616 19:52:05.695255 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 7bab084824a84c218ef69a18971e4b47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bab084824a84c218ef69a18971e4b47 already in progress: creating tablet
W20260616 19:52:05.695472 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8cf5611e97e14eb1bf8515532f3a43be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cf5611e97e14eb1bf8515532f3a43be already in progress: creating tablet
W20260616 19:52:05.695674 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a2904f2e00314858899a760b84950e1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2904f2e00314858899a760b84950e1f already in progress: creating tablet
W20260616 19:52:05.695854 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet b99740ab59f947aabcac88dc2bf2de86 because the tablet was not found. No further retry: Not found: Tablet not found: b99740ab59f947aabcac88dc2bf2de86
W20260616 19:52:05.696007 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f92e45da793440d59439c715e8e50249 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f92e45da793440d59439c715e8e50249 already in progress: creating tablet
W20260616 19:52:05.696199 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1d368ec65b624ea58f7b750097a78ede because the tablet was not found. No further retry: Not found: Tablet not found: 1d368ec65b624ea58f7b750097a78ede
I20260616 19:52:05.696743 893 tablet_service.cc:1511] Processing CreateTablet for tablet d47a4d843ac94e4d94819a3e36702c70 (DEFAULT_TABLE table=default.Table_6317cff18ebf41fea539a7699abd46df [id=6434d4fb91c1476bbecf3bc4d48b6090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.697057 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d47a4d843ac94e4d94819a3e36702c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.699189 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d73be228664063822c41cbefafcab8" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:05.699747 996 leader_election.cc:343] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.699887 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 7955886341a94249afa849c51d34a0be with delete_type TABLET_DATA_DELETED (replaced by tablet 6c227e5c37c54323bc5e1338dbc9fd33) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:05.698336 1849 leader_election.cc:290] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.700120 1849 raft_consensus.cc:493] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.693104 898 tablet_service.cc:1511] Processing CreateTablet for tablet fe39df8bd431402ba646f632939eba3a (DEFAULT_TABLE table=default.Table_fd2877e9bb114ec3ac154536733fe899 [id=e8d71c73e6234a2aa771f143b262fe94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.700239 1849 raft_consensus.cc:515] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.700531 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe39df8bd431402ba646f632939eba3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:05.696445 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 9d9c89216995430188b1eed4c6b26d1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d9c89216995430188b1eed4c6b26d1e already in progress: creating tablet
W20260616 19:52:05.703048 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet e1ab9d0ac7df4d549d52014a0ecd9d1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1ab9d0ac7df4d549d52014a0ecd9d1a already in progress: creating tablet
W20260616 19:52:05.703289 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 731473c9021a4522ae2dfecff22c60e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 731473c9021a4522ae2dfecff22c60e6 already in progress: creating tablet
I20260616 19:52:05.703446 1060 raft_consensus.cc:2468] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
W20260616 19:52:05.703511 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c090cf49c61e487a974d953ed1903db7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c090cf49c61e487a974d953ed1903db7 already in progress: creating tablet
W20260616 19:52:05.703732 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 132596us
I20260616 19:52:05.703887 858 leader_election.cc:304] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:05.705011 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 63bb0e724ba04f79809850febc966c66 (DEFAULT_TABLE table=default.Table_45f727fb97db43d3bdbf9b1046001a45 [id=8e9bb037176e401bb84e6f46749c3050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.704957 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 964384a661834a6e9ffaa4724a0ee3be (DEFAULT_TABLE table=default.Table_9a016ce4f9ae4cec8cd633eb68a288bc [id=34123c70308b4225b63a577022611c32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.705143 1032 tablet_service.cc:1511] Processing CreateTablet for tablet ba092edcdecf485e96a392b3ea79b01a (DEFAULT_TABLE table=default.Table_453f5cc67bd947608ab2945126f31076 [id=e38f0b17a146473090e35286db1154d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.704975 1031 tablet_service.cc:1511] Processing CreateTablet for tablet fe39df8bd431402ba646f632939eba3a (DEFAULT_TABLE table=default.Table_fd2877e9bb114ec3ac154536733fe899 [id=e8d71c73e6234a2aa771f143b262fe94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.705367 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63bb0e724ba04f79809850febc966c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.708231 1021 tablet_service.cc:1511] Processing CreateTablet for tablet d428cbc3b40e4f36a3ec338070e3d550 (DEFAULT_TABLE table=default.Table_8f2d9ccc00284b5faaed69198782b56c [id=79077920c93743a4aafef01a47f7a085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.708606 1036 tablet_service.cc:1511] Processing CreateTablet for tablet d47a4d843ac94e4d94819a3e36702c70 (DEFAULT_TABLE table=default.Table_6317cff18ebf41fea539a7699abd46df [id=6434d4fb91c1476bbecf3bc4d48b6090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.713881 1923 raft_consensus.cc:2804] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:05.675595 751 tablet_service.cc:1511] Processing CreateTablet for tablet d47a4d843ac94e4d94819a3e36702c70 (DEFAULT_TABLE table=default.Table_6317cff18ebf41fea539a7699abd46df [id=6434d4fb91c1476bbecf3bc4d48b6090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.716214 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8dcb663cf2e443f1acd4b18280378729
I20260616 19:52:05.717397 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d5c82b71969e4cbcb890d16e1cdd5348
I20260616 19:52:05.718338 1849 leader_election.cc:290] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.718706 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d47a4d843ac94e4d94819a3e36702c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.722811 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3f47e767764032ae5a06e34e2de248" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:05.723371 996 leader_election.cc:343] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.724078 1030 tablet_service.cc:1511] Processing CreateTablet for tablet d98f5876fa234d1bb2dfcc2e24c85d4a (DEFAULT_TABLE table=default.Table_8e27f502e29d48349a01906652f67eb0 [id=e33379384da34accb103c1f3be9ea54c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.729856 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba092edcdecf485e96a392b3ea79b01a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.732719 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe39df8bd431402ba646f632939eba3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.735400 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 7955886341a94249afa849c51d34a0be with delete_type TABLET_DATA_DELETED (replaced by tablet 6c227e5c37c54323bc5e1338dbc9fd33) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.736652 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 4ffce2dc22e24d1684e6eae92c487cea (table default.Table_ee130ae3817f41f8ac49a76361fd23ea [id=a69482262948439783492742dcbf0b43]) successfully deleted
I20260616 19:52:05.736191 1193 tablet_replica.cc:333] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:52:05.737020 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 7e7f55f5946043108153b4c452a3d961 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e7f55f5946043108153b4c452a3d961 already in progress: creating tablet
W20260616 19:52:05.737576 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ea0a7f80c5a34dbfabce579b6f574f93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea0a7f80c5a34dbfabce579b6f574f93 already in progress: creating tablet
W20260616 19:52:05.737790 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet bcc5116ef5df4140a96f03c003337c68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcc5116ef5df4140a96f03c003337c68 already in progress: creating tablet
W20260616 19:52:05.738663 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0d4634afc3364221b4fdfcd3ce108a60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d4634afc3364221b4fdfcd3ce108a60 already in progress: creating tablet
W20260616 19:52:05.738932 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 7ac5b6be55944bdfb12db675442b1f1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ac5b6be55944bdfb12db675442b1f1d already in progress: creating tablet
I20260616 19:52:05.737054 1193 raft_consensus.cc:2243] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:05.739678 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0a406124a8d34e578ba94fab2a873a55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a406124a8d34e578ba94fab2a873a55 already in progress: creating tablet
W20260616 19:52:05.740113 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 802d30c340494490896c8da33d110708 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 802d30c340494490896c8da33d110708 already in progress: creating tablet
I20260616 19:52:05.741034 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet c5657b6b56af4b8f8eff1fa18836df9b (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]) successfully deleted
W20260616 19:52:05.741420 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 352ca272888f4dd2ab1a8127bb8c2b6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 352ca272888f4dd2ab1a8127bb8c2b6e already in progress: creating tablet
W20260616 19:52:05.741684 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d686190fb6a34ab18cc4799197765f1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d686190fb6a34ab18cc4799197765f1b already in progress: creating tablet
I20260616 19:52:05.742144 1193 raft_consensus.cc:2272] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.742627 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dcb663cf2e443f1acd4b18280378729 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:05.743288 1923 raft_consensus.cc:697] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:05.743600 1923 consensus_queue.cc:237] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.744035 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eab5bd3967c42e1b6b79558df742946 with delete_type TABLET_DATA_DELETED (replaced by tablet 65b0dc43b40649f29037f40d2ea9247e) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:05.744359 895 tablet_service.cc:1558] Processing DeleteTablet for tablet d5c82b71969e4cbcb890d16e1cdd5348 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:05.744663 898 tablet_service.cc:1558] Processing DeleteTablet for tablet b99740ab59f947aabcac88dc2bf2de86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:05.744771 858 consensus_peers.cc:597] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fdc6222db09d4cd987cbdf70e4d40f70. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:05.745141 898 tablet_service.cc:1558] Processing DeleteTablet for tablet eb024637294148c18b74bef47fb2fcce with delete_type TABLET_DATA_DELETED (replaced by tablet 64aa32856ca34743933931fb51f2bd7b) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:05.745189 895 tablet_service.cc:1558] Processing DeleteTablet for tablet ab33d99d857145dfbda54ff2f7464486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:05.746289 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d47a4d843ac94e4d94819a3e36702c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.746428 1193 ts_tablet_manager.cc:1916] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.748943 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d428cbc3b40e4f36a3ec338070e3d550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.749447 1196 tablet_bootstrap.cc:492] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:05.751205 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 15d6a025b9a248c5ab9422fe1c340f3e with delete_type TABLET_DATA_DELETED (replaced by tablet db750fc9641f492494fdb167de86f6df) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:05.754503 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964384a661834a6e9ffaa4724a0ee3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.749612 1196 ts_tablet_manager.cc:1403] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.079s user 0.003s sys 0.002s
I20260616 19:52:05.757846 1196 raft_consensus.cc:359] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.759460 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d98f5876fa234d1bb2dfcc2e24c85d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.763926 1923 raft_consensus.cc:493] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.764120 1923 raft_consensus.cc:515] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.764773 1923 leader_election.cc:290] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:05.764993 1196 raft_consensus.cc:385] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.765154 1196 raft_consensus.cc:740] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
W20260616 19:52:05.766960 858 leader_election.cc:343] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 4ffce2dc22e24d1684e6eae92c487cea
I20260616 19:52:05.768100 1196 consensus_queue.cc:260] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.770445 1196 ts_tablet_manager.cc:1434] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260616 19:52:05.775255 1196 tablet_bootstrap.cc:492] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:05.782191 1196 tablet_bootstrap.cc:654] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.783320 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 99b211692aca478bb40f0f2c3f50ca44 with delete_type TABLET_DATA_DELETED (replaced by tablet 44493f0ffd064249a28628cf24895395) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.783867 753 tablet_service.cc:1558] Processing DeleteTablet for tablet bfff9d60bb7e4a86b14687b581b45efe with delete_type TABLET_DATA_DELETED (replaced by tablet 0b362fa598a54632880faa42a9224ffd) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.784014 1193 ts_tablet_manager.cc:1929] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:05.784657 762 tablet_service.cc:1558] Processing DeleteTablet for tablet fdc6222db09d4cd987cbdf70e4d40f70 with delete_type TABLET_DATA_DELETED (replaced by tablet d5c82b71969e4cbcb890d16e1cdd5348) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.785019 758 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9d5b9b81694258accdb0d18ae094de (DEFAULT_TABLE table=default.Table_dae68b113ed343b4879c83b8554c55f2 [id=c1fbf8525bbe46ccb42a20618e0178a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.787406 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9d5b9b81694258accdb0d18ae094de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.790055 895 tablet_service.cc:1511] Processing CreateTablet for tablet c204a0af6eac4bc2897b48be50070860 (DEFAULT_TABLE table=default.Table_c152425c57194fcfb3477de6f8beb86a [id=e09f10fd6e8d42bcbaeacb800cc7f1c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.791113 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c204a0af6eac4bc2897b48be50070860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.794202 1849 raft_consensus.cc:493] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.794386 1849 raft_consensus.cc:515] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.795385 1849 leader_election.cc:290] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.799885 752 tablet_service.cc:1511] Processing CreateTablet for tablet d55200fc438d407e9930400424b88024 (DEFAULT_TABLE table=default.Table_e320a0e61e09447aa8206a307dd2c425 [id=ef03ac98d21e4ed3b09db81243db576b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.801173 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55200fc438d407e9930400424b88024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.804534 760 tablet_service.cc:1511] Processing CreateTablet for tablet 9360e6e758bd47c2b5adf035ac2cdab1 (DEFAULT_TABLE table=default.Table_f3c7d323882642c7a655b043d3b19e48 [id=cb79c2824e8a4a82ae476404913c5c31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.804922 762 tablet_service.cc:1511] Processing CreateTablet for tablet 6396397965c44e07850a6cc42cefab09 (DEFAULT_TABLE table=default.Table_9bb35be45c3b476a94e956aa287bc3a0 [id=57b5d2b03a354306b62b192b3f430c88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.804958 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dcb663cf2e443f1acd4b18280378729 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.805859 898 tablet_service.cc:1511] Processing CreateTablet for tablet d55200fc438d407e9930400424b88024 (DEFAULT_TABLE table=default.Table_e320a0e61e09447aa8206a307dd2c425 [id=ef03ac98d21e4ed3b09db81243db576b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.806222 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55200fc438d407e9930400424b88024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.669158 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 692) took 1714 ms. Trace:
I20260616 19:52:05.808753 893 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9d5b9b81694258accdb0d18ae094de (DEFAULT_TABLE table=default.Table_dae68b113ed343b4879c83b8554c55f2 [id=c1fbf8525bbe46ccb42a20618e0178a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.809080 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9d5b9b81694258accdb0d18ae094de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.809101 1192 tablet_bootstrap.cc:492] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:05.809336 1192 ts_tablet_manager.cc:1403] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.185s user 0.001s sys 0.006s
I20260616 19:52:05.809437 1191 rpcz_store.cc:276] 0616 19:52:03.955155 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.999442 (+ 44287us) service_pool.cc:224] Handling call
0616 19:52:05.668851 (+1669409us) ts_tablet_manager.cc:1151] Deleting tablet 451ef03db89043cbbed12a2a48a16adb
0616 19:52:05.668860 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.669141 (+ 281us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1645891}
I20260616 19:52:05.809909 900 tablet_service.cc:1511] Processing CreateTablet for tablet 6396397965c44e07850a6cc42cefab09 (DEFAULT_TABLE table=default.Table_9bb35be45c3b476a94e956aa287bc3a0 [id=57b5d2b03a354306b62b192b3f430c88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.810309 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6396397965c44e07850a6cc42cefab09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.810331 1192 raft_consensus.cc:359] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.810475 1192 raft_consensus.cc:385] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.810515 1192 raft_consensus.cc:740] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.811733 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 695) took 1610 ms. Trace:
I20260616 19:52:05.811800 892 tablet_service.cc:1511] Processing CreateTablet for tablet 3fcdc7ae19874ca794ae71d228e6ab27 (DEFAULT_TABLE table=default.Table_4bebbb5f40cf47028a0a1d3ba5749584 [id=7729f25ff79a46739f37758228b75581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.811810 1191 rpcz_store.cc:276] 0616 19:52:04.201016 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.201081 (+ 65us) service_pool.cc:224] Handling call
0616 19:52:05.811603 (+1610522us) ts_tablet_manager.cc:1151] Deleting tablet c6be4a4739464be7b246a54b7a33adaf
0616 19:52:05.811614 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.811717 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1545736}
I20260616 19:52:05.812086 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fcdc7ae19874ca794ae71d228e6ab27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.812605 1190 ts_tablet_manager.cc:1916] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.815181 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 696) took 1603 ms. Trace:
I20260616 19:52:05.815263 1191 rpcz_store.cc:276] 0616 19:52:04.212080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.224267 (+ 12187us) service_pool.cc:224] Handling call
0616 19:52:05.815054 (+1590787us) ts_tablet_manager.cc:1151] Deleting tablet d2b3bbc4adb0492a87cd9226cf6a3c8f
0616 19:52:05.815064 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.815165 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1548950}
I20260616 19:52:05.817946 763 tablet_service.cc:1558] Processing DeleteTablet for tablet d5c82b71969e4cbcb890d16e1cdd5348 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.754009 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b35cc83f4b7949c48cb314ef60302080"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:05.820135 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 139186us
W20260616 19:52:05.820578 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b35cc83f4b7949c48cb314ef60302080 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:05.820627 993 leader_election.cc:343] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.820735 993 leader_election.cc:304] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.821316 1996 raft_consensus.cc:493] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.821434 1996 raft_consensus.cc:515] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.755968 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 81f881fd3ad244f9afd70b4b99d9384d
I20260616 19:52:05.821995 1996 leader_election.cc:290] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.822134 1996 raft_consensus.cc:2749] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.824126 1193 log.cc:1199] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/3587c1ab487a424eb82f378ae081f514
I20260616 19:52:05.824136 1192 consensus_queue.cc:260] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.756246 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 795c9643c1e84ddabc9130ef42d5c793
I20260616 19:52:05.824538 778 raft_consensus.cc:3060] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.824661 1192 ts_tablet_manager.cc:1434] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260616 19:52:05.825522 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da74f89b7ff44f49b8e2f2c2cbcbdb0b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.826399 753 tablet_service.cc:1511] Processing CreateTablet for tablet c204a0af6eac4bc2897b48be50070860 (DEFAULT_TABLE table=default.Table_c152425c57194fcfb3477de6f8beb86a [id=e09f10fd6e8d42bcbaeacb800cc7f1c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.756570 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4c22afaade3c427bb128de3ad020da0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:05.827981 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c22afaade3c427bb128de3ad020da0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:05.756978 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5ce6fd6946e0465e8cb64119f4882a7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:05.829663 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ce6fd6946e0465e8cb64119f4882a7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:05.829823 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet e896d5aa87f14e5593d01085bb6d434f (table default.Table_8f195aaf0b9c47169f6c04a5e380bd22 [id=a2abe0bca3fa4d35b86a23f91f6973b4], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e896d5aa87f14e5593d01085bb6d434f consensus state has no leader
W20260616 19:52:05.830220 996 leader_election.cc:343] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.830559 757 tablet_service.cc:1511] Processing CreateTablet for tablet 3fcdc7ae19874ca794ae71d228e6ab27 (DEFAULT_TABLE table=default.Table_4bebbb5f40cf47028a0a1d3ba5749584 [id=7729f25ff79a46739f37758228b75581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.757364 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0a5aa20660b44678bdc1f462591bcf31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:05.831513 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a5aa20660b44678bdc1f462591bcf31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:05.831857 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 703) took 1263 ms. Trace:
I20260616 19:52:05.757712 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a4961084e6774012ba8ba01c5037956d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:05.832053 1191 rpcz_store.cc:276] 0616 19:52:04.568737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.568898 (+ 161us) service_pool.cc:224] Handling call
0616 19:52:05.831572 (+1262674us) ts_tablet_manager.cc:1151] Deleting tablet 0b362fa598a54632880faa42a9224ffd
0616 19:52:05.831588 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.831838 (+ 250us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1262349}
W20260616 19:52:05.832871 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4961084e6774012ba8ba01c5037956d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:05.833321 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 81f881fd3ad244f9afd70b4b99d9384d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:05.782064 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f176111bc2a7494da5e17986963a2c5c consensus state has no leader
I20260616 19:52:05.833979 1192 tablet_bootstrap.cc:492] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:05.834540 454 master_service.cc:960] ReplaceTablet: received request to replace tablet efd5fecc6d444e5fba9103287c09542e from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:05.835253 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_53ef12c3964e47fea4557953dcbd32fa" } new_table_name: "default.Table_79b6231edaca4531929b2578e8468670" modify_external_catalogs: true
I20260616 19:52:05.835553 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 705) took 1178 ms. Trace:
W20260616 19:52:05.784057 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d62405248304339a03b01bc28238b8b consensus state has no leader
I20260616 19:52:05.835863 1191 rpcz_store.cc:276] 0616 19:52:04.656921 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.656982 (+ 61us) service_pool.cc:224] Handling call
0616 19:52:05.833940 (+1176958us) ts_tablet_manager.cc:1151] Deleting tablet 1d825bcf365f424fb99a10afe3e96501
0616 19:52:05.834128 (+ 188us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.834986 (+ 858us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1176742}
I20260616 19:52:05.836952 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_609f08c548144b62a7533ccf6f2d5219" } new_table_name: "default.Table_8c30a601851d42a3b5fed5a8fc6efd53" modify_external_catalogs: true
I20260616 19:52:05.838223 1196 tablet_bootstrap.cc:492] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:05.838439 1196 ts_tablet_manager.cc:1403] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.008s
I20260616 19:52:05.838637 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 707) took 1159 ms. Trace:
I20260616 19:52:05.839072 1191 rpcz_store.cc:276] 0616 19:52:04.678919 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.678996 (+ 77us) service_pool.cc:224] Handling call
0616 19:52:05.837948 (+1158952us) ts_tablet_manager.cc:1151] Deleting tablet 7bab084824a84c218ef69a18971e4b47
0616 19:52:05.837959 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.838447 (+ 488us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1104444}
I20260616 19:52:05.840260 1196 raft_consensus.cc:359] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.840602 1196 raft_consensus.cc:385] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.840786 1196 raft_consensus.cc:740] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.841147 1196 consensus_queue.cc:260] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.841518 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 76d73be228664063822c41cbefafcab8 (table default.Table_16508a5420d3488088367681d9b55f03 [id=946fd4fcf5f244acafa1e82743e70af2]). Expected version 2 got 0
I20260616 19:52:05.808254 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 9c77fd138ce9463b8f2d6f4182a56559 (table default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17]). Expected version 1 got 0
I20260616 19:52:05.843086 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 709) took 1149 ms. Trace:
I20260616 19:52:05.844127 1196 ts_tablet_manager.cc:1434] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260616 19:52:05.845523 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 9c77fd138ce9463b8f2d6f4182a56559 (table default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17]). Expected version 1 got 0
I20260616 19:52:05.845940 1196 tablet_bootstrap.cc:492] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:05.846026 752 tablet_service.cc:1558] Processing DeleteTablet for tablet da51a682de41402cb537ab113f876a2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.846047 456 catalog_manager.cc:5696] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:05.846385 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 10fc1d2ecaa746bab980a708dd8eb93a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.843922 1191 rpcz_store.cc:276] 0616 19:52:04.693380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.693535 (+ 155us) service_pool.cc:224] Handling call
0616 19:52:05.841306 (+1147771us) ts_tablet_manager.cc:1151] Deleting tablet 8cf5611e97e14eb1bf8515532f3a43be
0616 19:52:05.841489 (+ 183us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.843068 (+ 1579us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1107276}
I20260616 19:52:05.849079 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9ec01309e72d4e3b9b0af09a393415cb" } modify_external_catalogs: true
I20260616 19:52:05.849407 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9ec01309e72d4e3b9b0af09a393415cb" } modify_external_catalogs: true
I20260616 19:52:05.849105 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 711) took 1132 ms. Trace:
I20260616 19:52:05.849380 1192 tablet_bootstrap.cc:654] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.849529 1191 rpcz_store.cc:276] 0616 19:52:04.716130 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.716184 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:05.848325 (+1132141us) ts_tablet_manager.cc:1151] Deleting tablet a2904f2e00314858899a760b84950e1f
0616 19:52:05.848335 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.848920 (+ 585us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1113615}
I20260616 19:52:05.851212 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6ef1c5dde9574dd0abbeab5e4fa9586d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:05.851708 1191 tablet_replica.cc:333] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:05.852183 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ef1c5dde9574dd0abbeab5e4fa9586d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:05.852927 1191 raft_consensus.cc:2243] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.853647 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9360e6e758bd47c2b5adf035ac2cdab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.853797 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62405248304339a03b01bc28238b8b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.853828 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4adff6e41148b8b54e969ea2eb7a91" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:05.854430 996 leader_election.cc:343] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.854571 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 81f881fd3ad244f9afd70b4b99d9384d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:05.854794 1193 ts_tablet_manager.cc:1950] T 3587c1ab487a424eb82f378ae081f514 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:52:05.854673 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 113001us
I20260616 19:52:05.855835 1191 raft_consensus.cc:2272] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.856168 777 raft_consensus.cc:3060] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.857009 1193 tablet_replica.cc:333] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:05.857236 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6396397965c44e07850a6cc42cefab09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.857545 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c204a0af6eac4bc2897b48be50070860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.857628 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 795c9643c1e84ddabc9130ef42d5c793 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:05.860416 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 3587c1ab487a424eb82f378ae081f514 (table default.Table_9fe1afa2ee854800ab19aac1fb4c6048 [id=4f2b128cff5248f98e3506bb72a39391]) successfully deleted
I20260616 19:52:05.860658 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dcb663cf2e443f1acd4b18280378729 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:05.860713 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2b7f591d97bc4571b294b06d990d4065 because the tablet was not found. No further retry: Not found: Tablet not found: 2b7f591d97bc4571b294b06d990d4065
W20260616 19:52:05.860966 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 7955886341a94249afa849c51d34a0be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7955886341a94249afa849c51d34a0be already in progress: creating tablet
I20260616 19:52:05.861346 765 tablet_service.cc:1558] Processing DeleteTablet for tablet c44422ddb8ce45a48bb9aaeb6c209f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.862175 1193 raft_consensus.cc:2243] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.862352 1193 raft_consensus.cc:2272] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.862838 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet d5c82b71969e4cbcb890d16e1cdd5348 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.863123 1193 ts_tablet_manager.cc:1916] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.863802 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d73be228664063822c41cbefafcab8" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:05.864042 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fcdc7ae19874ca794ae71d228e6ab27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.865507 1190 ts_tablet_manager.cc:1929] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:05.865739 1191 ts_tablet_manager.cc:1916] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.865903 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eab5bd3967c42e1b6b79558df742946 with delete_type TABLET_DATA_DELETED (replaced by tablet 65b0dc43b40649f29037f40d2ea9247e) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.866511 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b7f591d97bc4571b294b06d990d4065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.866966 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ffce2dc22e24d1684e6eae92c487cea" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.869635 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc181171b134de2b946376f468aec72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.870492 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ba2eefdfed14791b5a41decc34dce44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.871137 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 31592a5ffb04429c9315a4fd72308f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.873205 782 raft_consensus.cc:2468] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:05.873229 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet fdc6222db09d4cd987cbdf70e4d40f70 with delete_type TABLET_DATA_DELETED (replaced by tablet d5c82b71969e4cbcb890d16e1cdd5348) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.874071 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet a170db3d27fd40c1b74deab29e9a033f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.875319 1849 raft_consensus.cc:493] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.875442 1849 raft_consensus.cc:515] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.876053 1849 leader_election.cc:290] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.876869 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba2eefdfed14791b5a41decc34dce44" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.877050 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 73a754c728b5408eb47f91de93554ec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:05.877485 996 leader_election.cc:343] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.877660 1030 tablet_service.cc:1511] Processing CreateTablet for tablet c204a0af6eac4bc2897b48be50070860 (DEFAULT_TABLE table=default.Table_c152425c57194fcfb3477de6f8beb86a [id=e09f10fd6e8d42bcbaeacb800cc7f1c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.878063 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c204a0af6eac4bc2897b48be50070860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.878099 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 3fcdc7ae19874ca794ae71d228e6ab27 (DEFAULT_TABLE table=default.Table_4bebbb5f40cf47028a0a1d3ba5749584 [id=7729f25ff79a46739f37758228b75581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.878459 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fcdc7ae19874ca794ae71d228e6ab27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.880954 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9d5b9b81694258accdb0d18ae094de (DEFAULT_TABLE table=default.Table_dae68b113ed343b4879c83b8554c55f2 [id=c1fbf8525bbe46ccb42a20618e0178a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.881299 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9d5b9b81694258accdb0d18ae094de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.887393 1193 ts_tablet_manager.cc:1929] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:05.888772 1022 tablet_service.cc:1511] Processing CreateTablet for tablet d55200fc438d407e9930400424b88024 (DEFAULT_TABLE table=default.Table_e320a0e61e09447aa8206a307dd2c425 [id=ef03ac98d21e4ed3b09db81243db576b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.889145 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55200fc438d407e9930400424b88024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.893435 1193 log.cc:1199] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/99b211692aca478bb40f0f2c3f50ca44
I20260616 19:52:05.893776 1193 ts_tablet_manager.cc:1950] T 99b211692aca478bb40f0f2c3f50ca44 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:05.893314 1196 tablet_bootstrap.cc:654] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.895192 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 81f881fd3ad244f9afd70b4b99d9384d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.895677 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 795c9643c1e84ddabc9130ef42d5c793 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.895742 1849 raft_consensus.cc:493] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.895867 1849 raft_consensus.cc:515] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.896188 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet e91c377ae66441268351cd3592aa9dbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.896507 1849 leader_election.cc:290] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.896910 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 5029a79e046a489aa9976eff948a3c5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.897171 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79250767a94141cd900a9715e86128b8" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.897709 1198 tablet_bootstrap.cc:492] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:05.897828 1198 ts_tablet_manager.cc:1403] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.232s user 0.020s sys 0.056s
W20260616 19:52:05.897902 996 leader_election.cc:343] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.898360 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b with delete_type TABLET_DATA_DELETED (replaced by tablet f54eef97f8db47449564b49be608902f) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.898554 1198 raft_consensus.cc:359] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.898710 1198 raft_consensus.cc:385] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.898761 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet d9c664f0386549d6867c407526ee45a0 with delete_type TABLET_DATA_DELETED (replaced by tablet 3c90eb04585c4fa992435d11015ffec7) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:05.899219 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 79250767a94141cd900a9715e86128b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:05.900388 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 451ef03db89043cbbed12a2a48a16adb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 451ef03db89043cbbed12a2a48a16adb already in progress: creating tablet
W20260616 19:52:05.900780 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c6be4a4739464be7b246a54b7a33adaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6be4a4739464be7b246a54b7a33adaf already in progress: creating tablet
W20260616 19:52:05.901244 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d2b3bbc4adb0492a87cd9226cf6a3c8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2b3bbc4adb0492a87cd9226cf6a3c8f already in progress: creating tablet
W20260616 19:52:05.901510 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0b362fa598a54632880faa42a9224ffd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b362fa598a54632880faa42a9224ffd already in progress: creating tablet
W20260616 19:52:05.901783 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 1d825bcf365f424fb99a10afe3e96501 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d825bcf365f424fb99a10afe3e96501 already in progress: creating tablet
W20260616 19:52:05.902060 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 7bab084824a84c218ef69a18971e4b47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bab084824a84c218ef69a18971e4b47 already in progress: creating tablet
W20260616 19:52:05.902336 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8cf5611e97e14eb1bf8515532f3a43be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cf5611e97e14eb1bf8515532f3a43be already in progress: creating tablet
I20260616 19:52:05.895290 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 795c9643c1e84ddabc9130ef42d5c793 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:05.904294 1193 tablet_replica.cc:333] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:05.904641 1193 raft_consensus.cc:2243] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:05.898764 1198 raft_consensus.cc:740] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.906019 1198 consensus_queue.cc:260] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.910210 1198 ts_tablet_manager.cc:1434] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260616 19:52:05.910506 1198 tablet_bootstrap.cc:492] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:05.910535 1193 pending_rounds.cc:70] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:05.910708 1193 pending_rounds.cc:77] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595496297086976 op_type: NO_OP noop_request { }
I20260616 19:52:05.910902 1193 raft_consensus.cc:2889] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:05.911055 1193 raft_consensus.cc:2272] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.912153 1193 ts_tablet_manager.cc:1916] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.913172 1198 tablet_bootstrap.cc:654] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.920782 1196 tablet_bootstrap.cc:492] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:05.921021 1196 ts_tablet_manager.cc:1403] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.076s user 0.003s sys 0.002s
I20260616 19:52:05.921829 1196 raft_consensus.cc:359] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.922093 1196 raft_consensus.cc:385] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.922212 1196 raft_consensus.cc:740] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.922536 1196 consensus_queue.cc:260] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.923190 1196 ts_tablet_manager.cc:1434] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:05.923283 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 6396397965c44e07850a6cc42cefab09 (DEFAULT_TABLE table=default.Table_9bb35be45c3b476a94e956aa287bc3a0 [id=57b5d2b03a354306b62b192b3f430c88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.923771 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6396397965c44e07850a6cc42cefab09. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:05.924700 993 leader_election.cc:343] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.925642 993 leader_election.cc:304] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.926230 1996 raft_consensus.cc:2749] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.927448 1196 tablet_bootstrap.cc:492] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:05.865957 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3f47e767764032ae5a06e34e2de248" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:05.867822 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da74f89b7ff44f49b8e2f2c2cbcbdb0b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:05.868129 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62405248304339a03b01bc28238b8b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:05.929056 921 raft_consensus.cc:2468] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:05.929158 1196 tablet_bootstrap.cc:654] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.929345 1190 log.cc:1199] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/2b7f591d97bc4571b294b06d990d4065
I20260616 19:52:05.929786 1190 ts_tablet_manager.cc:1950] T 2b7f591d97bc4571b294b06d990d4065 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:05.930158 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 636) took 2514 ms. Trace:
I20260616 19:52:05.925666 2028 consensus_queue.cc:1048] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:05.925891 860 leader_election.cc:343] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.930682 1849 raft_consensus.cc:493] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:05.930815 1849 raft_consensus.cc:515] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.931424 860 leader_election.cc:304] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:05.931535 1849 leader_election.cc:290] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:05.931742 2028 raft_consensus.cc:2804] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:05.931855 2028 raft_consensus.cc:493] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:05.931972 2028 raft_consensus.cc:3060] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.932286 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31592a5ffb04429c9315a4fd72308f28" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:05.932819 996 leader_election.cc:343] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.934643 2028 raft_consensus.cc:515] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.934962 1193 ts_tablet_manager.cc:1929] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:05.935148 1193 log.cc:1199] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/bfff9d60bb7e4a86b14687b581b45efe
I20260616 19:52:05.935601 1193 ts_tablet_manager.cc:1950] T bfff9d60bb7e4a86b14687b581b45efe P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:52:05.936074 858 leader_election.cc:343] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 4ffce2dc22e24d1684e6eae92c487cea
I20260616 19:52:05.936312 2028 leader_election.cc:290] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:05.925447 895 tablet_service.cc:1511] Processing CreateTablet for tablet 9360e6e758bd47c2b5adf035ac2cdab1 (DEFAULT_TABLE table=default.Table_f3c7d323882642c7a655b043d3b19e48 [id=cb79c2824e8a4a82ae476404913c5c31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.936766 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9360e6e758bd47c2b5adf035ac2cdab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.937057 892 tablet_service.cc:1511] Processing CreateTablet for tablet 3d44aed473e44e2eaa0d166f164c9309 (DEFAULT_TABLE table=default.Table_52d50dabb1b2498f88d5a07f62f7d058 [id=e6bef21f2f3644859d5d44ef5d5b5b3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.937376 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d44aed473e44e2eaa0d166f164c9309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.940487 898 tablet_service.cc:1511] Processing CreateTablet for tablet f61d0824e6144f00956b4ee552b33029 (DEFAULT_TABLE table=default.Table_0d460c8772ab439ebbdb0ac62f94dd34 [id=75f8df1de2e74a4281ac234420b92fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.940817 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61d0824e6144f00956b4ee552b33029. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:05.941128 860 consensus_peers.cc:597] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3587c1ab487a424eb82f378ae081f514. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:05.941501 1190 rpcz_store.cc:276] 0616 19:52:03.415310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.415470 (+ 160us) service_pool.cc:224] Handling call
0616 19:52:05.686218 (+2270748us) ts_tablet_manager.cc:1151] Deleting tablet 2b7f591d97bc4571b294b06d990d4065
0616 19:52:05.686229 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.840448 (+154219us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.865456 (+ 25008us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:05.930142 (+ 64686us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2270469}
I20260616 19:52:05.944713 893 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8c37e4293a4f2fa4f54397686c5dfc (DEFAULT_TABLE table=default.Table_8edbc6ccbac744a6892039a2c31f4372 [id=b42e35b77a534a51bfa3422e35e6319b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.944913 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 635) took 2533 ms. Trace:
I20260616 19:52:05.945004 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8c37e4293a4f2fa4f54397686c5dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.944983 1190 rpcz_store.cc:276] 0616 19:52:03.411704 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.420722 (+ 9018us) service_pool.cc:224] Handling call
0616 19:52:05.944812 (+2524090us) ts_tablet_manager.cc:1151] Deleting tablet 2e059efed3da48b9a516fd3905f6d298
0616 19:52:05.944822 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.944898 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2523753}
I20260616 19:52:05.945433 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba2eefdfed14791b5a41decc34dce44" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:05.945998 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79250767a94141cd900a9715e86128b8" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:05.946455 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31592a5ffb04429c9315a4fd72308f28" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:05.947825 993 leader_election.cc:343] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.947952 993 leader_election.cc:304] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.949473 1849 raft_consensus.cc:2749] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:05.949848 993 leader_election.cc:343] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.949951 993 leader_election.cc:304] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.950268 1849 raft_consensus.cc:2749] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.950575 993 leader_election.cc:304] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:05.950879 1849 raft_consensus.cc:2804] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:05.950953 1849 raft_consensus.cc:493] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:05.951027 1849 raft_consensus.cc:3060] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.953550 1849 raft_consensus.cc:515] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.905074 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_60319baa28b942b29f5c6ec9005c162e" } new_table_name: "default.Table_91e28eb3cfb5400482186bbd63f63ff7" modify_external_catalogs: true
I20260616 19:52:05.905622 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 99b211692aca478bb40f0f2c3f50ca44 (table default.Table_718b661372f441feb171907daff44e2d [id=a5404ca6c40f44b8b881ef582d703fd5]) successfully deleted
W20260616 19:52:05.954450 448 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 48851.8us
I20260616 19:52:05.905717 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_67e9e36e50e4455fa01d01db4ab1e5aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:05.956029 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67e9e36e50e4455fa01d01db4ab1e5aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:05.956274 750 tablet_service.cc:1511] Processing CreateTablet for tablet 3d44aed473e44e2eaa0d166f164c9309 (DEFAULT_TABLE table=default.Table_52d50dabb1b2498f88d5a07f62f7d058 [id=e6bef21f2f3644859d5d44ef5d5b5b3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.956559 1849 leader_election.cc:290] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:05.941994 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 2b7f591d97bc4571b294b06d990d4065 (table default.Table_730210c795214b2bb698287fcbd1bde3 [id=e28d99c40da7450bb6878e43b20ff0c1]) successfully deleted
I20260616 19:52:05.956713 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d44aed473e44e2eaa0d166f164c9309. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:05.957036 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 2e059efed3da48b9a516fd3905f6d298 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e059efed3da48b9a516fd3905f6d298 already in progress: creating tablet
W20260616 19:52:05.943277 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4481d9d481ee45449ac332ff19c06a54 consensus state has no leader
I20260616 19:52:05.958765 455 master_service.cc:960] ReplaceTablet: received request to replace tablet b29cc69fd5234becb09a0b73919b461c from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:05.945647 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 731473c9021a4522ae2dfecff22c60e6 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:05.959923 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 637) took 2534 ms. Trace:
I20260616 19:52:05.960009 1190 rpcz_store.cc:276] 0616 19:52:03.425279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.426313 (+ 1034us) service_pool.cc:224] Handling call
0616 19:52:05.959817 (+2533504us) ts_tablet_manager.cc:1151] Deleting tablet 6b0f5388a73143569012ed714e53a8be
0616 19:52:05.959826 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.959905 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2533207}
I20260616 19:52:05.960434 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6ef350bba3a64c25ad0d77ff4fd442e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:05.960603 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 6b0f5388a73143569012ed714e53a8be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b0f5388a73143569012ed714e53a8be already in progress: creating tablet
I20260616 19:52:05.960778 760 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8c37e4293a4f2fa4f54397686c5dfc (DEFAULT_TABLE table=default.Table_8edbc6ccbac744a6892039a2c31f4372 [id=b42e35b77a534a51bfa3422e35e6319b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.960862 1190 tablet_replica.cc:333] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
W20260616 19:52:05.961036 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ef350bba3a64c25ad0d77ff4fd442e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:05.961138 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8c37e4293a4f2fa4f54397686c5dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.961125 1190 raft_consensus.cc:2243] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:05.961282 1190 raft_consensus.cc:2272] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:05.961784 1190 ts_tablet_manager.cc:1916] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:05.962883 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62405248304339a03b01bc28238b8b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:05.963840 1923 raft_consensus.cc:493] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:52:05.963821 996 leader_election.cc:343] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.963951 1923 raft_consensus.cc:515] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.964488 1923 leader_election.cc:290] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:05.964993 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c77fd138ce9463b8f2d6f4182a56559" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:05.965165 1060 raft_consensus.cc:2468] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:05.965487 858 leader_election.cc:304] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:05.965951 757 tablet_service.cc:1511] Processing CreateTablet for tablet f61d0824e6144f00956b4ee552b33029 (DEFAULT_TABLE table=default.Table_0d460c8772ab439ebbdb0ac62f94dd34 [id=75f8df1de2e74a4281ac234420b92fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.966281 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61d0824e6144f00956b4ee552b33029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.971786 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ffce2dc22e24d1684e6eae92c487cea" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:05.971909 993 leader_election.cc:343] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.971979 777 raft_consensus.cc:3060] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.972021 993 leader_election.cc:304] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.972383 1849 raft_consensus.cc:2749] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:05.972409 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 70088.8us
W20260616 19:52:05.972668 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a2904f2e00314858899a760b84950e1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2904f2e00314858899a760b84950e1f already in progress: creating tablet
W20260616 19:52:05.972817 993 leader_election.cc:343] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.972923 993 leader_election.cc:304] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.973016 1923 raft_consensus.cc:2804] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:05.973088 1923 raft_consensus.cc:493] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:05.973148 1923 raft_consensus.cc:3060] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.973266 1849 raft_consensus.cc:2749] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.973759 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 9360e6e758bd47c2b5adf035ac2cdab1 (DEFAULT_TABLE table=default.Table_f3c7d323882642c7a655b043d3b19e48 [id=cb79c2824e8a4a82ae476404913c5c31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.974087 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9360e6e758bd47c2b5adf035ac2cdab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.974521 777 raft_consensus.cc:2468] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:05.975514 1923 raft_consensus.cc:515] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:05.975759 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8b921aa9c61a4cf1baeea7ed881a484f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:05.976222 1923 leader_election.cc:290] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:05.976400 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b921aa9c61a4cf1baeea7ed881a484f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:05.977089 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c77fd138ce9463b8f2d6f4182a56559" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:05.977252 1060 raft_consensus.cc:3060] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.979467 1060 raft_consensus.cc:2468] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:05.980626 858 leader_election.cc:304] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:52:05.983458 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2171eb55560f44dd91ad52e0b5b49408 consensus state has no leader
I20260616 19:52:05.983640 1923 raft_consensus.cc:2804] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:05.983762 1923 raft_consensus.cc:697] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:05.983985 1923 consensus_queue.cc:237] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:52:05.984649 993 leader_election.cc:343] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:05.984758 993 leader_election.cc:304] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:05.985471 1849 raft_consensus.cc:2749] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:05.986536 1192 tablet_bootstrap.cc:492] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:05.986752 1192 ts_tablet_manager.cc:1403] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.154s user 0.005s sys 0.000s
I20260616 19:52:05.987474 1192 raft_consensus.cc:359] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.987622 1192 raft_consensus.cc:385] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.987681 1192 raft_consensus.cc:740] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.987823 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fc0e76e3150e401ca073ed6fda000612" } modify_external_catalogs: true
I20260616 19:52:05.987913 1192 consensus_queue.cc:260] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.988027 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fc0e76e3150e401ca073ed6fda000612" } modify_external_catalogs: true
I20260616 19:52:05.988505 1192 ts_tablet_manager.cc:1434] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:05.988761 1192 tablet_bootstrap.cc:492] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:05.991271 1192 tablet_bootstrap.cc:654] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:05.991329 1025 tablet_service.cc:1511] Processing CreateTablet for tablet f61d0824e6144f00956b4ee552b33029 (DEFAULT_TABLE table=default.Table_0d460c8772ab439ebbdb0ac62f94dd34 [id=75f8df1de2e74a4281ac234420b92fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:05.991714 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61d0824e6144f00956b4ee552b33029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:05.992441 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c77fd138ce9463b8f2d6f4182a56559" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:05.992640 777 raft_consensus.cc:2468] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:05.993371 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c77fd138ce9463b8f2d6f4182a56559" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:05.993496 777 raft_consensus.cc:3060] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.994926 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62405248304339a03b01bc28238b8b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:05.995061 921 raft_consensus.cc:3060] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:05.995965 777 raft_consensus.cc:2468] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:05.997037 1196 tablet_bootstrap.cc:492] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:05.997174 1196 ts_tablet_manager.cc:1403] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.074s user 0.001s sys 0.003s
I20260616 19:52:05.997872 1196 raft_consensus.cc:359] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.998042 1196 raft_consensus.cc:385] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:05.998042 921 raft_consensus.cc:2468] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:05.998109 1196 raft_consensus.cc:740] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:05.998312 1196 consensus_queue.cc:260] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:05.998787 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet d270afd0c0f3457aa6dd14721dca261d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.002372 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8c37e4293a4f2fa4f54397686c5dfc (DEFAULT_TABLE table=default.Table_8edbc6ccbac744a6892039a2c31f4372 [id=b42e35b77a534a51bfa3422e35e6319b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.005087 860 leader_election.cc:304] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:06.007107 1923 raft_consensus.cc:2804] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:06.007268 1923 raft_consensus.cc:697] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:06.007535 1923 consensus_queue.cc:237] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:06.008381 750 tablet_service.cc:1511] Processing CreateTablet for tablet 3decbe39deb84d1a85c3a9773fcbf5be (DEFAULT_TABLE table=default.Table_f23ea74ac0fe43bebde78acffb4c1a04 [id=992ff101fc2f434bbe657b3b2a41c11e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.009685 893 tablet_service.cc:1558] Processing DeleteTablet for tablet bfff9d60bb7e4a86b14687b581b45efe with delete_type TABLET_DATA_DELETED (replaced by tablet 0b362fa598a54632880faa42a9224ffd) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.009950 898 tablet_service.cc:1558] Processing DeleteTablet for tablet da51a682de41402cb537ab113f876a2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.010188 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ffce2dc22e24d1684e6eae92c487cea with delete_type TABLET_DATA_DELETED (replaced by tablet 2374c740a25442debce55e9d5309f79e) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.010527 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3decbe39deb84d1a85c3a9773fcbf5be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.013865 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 15d6a025b9a248c5ab9422fe1c340f3e with delete_type TABLET_DATA_DELETED (replaced by tablet db750fc9641f492494fdb167de86f6df) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.014578 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ffce2dc22e24d1684e6eae92c487cea with delete_type TABLET_DATA_DELETED (replaced by tablet 2374c740a25442debce55e9d5309f79e) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.010202 895 tablet_service.cc:1558] Processing DeleteTablet for tablet c44422ddb8ce45a48bb9aaeb6c209f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.018191 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_63bb1983029d46eeb2eff78065f24ca5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.018862 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63bb1983029d46eeb2eff78065f24ca5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.020726 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2f33e989c99c495d985aab8a0552fea3" } modify_external_catalogs: true
I20260616 19:52:06.020965 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2f33e989c99c495d985aab8a0552fea3" } modify_external_catalogs: true
I20260616 19:52:06.006711 993 leader_election.cc:304] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:06.023308 1996 raft_consensus.cc:2804] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:06.010947 1849 raft_consensus.cc:493] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.012519 1198 tablet_bootstrap.cc:492] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:06.023591 1198 ts_tablet_manager.cc:1403] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.113s user 0.014s sys 0.013s
I20260616 19:52:06.023531 1849 raft_consensus.cc:515] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.024436 1198 raft_consensus.cc:359] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.024669 1198 raft_consensus.cc:385] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.024749 1198 raft_consensus.cc:740] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.024791 1849 leader_election.cc:290] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:06.025012 1198 consensus_queue.cc:260] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.026748 1198 ts_tablet_manager.cc:1434] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:06.027113 1198 tablet_bootstrap.cc:492] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:06.027446 1996 raft_consensus.cc:697] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:06.023313 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8c37e4293a4f2fa4f54397686c5dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.028052 1996 consensus_queue.cc:237] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.029402 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5029a79e046a489aa9976eff948a3c5b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:06.029937 996 leader_election.cc:343] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.030633 1198 tablet_bootstrap.cc:654] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.033078 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5029a79e046a489aa9976eff948a3c5b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:06.033543 993 leader_election.cc:343] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.033679 993 leader_election.cc:304] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:06.034073 1849 raft_consensus.cc:2749] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:06.036321 1198 tablet_bootstrap.cc:492] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:06.036509 1198 ts_tablet_manager.cc:1403] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20260616 19:52:06.037659 1198 raft_consensus.cc:359] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:06.037897 1198 raft_consensus.cc:385] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.037968 1198 raft_consensus.cc:740] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.038247 1192 tablet_bootstrap.cc:492] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:06.038225 1198 consensus_queue.cc:260] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:06.038817 1198 ts_tablet_manager.cc:1434] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:06.039124 1198 tablet_bootstrap.cc:492] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:06.037663 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 3d44aed473e44e2eaa0d166f164c9309 (DEFAULT_TABLE table=default.Table_52d50dabb1b2498f88d5a07f62f7d058 [id=e6bef21f2f3644859d5d44ef5d5b5b3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.041466 760 tablet_service.cc:1511] Processing CreateTablet for tablet 9683db43fc9048779921a167dc63617a (DEFAULT_TABLE table=default.Table_3e6b6285a6f540d3aaabe694ab55e84e [id=9893040d561641148144f763fd7664d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.041846 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9683db43fc9048779921a167dc63617a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.045593 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2a1e4310104a4b238d80116604a1af3a
I20260616 19:52:06.041671 893 tablet_service.cc:1511] Processing CreateTablet for tablet 9683db43fc9048779921a167dc63617a (DEFAULT_TABLE table=default.Table_3e6b6285a6f540d3aaabe694ab55e84e [id=9893040d561641148144f763fd7664d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.048457 1192 ts_tablet_manager.cc:1403] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.060s user 0.004s sys 0.000s
I20260616 19:52:06.049052 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c278603497a14856bb053d15d26c6bf0" } modify_external_catalogs: true
I20260616 19:52:06.049248 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c278603497a14856bb053d15d26c6bf0" } modify_external_catalogs: true
I20260616 19:52:06.049247 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 9683db43fc9048779921a167dc63617a (DEFAULT_TABLE table=default.Table_3e6b6285a6f540d3aaabe694ab55e84e [id=9893040d561641148144f763fd7664d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.050096 892 tablet_service.cc:1511] Processing CreateTablet for tablet 71a23c82ace248b48c7086dcbabe3649 (DEFAULT_TABLE table=default.Table_2f33e989c99c495d985aab8a0552fea3 [id=5b8c3c7767a64dd4854bee9be2b22ba1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.047745 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a1e4310104a4b238d80116604a1af3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.048552 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9683db43fc9048779921a167dc63617a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.050621 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a1e4310104a4b238d80116604a1af3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.040736 1198 tablet_bootstrap.cc:654] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.051436 753 tablet_service.cc:1511] Processing CreateTablet for tablet 71a23c82ace248b48c7086dcbabe3649 (DEFAULT_TABLE table=default.Table_2f33e989c99c495d985aab8a0552fea3 [id=5b8c3c7767a64dd4854bee9be2b22ba1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.051748 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a23c82ace248b48c7086dcbabe3649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.053014 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a23c82ace248b48c7086dcbabe3649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.040867 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 3decbe39deb84d1a85c3a9773fcbf5be (DEFAULT_TABLE table=default.Table_f23ea74ac0fe43bebde78acffb4c1a04 [id=992ff101fc2f434bbe657b3b2a41c11e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.058370 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a1e4310104a4b238d80116604a1af3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.050086 1191 ts_tablet_manager.cc:1929] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:06.059712 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d44aed473e44e2eaa0d166f164c9309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.059922 1191 log.cc:1199] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/13e4e52fae124d4085b15e143e98a7e4
I20260616 19:52:06.060559 1198 tablet_bootstrap.cc:492] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:06.060751 1198 ts_tablet_manager.cc:1403] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.000s
I20260616 19:52:06.061110 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3decbe39deb84d1a85c3a9773fcbf5be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.061923 1198 raft_consensus.cc:359] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.062141 1198 raft_consensus.cc:385] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.062240 1198 raft_consensus.cc:740] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.041980 895 tablet_service.cc:1511] Processing CreateTablet for tablet 3decbe39deb84d1a85c3a9773fcbf5be (DEFAULT_TABLE table=default.Table_f23ea74ac0fe43bebde78acffb4c1a04 [id=992ff101fc2f434bbe657b3b2a41c11e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.062701 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3decbe39deb84d1a85c3a9773fcbf5be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.064747 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9683db43fc9048779921a167dc63617a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.067085 1198 consensus_queue.cc:260] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.067894 1198 ts_tablet_manager.cc:1434] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260616 19:52:06.068190 1198 tablet_bootstrap.cc:492] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:06.068639 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4" } modify_external_catalogs: true
I20260616 19:52:06.068825 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4" } modify_external_catalogs: true
I20260616 19:52:06.070905 1198 tablet_bootstrap.cc:654] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.075268 760 tablet_service.cc:1511] Processing CreateTablet for tablet aee589880bac4eff98fa6edd32c0b92d (DEFAULT_TABLE table=default.Table_f1bb97d3ca244915b45c1f1d931cc97e [id=c0e43fceb55041279bc9f2b415224da8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.075330 892 tablet_service.cc:1511] Processing CreateTablet for tablet aee589880bac4eff98fa6edd32c0b92d (DEFAULT_TABLE table=default.Table_f1bb97d3ca244915b45c1f1d931cc97e [id=c0e43fceb55041279bc9f2b415224da8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.075699 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee589880bac4eff98fa6edd32c0b92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.075737 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee589880bac4eff98fa6edd32c0b92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.080823 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 71a23c82ace248b48c7086dcbabe3649 (DEFAULT_TABLE table=default.Table_2f33e989c99c495d985aab8a0552fea3 [id=5b8c3c7767a64dd4854bee9be2b22ba1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.081270 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a23c82ace248b48c7086dcbabe3649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.084826 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9b3d704ef85c4307b3e1566686499acc" } new_table_name: "default.Table_3cf14af743a244c382cff85d7e6f7b97" modify_external_catalogs: true
I20260616 19:52:06.085187 1198 tablet_bootstrap.cc:492] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:06.085358 1198 ts_tablet_manager.cc:1403] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20260616 19:52:06.086151 1198 raft_consensus.cc:359] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.086417 1198 raft_consensus.cc:385] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.086510 1198 raft_consensus.cc:740] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.086812 1198 consensus_queue.cc:260] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.087364 1198 ts_tablet_manager.cc:1434] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:06.088012 1198 tablet_bootstrap.cc:492] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:06.096184 1196 ts_tablet_manager.cc:1434] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.099s user 0.001s sys 0.001s
I20260616 19:52:06.097553 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet bfff9d60bb7e4a86b14687b581b45efe (table default.Table_74f3d2b26e0d4319b73c964c2eaf9204 [id=a67306640a5b4c0a91a283892a3a8062]) successfully deleted
I20260616 19:52:06.099963 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_453f5cc67bd947608ab2945126f31076" } new_table_name: "default.Table_bcab4a4c76834c019a078e7bb73a6af5" modify_external_catalogs: true
I20260616 19:52:06.112668 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet b29cc69fd5234becb09a0b73919b461c
I20260616 19:52:06.113235 455 catalog_manager.cc:6784] ReplaceTablet: tablet b29cc69fd5234becb09a0b73919b461c deleted and replaced by tablet 0d8082b99233417a97046d2d1d3ef552
I20260616 19:52:06.114640 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet b29cc69fd5234becb09a0b73919b461c with delete_type TABLET_DATA_DELETED (replaced by tablet 0d8082b99233417a97046d2d1d3ef552) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.115880 753 tablet_service.cc:1558] Processing DeleteTablet for tablet b29cc69fd5234becb09a0b73919b461c with delete_type TABLET_DATA_DELETED (replaced by tablet 0d8082b99233417a97046d2d1d3ef552) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.116163 893 tablet_service.cc:1558] Processing DeleteTablet for tablet b29cc69fd5234becb09a0b73919b461c with delete_type TABLET_DATA_DELETED (replaced by tablet 0d8082b99233417a97046d2d1d3ef552) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.116871 1196 tablet_bootstrap.cc:492] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:06.117767 1192 raft_consensus.cc:359] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.118409 1192 raft_consensus.cc:385] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.118530 1192 raft_consensus.cc:740] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.118773 1192 consensus_queue.cc:260] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.120131 1192 ts_tablet_manager.cc:1434] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.070s user 0.002s sys 0.000s
I20260616 19:52:06.120486 1192 tablet_bootstrap.cc:492] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:06.121989 1192 tablet_bootstrap.cc:654] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.124805 1191 ts_tablet_manager.cc:1950] T 13e4e52fae124d4085b15e143e98a7e4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:06.125613 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 725) took 1004 ms. Trace:
I20260616 19:52:06.125753 1191 rpcz_store.cc:276] 0616 19:52:05.120820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.124094 (+ 3274us) service_pool.cc:224] Handling call
0616 19:52:05.851323 (+727229us) ts_tablet_manager.cc:1151] Deleting tablet 13e4e52fae124d4085b15e143e98a7e4
0616 19:52:05.851336 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.871014 (+ 19678us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:06.034970 (+163956us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:06.125594 (+ 90624us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":722856}
I20260616 19:52:06.126345 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 13e4e52fae124d4085b15e143e98a7e4 (table default.Table_08665ae0b3d543ee85db56ca306c7f4b [id=ee62532e9e6148ac830ee9efe0a88a24]) successfully deleted
W20260616 19:52:06.127111 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet f92e45da793440d59439c715e8e50249 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f92e45da793440d59439c715e8e50249 already in progress: creating tablet
W20260616 19:52:06.127735 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 7955886341a94249afa849c51d34a0be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7955886341a94249afa849c51d34a0be already in progress: creating tablet
W20260616 19:52:06.128348 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8dcb663cf2e443f1acd4b18280378729 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8dcb663cf2e443f1acd4b18280378729 already in progress: creating tablet
W20260616 19:52:06.128933 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d5c82b71969e4cbcb890d16e1cdd5348 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5c82b71969e4cbcb890d16e1cdd5348 already in progress: creating tablet
W20260616 19:52:06.129490 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8eab5bd3967c42e1b6b79558df742946 because the tablet was not found. No further retry: Not found: Tablet not found: 8eab5bd3967c42e1b6b79558df742946
I20260616 19:52:06.129817 1908 raft_consensus.cc:493] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.129952 1908 raft_consensus.cc:515] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.130569 1908 leader_election.cc:290] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:06.131562 719 leader_election.cc:343] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 15d6a025b9a248c5ab9422fe1c340f3e
I20260616 19:52:06.132396 1193 tablet_replica.cc:333] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:52:06.132575 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2b7f591d97bc4571b294b06d990d4065 because the tablet was not found. No further retry: Not found: Tablet not found: 2b7f591d97bc4571b294b06d990d4065
I20260616 19:52:06.132674 1193 raft_consensus.cc:2243] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:06.132843 1193 raft_consensus.cc:2272] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:06.132962 1191 tablet_replica.cc:333] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:06.133188 1191 raft_consensus.cc:2243] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:06.133388 1191 raft_consensus.cc:2272] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:06.134450 753 tablet_service.cc:1511] Processing CreateTablet for tablet b1771a4ed9d649558fed580992af1f96 (DEFAULT_TABLE table=default.Table_25fdb3a9609849db808152f62bb0c6bf [id=9dcac3f22b2d4e33bcb7fffe9236667f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.134826 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1771a4ed9d649558fed580992af1f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.138286 1193 ts_tablet_manager.cc:1916] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:06.144232 1193 ts_tablet_manager.cc:1929] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:06.175961 453 catalog_manager.cc:5696] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:06.176422 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 9c77fd138ce9463b8f2d6f4182a56559 (table default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17]). Expected version 1 got 0
I20260616 19:52:06.177693 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 1d62405248304339a03b01bc28238b8b (table default.Table_3dfb87e923144c1d804da28dbf9ec55a [id=26e971fd00814ec89e4b45ad7544739b]). Expected version 1 got 0
I20260616 19:52:06.197644 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 137c13d905eb4bf2937f730e5210266f
I20260616 19:52:06.198436 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e69337994b154a11a55144b5ebf72a9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.199007 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e69337994b154a11a55144b5ebf72a9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.207146 2066 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.189:43055 every 8 connection(s)
I20260616 19:52:06.207515 1732 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.189:43055
I20260616 19:52:06.209975 1732 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-1/data/info.pb
I20260616 19:52:06.215018 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasknFdngH/build/asan/bin/kudu as pid 1732
I20260616 19:52:06.218016 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0399a9b77bf7408fa8e519e25d79229a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.218799 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0399a9b77bf7408fa8e519e25d79229a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.220747 1193 log.cc:1199] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/fdc6222db09d4cd987cbdf70e4d40f70
I20260616 19:52:06.221107 1193 ts_tablet_manager.cc:1950] T fdc6222db09d4cd987cbdf70e4d40f70 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:06.222079 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet fdc6222db09d4cd987cbdf70e4d40f70 (table default.Table_ece3f5e58baa45dfb295c03ab6a85f01 [id=d5fe1c6faa0d446ca84e71bbdfb4018d]) successfully deleted
I20260616 19:52:06.171667 1196 tablet_bootstrap.cc:654] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.200062 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 137c13d905eb4bf2937f730e5210266f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.226416 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 71a23c82ace248b48c7086dcbabe3649
I20260616 19:52:06.227428 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a8e9b465f77e4975bd54ab7c5d117278"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.228060 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8e9b465f77e4975bd54ab7c5d117278 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.235699 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 71a23c82ace248b48c7086dcbabe3649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:06.250919 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8dcb663cf2e443f1acd4b18280378729 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8dcb663cf2e443f1acd4b18280378729 already in progress: creating tablet
W20260616 19:52:06.251991 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d5c82b71969e4cbcb890d16e1cdd5348 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5c82b71969e4cbcb890d16e1cdd5348 already in progress: creating tablet
W20260616 19:52:06.252496 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 81f881fd3ad244f9afd70b4b99d9384d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81f881fd3ad244f9afd70b4b99d9384d already in progress: creating tablet
I20260616 19:52:06.256546 1193 tablet_replica.cc:333] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:06.256978 1193 raft_consensus.cc:2243] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:06.258399 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 32ce369f4db042a5841003e4ea1fcc69
I20260616 19:52:06.261505 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 415ad9d0c3564453825c4b30c0ad64fa
I20260616 19:52:06.264109 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6638da797c494fa3b2ea3d0e50a34f63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.264868 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6638da797c494fa3b2ea3d0e50a34f63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.266525 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3f3995c8244446469858bbd49b97cc81" } new_table_name: "default.Table_8d997ea2bb3944d7a592a8aec76cb540" modify_external_catalogs: true
W20260616 19:52:06.268579 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88246ba54ff543cb8effb3b96019a2b8 consensus state has no leader
I20260616 19:52:06.268316 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 32ce369f4db042a5841003e4ea1fcc69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.269003 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5dc308301e974ad1bdad6358b69747de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:06.268502 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 415ad9d0c3564453825c4b30c0ad64fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:06.269594 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5dc308301e974ad1bdad6358b69747de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.269670 1193 raft_consensus.cc:2272] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:06.274421 1193 ts_tablet_manager.cc:1916] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:06.276597 1196 tablet_bootstrap.cc:492] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:06.276758 1196 ts_tablet_manager.cc:1403] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.160s user 0.004s sys 0.001s
I20260616 19:52:06.277660 1196 raft_consensus.cc:359] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.277848 1196 raft_consensus.cc:385] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.277904 1196 raft_consensus.cc:740] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.278123 1196 consensus_queue.cc:260] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.280877 1196 ts_tablet_manager.cc:1434] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260616 19:52:06.281180 1196 tablet_bootstrap.cc:492] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:06.283155 1196 tablet_bootstrap.cc:654] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.137962 1031 tablet_service.cc:1511] Processing CreateTablet for tablet b1771a4ed9d649558fed580992af1f96 (DEFAULT_TABLE table=default.Table_25fdb3a9609849db808152f62bb0c6bf [id=9dcac3f22b2d4e33bcb7fffe9236667f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.156951 1198 tablet_bootstrap.cc:654] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.201129 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 137c13d905eb4bf2937f730e5210266f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.228933 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 71a23c82ace248b48c7086dcbabe3649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.231873 1030 tablet_service.cc:1511] Processing CreateTablet for tablet aee589880bac4eff98fa6edd32c0b92d (DEFAULT_TABLE table=default.Table_f1bb97d3ca244915b45c1f1d931cc97e [id=c0e43fceb55041279bc9f2b415224da8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.259542 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 32ce369f4db042a5841003e4ea1fcc69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.262835 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 415ad9d0c3564453825c4b30c0ad64fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.294286 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1771a4ed9d649558fed580992af1f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.294481 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee589880bac4eff98fa6edd32c0b92d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:06.299868 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba092edcdecf485e96a392b3ea79b01a consensus state has no leader
I20260616 19:52:06.300151 458 master_service.cc:960] ReplaceTablet: received request to replace tablet 9446df9472e34ac79ec24cce89e3f5e5 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:06.302052 455 catalog_manager.cc:5696] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131). New cstate: current_term: 1 leader_uuid: "61c874fef3684d10a272a9c7f280e0e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:06.302425 455 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 1d62405248304339a03b01bc28238b8b (table default.Table_3dfb87e923144c1d804da28dbf9ec55a [id=26e971fd00814ec89e4b45ad7544739b]). Expected version 1 got 0
I20260616 19:52:06.302570 1191 ts_tablet_manager.cc:1916] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:06.132148 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d6a025b9a248c5ab9422fe1c340f3e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:06.144766 893 tablet_service.cc:1511] Processing CreateTablet for tablet b1771a4ed9d649558fed580992af1f96 (DEFAULT_TABLE table=default.Table_25fdb3a9609849db808152f62bb0c6bf [id=9dcac3f22b2d4e33bcb7fffe9236667f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.305755 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1771a4ed9d649558fed580992af1f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.306636 718 leader_election.cc:304] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:06.307657 2056 raft_consensus.cc:2749] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:06.309945 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_02bf2860f6fb4632b760335e3f6319c3" } new_table_name: "default.Table_45398de6fee946e390fc0b5b3e6abefd" modify_external_catalogs: true
I20260616 19:52:06.310705 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 5b34d497f9334e94b06cc9245fca04ed (table default.Table_7a777a2aa2cd44d1b7f9db66e8367a32 [id=6db44bdac0784e08b52a4db869edb3d3]). Expected version 1 got 0
I20260616 19:52:06.311859 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_56f10142b9c14500b0b99c646a62cf9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:06.312839 1198 tablet_bootstrap.cc:492] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:06.312774 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_16ebbe6e3c3b4fd185b78b20b1098bd5" } modify_external_catalogs: true
I20260616 19:52:06.312968 1198 ts_tablet_manager.cc:1403] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.225s user 0.030s sys 0.006s
I20260616 19:52:06.313246 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3dfb87e923144c1d804da28dbf9ec55a" } new_table_name: "default.Table_67f7ca211f5c4bd2b52bedf6e8882673" modify_external_catalogs: true
I20260616 19:52:06.313692 1198 raft_consensus.cc:359] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.173399 1190 ts_tablet_manager.cc:1929] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:06.202765 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 137c13d905eb4bf2937f730e5210266f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.237598 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 71a23c82ace248b48c7086dcbabe3649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.259505 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 32ce369f4db042a5841003e4ea1fcc69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.263052 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 415ad9d0c3564453825c4b30c0ad64fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.303774 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 13e4e52fae124d4085b15e143e98a7e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.315587 1190 log.cc:1199] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/36ea9b8ba668410bae016a008cf37910
W20260616 19:52:06.315737 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56f10142b9c14500b0b99c646a62cf9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.316004 1190 ts_tablet_manager.cc:1950] T 36ea9b8ba668410bae016a008cf37910 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:06.316354 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 638) took 2838 ms. Trace:
I20260616 19:52:06.316502 1190 rpcz_store.cc:276] 0616 19:52:03.477700 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.480511 (+ 2811us) service_pool.cc:224] Handling call
0616 19:52:05.960822 (+2480311us) ts_tablet_manager.cc:1151] Deleting tablet 36ea9b8ba668410bae016a008cf37910
0616 19:52:05.960830 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:05.964568 (+ 3738us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:06.173345 (+208777us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:06.316338 (+142993us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2480095}
I20260616 19:52:06.315898 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_16ebbe6e3c3b4fd185b78b20b1098bd5" } modify_external_catalogs: true
I20260616 19:52:06.317021 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 36ea9b8ba668410bae016a008cf37910 (table default.Table_78964cf02d6e4b94be59a534e00ada50 [id=7ba83bcdb62c4bc9804589f54ddb86d8]) successfully deleted
I20260616 19:52:06.317087 1190 tablet_replica.cc:333] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:06.317096 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bfea1b0367de4297b1a424da79faa638"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:06.317277 1190 raft_consensus.cc:2243] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:06.317421 1190 raft_consensus.cc:2272] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:06.317544 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfea1b0367de4297b1a424da79faa638 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.317906 1190 ts_tablet_manager.cc:1916] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:06.313846 1198 raft_consensus.cc:385] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.318241 1198 raft_consensus.cc:740] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.318495 1198 consensus_queue.cc:260] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.319329 1198 ts_tablet_manager.cc:1434] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260616 19:52:06.319581 1198 tablet_bootstrap.cc:492] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:06.320924 1198 tablet_bootstrap.cc:654] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:06.322058 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f872a8860a4b421483441d71814be4fc consensus state has no leader
I20260616 19:52:06.333163 1198 tablet_bootstrap.cc:492] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:06.333312 1198 ts_tablet_manager.cc:1403] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.001s
I20260616 19:52:06.334396 1198 raft_consensus.cc:359] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.334568 1198 raft_consensus.cc:385] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.334619 1198 raft_consensus.cc:740] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.335564 1198 consensus_queue.cc:260] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.336036 1198 ts_tablet_manager.cc:1434] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:06.338171 1198 tablet_bootstrap.cc:492] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:06.339697 1198 tablet_bootstrap.cc:654] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.340063 2075 tablet.cc:1724] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:06.341038 2067 sys_catalog.cc:263] Verifying existing consensus state
I20260616 19:52:06.344019 2076 tablet.cc:1724] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:06.344103 1193 ts_tablet_manager.cc:1929] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:06.344203 1193 log.cc:1199] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/da51a682de41402cb537ab113f876a2d
I20260616 19:52:06.344509 1193 ts_tablet_manager.cc:1950] T da51a682de41402cb537ab113f876a2d P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:06.347820 1198 tablet_bootstrap.cc:492] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:06.347950 1198 ts_tablet_manager.cc:1403] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20260616 19:52:06.348820 1198 raft_consensus.cc:359] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:06.348987 1198 raft_consensus.cc:385] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.349033 1198 raft_consensus.cc:740] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.349216 1198 consensus_queue.cc:260] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:06.349637 1198 ts_tablet_manager.cc:1434] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:06.349974 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 1d62405248304339a03b01bc28238b8b (table default.Table_3dfb87e923144c1d804da28dbf9ec55a [id=26e971fd00814ec89e4b45ad7544739b]). Expected version 1 got 0
I20260616 19:52:06.351840 1198 tablet_bootstrap.cc:492] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:06.353248 1191 ts_tablet_manager.cc:1929] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:06.353348 1191 log.cc:1199] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/1bc181171b134de2b946376f468aec72
I20260616 19:52:06.353549 1198 tablet_bootstrap.cc:654] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.353632 1191 ts_tablet_manager.cc:1950] T 1bc181171b134de2b946376f468aec72 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
W20260616 19:52:06.356025 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00ba17a832dc4eb2a672d1eb246dd5b3 consensus state has no leader
I20260616 19:52:06.360543 832 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:52:06.365688 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f1a2ae364984415eb1a4e7caee67847d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.366391 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1a2ae364984415eb1a4e7caee67847d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.370920 460 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet df036f9d31ca4770bb00bc9cece46953 (table default.Table_fd335042e2c64bfa9299d235a674767a [id=548cacd5de984fa89aa96b1c659f9e38]). Expected version 3 got 0
I20260616 19:52:06.371685 782 raft_consensus.cc:3060] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:06.374353 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d80d9028184443da49623228259263d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.374967 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet fbb308b05bb04bc18ccaa9550a73d3e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.375142 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 65b0dc43b40649f29037f40d2ea9247e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.375397 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cc988a195ec4bbf8691801421fed8bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.375999 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 44493f0ffd064249a28628cf24895395 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.376629 971 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
W20260616 19:52:06.378413 860 consensus_peers.cc:597] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99b211692aca478bb40f0f2c3f50ca44. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:06.378684 1196 tablet_bootstrap.cc:492] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:06.378834 1196 ts_tablet_manager.cc:1403] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.098s user 0.000s sys 0.006s
I20260616 19:52:06.379544 1196 raft_consensus.cc:359] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.379720 1196 raft_consensus.cc:385] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.382061 922 raft_consensus.cc:1275] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Refusing update from remote peer 61c874fef3684d10a272a9c7f280e0e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:52:06.382620 1996 consensus_queue.cc:1048] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:06.380714 782 raft_consensus.cc:1275] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Refusing update from remote peer 61c874fef3684d10a272a9c7f280e0e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:52:06.385728 1192 tablet_bootstrap.cc:492] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:06.379778 1196 raft_consensus.cc:740] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.386010 1192 ts_tablet_manager.cc:1403] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.266s user 0.004s sys 0.000s
I20260616 19:52:06.385993 1196 consensus_queue.cc:260] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.386505 1196 ts_tablet_manager.cc:1434] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260616 19:52:06.386639 1996 consensus_queue.cc:1048] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:06.387058 1192 raft_consensus.cc:359] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.387348 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet da51a682de41402cb537ab113f876a2d (table default.Table_10a5c35013c14fe1b8d9d1c77589d321 [id=c53bc843f4974b08965984db1910d6d5]) successfully deleted
I20260616 19:52:06.387583 1192 raft_consensus.cc:385] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.387809 1192 raft_consensus.cc:740] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.388290 1192 consensus_queue.cc:260] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.388921 1192 ts_tablet_manager.cc:1434] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260616 19:52:06.389987 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d800b4e2c2d42279c102e4e061f5530 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.389963 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_09b7966d2cdd415e871a77b0225b23ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.390862 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09b7966d2cdd415e871a77b0225b23ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.393833 1193 tablet_replica.cc:333] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:06.394655 1193 raft_consensus.cc:2243] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:06.394995 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:52:06.395483 1193 raft_consensus.cc:2272] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:06.399677 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_79b6231edaca4531929b2578e8468670" } modify_external_catalogs: true
I20260616 19:52:06.399869 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_79b6231edaca4531929b2578e8468670" } modify_external_catalogs: true
I20260616 19:52:06.400233 2067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: Bootstrap starting.
I20260616 19:52:06.404718 1193 ts_tablet_manager.cc:1916] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:06.406517 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1a24c6f631b84d5a90cc8cc8d52361ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.407127 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a24c6f631b84d5a90cc8cc8d52361ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.407593 1198 tablet_bootstrap.cc:492] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:06.407734 1198 ts_tablet_manager.cc:1403] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.056s user 0.008s sys 0.015s
I20260616 19:52:06.409025 1198 raft_consensus.cc:359] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.409174 1198 raft_consensus.cc:385] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.409224 1198 raft_consensus.cc:740] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.409459 1198 consensus_queue.cc:260] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.411834 1198 ts_tablet_manager.cc:1434] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260616 19:52:06.412101 1198 tablet_bootstrap.cc:492] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:06.415575 1996 raft_consensus.cc:493] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.415720 1996 raft_consensus.cc:515] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.416690 1996 leader_election.cc:290] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:06.416988 2087 tablet.cc:1724] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:06.417443 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d800b4e2c2d42279c102e4e061f5530" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:06.417984 996 leader_election.cc:343] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.418259 1198 tablet_bootstrap.cc:654] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.420287 1192 tablet_bootstrap.cc:492] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:06.418270 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d800b4e2c2d42279c102e4e061f5530" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:06.423491 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bd6fa49eff4400ca40c722e18cea951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:06.423815 993 leader_election.cc:343] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.423929 993 leader_election.cc:304] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:06.424139 1996 raft_consensus.cc:2749] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:06.434916 1198 tablet_bootstrap.cc:492] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:06.435192 1198 ts_tablet_manager.cc:1403] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.003s
I20260616 19:52:06.436116 1198 raft_consensus.cc:359] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.436391 1198 raft_consensus.cc:385] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.436525 1198 raft_consensus.cc:740] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.436795 1198 consensus_queue.cc:260] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.441813 1196 tablet_bootstrap.cc:492] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:06.443531 1196 tablet_bootstrap.cc:654] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.443815 1198 ts_tablet_manager.cc:1434] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260616 19:52:06.444137 1198 tablet_bootstrap.cc:492] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:06.445875 1198 tablet_bootstrap.cc:654] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.452669 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9446df9472e34ac79ec24cce89e3f5e5
I20260616 19:52:06.453225 458 catalog_manager.cc:6784] ReplaceTablet: tablet 9446df9472e34ac79ec24cce89e3f5e5 deleted and replaced by tablet 099199fa60b94308acb423f04d988f65
I20260616 19:52:06.453557 2094 tablet.cc:1724] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:06.453585 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d82de7981eb34e10866c36d2414328af" } modify_external_catalogs: true
I20260616 19:52:06.453797 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d82de7981eb34e10866c36d2414328af" } modify_external_catalogs: true
I20260616 19:52:06.454617 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 46faf1477a4b4c9994e556308647cad3 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:06.455722 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet cf136fa86c264f69a1703596cfd0e77a
I20260616 19:52:06.456136 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 9446df9472e34ac79ec24cce89e3f5e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 099199fa60b94308acb423f04d988f65) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.458104 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 9446df9472e34ac79ec24cce89e3f5e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 099199fa60b94308acb423f04d988f65) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.459271 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet cf136fa86c264f69a1703596cfd0e77a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.459980 757 tablet_service.cc:1558] Processing DeleteTablet for tablet cf136fa86c264f69a1703596cfd0e77a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.461630 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 9446df9472e34ac79ec24cce89e3f5e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 099199fa60b94308acb423f04d988f65) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.461805 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_395859028237411ba660f017c299cccf" } modify_external_catalogs: true
I20260616 19:52:06.461858 903 tablet_service.cc:1558] Processing DeleteTablet for tablet cf136fa86c264f69a1703596cfd0e77a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.461971 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_395859028237411ba660f017c299cccf" } modify_external_catalogs: true
I20260616 19:52:06.464349 1198 tablet_bootstrap.cc:492] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:06.464483 1198 ts_tablet_manager.cc:1403] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.002s
I20260616 19:52:06.465217 1198 raft_consensus.cc:359] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.465370 1198 raft_consensus.cc:385] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.465432 1198 raft_consensus.cc:740] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.465648 1198 consensus_queue.cc:260] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.465701 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5e42f2150dc84948b1f40371bee61202" } modify_external_catalogs: true
I20260616 19:52:06.465839 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5e42f2150dc84948b1f40371bee61202" } modify_external_catalogs: true
I20260616 19:52:06.466463 1198 ts_tablet_manager.cc:1434] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:06.466817 2092 tablet.cc:1724] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:06.470788 1190 ts_tablet_manager.cc:1929] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:06.470929 1190 log.cc:1199] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/1d368ec65b624ea58f7b750097a78ede
I20260616 19:52:06.471220 1190 ts_tablet_manager.cc:1950] T 1d368ec65b624ea58f7b750097a78ede P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:06.472318 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f53395a2b4ee42de9731707666f67440" } new_table_name: "default.Table_66792088ec464b908e89adc40f729a2e" modify_external_catalogs: true
W20260616 19:52:06.474556 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 47616.9us
I20260616 19:52:06.477643 1198 tablet_bootstrap.cc:492] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:06.479239 1198 tablet_bootstrap.cc:654] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.491062 1996 raft_consensus.cc:493] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.491221 1996 raft_consensus.cc:515] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.491273 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 1bc181171b134de2b946376f468aec72 (table default.Table_daf95e025c454ee1b78a61861cc1a23d [id=625dfecea84f40369353e2b7a6408e01]) successfully deleted
I20260616 19:52:06.491389 1191 tablet_replica.cc:333] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:06.491597 1191 raft_consensus.cc:2243] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:06.491750 1191 raft_consensus.cc:2272] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:06.491948 1996 leader_election.cc:290] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:06.492450 1191 ts_tablet_manager.cc:1916] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:06.492789 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb308b05bb04bc18ccaa9550a73d3e7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:06.493774 996 leader_election.cc:343] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.503352 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_db04f07eeb1544ec9a5b538d6cbd0a44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.503957 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db04f07eeb1544ec9a5b538d6cbd0a44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.504861 1198 tablet_bootstrap.cc:492] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:06.504990 1198 ts_tablet_manager.cc:1403] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.001s
I20260616 19:52:06.505787 1198 raft_consensus.cc:359] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.505947 1198 raft_consensus.cc:385] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.506006 1198 raft_consensus.cc:740] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.506191 1198 consensus_queue.cc:260] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.506695 1198 ts_tablet_manager.cc:1434] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:06.506958 1198 tablet_bootstrap.cc:492] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:06.509105 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3536b19bb5a945fe82c917a32a72747f" } new_table_name: "default.Table_1c49293ffd514b55954730a8880aab95" modify_external_catalogs: true
I20260616 19:52:06.511041 1198 tablet_bootstrap.cc:654] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.511960 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 642) took 2956 ms. Trace:
I20260616 19:52:06.512123 1190 rpcz_store.cc:276] 0616 19:52:03.555956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.556012 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:06.317040 (+2761028us) ts_tablet_manager.cc:1151] Deleting tablet 1d368ec65b624ea58f7b750097a78ede
0616 19:52:06.317052 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:06.397594 (+ 80542us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:06.470729 (+ 73135us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:06.511942 (+ 41213us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2760799}
I20260616 19:52:06.514827 1193 ts_tablet_manager.cc:1929] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:06.515439 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 1d368ec65b624ea58f7b750097a78ede (table default.Table_e2ea805b6664428787f4a70953fd22ea [id=0745df538b5e4be8b0ba20653abe53ae]) successfully deleted
I20260616 19:52:06.515950 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 643) took 2957 ms. Trace:
I20260616 19:52:06.516361 1190 rpcz_store.cc:276] 0616 19:52:03.558980 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.559026 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:06.515831 (+2956805us) ts_tablet_manager.cc:1151] Deleting tablet d4a2855b7dec4244a3fc52bdca7e7eb3
0616 19:52:06.515842 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:06.515932 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2956609}
I20260616 19:52:06.516637 2092 tablet.cc:1719] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2: Skipping requested alter to schema version 2, tablet already version 2
W20260616 19:52:06.517823 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d4a2855b7dec4244a3fc52bdca7e7eb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4a2855b7dec4244a3fc52bdca7e7eb3 already in progress: creating tablet
I20260616 19:52:06.518338 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 644) took 2949 ms. Trace:
W20260616 19:52:06.525382 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7c3e760d24247a5bc2b17a610ff49dc consensus state has no leader
I20260616 19:52:06.525818 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6b3560adb98443f2a64f79a3aa726779"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.530536 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b3560adb98443f2a64f79a3aa726779 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.530476 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_17aa3c8fef1e4aa4bcb957c7bda0c998"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.532786 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db750fc9641f492494fdb167de86f6df consensus state has no leader
I20260616 19:52:06.533174 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3c660a1e37484c9280b63eefa94e2a5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.533670 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c660a1e37484c9280b63eefa94e2a5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:06.534796 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17aa3c8fef1e4aa4bcb957c7bda0c998 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.536541 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bfea1b0367de4297b1a424da79faa638" } new_table_name: "default.Table_320b1c835f2741be8cf8c2cbca4d5611" modify_external_catalogs: true
I20260616 19:52:06.540591 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d6da0ac7a7c74b1895935478a9ad982a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.541109 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6da0ac7a7c74b1895935478a9ad982a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:06.553179 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a9e8877705840329d6a063bb5194965 has no consensus state
I20260616 19:52:06.554384 455 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 1d62405248304339a03b01bc28238b8b (table default.Table_67f7ca211f5c4bd2b52bedf6e8882673 [id=26e971fd00814ec89e4b45ad7544739b]). Expected version 2 got 0
I20260616 19:52:06.473143 2076 tablet.cc:1724] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:06.555104 452 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 1d62405248304339a03b01bc28238b8b (table default.Table_67f7ca211f5c4bd2b52bedf6e8882673 [id=26e971fd00814ec89e4b45ad7544739b]). Expected version 2 got 0
I20260616 19:52:06.495016 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb308b05bb04bc18ccaa9550a73d3e7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:06.555621 993 leader_election.cc:343] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.555737 993 leader_election.cc:304] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:06.556087 1996 raft_consensus.cc:2749] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:06.471858 1192 tablet_bootstrap.cc:654] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:06.526836 858 consensus_peers.cc:597] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15d6a025b9a248c5ab9422fe1c340f3e. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:06.517720 2094 tablet.cc:1719] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767: Skipping requested alter to schema version 2, tablet already version 2
I20260616 19:52:06.551129 1801 raft_consensus.cc:493] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.558683 1801 raft_consensus.cc:515] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.559449 1801 leader_election.cc:290] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:06.559473 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]). Expected version 2 got 0
I20260616 19:52:06.560194 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b34d497f9334e94b06cc9245fca04ed" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:06.560817 860 leader_election.cc:343] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.532740 1196 tablet_bootstrap.cc:492] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:06.550141 782 raft_consensus.cc:3060] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:06.563009 903 tablet_service.cc:1511] Processing CreateTablet for tablet fd7a70654d8e46fba2bd837a64af9064 (DEFAULT_TABLE table=default.Table_6ef1c5dde9574dd0abbeab5e4fa9586d [id=158e0dc494c445998204392d25e5ad71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.563786 1022 tablet_service.cc:1511] Processing CreateTablet for tablet fd7a70654d8e46fba2bd837a64af9064 (DEFAULT_TABLE table=default.Table_6ef1c5dde9574dd0abbeab5e4fa9586d [id=158e0dc494c445998204392d25e5ad71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.564069 892 tablet_service.cc:1511] Processing CreateTablet for tablet 25e12ce6f3cc4ee1924c061b71ae2bf3 (DEFAULT_TABLE table=default.Table_0a5aa20660b44678bdc1f462591bcf31 [id=ccd54fa80f4c4e8e8597c5b7263a15b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.564157 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7a70654d8e46fba2bd837a64af9064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.566567 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]). Expected version 2 got 0
I20260616 19:52:06.567682 1801 consensus_queue.cc:1048] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:06.567914 1196 ts_tablet_manager.cc:1403] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.126s user 0.002s sys 0.005s
I20260616 19:52:06.569224 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 25e12ce6f3cc4ee1924c061b71ae2bf3 (DEFAULT_TABLE table=default.Table_0a5aa20660b44678bdc1f462591bcf31 [id=ccd54fa80f4c4e8e8597c5b7263a15b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.569569 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e12ce6f3cc4ee1924c061b71ae2bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.569716 1196 raft_consensus.cc:359] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.569998 1196 raft_consensus.cc:385] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.570123 1196 raft_consensus.cc:740] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.570535 1196 consensus_queue.cc:260] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.571779 1196 ts_tablet_manager.cc:1434] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260616 19:52:06.572357 1196 tablet_bootstrap.cc:492] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:06.574793 757 tablet_service.cc:1511] Processing CreateTablet for tablet fd7a70654d8e46fba2bd837a64af9064 (DEFAULT_TABLE table=default.Table_6ef1c5dde9574dd0abbeab5e4fa9586d [id=158e0dc494c445998204392d25e5ad71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.575142 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7a70654d8e46fba2bd837a64af9064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.575066 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_45398de6fee946e390fc0b5b3e6abefd" } new_table_name: "default.Table_7e15421b63b144ea9b56c923da2da910" modify_external_catalogs: true
I20260616 19:52:06.555011 1190 rpcz_store.cc:276] 0616 19:52:03.568745 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.571310 (+ 2565us) service_pool.cc:224] Handling call
0616 19:52:06.518234 (+2946924us) ts_tablet_manager.cc:1151] Deleting tablet daf86e5d5f2341c78705f78c02695c17
0616 19:52:06.518243 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:06.518322 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2924183}
W20260616 19:52:06.575632 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet daf86e5d5f2341c78705f78c02695c17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daf86e5d5f2341c78705f78c02695c17 already in progress: creating tablet
I20260616 19:52:06.576225 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 645) took 2862 ms. Trace:
I20260616 19:52:06.576362 1190 rpcz_store.cc:276] 0616 19:52:03.713416 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.713467 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:06.575969 (+2862502us) ts_tablet_manager.cc:1151] Deleting tablet 7e7f55f5946043108153b4c452a3d961
0616 19:52:06.575980 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:06.576174 (+ 194us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2854093}
I20260616 19:52:06.576870 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e7113aa5e6074bba96617bb94cd588a2" } new_table_name: "default.Table_3afcb15aef0649c4953a07a0d5b2cb34" modify_external_catalogs: true
W20260616 19:52:06.576989 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 7e7f55f5946043108153b4c452a3d961 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e7f55f5946043108153b4c452a3d961 already in progress: creating tablet
I20260616 19:52:06.577481 1193 log.cc:1199] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/10fc1d2ecaa746bab980a708dd8eb93a
I20260616 19:52:06.577822 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 646) took 2816 ms. Trace:
I20260616 19:52:06.578107 1190 rpcz_store.cc:276] 0616 19:52:03.761392 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.761450 (+ 58us) service_pool.cc:224] Handling call
0616 19:52:06.577404 (+2815954us) ts_tablet_manager.cc:1151] Deleting tablet ea0a7f80c5a34dbfabce579b6f574f93
0616 19:52:06.577415 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:06.577700 (+ 285us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2815658}
W20260616 19:52:06.579861 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet ea0a7f80c5a34dbfabce579b6f574f93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea0a7f80c5a34dbfabce579b6f574f93 already in progress: creating tablet
I20260616 19:52:06.580397 900 tablet_service.cc:1511] Processing CreateTablet for tablet c37aeb69afa040eeb9db1f8bdc60bb99 (DEFAULT_TABLE table=default.Table_5ce6fd6946e0465e8cb64119f4882a7c [id=6a949b769989407c9c53da73c05c7ced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.580729 753 tablet_service.cc:1511] Processing CreateTablet for tablet 25e12ce6f3cc4ee1924c061b71ae2bf3 (DEFAULT_TABLE table=default.Table_0a5aa20660b44678bdc1f462591bcf31 [id=ccd54fa80f4c4e8e8597c5b7263a15b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.581043 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e12ce6f3cc4ee1924c061b71ae2bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.581698 898 tablet_service.cc:1511] Processing CreateTablet for tablet c30900c999934b17bab83a54944e4ddf (DEFAULT_TABLE table=default.Table_5e42f2150dc84948b1f40371bee61202 [id=e6a7727c8b1c49febd458781244defca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.582588 895 tablet_service.cc:1511] Processing CreateTablet for tablet a80ac3c00f4042ce94e61d51cdcca2b5 (DEFAULT_TABLE table=default.Table_1e12d129fff34ad8a4ab1f3d33c356b2 [id=44ab3bb35e1e45adaf48aebf596a6543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.585426 750 tablet_service.cc:1511] Processing CreateTablet for tablet c37aeb69afa040eeb9db1f8bdc60bb99 (DEFAULT_TABLE table=default.Table_5ce6fd6946e0465e8cb64119f4882a7c [id=6a949b769989407c9c53da73c05c7ced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.585762 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37aeb69afa040eeb9db1f8bdc60bb99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.586575 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0d8b9d6b95a74dbe97461b4bc9984fe3
I20260616 19:52:06.586699 752 tablet_service.cc:1511] Processing CreateTablet for tablet fdb74517ce5443a8bfea100ca364db1d (DEFAULT_TABLE table=default.Table_72c384e8d0904f978c889c73573b63d3 [id=b3350a34135f43eab426417fb93c163b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.587018 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb74517ce5443a8bfea100ca364db1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.587307 765 tablet_service.cc:1511] Processing CreateTablet for tablet 9a77f8c5c40e4892831cb8af6c305c62 (DEFAULT_TABLE table=default.Table_f5b9a0c493de47c389206c834de0c093 [id=a1148a2fb64040939a056107f27553ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.587698 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a77f8c5c40e4892831cb8af6c305c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.589079 760 tablet_service.cc:1511] Processing CreateTablet for tablet c30900c999934b17bab83a54944e4ddf (DEFAULT_TABLE table=default.Table_5e42f2150dc84948b1f40371bee61202 [id=e6a7727c8b1c49febd458781244defca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.589346 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c30900c999934b17bab83a54944e4ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.592692 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 613c869d4ac84ee0aa952718ba74917b
I20260616 19:52:06.592710 762 tablet_service.cc:1511] Processing CreateTablet for tablet a80ac3c00f4042ce94e61d51cdcca2b5 (DEFAULT_TABLE table=default.Table_1e12d129fff34ad8a4ab1f3d33c356b2 [id=44ab3bb35e1e45adaf48aebf596a6543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.592980 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80ac3c00f4042ce94e61d51cdcca2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.593420 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c30900c999934b17bab83a54944e4ddf
I20260616 19:52:06.594259 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2171eb55560f44dd91ad52e0b5b49408
I20260616 19:52:06.595700 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 613c869d4ac84ee0aa952718ba74917b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.596426 751 tablet_service.cc:1558] Processing DeleteTablet for tablet c30900c999934b17bab83a54944e4ddf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.596701 763 tablet_service.cc:1511] Processing CreateTablet for tablet cce749336e6146dda490587b01e071f0 (DEFAULT_TABLE table=default.Table_5bdf4f6d0abf4415bd063f13e2c112e1 [id=e4e01c9c3f724879aa5e2562de6f8411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.596858 886 tablet_service.cc:1511] Processing CreateTablet for tablet cce749336e6146dda490587b01e071f0 (DEFAULT_TABLE table=default.Table_5bdf4f6d0abf4415bd063f13e2c112e1 [id=e4e01c9c3f724879aa5e2562de6f8411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.596925 455 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_91e28eb3cfb5400482186bbd63f63ff7 [id=c7d1624942fb42aa95ad085062052262] alter complete (version 3)
I20260616 19:52:06.597009 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce749336e6146dda490587b01e071f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.597343 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:06.597743 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00ba17a832dc4eb2a672d1eb246dd5b3 consensus state has no leader
I20260616 19:52:06.598728 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 2171eb55560f44dd91ad52e0b5b49408 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.598977 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.600152 752 tablet_service.cc:1558] Processing DeleteTablet for tablet a170db3d27fd40c1b74deab29e9a033f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.600795 893 tablet_service.cc:1511] Processing CreateTablet for tablet 9a77f8c5c40e4892831cb8af6c305c62 (DEFAULT_TABLE table=default.Table_f5b9a0c493de47c389206c834de0c093 [id=a1148a2fb64040939a056107f27553ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.601171 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 613c869d4ac84ee0aa952718ba74917b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.601043 459 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_67f7ca211f5c4bd2b52bedf6e8882673 [id=26e971fd00814ec89e4b45ad7544739b] alter complete (version 2)
I20260616 19:52:06.601344 901 tablet_service.cc:1558] Processing DeleteTablet for tablet c30900c999934b17bab83a54944e4ddf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.601478 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 2171eb55560f44dd91ad52e0b5b49408 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:06.601765 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a889b7dea504e8192d1c81a79a975dd consensus state has no leader
I20260616 19:52:06.604089 904 tablet_service.cc:1511] Processing CreateTablet for tablet fdb74517ce5443a8bfea100ca364db1d (DEFAULT_TABLE table=default.Table_72c384e8d0904f978c889c73573b63d3 [id=b3350a34135f43eab426417fb93c163b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.605883 1193 ts_tablet_manager.cc:1950] T 10fc1d2ecaa746bab980a708dd8eb93a P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:06.607568 1021 tablet_service.cc:1511] Processing CreateTablet for tablet a80ac3c00f4042ce94e61d51cdcca2b5 (DEFAULT_TABLE table=default.Table_1e12d129fff34ad8a4ab1f3d33c356b2 [id=44ab3bb35e1e45adaf48aebf596a6543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.607963 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80ac3c00f4042ce94e61d51cdcca2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.607918 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 2171eb55560f44dd91ad52e0b5b49408 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.608201 1031 tablet_service.cc:1511] Processing CreateTablet for tablet c37aeb69afa040eeb9db1f8bdc60bb99 (DEFAULT_TABLE table=default.Table_5ce6fd6946e0465e8cb64119f4882a7c [id=6a949b769989407c9c53da73c05c7ced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.608202 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 5b34d497f9334e94b06cc9245fca04ed (table default.Table_7a777a2aa2cd44d1b7f9db66e8367a32 [id=6db44bdac0784e08b52a4db869edb3d3]). Expected version 1 got 0
I20260616 19:52:06.608572 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37aeb69afa040eeb9db1f8bdc60bb99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.608726 1025 tablet_service.cc:1511] Processing CreateTablet for tablet cce749336e6146dda490587b01e071f0 (DEFAULT_TABLE table=default.Table_5bdf4f6d0abf4415bd063f13e2c112e1 [id=e4e01c9c3f724879aa5e2562de6f8411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.609107 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce749336e6146dda490587b01e071f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.608366 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 647) took 2846 ms. Trace:
I20260616 19:52:06.610138 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc181171b134de2b946376f468aec72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.610585 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce749336e6146dda490587b01e071f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.610846 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37aeb69afa040eeb9db1f8bdc60bb99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.611891 1036 tablet_service.cc:1511] Processing CreateTablet for tablet c30900c999934b17bab83a54944e4ddf (DEFAULT_TABLE table=default.Table_5e42f2150dc84948b1f40371bee61202 [id=e6a7727c8b1c49febd458781244defca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.612190 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c30900c999934b17bab83a54944e4ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.614014 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80ac3c00f4042ce94e61d51cdcca2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.616714 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 9a77f8c5c40e4892831cb8af6c305c62 (DEFAULT_TABLE table=default.Table_f5b9a0c493de47c389206c834de0c093 [id=a1148a2fb64040939a056107f27553ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.616997 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a77f8c5c40e4892831cb8af6c305c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.617636 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c30900c999934b17bab83a54944e4ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.618284 765 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed5e591b7f74ade8414fb3675cfdde9 (DEFAULT_TABLE table=default.Table_832624f84ba445c8aeaad59da359a54d [id=733d95bdf0404ecba14a28bac6fe95f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.618634 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed5e591b7f74ade8414fb3675cfdde9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.619750 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.619956 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 613c869d4ac84ee0aa952718ba74917b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.620080 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet c30900c999934b17bab83a54944e4ddf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.620564 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet aa72e00b0a3a423f96bdd7abb6013810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.620831 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7a70654d8e46fba2bd837a64af9064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.620944 1996 raft_consensus.cc:493] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.621047 1996 raft_consensus.cc:515] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.621603 1996 leader_election.cc:290] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:06.621804 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb74517ce5443a8bfea100ca364db1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.624554 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a77f8c5c40e4892831cb8af6c305c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.624922 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e12ce6f3cc4ee1924c061b71ae2bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.625473 886 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed5e591b7f74ade8414fb3675cfdde9 (DEFAULT_TABLE table=default.Table_832624f84ba445c8aeaad59da359a54d [id=733d95bdf0404ecba14a28bac6fe95f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.625864 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed5e591b7f74ade8414fb3675cfdde9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.628757 1849 raft_consensus.cc:493] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.628882 1849 raft_consensus.cc:515] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.629415 1849 leader_election.cc:290] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:06.629518 1849 raft_consensus.cc:493] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.629595 1849 raft_consensus.cc:515] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.630002 1849 leader_election.cc:290] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:06.630208 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b34d497f9334e94b06cc9245fca04ed" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:06.630357 1060 raft_consensus.cc:2468] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:06.631178 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d80d9028184443da49623228259263d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:06.631606 752 tablet_service.cc:1511] Processing CreateTablet for tablet 150af2d5b0614adc8ae7a2bdac076a87 (DEFAULT_TABLE table=default.Table_2b676b8a786c46af8c7a3413082b686a [id=c7261f1640844a33bb6d6a869d3ae15e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.631989 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 150af2d5b0614adc8ae7a2bdac076a87. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:06.632233 993 leader_election.cc:343] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.632524 858 leader_election.cc:304] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:06.633190 1923 raft_consensus.cc:2804] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:06.633260 1923 raft_consensus.cc:493] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:06.633313 1923 raft_consensus.cc:3060] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:06.636456 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd6fa49eff4400ca40c722e18cea951" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:06.637635 777 raft_consensus.cc:3060] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:06.640369 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa72e00b0a3a423f96bdd7abb6013810" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:06.640884 752 tablet_service.cc:1511] Processing CreateTablet for tablet ad90d770dc9f4973b7cbbbe90f895646 (DEFAULT_TABLE table=default.Table_95dafd1b9c504c39a6ac9b0282d48afc [id=a639299e9ea84341b738fc6d8cfcb9e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.641227 1908 raft_consensus.cc:493] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.641297 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad90d770dc9f4973b7cbbbe90f895646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.641353 1908 raft_consensus.cc:515] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.641836 1923 raft_consensus.cc:515] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.642185 1908 leader_election.cc:290] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:06.642391 1923 leader_election.cc:290] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:06.642831 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a170db3d27fd40c1b74deab29e9a033f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:06.642987 924 raft_consensus.cc:2468] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:06.643337 718 leader_election.cc:304] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:06.643747 1908 raft_consensus.cc:2804] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:06.643823 1908 raft_consensus.cc:493] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:06.643903 1908 raft_consensus.cc:3060] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:06.644901 898 tablet_service.cc:1511] Processing CreateTablet for tablet 150af2d5b0614adc8ae7a2bdac076a87 (DEFAULT_TABLE table=default.Table_2b676b8a786c46af8c7a3413082b686a [id=c7261f1640844a33bb6d6a869d3ae15e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.645243 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 150af2d5b0614adc8ae7a2bdac076a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.646179 1908 raft_consensus.cc:515] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.647149 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a170db3d27fd40c1b74deab29e9a033f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:06.647286 924 raft_consensus.cc:3060] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:06.648146 765 tablet_service.cc:1511] Processing CreateTablet for tablet c438416106c547af9d4141b8ae7e5369 (DEFAULT_TABLE table=default.Table_b35cc83f4b7949c48cb314ef60302080 [id=1853ad4e15724a48a9442657380651f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.650219 924 raft_consensus.cc:2468] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:06.651265 895 tablet_service.cc:1511] Processing CreateTablet for tablet ad90d770dc9f4973b7cbbbe90f895646 (DEFAULT_TABLE table=default.Table_95dafd1b9c504c39a6ac9b0282d48afc [id=a639299e9ea84341b738fc6d8cfcb9e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.651600 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad90d770dc9f4973b7cbbbe90f895646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.651515 1801 consensus_queue.cc:1048] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:06.651556 893 tablet_service.cc:1511] Processing CreateTablet for tablet c438416106c547af9d4141b8ae7e5369 (DEFAULT_TABLE table=default.Table_b35cc83f4b7949c48cb314ef60302080 [id=1853ad4e15724a48a9442657380651f4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:06.651783 993 leader_election.cc:343] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.650566 718 leader_election.cc:304] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:06.651926 1801 consensus_queue.cc:1048] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:06.652014 993 leader_election.cc:343] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.652206 2056 raft_consensus.cc:2804] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:06.652316 2056 raft_consensus.cc:697] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:06.652598 2056 consensus_queue.cc:237] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.652896 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c438416106c547af9d4141b8ae7e5369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.653416 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c438416106c547af9d4141b8ae7e5369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.662519 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_63b3c20cbd1a4a0fa4d1ec335850d4a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.663208 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63b3c20cbd1a4a0fa4d1ec335850d4a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.666414 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_812254d7ada3439b99fc64f671dd62ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.666908 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_812254d7ada3439b99fc64f671dd62ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.666949 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_15f01a98a5844f30a111f3640753af1d" } modify_external_catalogs: true
I20260616 19:52:06.667140 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_15f01a98a5844f30a111f3640753af1d" } modify_external_catalogs: true
I20260616 19:52:06.668216 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d7bbc81ef86a48cf994293fb0c9dd2da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:06.668694 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bb94e65f654e4667a414a8ea104e7309"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:06.668692 1021 tablet_service.cc:1511] Processing CreateTablet for tablet ad90d770dc9f4973b7cbbbe90f895646 (DEFAULT_TABLE table=default.Table_95dafd1b9c504c39a6ac9b0282d48afc [id=a639299e9ea84341b738fc6d8cfcb9e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.669067 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a170db3d27fd40c1b74deab29e9a033f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:06.669091 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd6fa49eff4400ca40c722e18cea951" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:06.669164 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb94e65f654e4667a414a8ea104e7309 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.669257 1058 raft_consensus.cc:3060] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:06.668458 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed5e591b7f74ade8414fb3675cfdde9 (DEFAULT_TABLE table=default.Table_832624f84ba445c8aeaad59da359a54d [id=733d95bdf0404ecba14a28bac6fe95f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.669631 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d80d9028184443da49623228259263d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:06.669953 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa72e00b0a3a423f96bdd7abb6013810" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:06.670367 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7bbc81ef86a48cf994293fb0c9dd2da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.670773 1033 tablet_service.cc:1511] Processing CreateTablet for tablet c438416106c547af9d4141b8ae7e5369 (DEFAULT_TABLE table=default.Table_b35cc83f4b7949c48cb314ef60302080 [id=1853ad4e15724a48a9442657380651f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.671257 1027 tablet_service.cc:1511] Processing CreateTablet for tablet fdb74517ce5443a8bfea100ca364db1d (DEFAULT_TABLE table=default.Table_72c384e8d0904f978c889c73573b63d3 [id=b3350a34135f43eab426417fb93c163b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.671772 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 150af2d5b0614adc8ae7a2bdac076a87 (DEFAULT_TABLE table=default.Table_2b676b8a786c46af8c7a3413082b686a [id=c7261f1640844a33bb6d6a869d3ae15e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.672117 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a170db3d27fd40c1b74deab29e9a033f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:06.672101 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e9e55e0e0d1c4dd197f63a23ffe1f6cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:06.669088 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad90d770dc9f4973b7cbbbe90f895646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.673481 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed5e591b7f74ade8414fb3675cfdde9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.676632 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c438416106c547af9d4141b8ae7e5369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.680028 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d6707acac4ee4283b138fb44e4e82ce5
I20260616 19:52:06.680246 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb74517ce5443a8bfea100ca364db1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.680593 1193 tablet_replica.cc:333] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:06.680832 751 tablet_service.cc:1558] Processing DeleteTablet for tablet d6707acac4ee4283b138fb44e4e82ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.681210 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 10fc1d2ecaa746bab980a708dd8eb93a (table default.Table_61b32c8d9ca6461c8f3edd6bf27c79bc [id=8196a6bddad24186971f3213f68e4cfd]) successfully deleted
W20260616 19:52:06.683061 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9e55e0e0d1c4dd197f63a23ffe1f6cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.683934 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 150af2d5b0614adc8ae7a2bdac076a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.685084 898 tablet_service.cc:1558] Processing DeleteTablet for tablet d6707acac4ee4283b138fb44e4e82ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.687786 751 tablet_service.cc:1511] Processing CreateTablet for tablet aa989f24b81b4c148069d1d8176dad8b (DEFAULT_TABLE table=default.Table_67e9e36e50e4455fa01d01db4ab1e5aa [id=f4d1551ea20d4e0f943943d6b8c1b001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.690864 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa989f24b81b4c148069d1d8176dad8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.698333 898 tablet_service.cc:1511] Processing CreateTablet for tablet aa989f24b81b4c148069d1d8176dad8b (DEFAULT_TABLE table=default.Table_67e9e36e50e4455fa01d01db4ab1e5aa [id=f4d1551ea20d4e0f943943d6b8c1b001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.698760 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa989f24b81b4c148069d1d8176dad8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.700444 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b34d497f9334e94b06cc9245fca04ed" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:06.700644 777 raft_consensus.cc:3060] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:06.703202 751 tablet_service.cc:1511] Processing CreateTablet for tablet 261cb8d55cfb4f72acafe7ee84fd9d79 (DEFAULT_TABLE table=default.Table_a4961084e6774012ba8ba01c5037956d [id=70f2d7fa68764bdcb94cf16ff6b6b7dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.703718 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261cb8d55cfb4f72acafe7ee84fd9d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.704623 777 raft_consensus.cc:2468] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:06.705055 860 leader_election.cc:304] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:06.705307 1801 raft_consensus.cc:2804] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:06.705391 1801 raft_consensus.cc:697] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:06.705583 1801 consensus_queue.cc:237] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.707072 758 tablet_service.cc:1511] Processing CreateTablet for tablet 7f1657802a374b7e8da3c5c036b16274 (DEFAULT_TABLE table=default.Table_4c22afaade3c427bb128de3ad020da0a [id=5f505975c3304ee6bb6a385360ef3f0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.707412 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f1657802a374b7e8da3c5c036b16274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.708719 1024 tablet_service.cc:1511] Processing CreateTablet for tablet aa989f24b81b4c148069d1d8176dad8b (DEFAULT_TABLE table=default.Table_67e9e36e50e4455fa01d01db4ab1e5aa [id=f4d1551ea20d4e0f943943d6b8c1b001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.709172 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa989f24b81b4c148069d1d8176dad8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.710180 898 tablet_service.cc:1511] Processing CreateTablet for tablet 261cb8d55cfb4f72acafe7ee84fd9d79 (DEFAULT_TABLE table=default.Table_a4961084e6774012ba8ba01c5037956d [id=70f2d7fa68764bdcb94cf16ff6b6b7dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.710479 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261cb8d55cfb4f72acafe7ee84fd9d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.716719 895 tablet_service.cc:1511] Processing CreateTablet for tablet 7f1657802a374b7e8da3c5c036b16274 (DEFAULT_TABLE table=default.Table_4c22afaade3c427bb128de3ad020da0a [id=5f505975c3304ee6bb6a385360ef3f0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.717057 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f1657802a374b7e8da3c5c036b16274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.721781 751 tablet_service.cc:1511] Processing CreateTablet for tablet baf481c879644b7cb708c2d29aa1398d (DEFAULT_TABLE table=default.Table_2616b90e3ece41088782b3f8ad9e081a [id=5ec127caabc946fb9a51c30a3d6df2f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.722214 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf481c879644b7cb708c2d29aa1398d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:06.725708 996 leader_election.cc:343] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.725965 996 leader_election.cc:304] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:06.726261 1996 raft_consensus.cc:2749] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:06.726673 996 leader_election.cc:343] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.726840 996 leader_election.cc:304] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:06.727077 1996 raft_consensus.cc:2749] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:06.727451 996 leader_election.cc:343] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.727586 996 leader_election.cc:304] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:06.727810 1996 raft_consensus.cc:2749] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:06.728055 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_28f9c1cb3aa04a959b05b1cc91b14891" } new_table_name: "default.Table_5cfb44a1361b425cb452881659b21be2" modify_external_catalogs: true
I20260616 19:52:06.728658 895 tablet_service.cc:1511] Processing CreateTablet for tablet baf481c879644b7cb708c2d29aa1398d (DEFAULT_TABLE table=default.Table_2616b90e3ece41088782b3f8ad9e081a [id=5ec127caabc946fb9a51c30a3d6df2f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.733584 752 tablet_service.cc:1511] Processing CreateTablet for tablet f4095b92df9a422e85e38513e19eabc7 (DEFAULT_TABLE table=default.Table_b5ec74e27eec4acdb0c7bb63e4b0f610 [id=9eda4cfebe984185921c04e001bdc520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.734127 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4095b92df9a422e85e38513e19eabc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.735219 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf481c879644b7cb708c2d29aa1398d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:06.736840 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7cc0edadc1948ffbe15febbebb27b45 consensus state has no leader
I20260616 19:52:06.738256 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5d133f84e3184006a927183e55a5d2ed" } new_table_name: "default.Table_e81c4d57236048a894b29fda3bb1f845" modify_external_catalogs: true
I20260616 19:52:06.738749 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9ba363ec37354fccb7050c05449047d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.739248 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ba363ec37354fccb7050c05449047d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.739629 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a4c31ee1d10b4edabacedf66b29bc16b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.740057 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4c31ee1d10b4edabacedf66b29bc16b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.740100 1908 leader_election.cc:290] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:06.741540 893 tablet_service.cc:1511] Processing CreateTablet for tablet f4095b92df9a422e85e38513e19eabc7 (DEFAULT_TABLE table=default.Table_b5ec74e27eec4acdb0c7bb63e4b0f610 [id=9eda4cfebe984185921c04e001bdc520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.741991 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4095b92df9a422e85e38513e19eabc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.750142 1058 raft_consensus.cc:2468] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:06.751891 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_43afc983b9034c56bf7eb1cccf2c7e06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.752640 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43afc983b9034c56bf7eb1cccf2c7e06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:06.753808 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f176111bc2a7494da5e17986963a2c5c consensus state has no leader
I20260616 19:52:06.754041 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d0c4d2430280407e9ddf91a5e1ab4382"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.754601 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0c4d2430280407e9ddf91a5e1ab4382 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.755003 895 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8082b99233417a97046d2d1d3ef552 (DEFAULT_TABLE table=default.Table_c7617de287ff4770bb063b7ee633a61a [id=87238fcdc4114462bb14b2ca9fbc7438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.755656 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4be8f181fb634263aea92a56d3ca447d" } new_table_name: "default.Table_c94b80ec24544fa1a2d5ec562f2df384" modify_external_catalogs: true
I20260616 19:52:06.755399 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8082b99233417a97046d2d1d3ef552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.763372 904 tablet_service.cc:1511] Processing CreateTablet for tablet fea0e812d6e8484c9fc56478f89c1ebd (DEFAULT_TABLE table=default.Table_6ef350bba3a64c25ad0d77ff4fd442e8 [id=dae74e23c1704f0bbc64e2f3bf52c7db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.763720 2076 tablet.cc:1719] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e: Skipping requested alter to schema version 2, tablet already version 2
I20260616 19:52:06.763914 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea0e812d6e8484c9fc56478f89c1ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.764660 886 tablet_service.cc:1511] Processing CreateTablet for tablet 6c227e5c37c54323bc5e1338dbc9fd33 (DEFAULT_TABLE table=default.Table_d6a8e83a5dbb456b8b6c3124c83771ea [id=935fa232f32d405ca9cc5e9ef1fb4d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.764977 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c227e5c37c54323bc5e1338dbc9fd33. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:06.772874 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2fab0e788ab74d2dae042e30b594e971 consensus state has no leader
I20260616 19:52:06.774060 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_741b674265134685a9c017247e4df71e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:06.775465 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8082b99233417a97046d2d1d3ef552 (DEFAULT_TABLE table=default.Table_c7617de287ff4770bb063b7ee633a61a [id=87238fcdc4114462bb14b2ca9fbc7438]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:06.775511 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_741b674265134685a9c017247e4df71e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.775862 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8082b99233417a97046d2d1d3ef552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.783169 1036 tablet_service.cc:1511] Processing CreateTablet for tablet baf481c879644b7cb708c2d29aa1398d (DEFAULT_TABLE table=default.Table_2616b90e3ece41088782b3f8ad9e081a [id=5ec127caabc946fb9a51c30a3d6df2f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.783512 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf481c879644b7cb708c2d29aa1398d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.787930 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 261cb8d55cfb4f72acafe7ee84fd9d79 (DEFAULT_TABLE table=default.Table_a4961084e6774012ba8ba01c5037956d [id=70f2d7fa68764bdcb94cf16ff6b6b7dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.788276 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261cb8d55cfb4f72acafe7ee84fd9d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.792537 751 tablet_service.cc:1511] Processing CreateTablet for tablet 6c227e5c37c54323bc5e1338dbc9fd33 (DEFAULT_TABLE table=default.Table_d6a8e83a5dbb456b8b6c3124c83771ea [id=935fa232f32d405ca9cc5e9ef1fb4d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.793083 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet d6707acac4ee4283b138fb44e4e82ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.793910 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c227e5c37c54323bc5e1338dbc9fd33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.795630 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 6c227e5c37c54323bc5e1338dbc9fd33 (DEFAULT_TABLE table=default.Table_d6a8e83a5dbb456b8b6c3124c83771ea [id=935fa232f32d405ca9cc5e9ef1fb4d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.796000 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c227e5c37c54323bc5e1338dbc9fd33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.796849 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5cfb44a1361b425cb452881659b21be2" } modify_external_catalogs: true
I20260616 19:52:06.797044 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5cfb44a1361b425cb452881659b21be2" } modify_external_catalogs: true
I20260616 19:52:06.799301 752 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd39dba6d6f4ff892bfd0ff462b74bd (DEFAULT_TABLE table=default.Table_57b175e9c4084995aa9e67705af7098e [id=8f0cc4b54e91416eb40167368916a173]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.799616 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd39dba6d6f4ff892bfd0ff462b74bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.800530 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4ab08a7ef94e463799cff8417484c512" } modify_external_catalogs: true
I20260616 19:52:06.800693 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4ab08a7ef94e463799cff8417484c512" } modify_external_catalogs: true
I20260616 19:52:06.800797 1032 tablet_service.cc:1511] Processing CreateTablet for tablet fea0e812d6e8484c9fc56478f89c1ebd (DEFAULT_TABLE table=default.Table_6ef350bba3a64c25ad0d77ff4fd442e8 [id=dae74e23c1704f0bbc64e2f3bf52c7db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.801115 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea0e812d6e8484c9fc56478f89c1ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.801167 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9ba363ec37354fccb7050c05449047d0" } modify_external_catalogs: true
I20260616 19:52:06.801333 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9ba363ec37354fccb7050c05449047d0" } modify_external_catalogs: true
I20260616 19:52:06.801476 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a4c31ee1d10b4edabacedf66b29bc16b" } new_table_name: "default.Table_d3a16a3fb0be4caabdf0f9e1685869c7" modify_external_catalogs: true
I20260616 19:52:06.805682 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 7f1657802a374b7e8da3c5c036b16274 (DEFAULT_TABLE table=default.Table_4c22afaade3c427bb128de3ad020da0a [id=5f505975c3304ee6bb6a385360ef3f0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.806072 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f1657802a374b7e8da3c5c036b16274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.807863 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_66792088ec464b908e89adc40f729a2e" } modify_external_catalogs: true
I20260616 19:52:06.808066 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_66792088ec464b908e89adc40f729a2e" } modify_external_catalogs: true
W20260616 19:52:06.807869 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34264036a635419fbc8f9e2c388a817b has no consensus state
I20260616 19:52:06.807876 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2b676b8a786c46af8c7a3413082b686a" } new_table_name: "default.Table_fb615e00d33b41198a66d343a4fc73d0" modify_external_catalogs: true
I20260616 19:52:06.811028 760 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8082b99233417a97046d2d1d3ef552 (DEFAULT_TABLE table=default.Table_c7617de287ff4770bb063b7ee633a61a [id=87238fcdc4114462bb14b2ca9fbc7438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.811456 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8082b99233417a97046d2d1d3ef552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.812178 750 tablet_service.cc:1511] Processing CreateTablet for tablet fea0e812d6e8484c9fc56478f89c1ebd (DEFAULT_TABLE table=default.Table_6ef350bba3a64c25ad0d77ff4fd442e8 [id=dae74e23c1704f0bbc64e2f3bf52c7db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.812260 1022 tablet_service.cc:1511] Processing CreateTablet for tablet f4095b92df9a422e85e38513e19eabc7 (DEFAULT_TABLE table=default.Table_b5ec74e27eec4acdb0c7bb63e4b0f610 [id=9eda4cfebe984185921c04e001bdc520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.812697 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4095b92df9a422e85e38513e19eabc7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:06.814289 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 150af2d5b0614adc8ae7a2bdac076a87 consensus state has no leader
I20260616 19:52:06.814574 1801 raft_consensus.cc:493] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.814754 1801 raft_consensus.cc:515] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.814955 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea0e812d6e8484c9fc56478f89c1ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.815831 1801 leader_election.cc:290] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:06.815891 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e4e52fae124d4085b15e143e98a7e4" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:06.816376 860 leader_election.cc:343] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.816768 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd39dba6d6f4ff892bfd0ff462b74bd (DEFAULT_TABLE table=default.Table_57b175e9c4084995aa9e67705af7098e [id=8f0cc4b54e91416eb40167368916a173]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.817119 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd39dba6d6f4ff892bfd0ff462b74bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.831310 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 26b044bb36c84f64a32c774515a339c4
I20260616 19:52:06.832261 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 26b044bb36c84f64a32c774515a339c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.832374 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 26b044bb36c84f64a32c774515a339c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.832504 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 26b044bb36c84f64a32c774515a339c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.835729 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a7cc0edadc1948ffbe15febbebb27b45
I20260616 19:52:06.836521 895 tablet_service.cc:1558] Processing DeleteTablet for tablet a7cc0edadc1948ffbe15febbebb27b45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:06.836643 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 150af2d5b0614adc8ae7a2bdac076a87 (table default.Table_fb615e00d33b41198a66d343a4fc73d0 [id=c7261f1640844a33bb6d6a869d3ae15e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 150af2d5b0614adc8ae7a2bdac076a87 consensus state has no leader
I20260616 19:52:06.836721 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet a7cc0edadc1948ffbe15febbebb27b45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.837306 752 tablet_service.cc:1558] Processing DeleteTablet for tablet a7cc0edadc1948ffbe15febbebb27b45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.837724 1198 tablet_bootstrap.cc:492] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:06.837862 1198 ts_tablet_manager.cc:1403] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.331s user 0.007s sys 0.010s
I20260616 19:52:06.838677 1198 raft_consensus.cc:359] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.838856 1198 raft_consensus.cc:385] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.838925 1198 raft_consensus.cc:740] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.839125 1198 consensus_queue.cc:260] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.839633 1198 ts_tablet_manager.cc:1434] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:06.839982 751 tablet_service.cc:1511] Processing CreateTablet for tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7 (DEFAULT_TABLE table=default.Table_9ba363ec37354fccb7050c05449047d0 [id=fb05a1d76fbc479bab686db3d418c674]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.840358 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.843137 752 tablet_service.cc:1511] Processing CreateTablet for tablet 70f9487ce7f04264aff3d1895c05eb74 (DEFAULT_TABLE table=default.Table_812254d7ada3439b99fc64f671dd62ca [id=a14584b48dc342c4bf1f6fbadf141de8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.843531 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f9487ce7f04264aff3d1895c05eb74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.844900 1027 tablet_service.cc:1511] Processing CreateTablet for tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7 (DEFAULT_TABLE table=default.Table_9ba363ec37354fccb7050c05449047d0 [id=fb05a1d76fbc479bab686db3d418c674]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.845026 762 tablet_service.cc:1511] Processing CreateTablet for tablet e1b0f84293134dc1baafaefc0a03236c (DEFAULT_TABLE table=default.Table_d6da0ac7a7c74b1895935478a9ad982a [id=f73c23fd88fb4b8eaa3adbea3ddf5bb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.845317 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b0f84293134dc1baafaefc0a03236c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.845764 895 tablet_service.cc:1511] Processing CreateTablet for tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7 (DEFAULT_TABLE table=default.Table_9ba363ec37354fccb7050c05449047d0 [id=fb05a1d76fbc479bab686db3d418c674]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.846150 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.847792 753 tablet_service.cc:1511] Processing CreateTablet for tablet a935e1df16dd4ceabb270cfeb75c9fb2 (DEFAULT_TABLE table=default.Table_17aa3c8fef1e4aa4bcb957c7bda0c998 [id=c2e82114a2624e82912acf05567223be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.848095 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a935e1df16dd4ceabb270cfeb75c9fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.848750 886 tablet_service.cc:1511] Processing CreateTablet for tablet 70f9487ce7f04264aff3d1895c05eb74 (DEFAULT_TABLE table=default.Table_812254d7ada3439b99fc64f671dd62ca [id=a14584b48dc342c4bf1f6fbadf141de8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.848573 1025 tablet_service.cc:1511] Processing CreateTablet for tablet e1b0f84293134dc1baafaefc0a03236c (DEFAULT_TABLE table=default.Table_d6da0ac7a7c74b1895935478a9ad982a [id=f73c23fd88fb4b8eaa3adbea3ddf5bb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.849090 893 tablet_service.cc:1511] Processing CreateTablet for tablet e1b0f84293134dc1baafaefc0a03236c (DEFAULT_TABLE table=default.Table_d6da0ac7a7c74b1895935478a9ad982a [id=f73c23fd88fb4b8eaa3adbea3ddf5bb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.849086 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f9487ce7f04264aff3d1895c05eb74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.849627 903 tablet_service.cc:1511] Processing CreateTablet for tablet a935e1df16dd4ceabb270cfeb75c9fb2 (DEFAULT_TABLE table=default.Table_17aa3c8fef1e4aa4bcb957c7bda0c998 [id=c2e82114a2624e82912acf05567223be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.849972 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a935e1df16dd4ceabb270cfeb75c9fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.852375 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7
I20260616 19:52:06.852381 763 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcb0b9fbab1448e8f678e3197010b78 (DEFAULT_TABLE table=default.Table_3c660a1e37484c9280b63eefa94e2a5a [id=e7cb0d705a7241209b2bf35157b185c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.852569 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b0f84293134dc1baafaefc0a03236c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.852764 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcb0b9fbab1448e8f678e3197010b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.854849 1198 tablet_bootstrap.cc:492] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:06.856573 900 tablet_service.cc:1558] Processing DeleteTablet for tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.857204 892 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcb0b9fbab1448e8f678e3197010b78 (DEFAULT_TABLE table=default.Table_3c660a1e37484c9280b63eefa94e2a5a [id=e7cb0d705a7241209b2bf35157b185c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.857509 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcb0b9fbab1448e8f678e3197010b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.857465 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 70f9487ce7f04264aff3d1895c05eb74 (DEFAULT_TABLE table=default.Table_812254d7ada3439b99fc64f671dd62ca [id=a14584b48dc342c4bf1f6fbadf141de8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.861198 765 tablet_service.cc:1511] Processing CreateTablet for tablet 17295c1cb8b04b30bae1f6b194e68681 (DEFAULT_TABLE table=default.Table_09b7966d2cdd415e871a77b0225b23ef [id=31b5d76baf0c4cc9b59dc723504ca7eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.861363 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b0f84293134dc1baafaefc0a03236c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.861577 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17295c1cb8b04b30bae1f6b194e68681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.864992 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f9487ce7f04264aff3d1895c05eb74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.867095 903 tablet_service.cc:1511] Processing CreateTablet for tablet 17295c1cb8b04b30bae1f6b194e68681 (DEFAULT_TABLE table=default.Table_09b7966d2cdd415e871a77b0225b23ef [id=31b5d76baf0c4cc9b59dc723504ca7eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.867388 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17295c1cb8b04b30bae1f6b194e68681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.868324 1198 tablet_bootstrap.cc:654] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.869270 758 tablet_service.cc:1511] Processing CreateTablet for tablet 14a234e4e45f4b68be478bd4fe409225 (DEFAULT_TABLE table=default.Table_56f10142b9c14500b0b99c646a62cf9d [id=6f41b7e4ed9f4c8eb8f1e070576d2a44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.869601 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a234e4e45f4b68be478bd4fe409225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.869843 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d7c3e760d24247a5bc2b17a610ff49dc
I20260616 19:52:06.869962 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.871038 892 tablet_service.cc:1558] Processing DeleteTablet for tablet d7c3e760d24247a5bc2b17a610ff49dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.871294 757 tablet_service.cc:1558] Processing DeleteTablet for tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.871652 1033 tablet_service.cc:1511] Processing CreateTablet for tablet a935e1df16dd4ceabb270cfeb75c9fb2 (DEFAULT_TABLE table=default.Table_17aa3c8fef1e4aa4bcb957c7bda0c998 [id=c2e82114a2624e82912acf05567223be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.871985 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a935e1df16dd4ceabb270cfeb75c9fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.875660 757 tablet_service.cc:1558] Processing DeleteTablet for tablet d7c3e760d24247a5bc2b17a610ff49dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.878038 1996 raft_consensus.cc:493] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.878162 1996 raft_consensus.cc:515] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.878525 895 tablet_service.cc:1511] Processing CreateTablet for tablet 14a234e4e45f4b68be478bd4fe409225 (DEFAULT_TABLE table=default.Table_56f10142b9c14500b0b99c646a62cf9d [id=6f41b7e4ed9f4c8eb8f1e070576d2a44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.878782 1996 leader_election.cc:290] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:06.879060 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a234e4e45f4b68be478bd4fe409225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.879739 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be902fe29bb46a4bf71ee6384e6722a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:06.880481 993 leader_election.cc:343] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.610313 1190 rpcz_store.cc:276] 0616 19:52:03.761568 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.761616 (+ 48us) service_pool.cc:224] Handling call
0616 19:52:06.605965 (+2844349us) ts_tablet_manager.cc:1151] Deleting tablet bcc5116ef5df4140a96f03c003337c68
0616 19:52:06.606183 (+ 218us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:06.608063 (+ 1880us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2843538}
I20260616 19:52:06.880792 1996 raft_consensus.cc:493] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.880906 1996 raft_consensus.cc:515] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:06.881145 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet bcc5116ef5df4140a96f03c003337c68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcc5116ef5df4140a96f03c003337c68 already in progress: creating tablet
I20260616 19:52:06.881434 1190 tablet_replica.cc:333] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:06.881309 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f3cb6d6a4b17493eaecd974beddf55a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:06.881423 1996 leader_election.cc:290] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:06.881623 1190 raft_consensus.cc:2243] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:06.881729 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d270afd0c0f3457aa6dd14721dca261d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:06.881844 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3cb6d6a4b17493eaecd974beddf55a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.881867 1190 raft_consensus.cc:2272] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:06.882212 993 leader_election.cc:343] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.882422 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_826acb8b40cd4a23bfc7e5ee8e988006"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.882942 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_826acb8b40cd4a23bfc7e5ee8e988006 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.884441 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c2b44a48b8754af487aa042a8b651b52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:06.884963 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8b921aa9c61a4cf1baeea7ed881a484f" } modify_external_catalogs: true
I20260616 19:52:06.885162 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8b921aa9c61a4cf1baeea7ed881a484f" } modify_external_catalogs: true
W20260616 19:52:06.884971 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2b44a48b8754af487aa042a8b651b52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.887557 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a0a2f166e53c42be920e5837da2af9c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.888105 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0a2f166e53c42be920e5837da2af9c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.888830 1191 ts_tablet_manager.cc:1929] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:06.888934 1191 log.cc:1199] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/5ba2eefdfed14791b5a41decc34dce44
I20260616 19:52:06.889415 1191 ts_tablet_manager.cc:1950] T 5ba2eefdfed14791b5a41decc34dce44 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:06.889955 898 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd39dba6d6f4ff892bfd0ff462b74bd (DEFAULT_TABLE table=default.Table_57b175e9c4084995aa9e67705af7098e [id=8f0cc4b54e91416eb40167368916a173]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.890538 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd39dba6d6f4ff892bfd0ff462b74bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.892797 2056 raft_consensus.cc:493] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.892933 2056 raft_consensus.cc:515] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.893595 2056 leader_election.cc:290] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:06.894807 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be902fe29bb46a4bf71ee6384e6722a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:06.894953 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d270afd0c0f3457aa6dd14721dca261d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:06.895507 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.896075 1196 tablet_bootstrap.cc:700] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767: Time spent opening tablet: real 0.321s user 0.000s sys 0.000s
I20260616 19:52:06.896034 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcb0b9fbab1448e8f678e3197010b78 (DEFAULT_TABLE table=default.Table_3c660a1e37484c9280b63eefa94e2a5a [id=e7cb0d705a7241209b2bf35157b185c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.896373 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcb0b9fbab1448e8f678e3197010b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.896389 1196 tablet_bootstrap.cc:654] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:06.899968 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc181171b134de2b946376f468aec72" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:06.900528 718 leader_election.cc:343] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.900952 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b3ee96c545104d77b1ac2f90ab0b895e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.901470 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3ee96c545104d77b1ac2f90ab0b895e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.901742 1190 ts_tablet_manager.cc:1916] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:06.906569 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d522cc4b346241d1bac695f9a1d40fbb
I20260616 19:52:06.907408 892 tablet_service.cc:1558] Processing DeleteTablet for tablet d522cc4b346241d1bac695f9a1d40fbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:06.909351 751 tablet_service.cc:1558] Processing DeleteTablet for tablet d522cc4b346241d1bac695f9a1d40fbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:06.909578 892 tablet_service.cc:1511] Processing CreateTablet for tablet b6b9ff7a21d5448f9b1a20f5ac871a1c (DEFAULT_TABLE table=default.Table_a8e9b465f77e4975bd54ab7c5d117278 [id=ab6c8f812200434b8e1468177dd9e739]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.910018 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b9ff7a21d5448f9b1a20f5ac871a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.910075 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 17295c1cb8b04b30bae1f6b194e68681 (DEFAULT_TABLE table=default.Table_09b7966d2cdd415e871a77b0225b23ef [id=31b5d76baf0c4cc9b59dc723504ca7eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.910411 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17295c1cb8b04b30bae1f6b194e68681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.918951 752 tablet_service.cc:1511] Processing CreateTablet for tablet b6b9ff7a21d5448f9b1a20f5ac871a1c (DEFAULT_TABLE table=default.Table_a8e9b465f77e4975bd54ab7c5d117278 [id=ab6c8f812200434b8e1468177dd9e739]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.920923 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet d7c3e760d24247a5bc2b17a610ff49dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.921459 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 14a234e4e45f4b68be478bd4fe409225 (DEFAULT_TABLE table=default.Table_56f10142b9c14500b0b99c646a62cf9d [id=6f41b7e4ed9f4c8eb8f1e070576d2a44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.921833 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a234e4e45f4b68be478bd4fe409225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.922410 751 tablet_service.cc:1511] Processing CreateTablet for tablet cfbc5c9485b94928b6ae9a1f206c9c45 (DEFAULT_TABLE table=default.Table_0399a9b77bf7408fa8e519e25d79229a [id=71fbd30f057c45a28310758859cec208]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.923933 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b9ff7a21d5448f9b1a20f5ac871a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.924798 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbc5c9485b94928b6ae9a1f206c9c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.927845 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet d522cc4b346241d1bac695f9a1d40fbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.928270 1031 tablet_service.cc:1511] Processing CreateTablet for tablet b6b9ff7a21d5448f9b1a20f5ac871a1c (DEFAULT_TABLE table=default.Table_a8e9b465f77e4975bd54ab7c5d117278 [id=ab6c8f812200434b8e1468177dd9e739]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.928813 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b9ff7a21d5448f9b1a20f5ac871a1c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:06.929390 719 leader_election.cc:343] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 1bc181171b134de2b946376f468aec72
I20260616 19:52:06.929535 719 leader_election.cc:304] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:06.929898 2056 raft_consensus.cc:2749] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:06.932288 996 leader_election.cc:343] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.932507 996 leader_election.cc:304] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:06.932788 1996 raft_consensus.cc:2749] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:06.933178 996 leader_election.cc:343] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:06.934885 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 302355us
I20260616 19:52:06.935194 1996 raft_consensus.cc:493] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.935794 1996 raft_consensus.cc:515] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.936388 1996 leader_election.cc:290] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:06.935498 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b34d497f9334e94b06cc9245fca04ed" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:06.936620 1058 raft_consensus.cc:3060] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:06.938953 1058 raft_consensus.cc:2468] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:06.941843 971 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:52:06.946651 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df036f9d31ca4770bb00bc9cece46953" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:06.947453 860 consensus_peers.cc:597] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fdc6222db09d4cd987cbdf70e4d40f70. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:06.947930 993 leader_election.cc:343] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.950659 1192 tablet_bootstrap.cc:492] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:06.950875 1192 ts_tablet_manager.cc:1403] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.531s user 0.007s sys 0.005s
I20260616 19:52:06.951543 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_279bcff593544d69870123063bfb53b9" } new_table_name: "default.Table_db705d0c498b4a0ea5d58ef3ba508b30" modify_external_catalogs: true
I20260616 19:52:06.952378 1849 raft_consensus.cc:493] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:06.952520 1849 raft_consensus.cc:515] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:06.952514 1192 raft_consensus.cc:359] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.952659 1192 raft_consensus.cc:385] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:06.952706 1192 raft_consensus.cc:740] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:06.952862 1192 consensus_queue.cc:260] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:06.953106 1849 leader_election.cc:290] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:06.953476 750 tablet_service.cc:1511] Processing CreateTablet for tablet 966fabee5ae34c5da6a35d74caef244f (DEFAULT_TABLE table=default.Table_e69337994b154a11a55144b5ebf72a9f [id=cc2d8ff899244b25b39774a997a82465]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.953822 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966fabee5ae34c5da6a35d74caef244f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.956398 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2cbd7a4dd0864da7869f2c63357919ff" } new_table_name: "default.Table_47c7c784919540a4bda1aaf9cb6e3ab2" modify_external_catalogs: true
I20260616 19:52:06.956751 760 tablet_service.cc:1511] Processing CreateTablet for tablet 856ac4b8693941c7a19bb68f09ba1b73 (DEFAULT_TABLE table=default.Table_63bb1983029d46eeb2eff78065f24ca5 [id=d11d3d2e44f1487688eb9208b07eeb90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.957074 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856ac4b8693941c7a19bb68f09ba1b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.957443 893 tablet_service.cc:1511] Processing CreateTablet for tablet 856ac4b8693941c7a19bb68f09ba1b73 (DEFAULT_TABLE table=default.Table_63bb1983029d46eeb2eff78065f24ca5 [id=d11d3d2e44f1487688eb9208b07eeb90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.957748 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856ac4b8693941c7a19bb68f09ba1b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.957994 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_61c8c6e63044481d8029246da0b0537c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.958508 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61c8c6e63044481d8029246da0b0537c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.959421 904 tablet_service.cc:1511] Processing CreateTablet for tablet 966fabee5ae34c5da6a35d74caef244f (DEFAULT_TABLE table=default.Table_e69337994b154a11a55144b5ebf72a9f [id=cc2d8ff899244b25b39774a997a82465]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.959725 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966fabee5ae34c5da6a35d74caef244f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:06.961441 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf1ab0a125cf46e9a1afc625297db7af consensus state has no leader
I20260616 19:52:06.965814 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65b0dc43b40649f29037f40d2ea9247e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:06.966372 993 leader_election.cc:343] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:06.967267 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c5ecb50cf15042beaaefc878ab2172ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.967900 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5ecb50cf15042beaaefc878ab2172ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:06.971953 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 574927dc3a804b059e71630c133dcbea consensus state has no leader
I20260616 19:52:06.973822 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c2e1e7cdea7441a9908f57ba754d8696"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.974466 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2e1e7cdea7441a9908f57ba754d8696 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.975978 753 tablet_service.cc:1511] Processing CreateTablet for tablet d522cc4b346241d1bac695f9a1d40fbb (DEFAULT_TABLE table=default.Table_8b921aa9c61a4cf1baeea7ed881a484f [id=8acd3e7b80124255b8a2af407eb86b84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.976190 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cc60987ac3314143a7ef361f4c8e9a26" } new_table_name: "default.Table_6d962ea17ab14c7f93d302325434e697" modify_external_catalogs: true
I20260616 19:52:06.976392 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d522cc4b346241d1bac695f9a1d40fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.977597 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e58e0bf11d324917aa7b5d6553a4c3e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.978112 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e58e0bf11d324917aa7b5d6553a4c3e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.980082 903 tablet_service.cc:1511] Processing CreateTablet for tablet cfbc5c9485b94928b6ae9a1f206c9c45 (DEFAULT_TABLE table=default.Table_0399a9b77bf7408fa8e519e25d79229a [id=71fbd30f057c45a28310758859cec208]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.980564 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbc5c9485b94928b6ae9a1f206c9c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.982853 895 tablet_service.cc:1511] Processing CreateTablet for tablet d522cc4b346241d1bac695f9a1d40fbb (DEFAULT_TABLE table=default.Table_8b921aa9c61a4cf1baeea7ed881a484f [id=8acd3e7b80124255b8a2af407eb86b84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:06.983491 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d522cc4b346241d1bac695f9a1d40fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:06.988333 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0d0adaa9cacc40e38a992a15eccff3ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:06.988903 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d0adaa9cacc40e38a992a15eccff3ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:06.993932 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c35e4c8e9304e798c9031469877b70e with delete_type TABLET_DATA_DELETED (replaced by tablet b2e5e84b95c7429bb53dd616f118500a) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:06.998379 1801 consensus_queue.cc:1048] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:06.999425 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72850fb9855c48ba8540b2775055fbe5 consensus state has no leader
I20260616 19:52:07.002241 765 tablet_service.cc:1511] Processing CreateTablet for tablet 612c961eee254a749f82e803ffcf632d (DEFAULT_TABLE table=default.Table_63b3c20cbd1a4a0fa4d1ec335850d4a3 [id=524c6b82db4a4f7bbfab2420756398e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.002749 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 612c961eee254a749f82e803ffcf632d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.007472 1198 tablet_bootstrap.cc:492] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:07.007650 1198 ts_tablet_manager.cc:1403] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.153s user 0.003s sys 0.000s
I20260616 19:52:07.008167 1849 raft_consensus.cc:493] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.008306 1849 raft_consensus.cc:515] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:07.008823 1198 raft_consensus.cc:359] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:07.008996 1849 leader_election.cc:290] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:07.009701 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44493f0ffd064249a28628cf24895395" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:07.010380 993 leader_election.cc:343] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.009019 1198 raft_consensus.cc:385] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.010813 1198 raft_consensus.cc:740] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.010993 904 tablet_service.cc:1558] Processing DeleteTablet for tablet a170db3d27fd40c1b74deab29e9a033f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.011106 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9bdaebf159a743c09c4c8a5b3e57c61d" } new_table_name: "default.Table_06449d55572148c2ba81f10aac53e1da" modify_external_catalogs: true
I20260616 19:52:07.011188 1198 consensus_queue.cc:260] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:07.011718 1198 ts_tablet_manager.cc:1434] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260616 19:52:07.012509 1193 raft_consensus.cc:2243] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.012790 1193 pending_rounds.cc:70] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:07.012835 1193 pending_rounds.cc:77] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595497056350208 op_type: NO_OP noop_request { }
I20260616 19:52:07.012915 1193 raft_consensus.cc:2889] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:07.012995 1193 raft_consensus.cc:2272] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.014066 1193 ts_tablet_manager.cc:1916] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.019182 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fd335042e2c64bfa9299d235a674767a" } new_table_name: "default.Table_58b6a6df64fe459ab7a7abb175850554" modify_external_catalogs: true
I20260616 19:52:07.020738 1193 ts_tablet_manager.cc:1929] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:07.020910 1193 log.cc:1199] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/c44422ddb8ce45a48bb9aaeb6c209f21
I20260616 19:52:07.021411 1193 ts_tablet_manager.cc:1950] T c44422ddb8ce45a48bb9aaeb6c209f21 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:07.021798 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 741) took 1238 ms. Trace:
I20260616 19:52:07.021950 1193 rpcz_store.cc:276] 0616 19:52:05.783066 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.804498 (+ 21432us) service_pool.cc:224] Handling call
0616 19:52:06.680543 (+876045us) ts_tablet_manager.cc:1151] Deleting tablet c44422ddb8ce45a48bb9aaeb6c209f21
0616 19:52:06.680552 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.012713 (+332161us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x6160000a4e54. stack: 00007f140f1b8086 00007f140f1b7e40 00007f140e1713ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f141b1ec7e0 00007f141c538933 00007f141f0fbae7 00007f141f12ebb4 00007f141f10f5d0 00007f141f10f35d 0000000000aa681c 00007f140f1fdf6f 00007f140f20128b 00007f140f201108
0616 19:52:07.017250 (+ 4537us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.020687 (+ 3437us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.021782 (+ 1095us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762899200,"tablet-delete.queue_time_us":818395}
I20260616 19:52:07.022682 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet c44422ddb8ce45a48bb9aaeb6c209f21 (table default.Table_a70aca898ad449b481395f5ffc808a22 [id=ac53389fae904a0ea6ddcb9e82000d78]) successfully deleted
I20260616 19:52:07.023110 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 752) took 1197 ms. Trace:
I20260616 19:52:07.023257 1193 rpcz_store.cc:276] 0616 19:52:05.825222 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.854021 (+ 28799us) service_pool.cc:224] Handling call
0616 19:52:07.022985 (+1168964us) ts_tablet_manager.cc:1151] Deleting tablet 795c9643c1e84ddabc9130ef42d5c793
0616 19:52:07.022995 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.023093 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1119271}
W20260616 19:52:07.023775 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 795c9643c1e84ddabc9130ef42d5c793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 795c9643c1e84ddabc9130ef42d5c793 already in progress: creating tablet
W20260616 19:52:07.024296 860 consensus_peers.cc:597] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c44422ddb8ce45a48bb9aaeb6c209f21. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:07.024312 1193 tablet_replica.cc:333] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:07.024700 1193 raft_consensus.cc:2243] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.024968 1193 raft_consensus.cc:2272] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.027092 886 tablet_service.cc:1511] Processing CreateTablet for tablet 612c961eee254a749f82e803ffcf632d (DEFAULT_TABLE table=default.Table_63b3c20cbd1a4a0fa4d1ec335850d4a3 [id=524c6b82db4a4f7bbfab2420756398e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.027673 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 612c961eee254a749f82e803ffcf632d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.029050 904 tablet_service.cc:1511] Processing CreateTablet for tablet ebe069dd3e414b48b27769cd281b579d (DEFAULT_TABLE table=default.Table_d7bbc81ef86a48cf994293fb0c9dd2da [id=268509c99fcd41e4bb3ce619c49eae6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.029402 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe069dd3e414b48b27769cd281b579d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.030015 753 tablet_service.cc:1511] Processing CreateTablet for tablet 9614f1b2704749c1a4590303c7efc1d8 (DEFAULT_TABLE table=default.Table_bb94e65f654e4667a414a8ea104e7309 [id=00445be84f99437ea5b0a32c159634b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.030347 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9614f1b2704749c1a4590303c7efc1d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.036398 751 tablet_service.cc:1511] Processing CreateTablet for tablet ebe069dd3e414b48b27769cd281b579d (DEFAULT_TABLE table=default.Table_d7bbc81ef86a48cf994293fb0c9dd2da [id=268509c99fcd41e4bb3ce619c49eae6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.036480 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5993624d9698498986c80f02a4c7260b" } modify_external_catalogs: true
I20260616 19:52:07.036788 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5993624d9698498986c80f02a4c7260b" } modify_external_catalogs: true
I20260616 19:52:07.036909 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe069dd3e414b48b27769cd281b579d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.037804 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9bb35be45c3b476a94e956aa287bc3a0" } modify_external_catalogs: true
I20260616 19:52:07.037981 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9bb35be45c3b476a94e956aa287bc3a0" } modify_external_catalogs: true
I20260616 19:52:07.042069 1198 tablet_bootstrap.cc:492] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:07.043843 1198 tablet_bootstrap.cc:654] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.048913 996 leader_election.cc:304] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:07.049019 1908 raft_consensus.cc:493] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae28da1c4102450ab76eb2946a5cbf2e)
I20260616 19:52:07.049190 1908 raft_consensus.cc:515] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.049885 1849 raft_consensus.cc:2749] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:07.050091 1908 leader_election.cc:290] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:07.050809 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4adff6e41148b8b54e969ea2eb7a91" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:07.052321 1192 ts_tablet_manager.cc:1434] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.101s user 0.001s sys 0.000s
I20260616 19:52:07.054380 1196 tablet_bootstrap.cc:492] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:07.054523 1196 ts_tablet_manager.cc:1403] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.482s user 0.006s sys 0.000s
I20260616 19:52:07.055790 1193 ts_tablet_manager.cc:1916] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.057950 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b5ec74e27eec4acdb0c7bb63e4b0f610" } modify_external_catalogs: true
I20260616 19:52:07.058149 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b5ec74e27eec4acdb0c7bb63e4b0f610" } modify_external_catalogs: true
W20260616 19:52:07.060664 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df036f9d31ca4770bb00bc9cece46953 consensus state has no leader
I20260616 19:52:07.060801 752 tablet_service.cc:1511] Processing CreateTablet for tablet f5c56bc65793408d9a977880e1c054bc (DEFAULT_TABLE table=default.Table_f1a2ae364984415eb1a4e7caee67847d [id=b3f41e9ded304b6ea261d2987eae4b51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.061203 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c56bc65793408d9a977880e1c054bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.061455 892 tablet_service.cc:1511] Processing CreateTablet for tablet f5c56bc65793408d9a977880e1c054bc (DEFAULT_TABLE table=default.Table_f1a2ae364984415eb1a4e7caee67847d [id=b3f41e9ded304b6ea261d2987eae4b51]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:07.061857 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e2a3f93685146e9a7bf2713cc71dcb6 consensus state has no leader
I20260616 19:52:07.062008 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c56bc65793408d9a977880e1c054bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.065348 1192 tablet_bootstrap.cc:492] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:52:07.065618 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 132429us
I20260616 19:52:07.066104 1196 raft_consensus.cc:359] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.066437 1196 raft_consensus.cc:385] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.066550 1196 raft_consensus.cc:740] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.066794 1192 tablet_bootstrap.cc:654] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.067385 1196 consensus_queue.cc:260] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.068346 1196 ts_tablet_manager.cc:1434] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260616 19:52:07.068840 1196 tablet_bootstrap.cc:492] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:07.070631 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df036f9d31ca4770bb00bc9cece46953" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:07.070919 753 tablet_service.cc:1558] Processing DeleteTablet for tablet c44422ddb8ce45a48bb9aaeb6c209f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:53 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.076032 753 tablet_service.cc:1511] Processing CreateTablet for tablet 76a89e7686aa44df9bb017816d1accb1 (DEFAULT_TABLE table=default.Table_1a24c6f631b84d5a90cc8cc8d52361ab [id=9d89ab6cb63c45cc8583f4511407affe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.076357 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 6396397965c44e07850a6cc42cefab09
I20260616 19:52:07.076546 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a89e7686aa44df9bb017816d1accb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.077009 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 6396397965c44e07850a6cc42cefab09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.078507 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 272838af35d840faa7b11217456533c2
I20260616 19:52:07.079502 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 272838af35d840faa7b11217456533c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.080652 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8d997ea2bb3944d7a592a8aec76cb540" } modify_external_catalogs: true
I20260616 19:52:07.080857 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8d997ea2bb3944d7a592a8aec76cb540" } modify_external_catalogs: true
I20260616 19:52:07.085186 1849 raft_consensus.cc:493] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.085326 1849 raft_consensus.cc:515] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.085691 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 612c961eee254a749f82e803ffcf632d (DEFAULT_TABLE table=default.Table_63b3c20cbd1a4a0fa4d1ec335850d4a3 [id=524c6b82db4a4f7bbfab2420756398e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.085729 1032 tablet_service.cc:1511] Processing CreateTablet for tablet cfbc5c9485b94928b6ae9a1f206c9c45 (DEFAULT_TABLE table=default.Table_0399a9b77bf7408fa8e519e25d79229a [id=71fbd30f057c45a28310758859cec208]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.085987 1849 leader_election.cc:290] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:07.086663 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4adff6e41148b8b54e969ea2eb7a91" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:07.086925 1060 raft_consensus.cc:2468] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:07.089458 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 9060de590fa84ea08dc7d39765bc9308 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.089986 1024 tablet_service.cc:1511] Processing CreateTablet for tablet d522cc4b346241d1bac695f9a1d40fbb (DEFAULT_TABLE table=default.Table_8b921aa9c61a4cf1baeea7ed881a484f [id=8acd3e7b80124255b8a2af407eb86b84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.091394 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 966fabee5ae34c5da6a35d74caef244f (DEFAULT_TABLE table=default.Table_e69337994b154a11a55144b5ebf72a9f [id=cc2d8ff899244b25b39774a997a82465]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.091652 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 856ac4b8693941c7a19bb68f09ba1b73 (DEFAULT_TABLE table=default.Table_63bb1983029d46eeb2eff78065f24ca5 [id=d11d3d2e44f1487688eb9208b07eeb90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.093390 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f4095b92df9a422e85e38513e19eabc7
I20260616 19:52:07.094924 760 tablet_service.cc:1558] Processing DeleteTablet for tablet f4095b92df9a422e85e38513e19eabc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.096055 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_405a3541469c4dfeb2b9fed18455ef21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.096719 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_405a3541469c4dfeb2b9fed18455ef21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.097400 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 745) took 1227 ms. Trace:
I20260616 19:52:07.097539 1191 rpcz_store.cc:276] 0616 19:52:05.870401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.870453 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:06.491260 (+620807us) ts_tablet_manager.cc:1151] Deleting tablet 5ba2eefdfed14791b5a41decc34dce44
0616 19:52:06.491269 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:06.540902 (+ 49633us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:06.888781 (+347879us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.097383 (+208602us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":620648}
I20260616 19:52:07.098272 1191 tablet_replica.cc:333] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:07.098496 1191 raft_consensus.cc:2243] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.098029 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 612c961eee254a749f82e803ffcf632d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.098870 1030 tablet_service.cc:1511] Processing CreateTablet for tablet f5c56bc65793408d9a977880e1c054bc (DEFAULT_TABLE table=default.Table_f1a2ae364984415eb1a4e7caee67847d [id=b3f41e9ded304b6ea261d2987eae4b51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.099197 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c56bc65793408d9a977880e1c054bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.099521 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f872a8860a4b421483441d71814be4fc
I20260616 19:52:07.100196 760 tablet_service.cc:1558] Processing DeleteTablet for tablet f872a8860a4b421483441d71814be4fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.101074 1196 tablet_bootstrap.cc:654] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.104733 1036 tablet_service.cc:1511] Processing CreateTablet for tablet ebe069dd3e414b48b27769cd281b579d (DEFAULT_TABLE table=default.Table_d7bbc81ef86a48cf994293fb0c9dd2da [id=268509c99fcd41e4bb3ce619c49eae6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.104766 1191 raft_consensus.cc:2272] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.105162 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe069dd3e414b48b27769cd281b579d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.105460 1191 ts_tablet_manager.cc:1916] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.108500 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0399a9b77bf7408fa8e519e25d79229a" } modify_external_catalogs: true
I20260616 19:52:07.108719 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0399a9b77bf7408fa8e519e25d79229a" } modify_external_catalogs: true
I20260616 19:52:07.109932 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_268e03dfbe624ecda3c79e40904e6299"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.110929 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_268e03dfbe624ecda3c79e40904e6299 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.109932 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8e9f4830e713476d8fbd5693a5179d9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:07.112128 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44493f0ffd064249a28628cf24895395" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:07.112707 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e9f4830e713476d8fbd5693a5179d9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.112821 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d522cc4b346241d1bac695f9a1d40fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.113543 760 tablet_service.cc:1511] Processing CreateTablet for tablet 0a9e8877705840329d6a063bb5194965 (DEFAULT_TABLE table=default.Table_320b1c835f2741be8cf8c2cbca4d5611 [id=dbe0e668a004460aaecb9278b1cda5ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.113933 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a9e8877705840329d6a063bb5194965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.116770 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65b0dc43b40649f29037f40d2ea9247e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:07.116984 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966fabee5ae34c5da6a35d74caef244f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.117578 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856ac4b8693941c7a19bb68f09ba1b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.120124 1193 ts_tablet_manager.cc:1929] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:07.120234 1193 log.cc:1199] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/15d6a025b9a248c5ab9422fe1c340f3e
I20260616 19:52:07.120604 1193 ts_tablet_manager.cc:1950] T 15d6a025b9a248c5ab9422fe1c340f3e P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:07.121152 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 760) took 1107 ms. Trace:
I20260616 19:52:07.121292 1193 rpcz_store.cc:276] 0616 19:52:06.013730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.013789 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:07.024221 (+1010432us) ts_tablet_manager.cc:1151] Deleting tablet 15d6a025b9a248c5ab9422fe1c340f3e
0616 19:52:07.024236 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.058956 (+ 34720us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.120062 (+ 61106us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.121111 (+ 1049us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1010156}
I20260616 19:52:07.121836 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 15d6a025b9a248c5ab9422fe1c340f3e (table default.Table_1c49293ffd514b55954730a8880aab95 [id=4f3dc165f3d84700856eebc8f3243acf]) successfully deleted
I20260616 19:52:07.121996 1193 tablet_replica.cc:333] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:07.122325 1193 raft_consensus.cc:2243] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.122593 1193 raft_consensus.cc:2272] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.124339 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_80cdd5c8e7c245798a9bfe9ba16072f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.125037 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80cdd5c8e7c245798a9bfe9ba16072f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.126369 763 tablet_service.cc:1511] Processing CreateTablet for tablet 69067f37543a485d90afbcae88c08c11 (DEFAULT_TABLE table=default.Table_e9e55e0e0d1c4dd197f63a23ffe1f6cb [id=c144c3f65c0e41b894e7992b1c723a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.126744 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69067f37543a485d90afbcae88c08c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.126821 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e279cf57dad34327bd95056314038358"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.127290 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e279cf57dad34327bd95056314038358 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.130048 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 6396397965c44e07850a6cc42cefab09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.130139 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 272838af35d840faa7b11217456533c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.130467 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet f4095b92df9a422e85e38513e19eabc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.130903 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet f872a8860a4b421483441d71814be4fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.131348 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 0a9e8877705840329d6a063bb5194965 (DEFAULT_TABLE table=default.Table_320b1c835f2741be8cf8c2cbca4d5611 [id=dbe0e668a004460aaecb9278b1cda5ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.131716 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a9e8877705840329d6a063bb5194965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.132507 1196 tablet_bootstrap.cc:492] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:07.132638 1196 ts_tablet_manager.cc:1403] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.001s
I20260616 19:52:07.133358 1196 raft_consensus.cc:359] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:07.133518 1196 raft_consensus.cc:385] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.133570 1196 raft_consensus.cc:740] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.133777 1196 consensus_queue.cc:260] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:07.134223 1196 ts_tablet_manager.cc:1434] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:07.134471 1196 tablet_bootstrap.cc:492] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:07.135674 750 tablet_service.cc:1511] Processing CreateTablet for tablet 34264036a635419fbc8f9e2c388a817b (DEFAULT_TABLE table=default.Table_d3a16a3fb0be4caabdf0f9e1685869c7 [id=ecee94e957cb40dbb015b64d678fcaff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.136231 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34264036a635419fbc8f9e2c388a817b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.138552 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 9614f1b2704749c1a4590303c7efc1d8 (DEFAULT_TABLE table=default.Table_bb94e65f654e4667a414a8ea104e7309 [id=00445be84f99437ea5b0a32c159634b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.138971 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9614f1b2704749c1a4590303c7efc1d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.142400 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 76a89e7686aa44df9bb017816d1accb1 (DEFAULT_TABLE table=default.Table_1a24c6f631b84d5a90cc8cc8d52361ab [id=9d89ab6cb63c45cc8583f4511407affe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.142912 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a89e7686aa44df9bb017816d1accb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.146169 751 tablet_service.cc:1511] Processing CreateTablet for tablet e525b827e430429c9b3f00d6f84d1814 (DEFAULT_TABLE table=default.Table_5dc308301e974ad1bdad6358b69747de [id=e60e96bf4b4b499cacc5efbd22058470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.146533 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e525b827e430429c9b3f00d6f84d1814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.146566 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbc5c9485b94928b6ae9a1f206c9c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.155869 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc988a195ec4bbf8691801421fed8bb" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:07.159070 719 leader_election.cc:304] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:07.159397 1908 raft_consensus.cc:2804] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260616 19:52:07.159509 1908 raft_consensus.cc:493] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae28da1c4102450ab76eb2946a5cbf2e)
I20260616 19:52:07.159593 1908 raft_consensus.cc:3060] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Advancing to term 2
I20260616 19:52:07.159890 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 5ba2eefdfed14791b5a41decc34dce44 (table default.Table_1a330c132b3f4982b52e492c2ded8be7 [id=975461e7d8954e8fbe998142fb2783e9]) successfully deleted
I20260616 19:52:07.162815 1908 raft_consensus.cc:515] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.163631 1908 leader_election.cc:290] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 2 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:07.163687 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet cfbc5c9485b94928b6ae9a1f206c9c45
I20260616 19:52:07.164829 765 tablet_service.cc:1558] Processing DeleteTablet for tablet cfbc5c9485b94928b6ae9a1f206c9c45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.166472 765 tablet_service.cc:1511] Processing CreateTablet for tablet 3624b437ae284916b343c82c07c61e62 (DEFAULT_TABLE table=default.Table_6b3560adb98443f2a64f79a3aa726779 [id=b748357cc1c5489e8b22e4cf87e6d50b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.166886 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3624b437ae284916b343c82c07c61e62. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:07.168130 996 leader_election.cc:343] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.168622 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_acf6078226f644f8a0a87e37b73c6cb6" } new_table_name: "default.Table_c17ad23bee294c7ebb5f3a56c3993605" modify_external_catalogs: true
I20260616 19:52:07.171765 763 tablet_service.cc:1511] Processing CreateTablet for tablet 099199fa60b94308acb423f04d988f65 (DEFAULT_TABLE table=default.Table_bb4236ba15c042c2a67d464a935dd973 [id=285a48bd855f45609454a65af963f0f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.172125 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099199fa60b94308acb423f04d988f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.173035 996 leader_election.cc:304] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:07.173300 1849 raft_consensus.cc:2749] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:07.176379 996 leader_election.cc:343] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.176517 996 leader_election.cc:304] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:07.177995 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3bc2c54c225040748a5b58ee0f6c9f70" } new_table_name: "default.Table_88164ea8eb77409cae10a4349d05b55b" modify_external_catalogs: true
I20260616 19:52:07.178231 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4cabb1304dc14288988fe837d088cc27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.178758 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4cabb1304dc14288988fe837d088cc27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.077953 904 tablet_service.cc:1511] Processing CreateTablet for tablet 76a89e7686aa44df9bb017816d1accb1 (DEFAULT_TABLE table=default.Table_1a24c6f631b84d5a90cc8cc8d52361ab [id=9d89ab6cb63c45cc8583f4511407affe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.180648 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a89e7686aa44df9bb017816d1accb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.184260 1849 raft_consensus.cc:2749] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:07.080217 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 272838af35d840faa7b11217456533c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.080597 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 6396397965c44e07850a6cc42cefab09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.081284 895 tablet_service.cc:1511] Processing CreateTablet for tablet 9614f1b2704749c1a4590303c7efc1d8 (DEFAULT_TABLE table=default.Table_bb94e65f654e4667a414a8ea104e7309 [id=00445be84f99437ea5b0a32c159634b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.189342 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9614f1b2704749c1a4590303c7efc1d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.095468 896 tablet_service.cc:1558] Processing DeleteTablet for tablet f4095b92df9a422e85e38513e19eabc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.100260 901 tablet_service.cc:1558] Processing DeleteTablet for tablet f872a8860a4b421483441d71814be4fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.114292 887 tablet_service.cc:1511] Processing CreateTablet for tablet 0a9e8877705840329d6a063bb5194965 (DEFAULT_TABLE table=default.Table_320b1c835f2741be8cf8c2cbca4d5611 [id=dbe0e668a004460aaecb9278b1cda5ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.189805 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a9e8877705840329d6a063bb5194965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.116896 891 tablet_service.cc:1511] Processing CreateTablet for tablet 34264036a635419fbc8f9e2c388a817b (DEFAULT_TABLE table=default.Table_d3a16a3fb0be4caabdf0f9e1685869c7 [id=ecee94e957cb40dbb015b64d678fcaff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.192727 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34264036a635419fbc8f9e2c388a817b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.124924 897 tablet_service.cc:1511] Processing CreateTablet for tablet e525b827e430429c9b3f00d6f84d1814 (DEFAULT_TABLE table=default.Table_5dc308301e974ad1bdad6358b69747de [id=e60e96bf4b4b499cacc5efbd22058470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.154052 894 tablet_service.cc:1511] Processing CreateTablet for tablet 69067f37543a485d90afbcae88c08c11 (DEFAULT_TABLE table=default.Table_e9e55e0e0d1c4dd197f63a23ffe1f6cb [id=c144c3f65c0e41b894e7992b1c723a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.196720 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e525b827e430429c9b3f00d6f84d1814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.196893 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69067f37543a485d90afbcae88c08c11. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:07.197268 996 leader_election.cc:343] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.197386 996 leader_election.cc:304] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:07.197763 996 leader_election.cc:343] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.200811 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 34264036a635419fbc8f9e2c388a817b (DEFAULT_TABLE table=default.Table_d3a16a3fb0be4caabdf0f9e1685869c7 [id=ecee94e957cb40dbb015b64d678fcaff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.201967 1024 tablet_service.cc:1511] Processing CreateTablet for tablet e525b827e430429c9b3f00d6f84d1814 (DEFAULT_TABLE table=default.Table_5dc308301e974ad1bdad6358b69747de [id=e60e96bf4b4b499cacc5efbd22058470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.202168 1191 ts_tablet_manager.cc:1929] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:07.202270 1191 log.cc:1199] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/31592a5ffb04429c9315a4fd72308f28
I20260616 19:52:07.202565 1191 ts_tablet_manager.cc:1950] T 31592a5ffb04429c9315a4fd72308f28 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:07.202873 1996 raft_consensus.cc:2749] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:07.204440 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_91e28eb3cfb5400482186bbd63f63ff7" } new_table_name: "default.Table_f5c1eb12b45345aabb7ab3c7a1854ead" modify_external_catalogs: true
I20260616 19:52:07.204695 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2d3af2b449be4a3e86c6f58dfda03e6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.205287 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d3af2b449be4a3e86c6f58dfda03e6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.206188 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4adff6e41148b8b54e969ea2eb7a91" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:07.206342 1058 raft_consensus.cc:3060] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Advancing to term 2
I20260616 19:52:07.209545 1058 raft_consensus.cc:2468] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 2.
I20260616 19:52:07.210916 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 69067f37543a485d90afbcae88c08c11 (DEFAULT_TABLE table=default.Table_e9e55e0e0d1c4dd197f63a23ffe1f6cb [id=c144c3f65c0e41b894e7992b1c723a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.211333 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 0c281b936f2147b9989f03a3e1b6884e (DEFAULT_TABLE table=default.Table_6638da797c494fa3b2ea3d0e50a34f63 [id=af5965e0acec47028fa4d89d5ba00169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.212129 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b75452879004490ca0a5e9a28ddf4b80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.212867 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b75452879004490ca0a5e9a28ddf4b80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:07.213413 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33a6a46041464e93811b0c573db19f43 consensus state has no leader
I20260616 19:52:07.213922 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_dc02731815934261a7e270a538ea7228"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.214481 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc02731815934261a7e270a538ea7228 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.216665 1196 tablet_bootstrap.cc:654] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.217818 753 tablet_service.cc:1511] Processing CreateTablet for tablet 0c281b936f2147b9989f03a3e1b6884e (DEFAULT_TABLE table=default.Table_6638da797c494fa3b2ea3d0e50a34f63 [id=af5965e0acec47028fa4d89d5ba00169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.218302 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c281b936f2147b9989f03a3e1b6884e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.220820 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet cfbc5c9485b94928b6ae9a1f206c9c45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.223408 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 3624b437ae284916b343c82c07c61e62 (DEFAULT_TABLE table=default.Table_6b3560adb98443f2a64f79a3aa726779 [id=b748357cc1c5489e8b22e4cf87e6d50b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.223805 1192 tablet_bootstrap.cc:492] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:07.223851 719 leader_election.cc:304] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:07.223984 1192 ts_tablet_manager.cc:1403] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.159s user 0.002s sys 0.000s
I20260616 19:52:07.224319 2102 raft_consensus.cc:2804] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 2 FOLLOWER]: Leader election won for term 2
I20260616 19:52:07.224498 2102 raft_consensus.cc:697] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 2 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:07.224644 1192 raft_consensus.cc:359] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.224891 1192 raft_consensus.cc:385] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.224864 2102 consensus_queue.cc:237] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.225065 1192 raft_consensus.cc:740] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.225330 1192 consensus_queue.cc:260] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.226100 1192 ts_tablet_manager.cc:1434] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:07.226787 1192 tablet_bootstrap.cc:492] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:07.228425 1192 tablet_bootstrap.cc:654] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:07.234760 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eed22bbef8ef479dad179b96ba850d26 consensus state has no leader
I20260616 19:52:07.236542 894 tablet_service.cc:1511] Processing CreateTablet for tablet 099199fa60b94308acb423f04d988f65 (DEFAULT_TABLE table=default.Table_bb4236ba15c042c2a67d464a935dd973 [id=285a48bd855f45609454a65af963f0f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.236992 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099199fa60b94308acb423f04d988f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.238770 751 tablet_service.cc:1511] Processing CreateTablet for tablet cefa4f3eee5b49e6b23405cfd2daabaf (DEFAULT_TABLE table=default.Table_db04f07eeb1544ec9a5b538d6cbd0a44 [id=9cc2a16a252c4c91bf2da5098da5591d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.239187 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cefa4f3eee5b49e6b23405cfd2daabaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.239295 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 099199fa60b94308acb423f04d988f65 (DEFAULT_TABLE table=default.Table_bb4236ba15c042c2a67d464a935dd973 [id=285a48bd855f45609454a65af963f0f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.240677 778 raft_consensus.cc:1240] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [term 2 LEADER]: Rejecting Update request from peer ae28da1c4102450ab76eb2946a5cbf2e for earlier term 1. Current term is 2. Ops: []
I20260616 19:52:07.241863 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc988a195ec4bbf8691801421fed8bb" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:07.243225 2118 consensus_queue.cc:1059] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:07.243433 2118 consensus_queue.cc:1243] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Peer 7245e7dab0ec474a876537be514c8767 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260616 19:52:07.243538 2118 raft_consensus.cc:3055] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Stepping down as leader of term 1
I20260616 19:52:07.243608 2118 raft_consensus.cc:740] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:07.243839 2118 consensus_queue.cc:260] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.244123 2118 raft_consensus.cc:3060] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Advancing to term 2
I20260616 19:52:07.248212 891 tablet_service.cc:1511] Processing CreateTablet for tablet cefa4f3eee5b49e6b23405cfd2daabaf (DEFAULT_TABLE table=default.Table_db04f07eeb1544ec9a5b538d6cbd0a44 [id=9cc2a16a252c4c91bf2da5098da5591d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.249006 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cefa4f3eee5b49e6b23405cfd2daabaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.251358 1196 tablet_bootstrap.cc:492] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:07.251479 1196 ts_tablet_manager.cc:1403] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.117s user 0.003s sys 0.000s
I20260616 19:52:07.254416 1196 raft_consensus.cc:359] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.254655 1196 raft_consensus.cc:385] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.254731 1196 raft_consensus.cc:740] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.255033 1196 consensus_queue.cc:260] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.256156 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f0b3b9a1d74449d1a00b3c989eac3ee5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:07.256367 1196 ts_tablet_manager.cc:1434] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:52:07.256735 1196 tablet_bootstrap.cc:492] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:07.256739 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0b3b9a1d74449d1a00b3c989eac3ee5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.260445 2076 tablet.cc:1724] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:52:07.265659 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f5b9a0c493de47c389206c834de0c093" } new_table_name: "default.Table_d8af0c5b53b4415cbd6ca1339547f477" modify_external_catalogs: true
I20260616 19:52:07.265719 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5c350aaa51a946fdb5ae09ea14521686" } new_table_name: "default.Table_8523fd6785af4abea4891fea2612453d" modify_external_catalogs: true
I20260616 19:52:07.270027 2129 tablet.cc:1724] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260616 19:52:07.271593 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 198202us
W20260616 19:52:07.272692 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a77f8c5c40e4892831cb8af6c305c62 consensus state has no leader
I20260616 19:52:07.154645 1190 ts_tablet_manager.cc:1929] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:07.277038 1190 log.cc:1199] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/10fc1d2ecaa746bab980a708dd8eb93a
I20260616 19:52:07.163399 889 tablet_service.cc:1511] Processing CreateTablet for tablet 0c281b936f2147b9989f03a3e1b6884e (DEFAULT_TABLE table=default.Table_6638da797c494fa3b2ea3d0e50a34f63 [id=af5965e0acec47028fa4d89d5ba00169]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:07.277410 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d69db202af9e4d4f86a9d8d40e9fe3af consensus state has no leader
I20260616 19:52:07.277436 1190 ts_tablet_manager.cc:1950] T 10fc1d2ecaa746bab980a708dd8eb93a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:07.164639 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4adff6e41148b8b54e969ea2eb7a91" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:07.277752 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 648) took 3515 ms. Trace:
I20260616 19:52:07.277827 1190 rpcz_store.cc:276] 0616 19:52:03.761893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.761932 (+ 39us) service_pool.cc:224] Handling call
0616 19:52:06.881390 (+3119458us) ts_tablet_manager.cc:1151] Deleting tablet 10fc1d2ecaa746bab980a708dd8eb93a
0616 19:52:06.881399 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.014687 (+133288us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.154586 (+139899us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.277734 (+123148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3119326}
I20260616 19:52:07.278264 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 651) took 3515 ms. Trace:
I20260616 19:52:07.278321 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 10fc1d2ecaa746bab980a708dd8eb93a (table default.Table_61b32c8d9ca6461c8f3edd6bf27c79bc [id=8196a6bddad24186971f3213f68e4cfd]) successfully deleted
I20260616 19:52:07.278340 1190 rpcz_store.cc:276] 0616 19:52:03.763258 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.763300 (+ 42us) service_pool.cc:224] Handling call
0616 19:52:07.278155 (+3514855us) ts_tablet_manager.cc:1151] Deleting tablet 0d4634afc3364221b4fdfcd3ce108a60
0616 19:52:07.278164 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.278249 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3514647}
I20260616 19:52:07.278607 1190 tablet_replica.cc:333] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:07.278789 1190 raft_consensus.cc:2243] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:07.278779 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4bebbb5f40cf47028a0a1d3ba5749584" } modify_external_catalogs: true
I20260616 19:52:07.278939 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4bebbb5f40cf47028a0a1d3ba5749584" } modify_external_catalogs: true
I20260616 19:52:07.279024 1190 pending_rounds.cc:70] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:52:07.279080 1190 pending_rounds.cc:77] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595493468291072 op_type: NO_OP noop_request { }
I20260616 19:52:07.279170 1190 raft_consensus.cc:2889] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:07.279243 1190 raft_consensus.cc:2272] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.279749 1190 ts_tablet_manager.cc:1916] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:07.280014 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 0d4634afc3364221b4fdfcd3ce108a60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d4634afc3364221b4fdfcd3ce108a60 already in progress: creating tablet
I20260616 19:52:07.280050 924 raft_consensus.cc:2468] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 2.
I20260616 19:52:07.165583 902 tablet_service.cc:1558] Processing DeleteTablet for tablet cfbc5c9485b94928b6ae9a1f206c9c45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.280728 1198 tablet_bootstrap.cc:492] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:07.277441 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c281b936f2147b9989f03a3e1b6884e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.280858 1198 ts_tablet_manager.cc:1403] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.239s user 0.003s sys 0.000s
I20260616 19:52:07.281299 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_647d295a0348455285299b2011b05288" } modify_external_catalogs: true
I20260616 19:52:07.281466 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_647d295a0348455285299b2011b05288" } modify_external_catalogs: true
I20260616 19:52:07.283138 1198 raft_consensus.cc:359] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.283301 1198 raft_consensus.cc:385] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.283349 1198 raft_consensus.cc:740] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.283547 1198 consensus_queue.cc:260] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.284024 1198 ts_tablet_manager.cc:1434] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260616 19:52:07.288501 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet f13d175adfe540b39fd55004a11c9aad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:07.289471 993 leader_election.cc:343] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.289594 993 leader_election.cc:304] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:07.289928 1996 raft_consensus.cc:2749] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:07.291011 1025 tablet_service.cc:1511] Processing CreateTablet for tablet cefa4f3eee5b49e6b23405cfd2daabaf (DEFAULT_TABLE table=default.Table_db04f07eeb1544ec9a5b538d6cbd0a44 [id=9cc2a16a252c4c91bf2da5098da5591d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:07.168767 858 consensus_peers.cc:597] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c44422ddb8ce45a48bb9aaeb6c209f21. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:07.169667 890 tablet_service.cc:1511] Processing CreateTablet for tablet 3624b437ae284916b343c82c07c61e62 (DEFAULT_TABLE table=default.Table_6b3560adb98443f2a64f79a3aa726779 [id=b748357cc1c5489e8b22e4cf87e6d50b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.294813 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3624b437ae284916b343c82c07c61e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.297132 881 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:48628 (request call id 196) took 1121 ms. Trace:
I20260616 19:52:07.297276 881 rpcz_store.cc:276] 0616 19:52:06.175543 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.210461 (+ 34918us) service_pool.cc:224] Handling call
0616 19:52:06.399798 (+189337us) spinlock_profiling.cc:243] Waited 67.3 ms on lock 0x6160001b2254. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7cf5ef8c0 00007fb7d34a0f1f 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138 0000000000aa681c
0616 19:52:06.507631 (+107833us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x6160000c5b54. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7cf5ef8c0 00007fb7d34a0f1f 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138 0000000000aa681c
0616 19:52:07.297106 (+789475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392716032}
I20260616 19:52:07.304322 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_25fdb3a9609849db808152f62bb0c6bf" } modify_external_catalogs: true
I20260616 19:52:07.304733 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_163e2e0482594a22a6d411bd422c52fa" } modify_external_catalogs: true
W20260616 19:52:07.304374 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 135628us
W20260616 19:52:07.305193 858 leader_election.cc:343] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 13e4e52fae124d4085b15e143e98a7e4
I20260616 19:52:07.305356 858 leader_election.cc:304] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:07.307329 1196 tablet_bootstrap.cc:654] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.310003 2121 raft_consensus.cc:2749] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:07.312646 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e525b827e430429c9b3f00d6f84d1814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.313134 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34264036a635419fbc8f9e2c388a817b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.313488 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 746) took 1442 ms. Trace:
I20260616 19:52:07.313563 1191 rpcz_store.cc:276] 0616 19:52:05.871046 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.871097 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:07.098225 (+1227128us) ts_tablet_manager.cc:1151] Deleting tablet 31592a5ffb04429c9315a4fd72308f28
0616 19:52:07.098236 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.108251 (+ 10015us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.175352 (+ 67101us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.313470 (+138118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1226953}
I20260616 19:52:07.313911 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 747) took 1440 ms. Trace:
I20260616 19:52:07.313969 1191 rpcz_store.cc:276] 0616 19:52:05.873122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.873189 (+ 67us) service_pool.cc:224] Handling call
0616 19:52:07.313831 (+1440642us) ts_tablet_manager.cc:1151] Deleting tablet fdc6222db09d4cd987cbdf70e4d40f70
0616 19:52:07.313839 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.313900 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1440487}
I20260616 19:52:07.314163 1191 tablet_replica.cc:333] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:07.314327 1191 raft_consensus.cc:2243] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.314455 1191 raft_consensus.cc:2272] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.314942 1191 ts_tablet_manager.cc:1916] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.316671 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69067f37543a485d90afbcae88c08c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.317319 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 3a4a2f467b5b4121ae9a9973c153c69f
I20260616 19:52:07.318637 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_25fdb3a9609849db808152f62bb0c6bf" } modify_external_catalogs: true
I20260616 19:52:07.319948 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 3fcdc7ae19874ca794ae71d228e6ab27
I20260616 19:52:07.320653 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c281b936f2147b9989f03a3e1b6884e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.320938 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_163e2e0482594a22a6d411bd422c52fa" } modify_external_catalogs: true
I20260616 19:52:07.323912 1190 ts_tablet_manager.cc:1929] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:07.324023 1190 log.cc:1199] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/3587c1ab487a424eb82f378ae081f514
I20260616 19:52:07.324360 1190 ts_tablet_manager.cc:1950] T 3587c1ab487a424eb82f378ae081f514 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:07.325062 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3624b437ae284916b343c82c07c61e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.328831 1192 tablet_bootstrap.cc:492] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:07.329002 1192 ts_tablet_manager.cc:1403] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.102s user 0.000s sys 0.005s
I20260616 19:52:07.329015 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 31592a5ffb04429c9315a4fd72308f28 (table default.Table_6a6d8516df114593b27d86140407b724 [id=d104c5ac8acc4a6f9ed7cc87879d661b]) successfully deleted
W20260616 19:52:07.329288 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet fdc6222db09d4cd987cbdf70e4d40f70 because the tablet was not found. No further retry: Not found: Tablet not found: fdc6222db09d4cd987cbdf70e4d40f70
I20260616 19:52:07.329838 1192 raft_consensus.cc:359] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.330240 1196 tablet_bootstrap.cc:492] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:07.330372 1196 ts_tablet_manager.cc:1403] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.000s
I20260616 19:52:07.331072 1196 raft_consensus.cc:359] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.331265 1196 raft_consensus.cc:385] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.331317 1196 raft_consensus.cc:740] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.331553 1196 consensus_queue.cc:260] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.332115 1196 ts_tablet_manager.cc:1434] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:07.337782 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 5b34d497f9334e94b06cc9245fca04ed from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:07.337970 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a4a2f467b5b4121ae9a9973c153c69f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.339596 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcdc7ae19874ca794ae71d228e6ab27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.341727 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099199fa60b94308acb423f04d988f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.341813 1198 tablet_bootstrap.cc:492] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:07.343878 1198 tablet_bootstrap.cc:654] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.345280 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet b1771a4ed9d649558fed580992af1f96
I20260616 19:52:07.346933 1908 raft_consensus.cc:493] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.347066 1908 raft_consensus.cc:515] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:07.347383 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet b1771a4ed9d649558fed580992af1f96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.347705 1908 leader_election.cc:290] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:07.348951 1192 raft_consensus.cc:385] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.349167 1192 raft_consensus.cc:740] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.348387 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31592a5ffb04429c9315a4fd72308f28" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:07.349436 719 leader_election.cc:343] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 31592a5ffb04429c9315a4fd72308f28
I20260616 19:52:07.330395 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a4a2f467b5b4121ae9a9973c153c69f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.348112 892 tablet_service.cc:1558] Processing DeleteTablet for tablet b1771a4ed9d649558fed580992af1f96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.349591 1192 consensus_queue.cc:260] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:07.349862 718 leader_election.cc:343] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.349959 718 leader_election.cc:304] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:07.350474 1192 ts_tablet_manager.cc:1434] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.021s user 0.000s sys 0.002s
I20260616 19:52:07.350535 1908 raft_consensus.cc:2749] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:07.350927 1192 tablet_bootstrap.cc:492] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:07.353695 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ce114bf2907945889f8f1050d63d3965
I20260616 19:52:07.356339 750 tablet_service.cc:1558] Processing DeleteTablet for tablet b1771a4ed9d649558fed580992af1f96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.356451 765 tablet_service.cc:1558] Processing DeleteTablet for tablet ce114bf2907945889f8f1050d63d3965 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.356671 892 tablet_service.cc:1558] Processing DeleteTablet for tablet ce114bf2907945889f8f1050d63d3965 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.359133 1193 ts_tablet_manager.cc:1916] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:07.360248 860 consensus_peers.cc:597] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:07.364117 455 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 9c77fd138ce9463b8f2d6f4182a56559 (table default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17]). Expected version 1 got 0
I20260616 19:52:07.366101 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 15d6a025b9a248c5ab9422fe1c340f3e with delete_type TABLET_DATA_DELETED (replaced by tablet db750fc9641f492494fdb167de86f6df) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.366986 1996 raft_consensus.cc:493] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.367146 1996 raft_consensus.cc:515] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.367774 1996 leader_election.cc:290] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:07.368536 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf136fa86c264f69a1703596cfd0e77a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:07.369091 996 leader_election.cc:343] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.369211 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cefa4f3eee5b49e6b23405cfd2daabaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.369326 1196 tablet_bootstrap.cc:492] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:07.370605 1196 tablet_bootstrap.cc:654] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.371183 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf136fa86c264f69a1703596cfd0e77a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:07.371636 993 leader_election.cc:343] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.371738 993 leader_election.cc:304] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:07.372154 1996 raft_consensus.cc:2749] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:07.366818 1198 tablet_bootstrap.cc:492] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:07.372679 1198 ts_tablet_manager.cc:1403] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s
I20260616 19:52:07.373657 1198 raft_consensus.cc:359] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.373704 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7044ef52a676420a8846f7d3abb520ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:07.374114 1198 raft_consensus.cc:385] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.374195 1198 raft_consensus.cc:740] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
W20260616 19:52:07.374471 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7044ef52a676420a8846f7d3abb520ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.374488 1198 consensus_queue.cc:260] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.376565 1192 tablet_bootstrap.cc:654] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.379112 1198 ts_tablet_manager.cc:1434] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260616 19:52:07.379392 1198 tablet_bootstrap.cc:492] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:07.380805 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet cbd1070277a14fd98af5fa45925e4f0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.385571 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ec1c70e517834298a657d9b505317348"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:07.385910 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1c49293ffd514b55954730a8880aab95" } modify_external_catalogs: true
I20260616 19:52:07.386075 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1c49293ffd514b55954730a8880aab95" } modify_external_catalogs: true
W20260616 19:52:07.386220 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec1c70e517834298a657d9b505317348 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.386325 1198 tablet_bootstrap.cc:654] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.389484 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 658) took 3539 ms. Trace:
I20260616 19:52:07.389752 1190 rpcz_store.cc:276] 0616 19:52:03.849733 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.852604 (+ 2871us) service_pool.cc:224] Handling call
0616 19:52:07.278568 (+3425964us) ts_tablet_manager.cc:1151] Deleting tablet 3587c1ab487a424eb82f378ae081f514
0616 19:52:07.278576 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.321179 (+ 42603us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.323859 (+ 2680us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.389460 (+ 65601us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3422485}
I20260616 19:52:07.391076 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 3587c1ab487a424eb82f378ae081f514 (table default.Table_9fe1afa2ee854800ab19aac1fb4c6048 [id=4f2b128cff5248f98e3506bb72a39391]) successfully deleted
I20260616 19:52:07.392212 1190 tablet_replica.cc:333] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:07.393930 1190 raft_consensus.cc:2243] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:07.394311 1196 tablet_bootstrap.cc:492] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:07.394505 1196 ts_tablet_manager.cc:1403] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.004s
I20260616 19:52:07.395227 1196 raft_consensus.cc:359] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.395380 1196 raft_consensus.cc:385] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.395437 1196 raft_consensus.cc:740] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.395668 1196 consensus_queue.cc:260] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.396162 1196 ts_tablet_manager.cc:1434] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:07.396667 1196 tablet_bootstrap.cc:492] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:07.396528 1190 raft_consensus.cc:2272] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.396700 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_89ec43c7fc3847e1ae3dde1c2cc4682c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.398389 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89ec43c7fc3847e1ae3dde1c2cc4682c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.399580 1196 tablet_bootstrap.cc:654] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.402833 1190 ts_tablet_manager.cc:1916] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.406610 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet db750fc9641f492494fdb167de86f6df
I20260616 19:52:07.407480 753 tablet_service.cc:1558] Processing DeleteTablet for tablet db750fc9641f492494fdb167de86f6df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.407998 2120 raft_consensus.cc:493] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.408013 890 tablet_service.cc:1558] Processing DeleteTablet for tablet db750fc9641f492494fdb167de86f6df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.408138 2120 raft_consensus.cc:515] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.408756 2120 leader_election.cc:290] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:07.408957 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet db750fc9641f492494fdb167de86f6df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.409166 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcdc7ae19874ca794ae71d228e6ab27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.409296 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a754c728b5408eb47f91de93554ec5" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:07.409862 860 leader_election.cc:343] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.410852 1193 ts_tablet_manager.cc:1929] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:07.411897 1198 tablet_bootstrap.cc:492] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:07.412089 1198 ts_tablet_manager.cc:1403] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.001s
I20260616 19:52:07.414110 1191 ts_tablet_manager.cc:1929] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:07.414214 1191 log.cc:1199] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/a170db3d27fd40c1b74deab29e9a033f
I20260616 19:52:07.414510 1191 ts_tablet_manager.cc:1950] T a170db3d27fd40c1b74deab29e9a033f P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:07.414826 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 748) took 1540 ms. Trace:
I20260616 19:52:07.415028 1191 rpcz_store.cc:276] 0616 19:52:05.873982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.874033 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:07.314129 (+1440096us) ts_tablet_manager.cc:1151] Deleting tablet a170db3d27fd40c1b74deab29e9a033f
0616 19:52:07.314136 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.358207 (+ 44071us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.414059 (+ 55852us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.414811 (+ 752us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1439931}
I20260616 19:52:07.415450 1191 tablet_replica.cc:333] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:07.415727 1191 raft_consensus.cc:2243] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.415935 1191 raft_consensus.cc:2272] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.416033 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet a170db3d27fd40c1b74deab29e9a033f (table default.Table_b03768997ca94dd897aed95bee7efc2b [id=6ab2bb094a714f089de17dd9c6742619]) successfully deleted
I20260616 19:52:07.416510 1191 ts_tablet_manager.cc:1916] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.416949 1198 raft_consensus.cc:359] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.418890 1198 raft_consensus.cc:385] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.418988 1193 log.cc:1199] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/4ffce2dc22e24d1684e6eae92c487cea
I20260616 19:52:07.419013 1198 raft_consensus.cc:740] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.419255 1198 consensus_queue.cc:260] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.421213 1193 ts_tablet_manager.cc:1950] T 4ffce2dc22e24d1684e6eae92c487cea P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:07.421308 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet ce114bf2907945889f8f1050d63d3965 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.421900 1198 ts_tablet_manager.cc:1434] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260616 19:52:07.422106 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 759) took 1408 ms. Trace:
I20260616 19:52:07.422173 1198 tablet_bootstrap.cc:492] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:07.422256 1193 rpcz_store.cc:276] 0616 19:52:06.013430 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.014482 (+ 1052us) service_pool.cc:224] Handling call
0616 19:52:07.121923 (+1107441us) ts_tablet_manager.cc:1151] Deleting tablet 4ffce2dc22e24d1684e6eae92c487cea
0616 19:52:07.121933 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.390797 (+268864us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.410804 (+ 20007us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.422087 (+ 11283us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1107124}
I20260616 19:52:07.423714 1198 tablet_bootstrap.cc:654] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.424176 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 762) took 1373 ms. Trace:
I20260616 19:52:07.425282 1196 tablet_bootstrap.cc:492] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:07.425860 1196 ts_tablet_manager.cc:1403] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.001s
I20260616 19:52:07.426304 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 4ffce2dc22e24d1684e6eae92c487cea (table default.Table_ee130ae3817f41f8ac49a76361fd23ea [id=a69482262948439783492742dcbf0b43]) successfully deleted
I20260616 19:52:07.426721 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 19b9248b88434a6e9ef7a3d602eee70c with delete_type TABLET_DATA_DELETED (replaced by tablet 415ad9d0c3564453825c4b30c0ad64fa) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.427341 1196 raft_consensus.cc:359] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.427511 1196 raft_consensus.cc:385] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.427444 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcdc7ae19874ca794ae71d228e6ab27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.427570 1196 raft_consensus.cc:740] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.427790 1196 consensus_queue.cc:260] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.429936 1196 ts_tablet_manager.cc:1434] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260616 19:52:07.430411 1196 tablet_bootstrap.cc:492] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:07.430569 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a4a2f467b5b4121ae9a9973c153c69f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.433694 1196 tablet_bootstrap.cc:654] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.434669 1193 rpcz_store.cc:276] 0616 19:52:06.051055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.058291 (+ 7236us) service_pool.cc:224] Handling call
0616 19:52:07.424050 (+1365759us) ts_tablet_manager.cc:1151] Deleting tablet 2a1e4310104a4b238d80116604a1af3a
0616 19:52:07.424060 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.424148 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1365400}
W20260616 19:52:07.435109 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2a1e4310104a4b238d80116604a1af3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a1e4310104a4b238d80116604a1af3a already in progress: creating tablet
I20260616 19:52:07.435182 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 766) took 1321 ms. Trace:
I20260616 19:52:07.435257 1193 rpcz_store.cc:276] 0616 19:52:06.113410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.115795 (+ 2385us) service_pool.cc:224] Handling call
0616 19:52:07.435059 (+1319264us) ts_tablet_manager.cc:1151] Deleting tablet b29cc69fd5234becb09a0b73919b461c
0616 19:52:07.435069 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.435153 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1319013}
W20260616 19:52:07.435971 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet b29cc69fd5234becb09a0b73919b461c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b29cc69fd5234becb09a0b73919b461c already in progress: creating tablet
I20260616 19:52:07.436584 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 768) took 1238 ms. Trace:
I20260616 19:52:07.436668 1193 rpcz_store.cc:276] 0616 19:52:06.198289 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.199992 (+ 1703us) service_pool.cc:224] Handling call
0616 19:52:07.436487 (+1236495us) ts_tablet_manager.cc:1151] Deleting tablet 137c13d905eb4bf2937f730e5210266f
0616 19:52:07.436498 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.436570 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1213352}
W20260616 19:52:07.437076 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 137c13d905eb4bf2937f730e5210266f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 137c13d905eb4bf2937f730e5210266f already in progress: creating tablet
I20260616 19:52:07.437100 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 769) took 1203 ms. Trace:
I20260616 19:52:07.437189 1193 rpcz_store.cc:276] 0616 19:52:06.233276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.235636 (+ 2360us) service_pool.cc:224] Handling call
0616 19:52:07.437007 (+1201371us) ts_tablet_manager.cc:1151] Deleting tablet 71a23c82ace248b48c7086dcbabe3649
0616 19:52:07.437016 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.437085 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1201110}
W20260616 19:52:07.437549 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 71a23c82ace248b48c7086dcbabe3649 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71a23c82ace248b48c7086dcbabe3649 already in progress: creating tablet
I20260616 19:52:07.437605 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 770) took 1177 ms. Trace:
I20260616 19:52:07.437671 1193 rpcz_store.cc:276] 0616 19:52:06.260291 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.268251 (+ 7960us) service_pool.cc:224] Handling call
0616 19:52:07.437517 (+1169266us) ts_tablet_manager.cc:1151] Deleting tablet 32ce369f4db042a5841003e4ea1fcc69
0616 19:52:07.437525 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.437590 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1168276}
W20260616 19:52:07.438062 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 32ce369f4db042a5841003e4ea1fcc69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32ce369f4db042a5841003e4ea1fcc69 already in progress: creating tablet
I20260616 19:52:07.438088 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 771) took 1174 ms. Trace:
I20260616 19:52:07.438172 1193 rpcz_store.cc:276] 0616 19:52:06.263611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.268439 (+ 4828us) service_pool.cc:224] Handling call
0616 19:52:07.437999 (+1169560us) ts_tablet_manager.cc:1151] Deleting tablet 415ad9d0c3564453825c4b30c0ad64fa
0616 19:52:07.438007 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.438074 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1168692}
W20260616 19:52:07.438505 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 415ad9d0c3564453825c4b30c0ad64fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 415ad9d0c3564453825c4b30c0ad64fa already in progress: creating tablet
W20260616 19:52:07.439250 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 9446df9472e34ac79ec24cce89e3f5e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9446df9472e34ac79ec24cce89e3f5e5 already in progress: creating tablet
W20260616 19:52:07.439517 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet cf136fa86c264f69a1703596cfd0e77a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf136fa86c264f69a1703596cfd0e77a already in progress: creating tablet
W20260616 19:52:07.439777 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 613c869d4ac84ee0aa952718ba74917b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 613c869d4ac84ee0aa952718ba74917b already in progress: creating tablet
W20260616 19:52:07.439993 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c30900c999934b17bab83a54944e4ddf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c30900c999934b17bab83a54944e4ddf already in progress: creating tablet
W20260616 19:52:07.440249 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2171eb55560f44dd91ad52e0b5b49408 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2171eb55560f44dd91ad52e0b5b49408 already in progress: creating tablet
W20260616 19:52:07.445019 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 already in progress: creating tablet
I20260616 19:52:07.449371 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a754c728b5408eb47f91de93554ec5" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:07.450968 2120 raft_consensus.cc:493] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.451090 2120 raft_consensus.cc:515] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.451676 2120 leader_election.cc:290] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:07.452200 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc181171b134de2b946376f468aec72" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:07.452425 778 raft_consensus.cc:2468] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:07.452829 860 leader_election.cc:304] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:07.454805 2121 raft_consensus.cc:2804] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:07.454902 2121 raft_consensus.cc:493] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:07.454972 2121 raft_consensus.cc:3060] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:07.455919 1192 tablet_bootstrap.cc:492] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:07.457525 1192 ts_tablet_manager.cc:1403] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.107s user 0.006s sys 0.005s
I20260616 19:52:07.457999 2121 raft_consensus.cc:515] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.458231 1198 tablet_bootstrap.cc:492] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:07.458365 1198 ts_tablet_manager.cc:1403] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.036s user 0.008s sys 0.008s
I20260616 19:52:07.458633 2121 leader_election.cc:290] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:07.458791 1192 raft_consensus.cc:359] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.459020 1192 raft_consensus.cc:385] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.459082 1198 raft_consensus.cc:359] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.459154 1192 raft_consensus.cc:740] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.459239 1198 raft_consensus.cc:385] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.459220 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc181171b134de2b946376f468aec72" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:07.459295 1198 raft_consensus.cc:740] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.459390 778 raft_consensus.cc:3060] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:07.459645 1192 consensus_queue.cc:260] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.459873 1196 tablet_bootstrap.cc:492] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:07.459983 1196 ts_tablet_manager.cc:1403] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20260616 19:52:07.460675 1196 raft_consensus.cc:359] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.460813 1196 raft_consensus.cc:385] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.460855 1196 raft_consensus.cc:740] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.461036 1196 consensus_queue.cc:260] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.461880 778 raft_consensus.cc:2468] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:07.462250 860 leader_election.cc:304] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:07.462495 2119 raft_consensus.cc:2804] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:07.462591 2119 raft_consensus.cc:697] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:07.462845 2119 consensus_queue.cc:237] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.463321 1196 ts_tablet_manager.cc:1434] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:07.463572 1196 tablet_bootstrap.cc:492] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:07.464689 1192 ts_tablet_manager.cc:1434] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260616 19:52:07.465231 1192 tablet_bootstrap.cc:492] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:07.467569 1198 consensus_queue.cc:260] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.468597 1196 tablet_bootstrap.cc:654] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.469691 1192 tablet_bootstrap.cc:654] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.469743 1193 tablet_replica.cc:333] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:07.470043 1193 raft_consensus.cc:2243] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:07.470366 1193 pending_rounds.cc:70] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:07.470472 1193 pending_rounds.cc:77] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595501171560448 op_type: NO_OP noop_request { }
I20260616 19:52:07.470642 1193 raft_consensus.cc:2889] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:07.470791 1193 raft_consensus.cc:2272] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.470996 1190 ts_tablet_manager.cc:1929] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:07.471205 1190 log.cc:1199] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/fdc6222db09d4cd987cbdf70e4d40f70
I20260616 19:52:07.471668 1190 ts_tablet_manager.cc:1950] T fdc6222db09d4cd987cbdf70e4d40f70 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:07.471709 1193 ts_tablet_manager.cc:1916] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.475606 1198 ts_tablet_manager.cc:1434] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260616 19:52:07.478438 2067 log.cc:826] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: Log is configured to *not* fsync() on all Append() calls
I20260616 19:52:07.478837 832 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:52:07.480314 1198 tablet_bootstrap.cc:492] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:07.485855 1198 tablet_bootstrap.cc:654] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:07.478214 858 consensus_peers.cc:597] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ffce2dc22e24d1684e6eae92c487cea. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:07.486356 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 665) took 3511 ms. Trace:
I20260616 19:52:07.486467 1190 rpcz_store.cc:276] 0616 19:52:03.974955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.975447 (+ 492us) service_pool.cc:224] Handling call
0616 19:52:07.391923 (+3416476us) ts_tablet_manager.cc:1151] Deleting tablet fdc6222db09d4cd987cbdf70e4d40f70
0616 19:52:07.391935 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.447086 (+ 55151us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.470932 (+ 23846us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.486337 (+ 15405us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3352234}
I20260616 19:52:07.486837 2120 consensus_queue.cc:1048] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:07.490649 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 681) took 3508 ms. Trace:
I20260616 19:52:07.484488 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet b718514e4fbd4601afeb021ed35643e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.491533 1190 rpcz_store.cc:276] 0616 19:52:03.982330 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.039480 (+ 57150us) service_pool.cc:224] Handling call
0616 19:52:07.490523 (+3451043us) ts_tablet_manager.cc:1151] Deleting tablet 802d30c340494490896c8da33d110708
0616 19:52:07.490533 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.490631 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3450821}
W20260616 19:52:07.492091 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 802d30c340494490896c8da33d110708 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 802d30c340494490896c8da33d110708 already in progress: creating tablet
I20260616 19:52:07.492532 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 668) took 3516 ms. Trace:
I20260616 19:52:07.492655 1190 rpcz_store.cc:276] 0616 19:52:03.975634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:03.975681 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:07.492417 (+3516736us) ts_tablet_manager.cc:1151] Deleting tablet 7ac5b6be55944bdfb12db675442b1f1d
0616 19:52:07.492428 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.492518 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3452658}
W20260616 19:52:07.494980 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 7ac5b6be55944bdfb12db675442b1f1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ac5b6be55944bdfb12db675442b1f1d already in progress: creating tablet
I20260616 19:52:07.496383 1190 tablet_replica.cc:333] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:07.496990 1190 raft_consensus.cc:2243] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.497242 1190 raft_consensus.cc:2272] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.497519 1196 tablet_bootstrap.cc:492] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:07.497680 1196 ts_tablet_manager.cc:1403] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.002s
I20260616 19:52:07.498076 1190 ts_tablet_manager.cc:1916] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.498414 1196 raft_consensus.cc:359] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.498585 1196 raft_consensus.cc:385] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.498656 1196 raft_consensus.cc:740] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.498854 1196 consensus_queue.cc:260] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:07.487035 858 leader_election.cc:343] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: Tablet not RUNNING: STOPPED
I20260616 19:52:07.503178 858 leader_election.cc:304] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:07.503489 2120 raft_consensus.cc:2749] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:07.509913 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:52:07.510718 1196 ts_tablet_manager.cc:1434] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260616 19:52:07.512578 1196 tablet_bootstrap.cc:492] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:07.513559 1908 raft_consensus.cc:493] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.513801 1908 raft_consensus.cc:515] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.514593 1198 tablet_bootstrap.cc:492] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:07.514703 1908 leader_election.cc:290] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:07.514735 1198 ts_tablet_manager.cc:1403] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.001s
W20260616 19:52:07.514745 858 leader_election.cc:343] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 1bc181171b134de2b946376f468aec72
I20260616 19:52:07.515079 1192 tablet_bootstrap.cc:492] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:07.515324 1192 ts_tablet_manager.cc:1403] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.050s user 0.010s sys 0.000s
I20260616 19:52:07.515614 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a754c728b5408eb47f91de93554ec5" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:07.515826 924 raft_consensus.cc:2468] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:07.515844 1198 raft_consensus.cc:359] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:07.515995 1198 raft_consensus.cc:385] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.516093 1198 raft_consensus.cc:740] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.516325 718 leader_election.cc:304] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:07.516390 1198 consensus_queue.cc:260] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:07.516635 1908 raft_consensus.cc:2804] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:07.516697 1196 tablet_bootstrap.cc:654] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.516723 1908 raft_consensus.cc:493] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:07.516784 1908 raft_consensus.cc:3060] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:07.516695 1192 raft_consensus.cc:359] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:07.516940 1192 raft_consensus.cc:385] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.516988 1198 ts_tablet_manager.cc:1434] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:07.517026 1192 raft_consensus.cc:740] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.517252 1198 tablet_bootstrap.cc:492] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:07.517345 1192 consensus_queue.cc:260] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:07.518546 1198 tablet_bootstrap.cc:654] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.519798 1908 raft_consensus.cc:515] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.520800 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a754c728b5408eb47f91de93554ec5" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:07.520947 924 raft_consensus.cc:3060] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:07.523726 1192 ts_tablet_manager.cc:1434] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260616 19:52:07.523957 924 raft_consensus.cc:2468] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:07.524622 718 leader_election.cc:304] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:07.524886 2102 raft_consensus.cc:2804] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:07.525847 1193 ts_tablet_manager.cc:1929] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:07.526029 1193 log.cc:1199] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/a170db3d27fd40c1b74deab29e9a033f
I20260616 19:52:07.526521 1193 ts_tablet_manager.cc:1950] T a170db3d27fd40c1b74deab29e9a033f P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:07.527261 1908 leader_election.cc:290] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:07.527374 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a754c728b5408eb47f91de93554ec5" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:07.527536 2145 tablet.cc:1724] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:52:07.527792 1193 tablet_replica.cc:333] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:07.527947 1193 raft_consensus.cc:2243] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:07.527959 719 leader_election.cc:343] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: Tablet not RUNNING: STOPPED
I20260616 19:52:07.528105 1193 raft_consensus.cc:2272] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.528755 1193 ts_tablet_manager.cc:1916] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.533882 1192 tablet_bootstrap.cc:492] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:07.535771 1196 tablet_bootstrap.cc:492] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:07.535892 1196 ts_tablet_manager.cc:1403] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260616 19:52:07.536996 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a754c728b5408eb47f91de93554ec5" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:07.537415 971 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
W20260616 19:52:07.537410 719 leader_election.cc:343] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: Tablet not RUNNING: STOPPED
I20260616 19:52:07.537439 1196 raft_consensus.cc:359] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.537571 1196 raft_consensus.cc:385] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.537674 1196 raft_consensus.cc:740] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.537995 1196 consensus_queue.cc:260] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.538676 1196 ts_tablet_manager.cc:1434] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:07.538857 1190 ts_tablet_manager.cc:1929] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:07.539032 1196 tablet_bootstrap.cc:492] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:07.542200 1113 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.CreateTable -> {remote=127.0.105.190:35857, user_credentials={real_user=slave}} blocked reactor thread for 114250us
I20260616 19:52:07.542882 1196 tablet_bootstrap.cc:654] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.548564 1190 log.cc:1199] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/c5657b6b56af4b8f8eff1fa18836df9b
I20260616 19:52:07.549865 1198 tablet_bootstrap.cc:492] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:07.550087 1198 ts_tablet_manager.cc:1403] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.001s
I20260616 19:52:07.550951 1198 raft_consensus.cc:359] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.551227 1198 raft_consensus.cc:385] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.551333 1198 raft_consensus.cc:740] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.551647 1198 consensus_queue.cc:260] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.552289 1198 ts_tablet_manager.cc:1434] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:07.552649 1198 tablet_bootstrap.cc:492] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:07.553143 1190 ts_tablet_manager.cc:1950] T c5657b6b56af4b8f8eff1fa18836df9b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:07.554929 1198 tablet_bootstrap.cc:654] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:07.515076 858 leader_election.cc:343] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 1bc181171b134de2b946376f468aec72
I20260616 19:52:07.556519 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet a170db3d27fd40c1b74deab29e9a033f (table default.Table_b03768997ca94dd897aed95bee7efc2b [id=6ab2bb094a714f089de17dd9c6742619]) successfully deleted
I20260616 19:52:07.557578 1193 ts_tablet_manager.cc:1929] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:07.557670 1193 log.cc:1199] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/1bc181171b134de2b946376f468aec72
I20260616 19:52:07.557938 1193 ts_tablet_manager.cc:1950] T 1bc181171b134de2b946376f468aec72 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:07.560359 2119 consensus_queue.cc:1048] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:07.561997 1192 tablet_bootstrap.cc:654] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.562819 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 680) took 3580 ms. Trace:
I20260616 19:52:07.562965 1190 rpcz_store.cc:276] 0616 19:52:03.981929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.037718 (+ 55789us) service_pool.cc:224] Handling call
0616 19:52:07.495357 (+3457639us) ts_tablet_manager.cc:1151] Deleting tablet c5657b6b56af4b8f8eff1fa18836df9b
0616 19:52:07.496344 (+ 987us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.521301 (+ 24957us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.538811 (+ 17510us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.562799 (+ 23988us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3414582}
I20260616 19:52:07.563382 2102 raft_consensus.cc:697] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:07.563726 2102 consensus_queue.cc:237] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.564849 1191 ts_tablet_manager.cc:1929] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:07.565007 1191 log.cc:1199] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/73a754c728b5408eb47f91de93554ec5
I20260616 19:52:07.565354 1191 ts_tablet_manager.cc:1950] T 73a754c728b5408eb47f91de93554ec5 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:07.566352 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 749) took 1689 ms. Trace:
I20260616 19:52:07.566624 2120 consensus_queue.cc:1048] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:07.567713 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet c5657b6b56af4b8f8eff1fa18836df9b (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44]) successfully deleted
I20260616 19:52:07.571053 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_101fa88aedce4c9883f9cf7d0c2bb05c" } new_table_name: "default.Table_3052d1bef780427c8144b3bee6d9e057" modify_external_catalogs: true
I20260616 19:52:07.573563 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0dd5a3fc9a394487bb5d9412ccfe0bac" } modify_external_catalogs: true
I20260616 19:52:07.574628 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0dd5a3fc9a394487bb5d9412ccfe0bac" } modify_external_catalogs: true
I20260616 19:52:07.577190 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 685) took 3532 ms. Trace:
I20260616 19:52:07.578554 1190 rpcz_store.cc:276] 0616 19:52:04.044577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.080806 (+ 36229us) service_pool.cc:224] Handling call
0616 19:52:07.563517 (+3482711us) ts_tablet_manager.cc:1151] Deleting tablet 352ca272888f4dd2ab1a8127bb8c2b6e
0616 19:52:07.563527 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.577167 (+ 13640us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3482528}
I20260616 19:52:07.583601 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 686) took 3538 ms. Trace:
I20260616 19:52:07.583758 1190 rpcz_store.cc:276] 0616 19:52:04.044655 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.081000 (+ 36345us) service_pool.cc:224] Handling call
0616 19:52:07.579072 (+3498072us) ts_tablet_manager.cc:1151] Deleting tablet 451ef03db89043cbbed12a2a48a16adb
0616 19:52:07.583477 (+ 4405us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.583583 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3497947}
I20260616 19:52:07.584590 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b1c4351701974ad8945770a0482b8df5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:07.585248 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 687) took 3540 ms. Trace:
I20260616 19:52:07.585391 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_63d5b017cead47c3b7859cb97f00d64f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:07.585408 1190 rpcz_store.cc:276] 0616 19:52:04.044727 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.081113 (+ 36386us) service_pool.cc:224] Handling call
0616 19:52:07.584230 (+3503117us) ts_tablet_manager.cc:1151] Deleting tablet d686190fb6a34ab18cc4799197765f1b
0616 19:52:07.585128 (+ 898us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.585232 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3503001}
I20260616 19:52:07.585851 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 688) took 3541 ms. Trace:
I20260616 19:52:07.585920 1190 rpcz_store.cc:276] 0616 19:52:04.044809 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.081226 (+ 36417us) service_pool.cc:224] Handling call
0616 19:52:07.585755 (+3504529us) ts_tablet_manager.cc:1151] Deleting tablet 0a406124a8d34e578ba94fab2a873a55
0616 19:52:07.585765 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.585836 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3504422}
I20260616 19:52:07.585990 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f7ccee58ecd349ceae600f3b097451c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:07.586717 1190 tablet_replica.cc:333] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:07.586761 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9a016ce4f9ae4cec8cd633eb68a288bc" } new_table_name: "default.Table_46b4bfa888f24ed891dbe0678898e6c9" modify_external_catalogs: true
I20260616 19:52:07.587247 1190 raft_consensus.cc:2243] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:07.588191 1190 raft_consensus.cc:2272] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.588600 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 1bc181171b134de2b946376f468aec72 (table default.Table_daf95e025c454ee1b78a61861cc1a23d [id=625dfecea84f40369353e2b7a6408e01]) successfully deleted
W20260616 19:52:07.589500 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 352ca272888f4dd2ab1a8127bb8c2b6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 352ca272888f4dd2ab1a8127bb8c2b6e already in progress: creating tablet
I20260616 19:52:07.590162 1190 ts_tablet_manager.cc:1916] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:07.590221 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1c4351701974ad8945770a0482b8df5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:07.590359 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63d5b017cead47c3b7859cb97f00d64f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:07.590456 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7ccee58ecd349ceae600f3b097451c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:07.601742 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d6707acac4ee4283b138fb44e4e82ce5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6707acac4ee4283b138fb44e4e82ce5 already in progress: creating tablet
W20260616 19:52:07.602025 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 26b044bb36c84f64a32c774515a339c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26b044bb36c84f64a32c774515a339c4 already in progress: creating tablet
W20260616 19:52:07.602236 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a7cc0edadc1948ffbe15febbebb27b45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7cc0edadc1948ffbe15febbebb27b45 already in progress: creating tablet
W20260616 19:52:07.602407 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7 already in progress: creating tablet
W20260616 19:52:07.602620 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d7c3e760d24247a5bc2b17a610ff49dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7c3e760d24247a5bc2b17a610ff49dc already in progress: creating tablet
W20260616 19:52:07.602804 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d522cc4b346241d1bac695f9a1d40fbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d522cc4b346241d1bac695f9a1d40fbb already in progress: creating tablet
W20260616 19:52:07.603010 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c44422ddb8ce45a48bb9aaeb6c209f21 because the tablet was not found. No further retry: Not found: Tablet not found: c44422ddb8ce45a48bb9aaeb6c209f21
W20260616 19:52:07.603188 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 6396397965c44e07850a6cc42cefab09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6396397965c44e07850a6cc42cefab09 already in progress: creating tablet
W20260616 19:52:07.603353 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 272838af35d840faa7b11217456533c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 272838af35d840faa7b11217456533c2 already in progress: creating tablet
W20260616 19:52:07.603489 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f4095b92df9a422e85e38513e19eabc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4095b92df9a422e85e38513e19eabc7 already in progress: creating tablet
W20260616 19:52:07.603636 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f872a8860a4b421483441d71814be4fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f872a8860a4b421483441d71814be4fc already in progress: creating tablet
W20260616 19:52:07.603777 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet cfbc5c9485b94928b6ae9a1f206c9c45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cfbc5c9485b94928b6ae9a1f206c9c45 already in progress: creating tablet
W20260616 19:52:07.603925 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 3a4a2f467b5b4121ae9a9973c153c69f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a4a2f467b5b4121ae9a9973c153c69f already in progress: creating tablet
W20260616 19:52:07.604070 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 3fcdc7ae19874ca794ae71d228e6ab27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fcdc7ae19874ca794ae71d228e6ab27 already in progress: creating tablet
W20260616 19:52:07.604257 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet b1771a4ed9d649558fed580992af1f96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1771a4ed9d649558fed580992af1f96 already in progress: creating tablet
W20260616 19:52:07.604411 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet ce114bf2907945889f8f1050d63d3965 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce114bf2907945889f8f1050d63d3965 already in progress: creating tablet
I20260616 19:52:07.614475 1190 ts_tablet_manager.cc:1929] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:07.621136 1192 tablet_bootstrap.cc:492] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:07.624614 1190 log.cc:1199] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/99b211692aca478bb40f0f2c3f50ca44
I20260616 19:52:07.624890 1192 ts_tablet_manager.cc:1403] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.091s user 0.011s sys 0.000s
I20260616 19:52:07.625294 1190 ts_tablet_manager.cc:1950] T 99b211692aca478bb40f0f2c3f50ca44 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
W20260616 19:52:07.604554 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 451ef03db89043cbbed12a2a48a16adb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 451ef03db89043cbbed12a2a48a16adb already in progress: creating tablet
I20260616 19:52:07.626133 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 689) took 3486 ms. Trace:
W20260616 19:52:07.626291 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d686190fb6a34ab18cc4799197765f1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d686190fb6a34ab18cc4799197765f1b already in progress: creating tablet
I20260616 19:52:07.626207 1190 rpcz_store.cc:276] 0616 19:52:04.140311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.141337 (+ 1026us) service_pool.cc:224] Handling call
0616 19:52:07.586676 (+3445339us) ts_tablet_manager.cc:1151] Deleting tablet 99b211692aca478bb40f0f2c3f50ca44
0616 19:52:07.586685 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.593976 (+ 7291us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.614419 (+ 20443us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.626116 (+ 11697us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3445141}
W20260616 19:52:07.626528 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 0a406124a8d34e578ba94fab2a873a55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a406124a8d34e578ba94fab2a873a55 already in progress: creating tablet
I20260616 19:52:07.626432 1192 raft_consensus.cc:359] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.626749 1192 raft_consensus.cc:385] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.626878 1192 raft_consensus.cc:740] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.627244 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 99b211692aca478bb40f0f2c3f50ca44 (table default.Table_718b661372f441feb171907daff44e2d [id=a5404ca6c40f44b8b881ef582d703fd5]) successfully deleted
I20260616 19:52:07.627274 1192 consensus_queue.cc:260] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.627315 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 691) took 3417 ms. Trace:
I20260616 19:52:07.627815 1190 rpcz_store.cc:276] 0616 19:52:04.209854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.212552 (+ 2698us) service_pool.cc:224] Handling call
0616 19:52:07.627192 (+3414640us) ts_tablet_manager.cc:1151] Deleting tablet d2b3bbc4adb0492a87cd9226cf6a3c8f
0616 19:52:07.627203 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.627300 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3414437}
I20260616 19:52:07.628340 892 tablet_service.cc:1511] Processing CreateTablet for tablet 170cf5905025434995e7c9cdc802211b (DEFAULT_TABLE table=default.Table_4cabb1304dc14288988fe837d088cc27 [id=c6680b8e2629450ea3b07af3c13c12b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.628648 903 tablet_service.cc:1511] Processing CreateTablet for tablet 4f858ecd77984b1c9f729e201b099e66 (DEFAULT_TABLE table=default.Table_80cdd5c8e7c245798a9bfe9ba16072f7 [id=33cb3299ee56407691fbe4532ac81108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.628799 886 tablet_service.cc:1511] Processing CreateTablet for tablet 685aadc62418461ebad96b58a9ccca35 (DEFAULT_TABLE table=default.Table_8e9f4830e713476d8fbd5693a5179d9a [id=bd6c8e957fcf480384abdf4dd5689ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.629256 902 tablet_service.cc:1511] Processing CreateTablet for tablet 8b127b94a7e948798efc4e93512dc691 (DEFAULT_TABLE table=default.Table_268e03dfbe624ecda3c79e40904e6299 [id=f1f9b4a24a2a4cb5acfd2997d4f1bd35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.629858 891 tablet_service.cc:1511] Processing CreateTablet for tablet 337f646b06024c0eacb335b6e2929e17 (DEFAULT_TABLE table=default.Table_0d0adaa9cacc40e38a992a15eccff3ec [id=bcc3afe19bae4635a2d5a5043a871a52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.630144 890 tablet_service.cc:1511] Processing CreateTablet for tablet b404671bc58045538f2c27b3d2c01478 (DEFAULT_TABLE table=default.Table_2d3af2b449be4a3e86c6f58dfda03e6d [id=0efb8878e15146aaa89716a02c60d8c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.630291 889 tablet_service.cc:1511] Processing CreateTablet for tablet 43f2f5f0d53a4098bef75a9006c81e80 (DEFAULT_TABLE table=default.Table_b75452879004490ca0a5e9a28ddf4b80 [id=6f09777934f741ab973f6a9c87de4761]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:07.630549 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d2b3bbc4adb0492a87cd9226cf6a3c8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2b3bbc4adb0492a87cd9226cf6a3c8f already in progress: creating tablet
W20260616 19:52:07.630895 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet db750fc9641f492494fdb167de86f6df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db750fc9641f492494fdb167de86f6df already in progress: creating tablet
I20260616 19:52:07.631497 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170cf5905025434995e7c9cdc802211b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.631733 753 tablet_service.cc:1511] Processing CreateTablet for tablet 43f2f5f0d53a4098bef75a9006c81e80 (DEFAULT_TABLE table=default.Table_b75452879004490ca0a5e9a28ddf4b80 [id=6f09777934f741ab973f6a9c87de4761]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.632169 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f2f5f0d53a4098bef75a9006c81e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.636914 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 690) took 3440 ms. Trace:
I20260616 19:52:07.637012 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f858ecd77984b1c9f729e201b099e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.637054 1190 rpcz_store.cc:276] 0616 19:52:04.196610 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.196881 (+ 271us) service_pool.cc:224] Handling call
0616 19:52:07.629184 (+3432303us) ts_tablet_manager.cc:1151] Deleting tablet c6be4a4739464be7b246a54b7a33adaf
0616 19:52:07.636785 (+ 7601us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.636894 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3402007}
I20260616 19:52:07.637372 751 tablet_service.cc:1511] Processing CreateTablet for tablet b404671bc58045538f2c27b3d2c01478 (DEFAULT_TABLE table=default.Table_2d3af2b449be4a3e86c6f58dfda03e6d [id=0efb8878e15146aaa89716a02c60d8c5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:07.637537 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c6be4a4739464be7b246a54b7a33adaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6be4a4739464be7b246a54b7a33adaf already in progress: creating tablet
I20260616 19:52:07.637712 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b404671bc58045538f2c27b3d2c01478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.637863 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 698) took 3068 ms. Trace:
I20260616 19:52:07.637928 1190 rpcz_store.cc:276] 0616 19:52:04.568965 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.569028 (+ 63us) service_pool.cc:224] Handling call
0616 19:52:07.637759 (+3068731us) ts_tablet_manager.cc:1151] Deleting tablet 0b362fa598a54632880faa42a9224ffd
0616 19:52:07.637767 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.637841 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3068503}
W20260616 19:52:07.638330 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 0b362fa598a54632880faa42a9224ffd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b362fa598a54632880faa42a9224ffd already in progress: creating tablet
I20260616 19:52:07.638636 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 703) took 2960 ms. Trace:
I20260616 19:52:07.638712 1190 rpcz_store.cc:276] 0616 19:52:04.678705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.678761 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:07.638537 (+2959776us) ts_tablet_manager.cc:1151] Deleting tablet 7bab084824a84c218ef69a18971e4b47
0616 19:52:07.638545 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.638622 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2959136}
W20260616 19:52:07.639067 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 7bab084824a84c218ef69a18971e4b47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bab084824a84c218ef69a18971e4b47 already in progress: creating tablet
I20260616 19:52:07.639371 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 700) took 2982 ms. Trace:
I20260616 19:52:07.639430 1190 rpcz_store.cc:276] 0616 19:52:04.656452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.656527 (+ 75us) service_pool.cc:224] Handling call
0616 19:52:07.639283 (+2982756us) ts_tablet_manager.cc:1151] Deleting tablet 1d825bcf365f424fb99a10afe3e96501
0616 19:52:07.639292 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.639356 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2946404}
W20260616 19:52:07.639819 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 1d825bcf365f424fb99a10afe3e96501 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d825bcf365f424fb99a10afe3e96501 already in progress: creating tablet
I20260616 19:52:07.640137 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 704) took 2947 ms. Trace:
I20260616 19:52:07.640203 1190 rpcz_store.cc:276] 0616 19:52:04.693035 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.693084 (+ 49us) service_pool.cc:224] Handling call
0616 19:52:07.640028 (+2946944us) ts_tablet_manager.cc:1151] Deleting tablet 8cf5611e97e14eb1bf8515532f3a43be
0616 19:52:07.640036 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.640122 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2929616}
I20260616 19:52:07.604737 456 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 9c77fd138ce9463b8f2d6f4182a56559 (table default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17]). Expected version 1 got 0
W20260616 19:52:07.640609 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 8cf5611e97e14eb1bf8515532f3a43be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cf5611e97e14eb1bf8515532f3a43be already in progress: creating tablet
I20260616 19:52:07.641093 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b404671bc58045538f2c27b3d2c01478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.641074 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 706) took 2664 ms. Trace:
I20260616 19:52:07.641563 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_63bb1983029d46eeb2eff78065f24ca5" } new_table_name: "default.Table_f56d13a3e06b488ca66f63af67002ef4" modify_external_catalogs: true
I20260616 19:52:07.641716 1190 rpcz_store.cc:276] 0616 19:52:04.977107 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:04.977157 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:07.640977 (+2663820us) ts_tablet_manager.cc:1151] Deleting tablet a2904f2e00314858899a760b84950e1f
0616 19:52:07.640984 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.641059 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2663639}
W20260616 19:52:07.642127 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a2904f2e00314858899a760b84950e1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2904f2e00314858899a760b84950e1f already in progress: creating tablet
I20260616 19:52:07.642685 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 720) took 2447 ms. Trace:
I20260616 19:52:07.642755 1190 rpcz_store.cc:276] 0616 19:52:05.194910 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.194961 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:07.642581 (+2447620us) ts_tablet_manager.cc:1151] Deleting tablet f92e45da793440d59439c715e8e50249
0616 19:52:07.642591 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.642666 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2447422}
W20260616 19:52:07.643121 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet f92e45da793440d59439c715e8e50249 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f92e45da793440d59439c715e8e50249 already in progress: creating tablet
I20260616 19:52:07.643296 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 9c77fd138ce9463b8f2d6f4182a56559 (table default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17]). Expected version 1 got 0
I20260616 19:52:07.643555 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 4d3f47e767764032ae5a06e34e2de248 (table default.Table_1516f5dc3b2b4de48c2c4076d1cb1205 [id=af4aada43ecf46b8bacf0d9d1388e92e]). Expected version 1 got 0
I20260616 19:52:07.643822 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 733) took 1950 ms. Trace:
I20260616 19:52:07.643699 461 catalog_manager.cc:5696] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 1 to 2, leader changed from ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130) to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 2 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } }
I20260616 19:52:07.643885 1190 rpcz_store.cc:276] 0616 19:52:05.692947 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.699814 (+ 6867us) service_pool.cc:224] Handling call
0616 19:52:07.643736 (+1943922us) ts_tablet_manager.cc:1151] Deleting tablet 7955886341a94249afa849c51d34a0be
0616 19:52:07.643744 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.643808 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1943743}
W20260616 19:52:07.644282 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 7955886341a94249afa849c51d34a0be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7955886341a94249afa849c51d34a0be already in progress: creating tablet
W20260616 19:52:07.617640 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5cdab77ddde941bbafc23c90f45270ef consensus state has no leader
I20260616 19:52:07.619783 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 990ea67ce4664c27857a15bac92d0d42
I20260616 19:52:07.645177 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b127b94a7e948798efc4e93512dc691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.645614 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_771c21e2e42f493baa45a3dd0c7df5e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:07.645888 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_558d3e1cd5dd4d3dad3ba5d0a43bb76f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.646174 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_771c21e2e42f493baa45a3dd0c7df5e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:07.646275 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_558d3e1cd5dd4d3dad3ba5d0a43bb76f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.620167 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 5b34d497f9334e94b06cc9245fca04ed
I20260616 19:52:07.647636 460 catalog_manager.cc:6784] ReplaceTablet: tablet 5b34d497f9334e94b06cc9245fca04ed deleted and replaced by tablet b949b3d1e16d49a6a1bce5ca21a268c3
I20260616 19:52:07.647908 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 734) took 1905 ms. Trace:
I20260616 19:52:07.647964 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dc32eb83877c44ef9915af11d1e1a1b0" } new_table_name: "default.Table_b8e53692fe644e23bb67d13957bd8313" modify_external_catalogs: true
I20260616 19:52:07.647972 1190 rpcz_store.cc:276] 0616 19:52:05.742219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.742560 (+ 341us) service_pool.cc:224] Handling call
0616 19:52:07.647810 (+1905250us) ts_tablet_manager.cc:1151] Deleting tablet 8dcb663cf2e443f1acd4b18280378729
0616 19:52:07.647820 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.647893 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1905020}
I20260616 19:52:07.648684 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337f646b06024c0eacb335b6e2929e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.648780 1190 tablet_replica.cc:333] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:07.624012 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_934ab6946cae48ae8570ec7973cd70fa" } new_table_name: "default.Table_26590e65265a4f7f9bdba214ba969d00" modify_external_catalogs: true
I20260616 19:52:07.648948 1190 raft_consensus.cc:2243] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.649101 1190 raft_consensus.cc:2272] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.650157 765 tablet_service.cc:1511] Processing CreateTablet for tablet 170cf5905025434995e7c9cdc802211b (DEFAULT_TABLE table=default.Table_4cabb1304dc14288988fe837d088cc27 [id=c6680b8e2629450ea3b07af3c13c12b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.650403 750 tablet_service.cc:1511] Processing CreateTablet for tablet 685aadc62418461ebad96b58a9ccca35 (DEFAULT_TABLE table=default.Table_8e9f4830e713476d8fbd5693a5179d9a [id=bd6c8e957fcf480384abdf4dd5689ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.650496 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170cf5905025434995e7c9cdc802211b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.650755 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685aadc62418461ebad96b58a9ccca35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.653324 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685aadc62418461ebad96b58a9ccca35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.625061 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_883e227c1e8f4e85b6265ea1dee66680"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:07.624430 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7af7e490f00745fb8ac2052e56b9d680"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.656716 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7af7e490f00745fb8ac2052e56b9d680 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.657272 1190 ts_tablet_manager.cc:1916] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:07.657963 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_883e227c1e8f4e85b6265ea1dee66680 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:07.658077 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 964384a661834a6e9ffaa4724a0ee3be consensus state has no leader
I20260616 19:52:07.658517 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9b86a6539e534ff4a58c2c7ad01e99a0" } modify_external_catalogs: true
I20260616 19:52:07.658679 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9b86a6539e534ff4a58c2c7ad01e99a0" } modify_external_catalogs: true
I20260616 19:52:07.658836 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f2f5f0d53a4098bef75a9006c81e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.659773 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 990ea67ce4664c27857a15bac92d0d42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.659962 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b34d497f9334e94b06cc9245fca04ed with delete_type TABLET_DATA_DELETED (replaced by tablet b949b3d1e16d49a6a1bce5ca21a268c3) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:07.660249 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 8dcb663cf2e443f1acd4b18280378729 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8dcb663cf2e443f1acd4b18280378729 already in progress: creating tablet
W20260616 19:52:07.669916 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 856ac4b8693941c7a19bb68f09ba1b73 consensus state has no leader
I20260616 19:52:07.671703 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 9c77fd138ce9463b8f2d6f4182a56559 (table default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17]). Expected version 1 got 0
I20260616 19:52:07.679005 765 tablet_service.cc:1511] Processing CreateTablet for tablet 4f858ecd77984b1c9f729e201b099e66 (DEFAULT_TABLE table=default.Table_80cdd5c8e7c245798a9bfe9ba16072f7 [id=33cb3299ee56407691fbe4532ac81108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.679186 902 tablet_service.cc:1511] Processing CreateTablet for tablet faf4a0e2d3a1415aafe22501d8ae88b4 (DEFAULT_TABLE table=default.Table_c2e1e7cdea7441a9908f57ba754d8696 [id=0465ac6fb8a24767a03a702199ee69c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.679466 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f858ecd77984b1c9f729e201b099e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.679996 887 tablet_service.cc:1511] Processing CreateTablet for tablet b1a8c130213c4f20b7865c626a3c49cd (DEFAULT_TABLE table=default.Table_e58e0bf11d324917aa7b5d6553a4c3e8 [id=35923f0dcccd4063851c536b258aed85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.680336 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a8c130213c4f20b7865c626a3c49cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.681559 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 63bb0e724ba04f79809850febc966c66 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:07.682431 1192 ts_tablet_manager.cc:1434] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.057s user 0.003s sys 0.000s
I20260616 19:52:07.687139 886 tablet_service.cc:1511] Processing CreateTablet for tablet c9c883c54a9742a2bbc7f95d9bd158cb (DEFAULT_TABLE table=default.Table_c5ecb50cf15042beaaefc878ab2172ab [id=01797cfada0c427db6c6498bf8ed0073]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.687525 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9c883c54a9742a2bbc7f95d9bd158cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.687695 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf4a0e2d3a1415aafe22501d8ae88b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.690291 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 990ea67ce4664c27857a15bac92d0d42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.690758 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b34d497f9334e94b06cc9245fca04ed with delete_type TABLET_DATA_DELETED (replaced by tablet b949b3d1e16d49a6a1bce5ca21a268c3) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.690955 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 13e4e52fae124d4085b15e143e98a7e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.691016 1193 tablet_replica.cc:333] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:07.691112 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 31592a5ffb04429c9315a4fd72308f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:07.691262 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e8d16ee7d094d61884c72d8eac98e37 consensus state has no leader
I20260616 19:52:07.691295 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ba2eefdfed14791b5a41decc34dce44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.691615 757 tablet_service.cc:1511] Processing CreateTablet for tablet b1a8c130213c4f20b7865c626a3c49cd (DEFAULT_TABLE table=default.Table_e58e0bf11d324917aa7b5d6553a4c3e8 [id=35923f0dcccd4063851c536b258aed85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.691960 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a8c130213c4f20b7865c626a3c49cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.692802 1192 tablet_bootstrap.cc:492] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:07.695263 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 3b57bceabff64533ae3a49b8afda614d
I20260616 19:52:07.695938 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b57bceabff64533ae3a49b8afda614d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.696736 758 tablet_service.cc:1511] Processing CreateTablet for tablet c9c883c54a9742a2bbc7f95d9bd158cb (DEFAULT_TABLE table=default.Table_c5ecb50cf15042beaaefc878ab2172ab [id=01797cfada0c427db6c6498bf8ed0073]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.697078 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9c883c54a9742a2bbc7f95d9bd158cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.697999 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_093bd1c50f834db49bf52da0c66fae6d" } modify_external_catalogs: true
I20260616 19:52:07.698185 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_093bd1c50f834db49bf52da0c66fae6d" } modify_external_catalogs: true
I20260616 19:52:07.699774 890 tablet_service.cc:1511] Processing CreateTablet for tablet a7068e6097064553bdf353fa01ca9513 (DEFAULT_TABLE table=default.Table_a0a2f166e53c42be920e5837da2af9c0 [id=c7a068331d3943f9b1a453e138f4387c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.700088 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7068e6097064553bdf353fa01ca9513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.700434 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4791ad7d3cf045f6b0c8ae18d7977c59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.700970 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4791ad7d3cf045f6b0c8ae18d7977c59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.702313 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 9c77fd138ce9463b8f2d6f4182a56559 (table default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17]). Expected version 1 got 0
I20260616 19:52:07.700155 1192 tablet_bootstrap.cc:654] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.703051 887 tablet_service.cc:1511] Processing CreateTablet for tablet bd7b91e00d6c4f70b0eda75fe83d617e (DEFAULT_TABLE table=default.Table_c2b44a48b8754af487aa042a8b651b52 [id=6040eab84da140d89abf9f7d124f453e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.703505 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7b91e00d6c4f70b0eda75fe83d617e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.704303 750 tablet_service.cc:1511] Processing CreateTablet for tablet faf4a0e2d3a1415aafe22501d8ae88b4 (DEFAULT_TABLE table=default.Table_c2e1e7cdea7441a9908f57ba754d8696 [id=0465ac6fb8a24767a03a702199ee69c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.704668 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf4a0e2d3a1415aafe22501d8ae88b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.704879 891 tablet_service.cc:1511] Processing CreateTablet for tablet b65c52ad5b0d48caa5da88c75c60971c (DEFAULT_TABLE table=default.Table_741b674265134685a9c017247e4df71e [id=5c542a2fab584b4893de2f2d5a2f3fa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.705248 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65c52ad5b0d48caa5da88c75c60971c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.708824 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d7bbc81ef86a48cf994293fb0c9dd2da" } modify_external_catalogs: true
I20260616 19:52:07.709009 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d7bbc81ef86a48cf994293fb0c9dd2da" } modify_external_catalogs: true
I20260616 19:52:07.710450 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bb4236ba15c042c2a67d464a935dd973" } modify_external_catalogs: true
I20260616 19:52:07.710654 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bb4236ba15c042c2a67d464a935dd973" } modify_external_catalogs: true
I20260616 19:52:07.711959 889 tablet_service.cc:1511] Processing CreateTablet for tablet d96f12219218401f946dabe5cb07e80d (DEFAULT_TABLE table=default.Table_d0c4d2430280407e9ddf91a5e1ab4382 [id=5fe6970110d84daa851cfb3e7a726767]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.712412 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96f12219218401f946dabe5cb07e80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.718592 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b57bceabff64533ae3a49b8afda614d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:07.719709 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 990ea67ce4664c27857a15bac92d0d42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 990ea67ce4664c27857a15bac92d0d42 already in progress: creating tablet
I20260616 19:52:07.720633 765 tablet_service.cc:1511] Processing CreateTablet for tablet a7068e6097064553bdf353fa01ca9513 (DEFAULT_TABLE table=default.Table_a0a2f166e53c42be920e5837da2af9c0 [id=c7a068331d3943f9b1a453e138f4387c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.721062 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7068e6097064553bdf353fa01ca9513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.722474 1193 raft_consensus.cc:2243] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.722772 1193 raft_consensus.cc:2272] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.724323 1193 ts_tablet_manager.cc:1916] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.728747 762 tablet_service.cc:1511] Processing CreateTablet for tablet d96f12219218401f946dabe5cb07e80d (DEFAULT_TABLE table=default.Table_d0c4d2430280407e9ddf91a5e1ab4382 [id=5fe6970110d84daa851cfb3e7a726767]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.730893 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96f12219218401f946dabe5cb07e80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.731608 1193 ts_tablet_manager.cc:1929] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:07.731714 1193 log.cc:1199] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/5b34d497f9334e94b06cc9245fca04ed
I20260616 19:52:07.732091 1193 ts_tablet_manager.cc:1950] T 5b34d497f9334e94b06cc9245fca04ed P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:07.733053 1193 tablet_replica.cc:333] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:07.733210 1193 raft_consensus.cc:2243] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.733338 1193 raft_consensus.cc:2272] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.733791 1193 ts_tablet_manager.cc:1916] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.735042 455 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 4d3f47e767764032ae5a06e34e2de248 (table default.Table_1516f5dc3b2b4de48c2c4076d1cb1205 [id=af4aada43ecf46b8bacf0d9d1388e92e]). Expected version 1 got 0
I20260616 19:52:07.735410 455 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet df036f9d31ca4770bb00bc9cece46953 (table default.Table_58b6a6df64fe459ab7a7abb175850554 [id=548cacd5de984fa89aa96b1c659f9e38]). Expected version 4 got 0
I20260616 19:52:07.747917 458 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_f5c1eb12b45345aabb7ab3c7a1854ead [id=c7d1624942fb42aa95ad085062052262] alter complete (version 4)
I20260616 19:52:07.749432 751 tablet_service.cc:1511] Processing CreateTablet for tablet 8b127b94a7e948798efc4e93512dc691 (DEFAULT_TABLE table=default.Table_268e03dfbe624ecda3c79e40904e6299 [id=f1f9b4a24a2a4cb5acfd2997d4f1bd35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.749838 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b127b94a7e948798efc4e93512dc691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.755530 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 99b211692aca478bb40f0f2c3f50ca44 with delete_type TABLET_DATA_DELETED (replaced by tablet 44493f0ffd064249a28628cf24895395) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.755853 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 73a754c728b5408eb47f91de93554ec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.756080 890 tablet_service.cc:1558] Processing DeleteTablet for tablet fdc6222db09d4cd987cbdf70e4d40f70 with delete_type TABLET_DATA_DELETED (replaced by tablet d5c82b71969e4cbcb890d16e1cdd5348) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.756569 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ba2eefdfed14791b5a41decc34dce44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.756819 750 tablet_service.cc:1511] Processing CreateTablet for tablet bd7b91e00d6c4f70b0eda75fe83d617e (DEFAULT_TABLE table=default.Table_c2b44a48b8754af487aa042a8b651b52 [id=6040eab84da140d89abf9f7d124f453e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.756896 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc181171b134de2b946376f468aec72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.757299 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7b91e00d6c4f70b0eda75fe83d617e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.760329 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 4d3f47e767764032ae5a06e34e2de248 (table default.Table_1516f5dc3b2b4de48c2c4076d1cb1205 [id=af4aada43ecf46b8bacf0d9d1388e92e]). Expected version 1 got 0
I20260616 19:52:07.760548 1192 tablet_bootstrap.cc:492] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:07.760744 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet eb04ccc26e64484a9a29c515d4b954fe
I20260616 19:52:07.760812 1192 ts_tablet_manager.cc:1403] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.002s
I20260616 19:52:07.761473 753 tablet_service.cc:1511] Processing CreateTablet for tablet 337f646b06024c0eacb335b6e2929e17 (DEFAULT_TABLE table=default.Table_0d0adaa9cacc40e38a992a15eccff3ec [id=bcc3afe19bae4635a2d5a5043a871a52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.762072 1192 raft_consensus.cc:359] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.762176 758 tablet_service.cc:1511] Processing CreateTablet for tablet b65c52ad5b0d48caa5da88c75c60971c (DEFAULT_TABLE table=default.Table_741b674265134685a9c017247e4df71e [id=5c542a2fab584b4893de2f2d5a2f3fa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.762588 891 tablet_service.cc:1558] Processing DeleteTablet for tablet eb04ccc26e64484a9a29c515d4b954fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.762442 1192 raft_consensus.cc:385] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.763027 1192 raft_consensus.cc:740] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.772737 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 63bb0e724ba04f79809850febc966c66
I20260616 19:52:07.773499 460 catalog_manager.cc:6784] ReplaceTablet: tablet 63bb0e724ba04f79809850febc966c66 deleted and replaced by tablet 1106555fe0f44aa595f2ba00a19e914a
I20260616 19:52:07.773388 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 31592a5ffb04429c9315a4fd72308f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.774304 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ebe069dd3e414b48b27769cd281b579d
I20260616 19:52:07.774523 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 79250767a94141cd900a9715e86128b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.775334 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 099199fa60b94308acb423f04d988f65
I20260616 19:52:07.777032 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337f646b06024c0eacb335b6e2929e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.777253 886 tablet_service.cc:1558] Processing DeleteTablet for tablet ebe069dd3e414b48b27769cd281b579d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.777570 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bb0e724ba04f79809850febc966c66 with delete_type TABLET_DATA_DELETED (replaced by tablet 1106555fe0f44aa595f2ba00a19e914a) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.777666 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65c52ad5b0d48caa5da88c75c60971c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.763859 1192 consensus_queue.cc:260] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.781976 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 76d73be228664063822c41cbefafcab8 (table default.Table_16508a5420d3488088367681d9b55f03 [id=946fd4fcf5f244acafa1e82743e70af2]). Expected version 2 got 0
I20260616 19:52:07.786657 1192 ts_tablet_manager.cc:1434] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260616 19:52:07.791867 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bb0e724ba04f79809850febc966c66 with delete_type TABLET_DATA_DELETED (replaced by tablet 1106555fe0f44aa595f2ba00a19e914a) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.791985 2102 raft_consensus.cc:493] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.792153 2102 raft_consensus.cc:515] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.792802 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 099199fa60b94308acb423f04d988f65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.792961 2102 leader_election.cc:290] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:07.793334 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d80d9028184443da49623228259263d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:07.793430 765 tablet_service.cc:1558] Processing DeleteTablet for tablet ebe069dd3e414b48b27769cd281b579d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:07.793879 718 leader_election.cc:343] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.794337 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d80d9028184443da49623228259263d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.794575 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 73a754c728b5408eb47f91de93554ec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.794818 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 099199fa60b94308acb423f04d988f65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.795428 765 tablet_service.cc:1558] Processing DeleteTablet for tablet d9c664f0386549d6867c407526ee45a0 with delete_type TABLET_DATA_DELETED (replaced by tablet 3c90eb04585c4fa992435d11015ffec7) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.796430 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c55c1fac1f784f91b12629f33809763c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:07.797083 1190 ts_tablet_manager.cc:1929] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260616 19:52:07.797161 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c55c1fac1f784f91b12629f33809763c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.797209 1190 log.cc:1199] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/8eab5bd3967c42e1b6b79558df742946
I20260616 19:52:07.797636 1190 ts_tablet_manager.cc:1950] T 8eab5bd3967c42e1b6b79558df742946 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:07.797645 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 76d73be228664063822c41cbefafcab8 (table default.Table_16508a5420d3488088367681d9b55f03 [id=946fd4fcf5f244acafa1e82743e70af2]). Expected version 2 got 0
I20260616 19:52:07.797979 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 736) took 2054 ms. Trace:
I20260616 19:52:07.798072 1190 rpcz_store.cc:276] 0616 19:52:05.743932 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.743988 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:07.648745 (+1904757us) ts_tablet_manager.cc:1151] Deleting tablet 8eab5bd3967c42e1b6b79558df742946
0616 19:52:07.648752 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.752527 (+103775us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.797006 (+ 44479us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.797962 (+ 956us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1904589}
I20260616 19:52:07.798507 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 735) took 2054 ms. Trace:
I20260616 19:52:07.798583 1190 rpcz_store.cc:276] 0616 19:52:05.743662 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.744315 (+ 653us) service_pool.cc:224] Handling call
0616 19:52:07.798393 (+2054078us) ts_tablet_manager.cc:1151] Deleting tablet d5c82b71969e4cbcb890d16e1cdd5348
0616 19:52:07.798402 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.798494 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2053889}
I20260616 19:52:07.798821 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 8eab5bd3967c42e1b6b79558df742946 (table default.Table_8fff86d5c2344e2fb59db9872ee90b74 [id=06f5d602dcec42a884b5eb53f9d0a27c]) successfully deleted
W20260616 19:52:07.799098 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d5c82b71969e4cbcb890d16e1cdd5348 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5c82b71969e4cbcb890d16e1cdd5348 already in progress: creating tablet
I20260616 19:52:07.799383 1193 ts_tablet_manager.cc:1929] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:07.799489 1193 log.cc:1199] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/13e4e52fae124d4085b15e143e98a7e4
I20260616 19:52:07.799746 1193 ts_tablet_manager.cc:1950] T 13e4e52fae124d4085b15e143e98a7e4 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:07.589483 1198 tablet_bootstrap.cc:492] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:07.800590 1193 tablet_replica.cc:333] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:07.800595 1198 ts_tablet_manager.cc:1403] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.248s user 0.004s sys 0.000s
I20260616 19:52:07.800756 1193 raft_consensus.cc:2243] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.800890 1193 raft_consensus.cc:2272] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.801774 1193 ts_tablet_manager.cc:1916] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.801810 1198 raft_consensus.cc:359] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.801947 1198 raft_consensus.cc:385] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.801992 1198 raft_consensus.cc:740] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.802194 1198 consensus_queue.cc:260] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.802628 1198 ts_tablet_manager.cc:1434] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:07.802815 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 5b34d497f9334e94b06cc9245fca04ed (table default.Table_7a777a2aa2cd44d1b7f9db66e8367a32 [id=6db44bdac0784e08b52a4db869edb3d3]) successfully deleted
I20260616 19:52:07.802866 1198 tablet_bootstrap.cc:492] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:07.803325 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 13e4e52fae124d4085b15e143e98a7e4 (table default.Table_08665ae0b3d543ee85db56ca306c7f4b [id=ee62532e9e6148ac830ee9efe0a88a24]) successfully deleted
I20260616 19:52:07.595641 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 43f2f5f0d53a4098bef75a9006c81e80 (DEFAULT_TABLE table=default.Table_b75452879004490ca0a5e9a28ddf4b80 [id=6f09777934f741ab973f6a9c87de4761]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.596400 1036 tablet_service.cc:1511] Processing CreateTablet for tablet b404671bc58045538f2c27b3d2c01478 (DEFAULT_TABLE table=default.Table_2d3af2b449be4a3e86c6f58dfda03e6d [id=0efb8878e15146aaa89716a02c60d8c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.803823 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b404671bc58045538f2c27b3d2c01478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.803787 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 79250767a94141cd900a9715e86128b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.606446 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 685aadc62418461ebad96b58a9ccca35 (DEFAULT_TABLE table=default.Table_8e9f4830e713476d8fbd5693a5179d9a [id=bd6c8e957fcf480384abdf4dd5689ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.804497 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685aadc62418461ebad96b58a9ccca35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.607180 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 4f858ecd77984b1c9f729e201b099e66 (DEFAULT_TABLE table=default.Table_80cdd5c8e7c245798a9bfe9ba16072f7 [id=33cb3299ee56407691fbe4532ac81108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.804764 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f858ecd77984b1c9f729e201b099e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.805428 1192 tablet_bootstrap.cc:492] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:07.607939 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 8b127b94a7e948798efc4e93512dc691 (DEFAULT_TABLE table=default.Table_268e03dfbe624ecda3c79e40904e6299 [id=f1f9b4a24a2a4cb5acfd2997d4f1bd35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.805745 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b127b94a7e948798efc4e93512dc691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.608793 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 337f646b06024c0eacb335b6e2929e17 (DEFAULT_TABLE table=default.Table_0d0adaa9cacc40e38a992a15eccff3ec [id=bcc3afe19bae4635a2d5a5043a871a52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.806344 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337f646b06024c0eacb335b6e2929e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.611769 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 170cf5905025434995e7c9cdc802211b (DEFAULT_TABLE table=default.Table_4cabb1304dc14288988fe837d088cc27 [id=c6680b8e2629450ea3b07af3c13c12b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.807261 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170cf5905025434995e7c9cdc802211b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.647567 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 990ea67ce4664c27857a15bac92d0d42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.651146 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b34d497f9334e94b06cc9245fca04ed with delete_type TABLET_DATA_DELETED (replaced by tablet b949b3d1e16d49a6a1bce5ca21a268c3) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.665364 1996 raft_consensus.cc:493] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.676916 1849 raft_consensus.cc:493] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.807734 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet ebe069dd3e414b48b27769cd281b579d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.807684 1996 raft_consensus.cc:515] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.807770 1849 raft_consensus.cc:515] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.681344 1029 tablet_service.cc:1511] Processing CreateTablet for tablet faf4a0e2d3a1415aafe22501d8ae88b4 (DEFAULT_TABLE table=default.Table_c2e1e7cdea7441a9908f57ba754d8696 [id=0465ac6fb8a24767a03a702199ee69c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.807897 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 099199fa60b94308acb423f04d988f65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.684635 1027 tablet_service.cc:1511] Processing CreateTablet for tablet b1a8c130213c4f20b7865c626a3c49cd (DEFAULT_TABLE table=default.Table_e58e0bf11d324917aa7b5d6553a4c3e8 [id=35923f0dcccd4063851c536b258aed85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.808086 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf4a0e2d3a1415aafe22501d8ae88b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.807690 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bb0e724ba04f79809850febc966c66 with delete_type TABLET_DATA_DELETED (replaced by tablet 1106555fe0f44aa595f2ba00a19e914a) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.808259 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a8c130213c4f20b7865c626a3c49cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.690075 1022 tablet_service.cc:1511] Processing CreateTablet for tablet c9c883c54a9742a2bbc7f95d9bd158cb (DEFAULT_TABLE table=default.Table_c5ecb50cf15042beaaefc878ab2172ab [id=01797cfada0c427db6c6498bf8ed0073]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.696045 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b57bceabff64533ae3a49b8afda614d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.700059 1026 tablet_service.cc:1511] Processing CreateTablet for tablet a7068e6097064553bdf353fa01ca9513 (DEFAULT_TABLE table=default.Table_a0a2f166e53c42be920e5837da2af9c0 [id=c7a068331d3943f9b1a453e138f4387c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.703428 1039 tablet_service.cc:1511] Processing CreateTablet for tablet bd7b91e00d6c4f70b0eda75fe83d617e (DEFAULT_TABLE table=default.Table_c2b44a48b8754af487aa042a8b651b52 [id=6040eab84da140d89abf9f7d124f453e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.808954 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9c883c54a9742a2bbc7f95d9bd158cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.809177 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7b91e00d6c4f70b0eda75fe83d617e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.704887 1023 tablet_service.cc:1511] Processing CreateTablet for tablet b65c52ad5b0d48caa5da88c75c60971c (DEFAULT_TABLE table=default.Table_741b674265134685a9c017247e4df71e [id=5c542a2fab584b4893de2f2d5a2f3fa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.707139 1040 tablet_service.cc:1511] Processing CreateTablet for tablet d96f12219218401f946dabe5cb07e80d (DEFAULT_TABLE table=default.Table_d0c4d2430280407e9ddf91a5e1ab4382 [id=5fe6970110d84daa851cfb3e7a726767]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.737329 2160 raft_consensus.cc:493] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.809617 2160 raft_consensus.cc:515] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.758786 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 64aa32856ca34743933931fb51f2bd7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.759253 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 17029c1ba36644e9847200b54bf9094c with delete_type TABLET_DATA_DELETED (replaced by tablet 29df38f273494a079bdc76a915d43dab) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.770390 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet eb04ccc26e64484a9a29c515d4b954fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:07.800427 1191 rpcz_store.cc:276] 0616 19:52:05.876976 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.877019 (+ 43us) service_pool.cc:224] Handling call
0616 19:52:07.415404 (+1538385us) ts_tablet_manager.cc:1151] Deleting tablet 73a754c728b5408eb47f91de93554ec5
0616 19:52:07.415414 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.419307 (+ 3893us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.564796 (+145489us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.566335 (+ 1539us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1538254}
I20260616 19:52:07.813787 750 tablet_service.cc:1511] Processing CreateTablet for tablet 10b02ac0fa4744e48529b35a4ca78567 (DEFAULT_TABLE table=default.Table_826acb8b40cd4a23bfc7e5ee8e988006 [id=43f319924cee43ada7364fa567ae3183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.813889 1192 tablet_bootstrap.cc:654] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.815994 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 73a754c728b5408eb47f91de93554ec5 (table default.Table_5f98dbc56e0e44ba93e5e67cb2a74652 [id=c6d68b5708374d73be79937542dc39a4]) successfully deleted
I20260616 19:52:07.816321 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 755) took 1921 ms. Trace:
I20260616 19:52:07.782423 2164 raft_consensus.cc:493] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.793395 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d80d9028184443da49623228259263d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:07.816452 1191 rpcz_store.cc:276] 0616 19:52:05.895075 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.895124 (+ 49us) service_pool.cc:224] Handling call
0616 19:52:07.816112 (+1920988us) ts_tablet_manager.cc:1151] Deleting tablet 81f881fd3ad244f9afd70b4b99d9384d
0616 19:52:07.816124 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.816279 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1920769}
I20260616 19:52:07.816673 1060 raft_consensus.cc:2468] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:07.781062 2165 raft_consensus.cc:493] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:52:07.817008 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 81f881fd3ad244f9afd70b4b99d9384d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81f881fd3ad244f9afd70b4b99d9384d already in progress: creating tablet
I20260616 19:52:07.817111 2165 raft_consensus.cc:515] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:07.817308 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 756) took 1921 ms. Trace:
I20260616 19:52:07.817327 719 leader_election.cc:304] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:07.817376 2164 raft_consensus.cc:515] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.817653 2163 raft_consensus.cc:493] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.817790 2102 raft_consensus.cc:2804] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:07.817879 2102 raft_consensus.cc:493] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:07.817957 2102 raft_consensus.cc:3060] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:07.819465 753 tablet_service.cc:1558] Processing DeleteTablet for tablet eb04ccc26e64484a9a29c515d4b954fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:07.819597 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_42281f84356440f9b330a2a8c0611cf0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:07.820509 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 737) took 2076 ms. Trace:
I20260616 19:52:07.820883 2102 raft_consensus.cc:515] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.820762 1190 rpcz_store.cc:276] 0616 19:52:05.744257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.744621 (+ 364us) service_pool.cc:224] Handling call
0616 19:52:07.820249 (+2075628us) ts_tablet_manager.cc:1151] Deleting tablet b99740ab59f947aabcac88dc2bf2de86
0616 19:52:07.820259 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.820490 (+ 231us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2075333}
W20260616 19:52:07.821733 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet b99740ab59f947aabcac88dc2bf2de86 because the tablet was not found. No further retry: Not found: Tablet not found: b99740ab59f947aabcac88dc2bf2de86
I20260616 19:52:07.822068 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d80d9028184443da49623228259263d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:07.822220 1060 raft_consensus.cc:3060] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:07.822495 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 739) took 2077 ms. Trace:
I20260616 19:52:07.822676 1190 rpcz_store.cc:276] 0616 19:52:05.745050 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.745099 (+ 49us) service_pool.cc:224] Handling call
0616 19:52:07.822138 (+2077039us) ts_tablet_manager.cc:1151] Deleting tablet eb024637294148c18b74bef47fb2fcce
0616 19:52:07.822238 (+ 100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.822393 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2076893}
W20260616 19:52:07.823827 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet eb024637294148c18b74bef47fb2fcce because the tablet was not found. No further retry: Not found: Tablet not found: eb024637294148c18b74bef47fb2fcce
I20260616 19:52:07.823812 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 738) took 2078 ms. Trace:
I20260616 19:52:07.823818 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d80d9028184443da49623228259263d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:07.824115 2102 leader_election.cc:290] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:07.824059 1190 rpcz_store.cc:276] 0616 19:52:05.744804 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.745131 (+ 327us) service_pool.cc:224] Handling call
0616 19:52:07.823560 (+2078429us) ts_tablet_manager.cc:1151] Deleting tablet ab33d99d857145dfbda54ff2f7464486
0616 19:52:07.823570 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.823711 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2077769}
W20260616 19:52:07.824508 718 leader_election.cc:343] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:07.824913 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet ab33d99d857145dfbda54ff2f7464486 because the tablet was not found. No further retry: Not found: Tablet not found: ab33d99d857145dfbda54ff2f7464486
I20260616 19:52:07.825371 890 tablet_service.cc:1511] Processing CreateTablet for tablet 10b02ac0fa4744e48529b35a4ca78567 (DEFAULT_TABLE table=default.Table_826acb8b40cd4a23bfc7e5ee8e988006 [id=43f319924cee43ada7364fa567ae3183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.826262 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b02ac0fa4744e48529b35a4ca78567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.826238 1196 tablet_bootstrap.cc:492] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:07.826509 1196 ts_tablet_manager.cc:1403] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.288s user 0.027s sys 0.004s
I20260616 19:52:07.827943 1196 raft_consensus.cc:359] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.828289 1196 raft_consensus.cc:385] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.828437 1196 raft_consensus.cc:740] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.828915 1196 consensus_queue.cc:260] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.829346 1192 tablet_bootstrap.cc:492] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:07.829511 1192 ts_tablet_manager.cc:1403] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.004s
I20260616 19:52:07.830235 1192 raft_consensus.cc:359] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.830478 1192 raft_consensus.cc:385] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:07.830571 1192 raft_consensus.cc:740] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:07.830834 1192 consensus_queue.cc:260] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.831485 889 tablet_service.cc:1511] Processing CreateTablet for tablet 51983531f0f5423aa5f4bb3435cd5a7e (DEFAULT_TABLE table=default.Table_f3cb6d6a4b17493eaecd974beddf55a1 [id=6137c81db743472abb696cc49456c112]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.831980 1192 ts_tablet_manager.cc:1434] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20260616 19:52:07.834208 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42281f84356440f9b330a2a8c0611cf0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.835680 891 tablet_service.cc:1511] Processing CreateTablet for tablet 52316bd99a2f4c4ebe4f8dbd1f7e186a (DEFAULT_TABLE table=default.Table_b3ee96c545104d77b1ac2f90ab0b895e [id=2ccbe172f2134dad9f410546868c033c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.836493 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b02ac0fa4744e48529b35a4ca78567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.837075 459 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 76d73be228664063822c41cbefafcab8 (table default.Table_16508a5420d3488088367681d9b55f03 [id=946fd4fcf5f244acafa1e82743e70af2]). Expected version 2 got 0
I20260616 19:52:07.842898 1193 ts_tablet_manager.cc:1929] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:07.843012 1193 log.cc:1199] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/31592a5ffb04429c9315a4fd72308f28
I20260616 19:52:07.843374 1193 ts_tablet_manager.cc:1950] T 31592a5ffb04429c9315a4fd72308f28 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:07.843881 1193 tablet_replica.cc:333] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:07.844127 1193 raft_consensus.cc:2243] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.844305 1193 raft_consensus.cc:2272] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.848017 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 31592a5ffb04429c9315a4fd72308f28 (table default.Table_6a6d8516df114593b27d86140407b724 [id=d104c5ac8acc4a6f9ed7cc87879d661b]) successfully deleted
I20260616 19:52:07.848543 459 master_service.cc:960] ReplaceTablet: received request to replace tablet 3de0e62cfd33410490a0b460fd5f69e9 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:07.850342 753 tablet_service.cc:1511] Processing CreateTablet for tablet 51983531f0f5423aa5f4bb3435cd5a7e (DEFAULT_TABLE table=default.Table_f3cb6d6a4b17493eaecd974beddf55a1 [id=6137c81db743472abb696cc49456c112]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.850838 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51983531f0f5423aa5f4bb3435cd5a7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.856194 1196 ts_tablet_manager.cc:1434] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.029s user 0.002s sys 0.000s
I20260616 19:52:07.856570 1196 tablet_bootstrap.cc:492] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:07.857167 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet cf89adf3cbe54beab939645f7ebbb616 (table default.Table_66491a1a28a6487194eaf8e06bd30094 [id=49836b9e43a84e85b365fba5755f1c44], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cf89adf3cbe54beab939645f7ebbb616 consensus state has no leader
W20260616 19:52:07.859645 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 133372us
I20260616 19:52:07.860389 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96f12219218401f946dabe5cb07e80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.860680 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65c52ad5b0d48caa5da88c75c60971c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.860961 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7068e6097064553bdf353fa01ca9513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.817430 1191 rpcz_store.cc:276] 0616 19:52:05.895584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.895632 (+ 48us) service_pool.cc:224] Handling call
0616 19:52:07.817125 (+1921493us) ts_tablet_manager.cc:1151] Deleting tablet 795c9643c1e84ddabc9130ef42d5c793
0616 19:52:07.817157 (+ 32us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.817290 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1921315}
I20260616 19:52:07.861992 1191 tablet_replica.cc:333] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:07.862269 1191 raft_consensus.cc:2243] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:07.862469 1191 raft_consensus.cc:2272] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.863024 1191 ts_tablet_manager.cc:1916] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.817751 2163 raft_consensus.cc:515] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:07.868019 1849 leader_election.cc:290] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:07.867709 456 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 76d73be228664063822c41cbefafcab8 (table default.Table_16508a5420d3488088367681d9b55f03 [id=946fd4fcf5f244acafa1e82743e70af2]). Expected version 2 got 0
I20260616 19:52:07.868583 2160 leader_election.cc:290] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:07.868624 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 795c9643c1e84ddabc9130ef42d5c793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 795c9643c1e84ddabc9130ef42d5c793 already in progress: creating tablet
I20260616 19:52:07.869024 2164 leader_election.cc:290] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:07.869182 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13d175adfe540b39fd55004a11c9aad" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:07.869279 2067 log.cc:927] Time spent T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: Append to log took a long time: real 0.061s user 0.002s sys 0.000s
I20260616 19:52:07.869791 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 3de0e62cfd33410490a0b460fd5f69e9
I20260616 19:52:07.870267 459 catalog_manager.cc:6784] ReplaceTablet: tablet 3de0e62cfd33410490a0b460fd5f69e9 deleted and replaced by tablet 7d486a9c69954dc4a9b664d89d2bf28a
I20260616 19:52:07.870334 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13d175adfe540b39fd55004a11c9aad" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:07.870519 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17029c1ba36644e9847200b54bf9094c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:07.870841 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b9248b88434a6e9ef7a3d602eee70c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:07.870958 993 leader_election.cc:343] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:07.871129 993 leader_election.cc:343] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.871408 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 3de0e62cfd33410490a0b460fd5f69e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d486a9c69954dc4a9b664d89d2bf28a) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:07.868402 758 tablet_service.cc:1511] Processing CreateTablet for tablet 52316bd99a2f4c4ebe4f8dbd1f7e186a (DEFAULT_TABLE table=default.Table_b3ee96c545104d77b1ac2f90ab0b895e [id=2ccbe172f2134dad9f410546868c033c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:07.872692 993 leader_election.cc:343] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.873582 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 3de0e62cfd33410490a0b460fd5f69e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d486a9c69954dc4a9b664d89d2bf28a) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:07.874512 860 consensus_peers.cc:597] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15d6a025b9a248c5ab9422fe1c340f3e. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:07.876281 1193 ts_tablet_manager.cc:1916] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.876904 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f2f5f0d53a4098bef75a9006c81e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.877667 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 51983531f0f5423aa5f4bb3435cd5a7e (DEFAULT_TABLE table=default.Table_f3cb6d6a4b17493eaecd974beddf55a1 [id=6137c81db743472abb696cc49456c112]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.878047 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51983531f0f5423aa5f4bb3435cd5a7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.876952 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52316bd99a2f4c4ebe4f8dbd1f7e186a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.825438 1190 tablet_replica.cc:333] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:07.880697 1190 raft_consensus.cc:2243] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:07.881508 1996 leader_election.cc:290] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:07.882113 1190 raft_consensus.cc:2272] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.882081 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c35e4c8e9304e798c9031469877b70e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:07.883932 993 leader_election.cc:343] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.885798 1192 tablet_bootstrap.cc:492] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:07.877210 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 10b02ac0fa4744e48529b35a4ca78567 (DEFAULT_TABLE table=default.Table_826acb8b40cd4a23bfc7e5ee8e988006 [id=43f319924cee43ada7364fa567ae3183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.887795 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b02ac0fa4744e48529b35a4ca78567. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:07.888942 996 leader_election.cc:343] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.889073 996 leader_election.cc:304] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:07.889953 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c35e4c8e9304e798c9031469877b70e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:07.890025 1996 raft_consensus.cc:2749] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:07.890305 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17029c1ba36644e9847200b54bf9094c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:07.890623 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b9248b88434a6e9ef7a3d602eee70c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:07.891808 996 leader_election.cc:343] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.891904 1190 ts_tablet_manager.cc:1916] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:07.891916 996 leader_election.cc:304] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:07.892294 996 leader_election.cc:343] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.892381 996 leader_election.cc:304] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:07.892738 996 leader_election.cc:343] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.892831 996 leader_election.cc:304] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:07.892970 2164 raft_consensus.cc:2749] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:07.893126 2164 raft_consensus.cc:2749] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:07.894006 455 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet df036f9d31ca4770bb00bc9cece46953 (table default.Table_58b6a6df64fe459ab7a7abb175850554 [id=548cacd5de984fa89aa96b1c659f9e38]). Expected version 4 got 0
I20260616 19:52:07.895408 1060 raft_consensus.cc:2468] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:07.896656 2169 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260616 19:52:07.899755 1193 ts_tablet_manager.cc:1929] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:07.903158 2129 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260616 19:52:07.904201 2102 raft_consensus.cc:493] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.905843 2102 raft_consensus.cc:515] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.906594 2102 leader_election.cc:290] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:07.891862 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 52316bd99a2f4c4ebe4f8dbd1f7e186a (DEFAULT_TABLE table=default.Table_b3ee96c545104d77b1ac2f90ab0b895e [id=2ccbe172f2134dad9f410546868c033c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.910029 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df036f9d31ca4770bb00bc9cece46953" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:07.910210 922 raft_consensus.cc:2468] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:07.910655 718 leader_election.cc:304] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:07.911000 2102 raft_consensus.cc:2804] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:07.911078 2102 raft_consensus.cc:493] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:07.911139 2102 raft_consensus.cc:3060] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:07.913432 1996 raft_consensus.cc:2749] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:07.913465 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df036f9d31ca4770bb00bc9cece46953" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:07.913527 1193 log.cc:1199] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/5ba2eefdfed14791b5a41decc34dce44
I20260616 19:52:07.913620 1060 raft_consensus.cc:2468] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:07.914227 719 leader_election.cc:304] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:07.914960 2149 raft_consensus.cc:2804] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:07.915091 2149 raft_consensus.cc:697] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:07.915329 2149 consensus_queue.cc:237] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.924576 455 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_b8e53692fe644e23bb67d13957bd8313 [id=46c822de2dc2471d847af2e018102efc] alter complete (version 5)
I20260616 19:52:07.926043 1193 ts_tablet_manager.cc:1950] T 5ba2eefdfed14791b5a41decc34dce44 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:07.927367 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 5ba2eefdfed14791b5a41decc34dce44 (table default.Table_1a330c132b3f4982b52e492c2ded8be7 [id=975461e7d8954e8fbe998142fb2783e9]) successfully deleted
W20260616 19:52:07.928860 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 3b57bceabff64533ae3a49b8afda614d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b57bceabff64533ae3a49b8afda614d already in progress: creating tablet
W20260616 19:52:07.930354 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 63bb0e724ba04f79809850febc966c66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63bb0e724ba04f79809850febc966c66 already in progress: creating tablet
I20260616 19:52:07.928676 2102 raft_consensus.cc:515] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.930727 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 3de0e62cfd33410490a0b460fd5f69e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d486a9c69954dc4a9b664d89d2bf28a) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:07.932287 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 099199fa60b94308acb423f04d988f65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 099199fa60b94308acb423f04d988f65 already in progress: creating tablet
I20260616 19:52:07.933135 2102 leader_election.cc:290] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:07.933966 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet ebe069dd3e414b48b27769cd281b579d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebe069dd3e414b48b27769cd281b579d already in progress: creating tablet
I20260616 19:52:07.935001 1193 tablet_replica.cc:333] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:07.937353 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df036f9d31ca4770bb00bc9cece46953" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:07.937539 922 raft_consensus.cc:3060] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:07.939152 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_67f7ca211f5c4bd2b52bedf6e8882673" } new_table_name: "default.Table_963b2a8a65b14b5caecd9f3b7bcd615d" modify_external_catalogs: true
I20260616 19:52:07.940092 922 raft_consensus.cc:2468] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:07.940510 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52316bd99a2f4c4ebe4f8dbd1f7e186a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.940685 890 tablet_service.cc:1511] Processing CreateTablet for tablet 81f1b53b6e7b4f47b2f56322ce0b3d7d (DEFAULT_TABLE table=default.Table_e279cf57dad34327bd95056314038358 [id=e79d05744fa14d54abaa11309e85c1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.941329 2165 leader_election.cc:290] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:07.944049 718 leader_election.cc:304] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:07.947141 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df036f9d31ca4770bb00bc9cece46953" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:07.947317 1060 raft_consensus.cc:3060] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:07.951334 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64aa32856ca34743933931fb51f2bd7b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:07.951929 993 leader_election.cc:343] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.952631 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64aa32856ca34743933931fb51f2bd7b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:07.953182 2165 raft_consensus.cc:493] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.953307 2165 raft_consensus.cc:515] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.953501 2149 raft_consensus.cc:2804] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:07.953652 2149 raft_consensus.cc:697] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:07.953857 2165 leader_election.cc:290] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:07.954054 2149 consensus_queue.cc:237] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.954502 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b718514e4fbd4601afeb021ed35643e6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:07.954965 993 leader_election.cc:343] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.958570 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f1b53b6e7b4f47b2f56322ce0b3d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.958750 1192 tablet_bootstrap.cc:654] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:07.959733 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51983531f0f5423aa5f4bb3435cd5a7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.963462 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52316bd99a2f4c4ebe4f8dbd1f7e186a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.963701 1190 ts_tablet_manager.cc:1929] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:07.963791 1190 log.cc:1199] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/15d6a025b9a248c5ab9422fe1c340f3e
I20260616 19:52:07.964154 1190 ts_tablet_manager.cc:1950] T 15d6a025b9a248c5ab9422fe1c340f3e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:07.966430 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet df036f9d31ca4770bb00bc9cece46953 (table default.Table_58b6a6df64fe459ab7a7abb175850554 [id=548cacd5de984fa89aa96b1c659f9e38]). Expected version 4 got 0
I20260616 19:52:07.967494 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_826acb8b40cd4a23bfc7e5ee8e988006" } modify_external_catalogs: true
I20260616 19:52:07.967687 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_826acb8b40cd4a23bfc7e5ee8e988006" } modify_external_catalogs: true
I20260616 19:52:07.975287 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 10b02ac0fa4744e48529b35a4ca78567
I20260616 19:52:07.976730 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f7a41c7ea8ae42618e88dfbe92c30830"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:07.976948 1060 raft_consensus.cc:2468] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:07.977514 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7a41c7ea8ae42618e88dfbe92c30830 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.984812 2102 raft_consensus.cc:493] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:07.984951 2102 raft_consensus.cc:515] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.985574 2102 leader_election.cc:290] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:07.986761 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79250767a94141cd900a9715e86128b8" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:07.986956 922 raft_consensus.cc:2468] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:07.987404 718 leader_election.cc:304] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:07.987692 2102 raft_consensus.cc:2804] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:07.987775 2102 raft_consensus.cc:493] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:07.987848 2102 raft_consensus.cc:3060] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:07.937273 1193 raft_consensus.cc:2243] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:07.990166 1193 pending_rounds.cc:70] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:07.990234 1193 pending_rounds.cc:77] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595506343862272 op_type: NO_OP noop_request { }
I20260616 19:52:07.990284 2102 raft_consensus.cc:515] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:07.990718 1193 raft_consensus.cc:2889] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:07.990825 1193 raft_consensus.cc:2272] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:07.993638 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79250767a94141cd900a9715e86128b8" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:07.993791 921 raft_consensus.cc:3060] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:07.995172 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9060de590fa84ea08dc7d39765bc9308" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:07.995504 2171 log.cc:927] Time spent T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
I20260616 19:52:07.996078 921 raft_consensus.cc:2468] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:07.996281 2171 consensus_queue.cc:1175] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7245e7dab0ec474a876537be514c8767" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260616 19:52:07.996336 2102 leader_election.cc:290] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:07.997313 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9060de590fa84ea08dc7d39765bc9308" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:07.997779 993 leader_election.cc:343] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:07.997848 718 leader_election.cc:304] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:07.998123 2102 raft_consensus.cc:2804] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:07.998435 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 81f1b53b6e7b4f47b2f56322ce0b3d7d (DEFAULT_TABLE table=default.Table_e279cf57dad34327bd95056314038358 [id=e79d05744fa14d54abaa11309e85c1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:07.998728 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_72c384e8d0904f978c889c73573b63d3" } modify_external_catalogs: true
I20260616 19:52:07.998842 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f1b53b6e7b4f47b2f56322ce0b3d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:07.998653 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9f2c579d658b45ddae055d6efafecb87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:07.999348 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f2c579d658b45ddae055d6efafecb87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:07.999028 2102 raft_consensus.cc:697] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:07.989476 2163 leader_election.cc:290] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:07.999154 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 10b02ac0fa4744e48529b35a4ca78567 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.002286 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_72c384e8d0904f978c889c73573b63d3" } modify_external_catalogs: true
I20260616 19:52:08.001281 2102 consensus_queue.cc:237] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.008670 1198 tablet_bootstrap.cc:654] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.009150 1196 tablet_bootstrap.cc:700] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767: Time spent opening tablet: real 0.150s user 0.000s sys 0.000s
I20260616 19:52:08.009418 1196 tablet_bootstrap.cc:654] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.011713 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f1e5bbbb9374450f8072f3a577243c63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.012259 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1e5bbbb9374450f8072f3a577243c63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:08.019604 996 leader_election.cc:343] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.019630 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79250767a94141cd900a9715e86128b8" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:08.019752 996 leader_election.cc:304] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:08.019833 1057 raft_consensus.cc:3060] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.019979 2163 raft_consensus.cc:2749] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:08.020336 996 leader_election.cc:343] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.020440 996 leader_election.cc:304] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:08.022549 2163 raft_consensus.cc:2749] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:08.022871 1192 tablet_bootstrap.cc:492] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:08.023007 1192 ts_tablet_manager.cc:1403] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.137s user 0.008s sys 0.007s
I20260616 19:52:08.023101 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79250767a94141cd900a9715e86128b8" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:08.023634 1192 raft_consensus.cc:359] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.023784 1192 raft_consensus.cc:385] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.023828 1192 raft_consensus.cc:740] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.023783 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_00198787acf34996be2d5ee946f8b6ae" } new_table_name: "default.Table_9eb13a45afad449a9bf9b25a0f5d4d1d" modify_external_catalogs: true
I20260616 19:52:08.024338 1192 consensus_queue.cc:260] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.025532 1192 ts_tablet_manager.cc:1434] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:52:08.026156 1192 tablet_bootstrap.cc:492] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:08.028507 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]). Expected version 2 got 0
I20260616 19:52:08.034935 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]). Expected version 2 got 0
I20260616 19:52:08.036638 1192 tablet_bootstrap.cc:654] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:08.039208 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61132c1c9cd24b7d923f1d65ad04c340 consensus state has no leader
I20260616 19:52:08.039748 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 10b02ac0fa4744e48529b35a4ca78567 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.043007 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b718514e4fbd4601afeb021ed35643e6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:08.043424 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4003eb071717454ca2cc028a19cf074d" } new_table_name: "default.Table_9ce10fb69c4a461c8bfedd883535ba2b" modify_external_catalogs: true
I20260616 19:52:08.043762 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fdb74517ce5443a8bfea100ca364db1d
I20260616 19:52:08.044570 889 tablet_service.cc:1558] Processing DeleteTablet for tablet fdb74517ce5443a8bfea100ca364db1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:08.048120 996 leader_election.cc:343] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.048485 996 leader_election.cc:304] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:08.048350 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet fdb74517ce5443a8bfea100ca364db1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.048866 2163 raft_consensus.cc:2749] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:08.049549 2163 raft_consensus.cc:493] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.049672 2163 raft_consensus.cc:515] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:08.050587 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2dfa92a1ce0448c1ba877319cdd4e9b5 consensus state has no leader
I20260616 19:52:08.051656 1193 ts_tablet_manager.cc:1916] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:08.058075 2067 log.cc:927] Time spent T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: Append to log took a long time: real 0.182s user 0.000s sys 0.002s
I20260616 19:52:08.058123 2163 leader_election.cc:290] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:08.058936 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd1070277a14fd98af5fa45925e4f0f" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:08.059715 993 leader_election.cc:343] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.059738 889 tablet_service.cc:1511] Processing CreateTablet for tablet cd19e83413ad420e97af92ca609757e5 (DEFAULT_TABLE table=default.Table_61c8c6e63044481d8029246da0b0537c [id=ed4a11326d1e428da583a93c449e9167]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.060137 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd19e83413ad420e97af92ca609757e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.068783 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5dc308301e974ad1bdad6358b69747de" } new_table_name: "default.Table_01262b4246a743deab2b14b1d1949cb7" modify_external_catalogs: true
I20260616 19:52:08.069578 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd1070277a14fd98af5fa45925e4f0f" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:08.070194 996 leader_election.cc:343] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.070382 996 leader_election.cc:304] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:08.070842 1060 raft_consensus.cc:1275] T 8d4adff6e41148b8b54e969ea2eb7a91 P 61c874fef3684d10a272a9c7f280e0e2 [term 2 FOLLOWER]: Refusing update from remote peer 7245e7dab0ec474a876537be514c8767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260616 19:52:08.077800 1057 raft_consensus.cc:2468] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:08.078848 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e525b827e430429c9b3f00d6f84d1814 consensus state has no leader
I20260616 19:52:08.081636 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 10b02ac0fa4744e48529b35a4ca78567 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.081606 758 tablet_service.cc:1511] Processing CreateTablet for tablet 81f1b53b6e7b4f47b2f56322ce0b3d7d (DEFAULT_TABLE table=default.Table_e279cf57dad34327bd95056314038358 [id=e79d05744fa14d54abaa11309e85c1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.081985 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f1b53b6e7b4f47b2f56322ce0b3d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.082108 750 tablet_service.cc:1558] Processing DeleteTablet for tablet fdb74517ce5443a8bfea100ca364db1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.082345 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cca35e086f1b4097b41fbaa853cc2473"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.082257 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ac1073c32224454fa8c4290c02d5e511"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.082759 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_57b175e9c4084995aa9e67705af7098e" } modify_external_catalogs: true
W20260616 19:52:08.082916 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac1073c32224454fa8c4290c02d5e511 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.082947 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_57b175e9c4084995aa9e67705af7098e" } modify_external_catalogs: true
I20260616 19:52:08.084326 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f7b097131a324d9f90b11941f4f31708" } modify_external_catalogs: true
W20260616 19:52:08.084542 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cca35e086f1b4097b41fbaa853cc2473 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.084511 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f7b097131a324d9f90b11941f4f31708" } modify_external_catalogs: true
I20260616 19:52:08.084801 753 tablet_service.cc:1511] Processing CreateTablet for tablet cd19e83413ad420e97af92ca609757e5 (DEFAULT_TABLE table=default.Table_61c8c6e63044481d8029246da0b0537c [id=ed4a11326d1e428da583a93c449e9167]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.084911 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_58cf14ca021e4270bac10dd0ef488b7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.085175 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd19e83413ad420e97af92ca609757e5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:08.085381 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58cf14ca021e4270bac10dd0ef488b7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.086591 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7b0af6c08cd34ef09c44a86ea3f12671" } modify_external_catalogs: true
I20260616 19:52:08.086772 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7b0af6c08cd34ef09c44a86ea3f12671" } modify_external_catalogs: true
I20260616 19:52:08.087044 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 47b548b6b7f746fe9fd67c2e6563e961 with delete_type TABLET_DATA_DELETED (replaced by tablet bcc5116ef5df4140a96f03c003337c68) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.087265 2161 raft_consensus.cc:2749] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:08.088229 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_104c94f36fc243ba8d761682dae23716"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.088542 2102 consensus_queue.cc:1048] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:08.089857 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_104c94f36fc243ba8d761682dae23716 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.094213 1191 ts_tablet_manager.cc:1929] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:08.094461 2102 raft_consensus.cc:493] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.094630 2102 raft_consensus.cc:515] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.095095 1191 log.cc:1199] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/e91c377ae66441268351cd3592aa9dbc
I20260616 19:52:08.095376 2102 leader_election.cc:290] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:08.095743 1191 ts_tablet_manager.cc:1950] T e91c377ae66441268351cd3592aa9dbc P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:08.095664 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8c1e33ea95f14cea8bb1cb6e0d037b46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.095959 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3f47e767764032ae5a06e34e2de248" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:08.096163 922 raft_consensus.cc:2468] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
W20260616 19:52:08.096220 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c1e33ea95f14cea8bb1cb6e0d037b46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.096853 718 leader_election.cc:304] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:08.097193 2102 raft_consensus.cc:2804] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:08.097270 2102 raft_consensus.cc:493] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:08.097337 2102 raft_consensus.cc:3060] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.097322 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 757) took 2201 ms. Trace:
I20260616 19:52:08.097398 1191 rpcz_store.cc:276] 0616 19:52:05.896047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.896093 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:07.861930 (+1965837us) ts_tablet_manager.cc:1151] Deleting tablet e91c377ae66441268351cd3592aa9dbc
0616 19:52:07.861945 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.055621 (+193676us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.094155 (+ 38534us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.097306 (+ 3151us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1965636}
I20260616 19:52:08.098321 1191 tablet_replica.cc:333] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:08.098722 1191 raft_consensus.cc:2243] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:08.099067 1191 raft_consensus.cc:2272] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.099718 1191 ts_tablet_manager.cc:1916] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.100075 2102 raft_consensus.cc:515] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.099705 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3ed66cdb27fb445a80ad6cdfa884b795"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.100411 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet e91c377ae66441268351cd3592aa9dbc (table default.Table_44015174890646ee876b8d08923fc342 [id=0bc90fd55c8e4d5b8ac18717e00cea54]) successfully deleted
W20260616 19:52:08.103487 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ed66cdb27fb445a80ad6cdfa884b795 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.105752 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3f47e767764032ae5a06e34e2de248" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:08.105928 922 raft_consensus.cc:3060] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.106544 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7e2fb4a0198342edaf87eb1b1f6406fb
I20260616 19:52:08.106531 921 raft_consensus.cc:1275] T 8d4adff6e41148b8b54e969ea2eb7a91 P ae28da1c4102450ab76eb2946a5cbf2e [term 2 FOLLOWER]: Refusing update from remote peer 7245e7dab0ec474a876537be514c8767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260616 19:52:08.106199 2102 leader_election.cc:290] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:08.107874 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1eacae5ee28947a9a4fb2315165c4df2
I20260616 19:52:08.108420 922 raft_consensus.cc:2468] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:08.106508 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9fd39dba6d6f4ff892bfd0ff462b74bd
I20260616 19:52:08.108996 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 1eacae5ee28947a9a4fb2315165c4df2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.110112 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fd39dba6d6f4ff892bfd0ff462b74bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.110291 718 leader_election.cc:304] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:08.110543 1908 consensus_queue.cc:1048] T 8d4adff6e41148b8b54e969ea2eb7a91 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260616 19:52:08.110822 2102 raft_consensus.cc:2804] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:08.111063 2102 raft_consensus.cc:697] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:08.111519 2102 consensus_queue.cc:237] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.111766 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e2fb4a0198342edaf87eb1b1f6406fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.113752 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_14591625550c4aa5a5a46a183fb22a3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.114760 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14591625550c4aa5a5a46a183fb22a3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.124529 1196 tablet_bootstrap.cc:492] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:08.129731 889 tablet_service.cc:1511] Processing CreateTablet for tablet ff15bdd9630e497ebc5b64ac8d783085 (DEFAULT_TABLE table=default.Table_405a3541469c4dfeb2b9fed18455ef21 [id=ae71e95d9b9e4dd086bc9ae14e80cce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.130290 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff15bdd9630e497ebc5b64ac8d783085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.102185 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3f47e767764032ae5a06e34e2de248" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:08.133898 1060 raft_consensus.cc:2468] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:08.109103 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e2fb4a0198342edaf87eb1b1f6406fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.123229 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 1eacae5ee28947a9a4fb2315165c4df2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.123890 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3f47e767764032ae5a06e34e2de248" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:08.134282 1055 raft_consensus.cc:3060] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.128486 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fd39dba6d6f4ff892bfd0ff462b74bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.133190 1026 tablet_service.cc:1511] Processing CreateTablet for tablet cd19e83413ad420e97af92ca609757e5 (DEFAULT_TABLE table=default.Table_61c8c6e63044481d8029246da0b0537c [id=ed4a11326d1e428da583a93c449e9167]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.135476 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd19e83413ad420e97af92ca609757e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.137450 1055 raft_consensus.cc:2468] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:08.138816 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e2fb4a0198342edaf87eb1b1f6406fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.140888 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 1eacae5ee28947a9a4fb2315165c4df2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.141706 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fd39dba6d6f4ff892bfd0ff462b74bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.144038 1196 ts_tablet_manager.cc:1403] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.288s user 0.005s sys 0.000s
I20260616 19:52:08.144975 1196 raft_consensus.cc:359] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.153095 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 740) took 2404 ms. Trace:
I20260616 19:52:08.153349 1190 rpcz_store.cc:276] 0616 19:52:05.748598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.751139 (+ 2541us) service_pool.cc:224] Handling call
0616 19:52:07.825312 (+2074173us) ts_tablet_manager.cc:1151] Deleting tablet 15d6a025b9a248c5ab9422fe1c340f3e
0616 19:52:07.825321 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:07.960385 (+135064us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:07.963658 (+ 3273us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.153070 (+189412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816,"tablet-delete.queue_time_us":2073978}
I20260616 19:52:08.154187 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 746) took 2299 ms. Trace:
I20260616 19:52:08.154330 1190 rpcz_store.cc:276] 0616 19:52:05.854439 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.854499 (+ 60us) service_pool.cc:224] Handling call
0616 19:52:08.154053 (+2299554us) ts_tablet_manager.cc:1151] Deleting tablet 81f881fd3ad244f9afd70b4b99d9384d
0616 19:52:08.154077 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.154170 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2299341}
W20260616 19:52:08.155043 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 81f881fd3ad244f9afd70b4b99d9384d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81f881fd3ad244f9afd70b4b99d9384d already in progress: creating tablet
I20260616 19:52:08.155712 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 747) took 2299 ms. Trace:
I20260616 19:52:08.155864 1190 rpcz_store.cc:276] 0616 19:52:05.856530 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.857554 (+ 1024us) service_pool.cc:224] Handling call
0616 19:52:08.155604 (+2298050us) ts_tablet_manager.cc:1151] Deleting tablet 795c9643c1e84ddabc9130ef42d5c793
0616 19:52:08.155614 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.155695 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2297872}
W20260616 19:52:08.156339 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 795c9643c1e84ddabc9130ef42d5c793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 795c9643c1e84ddabc9130ef42d5c793 already in progress: creating tablet
I20260616 19:52:08.156701 1190 tablet_replica.cc:333] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:08.157104 1190 raft_consensus.cc:2243] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:08.159154 1030 tablet_service.cc:1511] Processing CreateTablet for tablet ff15bdd9630e497ebc5b64ac8d783085 (DEFAULT_TABLE table=default.Table_405a3541469c4dfeb2b9fed18455ef21 [id=ae71e95d9b9e4dd086bc9ae14e80cce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.159576 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff15bdd9630e497ebc5b64ac8d783085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.164032 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 11fae62d87734c369bbb6a6ac95413e9 (DEFAULT_TABLE table=default.Table_43afc983b9034c56bf7eb1cccf2c7e06 [id=7fb6b3dd92da4d9fbad664f4bde7de47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.164240 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_812254d7ada3439b99fc64f671dd62ca" } new_table_name: "default.Table_86e8fc81f0ad40c69bd98ac8e25d2766" modify_external_catalogs: true
I20260616 19:52:08.164394 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11fae62d87734c369bbb6a6ac95413e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.168841 456 catalog_manager.cc:5696] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } }
I20260616 19:52:08.154176 753 tablet_service.cc:1511] Processing CreateTablet for tablet ff15bdd9630e497ebc5b64ac8d783085 (DEFAULT_TABLE table=default.Table_405a3541469c4dfeb2b9fed18455ef21 [id=ae71e95d9b9e4dd086bc9ae14e80cce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.170348 1196 raft_consensus.cc:385] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.170425 1196 raft_consensus.cc:740] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.170626 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff15bdd9630e497ebc5b64ac8d783085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.170675 1196 consensus_queue.cc:260] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.171224 1196 ts_tablet_manager.cc:1434] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260616 19:52:08.171512 1196 tablet_bootstrap.cc:492] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:08.178740 2182 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260616 19:52:08.193045 1190 raft_consensus.cc:2272] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.185631 2121 raft_consensus.cc:493] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.195246 2121 raft_consensus.cc:515] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.195689 1190 ts_tablet_manager.cc:1916] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.195914 2121 leader_election.cc:290] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:08.160025 891 tablet_service.cc:1511] Processing CreateTablet for tablet 11fae62d87734c369bbb6a6ac95413e9 (DEFAULT_TABLE table=default.Table_43afc983b9034c56bf7eb1cccf2c7e06 [id=7fb6b3dd92da4d9fbad664f4bde7de47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.196692 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11fae62d87734c369bbb6a6ac95413e9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:08.197254 860 leader_election.cc:343] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 5ba2eefdfed14791b5a41decc34dce44
I20260616 19:52:08.195087 971 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
W20260616 19:52:08.202593 858 leader_election.cc:343] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 5ba2eefdfed14791b5a41decc34dce44
I20260616 19:52:08.202600 1026 tablet_service.cc:1511] Processing CreateTablet for tablet cecf1e85135745ea98e9abf4cd2a9f79 (DEFAULT_TABLE table=default.Table_dc02731815934261a7e270a538ea7228 [id=970bb28d8a7848f69133fd906cadb5af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.202736 858 leader_election.cc:304] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:08.202978 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecf1e85135745ea98e9abf4cd2a9f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.203383 890 tablet_service.cc:1511] Processing CreateTablet for tablet cecf1e85135745ea98e9abf4cd2a9f79 (DEFAULT_TABLE table=default.Table_dc02731815934261a7e270a538ea7228 [id=970bb28d8a7848f69133fd906cadb5af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.203778 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecf1e85135745ea98e9abf4cd2a9f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.205250 456 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet df036f9d31ca4770bb00bc9cece46953 (table default.Table_58b6a6df64fe459ab7a7abb175850554 [id=548cacd5de984fa89aa96b1c659f9e38]). Expected version 4 got 0
I20260616 19:52:08.208034 886 tablet_service.cc:1511] Processing CreateTablet for tablet 296dd76b85b244769d9e4c51163a4e4a (DEFAULT_TABLE table=default.Table_f0b3b9a1d74449d1a00b3c989eac3ee5 [id=36b6b6a37b024b26a2fda0087027dfa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.208483 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296dd76b85b244769d9e4c51163a4e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.209296 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 296dd76b85b244769d9e4c51163a4e4a (DEFAULT_TABLE table=default.Table_f0b3b9a1d74449d1a00b3c989eac3ee5 [id=36b6b6a37b024b26a2fda0087027dfa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.209623 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296dd76b85b244769d9e4c51163a4e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.211009 1198 tablet_bootstrap.cc:492] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:08.211128 1198 ts_tablet_manager.cc:1403] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.408s user 0.005s sys 0.020s
I20260616 19:52:08.211758 1198 raft_consensus.cc:359] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.211927 1198 raft_consensus.cc:385] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.211977 1198 raft_consensus.cc:740] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.212260 751 tablet_service.cc:1511] Processing CreateTablet for tablet 296dd76b85b244769d9e4c51163a4e4a (DEFAULT_TABLE table=default.Table_f0b3b9a1d74449d1a00b3c989eac3ee5 [id=36b6b6a37b024b26a2fda0087027dfa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.212625 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296dd76b85b244769d9e4c51163a4e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.167918 1193 ts_tablet_manager.cc:1929] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:08.168576 750 tablet_service.cc:1511] Processing CreateTablet for tablet 11fae62d87734c369bbb6a6ac95413e9 (DEFAULT_TABLE table=default.Table_43afc983b9034c56bf7eb1cccf2c7e06 [id=7fb6b3dd92da4d9fbad664f4bde7de47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.216599 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11fae62d87734c369bbb6a6ac95413e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.217540 2121 raft_consensus.cc:2749] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:08.219341 2149 raft_consensus.cc:493] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.219550 2149 raft_consensus.cc:515] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.169811 758 tablet_service.cc:1511] Processing CreateTablet for tablet cecf1e85135745ea98e9abf4cd2a9f79 (DEFAULT_TABLE table=default.Table_dc02731815934261a7e270a538ea7228 [id=970bb28d8a7848f69133fd906cadb5af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.220933 2149 leader_election.cc:290] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:08.221010 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c664f0386549d6867c407526ee45a0" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:08.221206 1058 raft_consensus.cc:2468] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:08.221401 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c664f0386549d6867c407526ee45a0" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:08.221686 719 leader_election.cc:304] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
W20260616 19:52:08.222121 718 leader_election.cc:343] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.222489 1908 raft_consensus.cc:2804] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:08.222609 1908 raft_consensus.cc:493] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:08.222746 1908 raft_consensus.cc:3060] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.223668 1193 log.cc:1199] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/1d80d9028184443da49623228259263d
I20260616 19:52:08.223932 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecf1e85135745ea98e9abf4cd2a9f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.224243 1193 ts_tablet_manager.cc:1950] T 1d80d9028184443da49623228259263d P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:08.225535 1193 tablet_replica.cc:333] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:08.225829 1193 raft_consensus.cc:2243] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:08.226125 1193 pending_rounds.cc:70] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:08.226384 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 1d80d9028184443da49623228259263d (table default.Table_97db7730461e4d00ab3bc527573cde94 [id=cd27259f954043f8b50d2bb5788f1ecb]) successfully deleted
I20260616 19:52:08.227121 2129 tablet.cc:1724] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:08.232317 1196 tablet_bootstrap.cc:654] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.237491 1193 pending_rounds.cc:77] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595504904130560 op_type: NO_OP noop_request { }
I20260616 19:52:08.242461 1193 raft_consensus.cc:2889] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:08.245919 2185 tablet.cc:1724] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:08.251649 1191 ts_tablet_manager.cc:1929] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:08.242712 1193 raft_consensus.cc:2272] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.256191 1191 log.cc:1199] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/5029a79e046a489aa9976eff948a3c5b
I20260616 19:52:08.256660 1193 ts_tablet_manager.cc:1916] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.212929 1198 consensus_queue.cc:260] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.257313 1198 ts_tablet_manager.cc:1434] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.046s user 0.001s sys 0.001s
I20260616 19:52:08.257627 1198 tablet_bootstrap.cc:492] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:08.259014 1198 tablet_bootstrap.cc:654] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.266742 1191 ts_tablet_manager.cc:1950] T 5029a79e046a489aa9976eff948a3c5b P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:08.268972 2169 tablet.cc:1724] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:08.270068 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 758) took 2373 ms. Trace:
I20260616 19:52:08.270861 1191 rpcz_store.cc:276] 0616 19:52:05.896533 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.896875 (+ 342us) service_pool.cc:224] Handling call
0616 19:52:08.098278 (+2201403us) ts_tablet_manager.cc:1151] Deleting tablet 5029a79e046a489aa9976eff948a3c5b
0616 19:52:08.098287 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.157424 (+ 59137us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.251588 (+ 94164us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.270044 (+ 18456us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2201273}
I20260616 19:52:08.272238 1192 tablet_bootstrap.cc:492] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:08.272624 1192 ts_tablet_manager.cc:1403] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.247s user 0.019s sys 0.010s
I20260616 19:52:08.272981 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 5029a79e046a489aa9976eff948a3c5b (table default.Table_010bd6ff844d4227b21111bb4499d70b [id=7f01acd67fa942bfb14744f0851047e7]) successfully deleted
I20260616 19:52:08.274144 1191 tablet_replica.cc:333] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:08.278545 1191 raft_consensus.cc:2243] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:08.279830 1191 raft_consensus.cc:2272] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.280644 1908 raft_consensus.cc:515] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.283644 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c664f0386549d6867c407526ee45a0" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:08.284350 718 leader_election.cc:343] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.284173 1191 ts_tablet_manager.cc:1916] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.285763 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c664f0386549d6867c407526ee45a0" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:08.285926 1057 raft_consensus.cc:3060] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.288673 1057 raft_consensus.cc:2468] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:08.289294 719 leader_election.cc:304] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:08.289585 2102 raft_consensus.cc:2804] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:08.289642 1908 leader_election.cc:290] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:08.289709 2102 raft_consensus.cc:697] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:08.290933 2102 consensus_queue.cc:237] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.292855 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1465eae9fad14db1b3cc0433cdfccf7b" } new_table_name: "default.Table_8cda9a799036458f9543a8a8aac3ee5a" modify_external_catalogs: true
I20260616 19:52:08.292887 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e69337994b154a11a55144b5ebf72a9f" } modify_external_catalogs: true
I20260616 19:52:08.294021 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7fdf897f4b914166b13a672f25c44393"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.294721 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fdf897f4b914166b13a672f25c44393 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.295084 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_88a6448fd79944399d261dfe7a13259b" } new_table_name: "default.Table_36702e35975c49f2b9dd011e40692255" modify_external_catalogs: true
I20260616 19:52:08.294086 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_28a18e68feba4a7789a6693a706adb55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.295324 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8d5418c55a5b4b00bdf64e1d72483b58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.295637 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28a18e68feba4a7789a6693a706adb55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:08.295809 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d5418c55a5b4b00bdf64e1d72483b58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.313799 1192 raft_consensus.cc:359] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.314494 1192 raft_consensus.cc:385] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.314849 1192 raft_consensus.cc:740] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.315758 1192 consensus_queue.cc:260] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.332440 1191 ts_tablet_manager.cc:1929] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:08.333263 1196 tablet_bootstrap.cc:492] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:08.333864 1196 ts_tablet_manager.cc:1403] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.162s user 0.005s sys 0.000s
I20260616 19:52:08.333702 1191 log.cc:1199] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/da74f89b7ff44f49b8e2f2c2cbcbdb0b
I20260616 19:52:08.336589 1191 ts_tablet_manager.cc:1950] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:08.337026 2161 raft_consensus.cc:493] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.337410 2161 raft_consensus.cc:515] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.338495 2161 leader_election.cc:290] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:08.339463 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf57dd6d704645b6bf97b730dbe964" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:08.342022 996 leader_election.cc:343] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.343511 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 759) took 2445 ms. Trace:
I20260616 19:52:08.344269 1191 rpcz_store.cc:276] 0616 19:52:05.898283 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.898327 (+ 44us) service_pool.cc:224] Handling call
0616 19:52:08.273921 (+2375594us) ts_tablet_manager.cc:1151] Deleting tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b
0616 19:52:08.273937 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.308919 (+ 34982us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.331992 (+ 23073us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.343367 (+ 11375us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2375106}
I20260616 19:52:08.346653 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b (table default.Table_2349f63e2a7e4af4ae0a80e8ed86c6a9 [id=f37d0e612ff74a31842cf47ec47beb3f]) successfully deleted
I20260616 19:52:08.348042 1191 tablet_replica.cc:333] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:08.349637 1191 raft_consensus.cc:2243] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:08.350790 1191 raft_consensus.cc:2272] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.354305 1191 ts_tablet_manager.cc:1916] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.355052 1198 tablet_bootstrap.cc:492] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:08.355247 1198 ts_tablet_manager.cc:1403] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.098s user 0.006s sys 0.017s
I20260616 19:52:08.357026 1198 raft_consensus.cc:359] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.357240 1198 raft_consensus.cc:385] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.357321 1198 raft_consensus.cc:740] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.357570 1198 consensus_queue.cc:260] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.358155 1198 ts_tablet_manager.cc:1434] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:08.361194 1198 tablet_bootstrap.cc:492] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:08.372599 1198 tablet_bootstrap.cc:654] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.394145 2121 raft_consensus.cc:493] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.403707 2121 raft_consensus.cc:515] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.395160 1923 raft_consensus.cc:493] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.339023 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf57dd6d704645b6bf97b730dbe964" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:08.405017 1923 raft_consensus.cc:515] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.405150 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d73be228664063822c41cbefafcab8" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:08.405412 1057 raft_consensus.cc:2468] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
W20260616 19:52:08.405537 993 leader_election.cc:343] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.405640 993 leader_election.cc:304] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:08.405712 1923 leader_election.cc:290] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:08.405925 2161 raft_consensus.cc:2749] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:08.406363 858 leader_election.cc:304] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:08.406754 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be902fe29bb46a4bf71ee6384e6722a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:08.407119 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be902fe29bb46a4bf71ee6384e6722a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:08.407336 1057 raft_consensus.cc:2468] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
W20260616 19:52:08.407428 860 leader_election.cc:343] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.407739 2121 leader_election.cc:290] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:08.407919 2121 raft_consensus.cc:2804] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:08.407990 2121 raft_consensus.cc:493] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:08.408066 2121 raft_consensus.cc:3060] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.408190 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d73be228664063822c41cbefafcab8" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:08.408380 784 raft_consensus.cc:2468] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:08.412083 858 leader_election.cc:304] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:08.412614 1923 raft_consensus.cc:2804] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:08.412709 1923 raft_consensus.cc:493] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:08.412782 1923 raft_consensus.cc:3060] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.416221 1923 raft_consensus.cc:515] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.417021 2121 raft_consensus.cc:515] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.418450 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d73be228664063822c41cbefafcab8" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:08.418669 1057 raft_consensus.cc:3060] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.422324 1057 raft_consensus.cc:2468] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:08.422930 858 leader_election.cc:304] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:08.423764 1923 leader_election.cc:290] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:08.424597 1923 raft_consensus.cc:2804] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:08.424803 1923 raft_consensus.cc:697] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:08.424535 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be902fe29bb46a4bf71ee6384e6722a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:08.425127 1923 consensus_queue.cc:237] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.425244 1058 raft_consensus.cc:3060] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.426736 2121 leader_election.cc:290] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:08.318166 1192 ts_tablet_manager.cc:1434] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.045s user 0.002s sys 0.002s
I20260616 19:52:08.429565 1058 raft_consensus.cc:2468] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:08.430281 858 leader_election.cc:304] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:08.424351 1191 ts_tablet_manager.cc:1929] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:08.431306 1191 log.cc:1199] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/d9c664f0386549d6867c407526ee45a0
I20260616 19:52:08.432034 1191 ts_tablet_manager.cc:1950] T d9c664f0386549d6867c407526ee45a0 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:08.432397 2192 raft_consensus.cc:2804] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:08.432533 2192 raft_consensus.cc:697] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:08.432982 2192 consensus_queue.cc:237] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.434463 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 760) took 2535 ms. Trace:
I20260616 19:52:08.445266 1191 rpcz_store.cc:276] 0616 19:52:05.898675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.898722 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:08.347613 (+2448891us) ts_tablet_manager.cc:1151] Deleting tablet d9c664f0386549d6867c407526ee45a0
0616 19:52:08.347753 (+ 140us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.397130 (+ 49377us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.424275 (+ 27145us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.434441 (+ 10166us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2448535}
I20260616 19:52:08.445849 1191 tablet_replica.cc:333] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:08.446151 1191 raft_consensus.cc:2243] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:08.446426 1191 raft_consensus.cc:2272] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.446478 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet d9c664f0386549d6867c407526ee45a0 (table default.Table_8f93c0209c4d41ea9c714fe9ebed8588 [id=0cc25e520828404183490059b522eefb]) successfully deleted
I20260616 19:52:08.446856 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be902fe29bb46a4bf71ee6384e6722a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:08.447172 1191 ts_tablet_manager.cc:1916] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.447268 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d73be228664063822c41cbefafcab8" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:08.447424 778 raft_consensus.cc:3060] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.448228 1192 tablet_bootstrap.cc:492] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:08.450034 778 raft_consensus.cc:2468] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
W20260616 19:52:08.451164 860 leader_election.cc:343] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.452096 1196 raft_consensus.cc:359] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.454965 2161 raft_consensus.cc:493] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.455138 2161 raft_consensus.cc:515] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.455771 2161 leader_election.cc:290] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:08.456238 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b548b6b7f746fe9fd67c2e6563e961" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:08.456749 993 leader_election.cc:343] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.456970 1196 raft_consensus.cc:385] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.457283 1196 raft_consensus.cc:740] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.458545 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b548b6b7f746fe9fd67c2e6563e961" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:08.459024 996 leader_election.cc:343] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.459169 996 leader_election.cc:304] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:08.459779 2161 raft_consensus.cc:2749] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:08.462065 1191 ts_tablet_manager.cc:1929] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:08.464164 1191 log.cc:1199] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/79250767a94141cd900a9715e86128b8
I20260616 19:52:08.464582 1191 ts_tablet_manager.cc:1950] T 79250767a94141cd900a9715e86128b8 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
W20260616 19:52:08.465360 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 70f9487ce7f04264aff3d1895c05eb74 consensus state has no leader
I20260616 19:52:08.465806 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bb94e65f654e4667a414a8ea104e7309" } modify_external_catalogs: true
I20260616 19:52:08.466032 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bb94e65f654e4667a414a8ea104e7309" } modify_external_catalogs: true
I20260616 19:52:08.468063 2161 raft_consensus.cc:493] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.468246 2161 raft_consensus.cc:515] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.468660 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5ce6fd6946e0465e8cb64119f4882a7c" } new_table_name: "default.Table_e986dba9a8714033911e828afac47182" modify_external_catalogs: true
I20260616 19:52:08.468946 2161 leader_election.cc:290] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:08.469671 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5dc1e6cde347fc9a34e555385dc646" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:08.470258 993 leader_election.cc:343] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.470866 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5dc1e6cde347fc9a34e555385dc646" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:08.471410 996 leader_election.cc:343] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.471535 996 leader_election.cc:304] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:08.471958 2161 raft_consensus.cc:2749] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:08.472182 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e69337994b154a11a55144b5ebf72a9f" } modify_external_catalogs: true
I20260616 19:52:08.473719 456 catalog_manager.cc:5696] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } }
I20260616 19:52:08.475351 456 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 4d3f47e767764032ae5a06e34e2de248 (table default.Table_1516f5dc3b2b4de48c2c4076d1cb1205 [id=af4aada43ecf46b8bacf0d9d1388e92e]). Expected version 1 got 0
I20260616 19:52:08.475598 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 761) took 2576 ms. Trace:
I20260616 19:52:08.475687 1191 rpcz_store.cc:276] 0616 19:52:05.899123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.899185 (+ 62us) service_pool.cc:224] Handling call
0616 19:52:08.445794 (+2546609us) ts_tablet_manager.cc:1151] Deleting tablet 79250767a94141cd900a9715e86128b8
0616 19:52:08.445807 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.450191 (+ 4384us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.461986 (+ 11795us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.475531 (+ 13545us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2546472}
I20260616 19:52:08.476177 1191 tablet_replica.cc:333] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:08.476397 1191 raft_consensus.cc:2243] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:08.476433 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 79250767a94141cd900a9715e86128b8 (table default.Table_8d5fed2f6cff49c4b8a9cd2c5a907fa9 [id=4fdd38d3f8d747b0b6181ee77db8e90a]) successfully deleted
I20260616 19:52:08.476706 1191 raft_consensus.cc:2272] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.477298 1191 ts_tablet_manager.cc:1916] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.477381 1196 consensus_queue.cc:260] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.479182 1196 ts_tablet_manager.cc:1434] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.145s user 0.003s sys 0.000s
W20260616 19:52:08.480384 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c37aeb69afa040eeb9db1f8bdc60bb99 consensus state has no leader
I20260616 19:52:08.480854 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_90dd7bdb2d6943c5a3864e1a09318956" } new_table_name: "default.Table_0f1fc65bff7e42619d3aa73728761fc7" modify_external_catalogs: true
I20260616 19:52:08.484237 1193 ts_tablet_manager.cc:1929] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:08.484402 1193 log.cc:1199] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/73a754c728b5408eb47f91de93554ec5
I20260616 19:52:08.484958 1193 ts_tablet_manager.cc:1950] T 73a754c728b5408eb47f91de93554ec5 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:08.486665 1196 tablet_bootstrap.cc:492] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:08.486990 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0f25c7f0e55b413b8979e51adc294a9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.487564 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f25c7f0e55b413b8979e51adc294a9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.488441 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b30509a276f0479580ea240dee3f98bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.488828 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9614f1b2704749c1a4590303c7efc1d8
I20260616 19:52:08.488883 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 966fabee5ae34c5da6a35d74caef244f
W20260616 19:52:08.489015 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b30509a276f0479580ea240dee3f98bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.489610 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3f1ead1791b844acbe29bd0f9c9e6488" } modify_external_catalogs: true
I20260616 19:52:08.489679 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f67b3d225b1640d8abebc117046112d3" } modify_external_catalogs: true
I20260616 19:52:08.489785 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3f1ead1791b844acbe29bd0f9c9e6488" } modify_external_catalogs: true
I20260616 19:52:08.489862 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f67b3d225b1640d8abebc117046112d3" } modify_external_catalogs: true
W20260616 19:52:08.491226 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31db3862f78943519bcd9531c5530048 consensus state has no leader
I20260616 19:52:08.491578 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_42281f84356440f9b330a2a8c0611cf0" } modify_external_catalogs: true
I20260616 19:52:08.491724 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_42281f84356440f9b330a2a8c0611cf0" } modify_external_catalogs: true
I20260616 19:52:08.493466 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 966fabee5ae34c5da6a35d74caef244f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.493605 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 966fabee5ae34c5da6a35d74caef244f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.493710 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 9614f1b2704749c1a4590303c7efc1d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.493472 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 9614f1b2704749c1a4590303c7efc1d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.494496 1192 tablet_bootstrap.cc:654] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.496483 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 966fabee5ae34c5da6a35d74caef244f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.496747 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 9614f1b2704749c1a4590303c7efc1d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.496979 1190 ts_tablet_manager.cc:1929] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:08.497179 1190 log.cc:1199] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/bfff9d60bb7e4a86b14687b581b45efe
I20260616 19:52:08.497597 1190 ts_tablet_manager.cc:1950] T bfff9d60bb7e4a86b14687b581b45efe P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:08.498016 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 753) took 2488 ms. Trace:
I20260616 19:52:08.498153 1190 rpcz_store.cc:276] 0616 19:52:06.009577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.009637 (+ 60us) service_pool.cc:224] Handling call
0616 19:52:08.156654 (+2147017us) ts_tablet_manager.cc:1151] Deleting tablet bfff9d60bb7e4a86b14687b581b45efe
0616 19:52:08.156663 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.384362 (+227699us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.496913 (+112551us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.497997 (+ 1084us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2146772}
I20260616 19:52:08.498847 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet bfff9d60bb7e4a86b14687b581b45efe (table default.Table_74f3d2b26e0d4319b73c964c2eaf9204 [id=a67306640a5b4c0a91a283892a3a8062]) successfully deleted
I20260616 19:52:08.499573 1190 tablet_replica.cc:333] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:08.500162 1190 raft_consensus.cc:2243] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:08.511346 832 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:52:08.516568 1191 ts_tablet_manager.cc:1929] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:08.516845 1191 log.cc:1199] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/d270afd0c0f3457aa6dd14721dca261d
I20260616 19:52:08.517448 1191 ts_tablet_manager.cc:1950] T d270afd0c0f3457aa6dd14721dca261d P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:08.517813 1196 tablet_bootstrap.cc:654] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.523234 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 765) took 2524 ms. Trace:
W20260616 19:52:08.533305 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d0e9ed8303274b5f8ec3a2bd0a070b48 consensus state has no leader
I20260616 19:52:08.530243 1198 tablet_bootstrap.cc:492] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:08.534046 1198 ts_tablet_manager.cc:1403] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.173s user 0.035s sys 0.035s
W20260616 19:52:08.534085 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f97b0a0e70e4fb2b318ffbbcb0ed790 consensus state has no leader
I20260616 19:52:08.533994 1191 rpcz_store.cc:276] 0616 19:52:05.998591 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:05.998714 (+ 123us) service_pool.cc:224] Handling call
0616 19:52:08.476073 (+2477359us) ts_tablet_manager.cc:1151] Deleting tablet d270afd0c0f3457aa6dd14721dca261d
0616 19:52:08.476084 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.482444 (+ 6360us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.511216 (+ 28772us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.523197 (+ 11981us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2477145}
I20260616 19:52:08.534806 1198 raft_consensus.cc:359] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.534866 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet d270afd0c0f3457aa6dd14721dca261d (table default.Table_ea860bf78ecb48ebb09d584767ab3f41 [id=014e024d22a94b42b4e61fac211f07e9]) successfully deleted
I20260616 19:52:08.535276 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 2f1e12555be64192860eab59b3aeb562
I20260616 19:52:08.535360 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 768) took 2486 ms. Trace:
I20260616 19:52:08.535512 1198 raft_consensus.cc:385] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.535614 1198 raft_consensus.cc:740] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.536027 1198 consensus_queue.cc:260] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.536703 1198 ts_tablet_manager.cc:1434] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:08.537063 1198 tablet_bootstrap.cc:492] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:08.538483 1198 tablet_bootstrap.cc:654] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.539115 1191 rpcz_store.cc:276] 0616 19:52:06.048063 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.050519 (+ 2456us) service_pool.cc:224] Handling call
0616 19:52:08.534734 (+2484215us) ts_tablet_manager.cc:1151] Deleting tablet 2a1e4310104a4b238d80116604a1af3a
0616 19:52:08.534746 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.534858 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2483980}
I20260616 19:52:08.539794 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f1e12555be64192860eab59b3aeb562 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:08.540235 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2a1e4310104a4b238d80116604a1af3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a1e4310104a4b238d80116604a1af3a already in progress: creating tablet
I20260616 19:52:08.544166 453 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 181a20d967b14e1b91b3f6dbcd7ed065
I20260616 19:52:08.544639 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 733f4f262ed64a01a5f5f4c68ba37872
I20260616 19:52:08.544593 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2e3589134c4b473a97c49a3e99b90589"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.545276 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e3589134c4b473a97c49a3e99b90589 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.545477 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_215a9cb092a94f93ab94bd88d433a976"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.545989 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_215a9cb092a94f93ab94bd88d433a976 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.546209 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 771) took 2425 ms. Trace:
I20260616 19:52:08.546700 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f1e12555be64192860eab59b3aeb562 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.549242 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 733f4f262ed64a01a5f5f4c68ba37872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.550186 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9437f0573ab044458aa96d4291c6efdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.550731 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9437f0573ab044458aa96d4291c6efdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.550765 1191 rpcz_store.cc:276] 0616 19:52:06.114399 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.114574 (+ 175us) service_pool.cc:224] Handling call
0616 19:52:08.539737 (+2425163us) ts_tablet_manager.cc:1151] Deleting tablet b29cc69fd5234becb09a0b73919b461c
0616 19:52:08.539746 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.539835 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2424857}
I20260616 19:52:08.551438 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 774) took 2350 ms. Trace:
I20260616 19:52:08.551563 1191 rpcz_store.cc:276] 0616 19:52:06.200963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.201034 (+ 71us) service_pool.cc:224] Handling call
0616 19:52:08.551281 (+2350247us) ts_tablet_manager.cc:1151] Deleting tablet 137c13d905eb4bf2937f730e5210266f
0616 19:52:08.551292 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.551394 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2257196}
W20260616 19:52:08.552361 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet b29cc69fd5234becb09a0b73919b461c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b29cc69fd5234becb09a0b73919b461c already in progress: creating tablet
I20260616 19:52:08.552425 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 733f4f262ed64a01a5f5f4c68ba37872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:08.552654 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 137c13d905eb4bf2937f730e5210266f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 137c13d905eb4bf2937f730e5210266f already in progress: creating tablet
I20260616 19:52:08.552088 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 775) took 2323 ms. Trace:
I20260616 19:52:08.552786 1191 rpcz_store.cc:276] 0616 19:52:06.228828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.228883 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:08.551952 (+2323069us) ts_tablet_manager.cc:1151] Deleting tablet 71a23c82ace248b48c7086dcbabe3649
0616 19:52:08.551962 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.552042 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2257803}
I20260616 19:52:08.553297 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 776) took 2293 ms. Trace:
I20260616 19:52:08.553495 1191 rpcz_store.cc:276] 0616 19:52:06.259437 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.259489 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:08.553163 (+2293674us) ts_tablet_manager.cc:1151] Deleting tablet 32ce369f4db042a5841003e4ea1fcc69
0616 19:52:08.553173 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.553250 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2258946}
I20260616 19:52:08.553699 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9c4283b5023f48ce914506250ea80e4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.553797 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6ae99f784fee4c47b163e188e692ead7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.554304 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c4283b5023f48ce914506250ea80e4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:08.554337 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ae99f784fee4c47b163e188e692ead7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.555646 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 777) took 2292 ms. Trace:
I20260616 19:52:08.555828 1191 rpcz_store.cc:276] 0616 19:52:06.262700 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.262765 (+ 65us) service_pool.cc:224] Handling call
0616 19:52:08.555477 (+2292712us) ts_tablet_manager.cc:1151] Deleting tablet 415ad9d0c3564453825c4b30c0ad64fa
0616 19:52:08.555487 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.555601 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2261202}
I20260616 19:52:08.556332 1191 tablet_replica.cc:333] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:08.556556 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 73a754c728b5408eb47f91de93554ec5 (table default.Table_5f98dbc56e0e44ba93e5e67cb2a74652 [id=c6d68b5708374d73be79937542dc39a4]) successfully deleted
I20260616 19:52:08.556804 1191 raft_consensus.cc:2243] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:08.557065 1191 raft_consensus.cc:2272] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.557757 1193 tablet_replica.cc:333] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:08.559556 1193 raft_consensus.cc:2243] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
W20260616 19:52:08.560868 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 71a23c82ace248b48c7086dcbabe3649 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71a23c82ace248b48c7086dcbabe3649 already in progress: creating tablet
I20260616 19:52:08.561023 1193 pending_rounds.cc:70] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
W20260616 19:52:08.561223 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 32ce369f4db042a5841003e4ea1fcc69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32ce369f4db042a5841003e4ea1fcc69 already in progress: creating tablet
W20260616 19:52:08.561479 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 415ad9d0c3564453825c4b30c0ad64fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 415ad9d0c3564453825c4b30c0ad64fa already in progress: creating tablet
I20260616 19:52:08.561479 1193 pending_rounds.cc:77] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595507882725376 op_type: NO_OP noop_request { }
I20260616 19:52:08.562136 1193 raft_consensus.cc:2889] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:08.563007 1193 raft_consensus.cc:2272] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.501514 2195 raft_consensus.cc:493] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.566721 2195 raft_consensus.cc:515] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.567373 2195 leader_election.cc:290] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:08.518930 858 consensus_peers.cc:597] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1bc181171b134de2b946376f468aec72. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:08.567521 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 48638.9us
I20260616 19:52:08.538867 1923 raft_consensus.cc:493] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.566743 1190 raft_consensus.cc:2272] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.568106 1923 raft_consensus.cc:515] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:08.568861 2121 raft_consensus.cc:670] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260616 19:52:08.538867 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f1e12555be64192860eab59b3aeb562 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.570097 1923 leader_election.cc:290] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:08.571305 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da74f89b7ff44f49b8e2f2c2cbcbdb0b" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:08.540232 1192 tablet_bootstrap.cc:492] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:08.548343 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 733f4f262ed64a01a5f5f4c68ba37872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.572751 1192 ts_tablet_manager.cc:1403] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.125s user 0.004s sys 0.000s
W20260616 19:52:08.573453 858 leader_election.cc:343] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 31592a5ffb04429c9315a4fd72308f28
I20260616 19:52:08.573562 1192 raft_consensus.cc:359] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.573783 1192 raft_consensus.cc:385] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260616 19:52:08.573807 858 leader_election.cc:343] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: da74f89b7ff44f49b8e2f2c2cbcbdb0b
I20260616 19:52:08.573848 1192 raft_consensus.cc:740] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.574079 1192 consensus_queue.cc:260] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:52:08.574270 860 leader_election.cc:343] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.574358 860 leader_election.cc:304] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:08.574708 1192 ts_tablet_manager.cc:1434] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:08.574854 1923 raft_consensus.cc:2749] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:08.574716 860 leader_election.cc:343] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 31592a5ffb04429c9315a4fd72308f28
I20260616 19:52:08.575035 1192 tablet_bootstrap.cc:492] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:08.575071 860 leader_election.cc:304] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:08.575413 2192 raft_consensus.cc:2749] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:08.576895 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 65b0dc43b40649f29037f40d2ea9247e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.579627 1191 ts_tablet_manager.cc:1916] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.585841 1190 ts_tablet_manager.cc:1916] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.589776 751 tablet_service.cc:1558] Processing DeleteTablet for tablet d270afd0c0f3457aa6dd14721dca261d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.572455 454 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_963b2a8a65b14b5caecd9f3b7bcd615d [id=26e971fd00814ec89e4b45ad7544739b] alter complete (version 3)
I20260616 19:52:08.590554 1196 tablet_bootstrap.cc:492] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:08.590796 1196 ts_tablet_manager.cc:1403] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.104s user 0.002s sys 0.002s
I20260616 19:52:08.593977 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet aabf57dd6d704645b6bf97b730dbe964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.594266 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet ca5dc1e6cde347fc9a34e555385dc646 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.595345 1196 raft_consensus.cc:359] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.595659 1196 raft_consensus.cc:385] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.595773 1196 raft_consensus.cc:740] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.596048 1196 consensus_queue.cc:260] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.596884 1196 ts_tablet_manager.cc:1434] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260616 19:52:08.599033 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e8160ad4cf74f16a586ae59291ce7d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.602587 2161 raft_consensus.cc:493] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.602849 2161 raft_consensus.cc:515] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.603406 1192 tablet_bootstrap.cc:654] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.603672 2161 leader_election.cc:290] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:08.605758 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8160ad4cf74f16a586ae59291ce7d1" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:08.606822 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8160ad4cf74f16a586ae59291ce7d1" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:08.607549 993 leader_election.cc:343] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:08.608124 996 leader_election.cc:343] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.608297 996 leader_election.cc:304] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:08.608929 2161 raft_consensus.cc:2749] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:08.611361 1196 tablet_bootstrap.cc:492] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:08.612746 1190 ts_tablet_manager.cc:1929] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:08.614113 1196 tablet_bootstrap.cc:654] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.617255 1198 tablet_bootstrap.cc:492] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:08.617435 1198 ts_tablet_manager.cc:1403] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.081s user 0.003s sys 0.000s
I20260616 19:52:08.618347 1198 raft_consensus.cc:359] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.618549 1198 raft_consensus.cc:385] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.618655 1198 raft_consensus.cc:740] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.618917 1198 consensus_queue.cc:260] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.614638 1193 ts_tablet_manager.cc:1916] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.624568 1196 tablet_bootstrap.cc:492] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:08.627779 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet f52b2c5ff6264ffe8d579cb3816fc253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.628089 1196 ts_tablet_manager.cc:1403] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260616 19:52:08.628086 1198 ts_tablet_manager.cc:1434] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260616 19:52:08.632457 1196 raft_consensus.cc:359] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.633679 1196 raft_consensus.cc:385] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.635319 1191 ts_tablet_manager.cc:1929] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:08.635876 1196 raft_consensus.cc:740] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.636443 1196 consensus_queue.cc:260] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.641059 1196 ts_tablet_manager.cc:1434] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260616 19:52:08.641942 1196 tablet_bootstrap.cc:492] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:08.637444 1198 tablet_bootstrap.cc:492] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:08.647043 1191 log.cc:1199] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/1d80d9028184443da49623228259263d
I20260616 19:52:08.647583 1191 ts_tablet_manager.cc:1950] T 1d80d9028184443da49623228259263d P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:08.650067 1196 tablet_bootstrap.cc:654] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:08.653649 860 consensus_peers.cc:597] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1bc181171b134de2b946376f468aec72. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:08.654429 1192 tablet_bootstrap.cc:492] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:08.655480 1190 log.cc:1199] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/da51a682de41402cb537ab113f876a2d
I20260616 19:52:08.655614 1192 ts_tablet_manager.cc:1403] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.081s user 0.003s sys 0.004s
I20260616 19:52:08.655884 1190 ts_tablet_manager.cc:1950] T da51a682de41402cb537ab113f876a2d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:08.656230 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 754) took 2646 ms. Trace:
I20260616 19:52:08.656359 1190 rpcz_store.cc:276] 0616 19:52:06.009842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.009914 (+ 72us) service_pool.cc:224] Handling call
0616 19:52:08.499512 (+2489598us) ts_tablet_manager.cc:1151] Deleting tablet da51a682de41402cb537ab113f876a2d
0616 19:52:08.499526 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.600522 (+100996us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.612623 (+ 12101us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.656215 (+ 43592us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2489384}
I20260616 19:52:08.656497 1192 raft_consensus.cc:359] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.656832 1192 raft_consensus.cc:385] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.656937 1192 raft_consensus.cc:740] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.657039 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet da51a682de41402cb537ab113f876a2d (table default.Table_10a5c35013c14fe1b8d9d1c77589d321 [id=c53bc843f4974b08965984db1910d6d5]) successfully deleted
I20260616 19:52:08.657233 1192 consensus_queue.cc:260] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.657784 1192 ts_tablet_manager.cc:1434] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:08.659878 1192 tablet_bootstrap.cc:492] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:08.657364 1190 tablet_replica.cc:333] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:08.662779 1198 tablet_bootstrap.cc:654] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.667132 751 tablet_service.cc:1558] Processing DeleteTablet for tablet cbd1070277a14fd98af5fa45925e4f0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.669534 1192 tablet_bootstrap.cc:654] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.669981 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 780) took 2275 ms. Trace:
I20260616 19:52:08.670243 1191 rpcz_store.cc:276] 0616 19:52:06.374252 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.374302 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:08.556259 (+2181957us) ts_tablet_manager.cc:1151] Deleting tablet 1d80d9028184443da49623228259263d
0616 19:52:08.556270 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.608995 (+ 52725us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.635231 (+ 26236us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.649478 (+ 14247us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2181766}
I20260616 19:52:08.670632 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9f2c579d658b45ddae055d6efafecb87" } new_table_name: "default.Table_b81acb60dbc145f9ae6b0560b0f5ef8f" modify_external_catalogs: true
I20260616 19:52:08.671155 1191 tablet_replica.cc:333] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:08.670967 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 1d80d9028184443da49623228259263d (table default.Table_97db7730461e4d00ab3bc527573cde94 [id=cd27259f954043f8b50d2bb5788f1ecb]) successfully deleted
I20260616 19:52:08.671907 1191 raft_consensus.cc:2243] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:08.672663 1191 raft_consensus.cc:2272] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.674423 1191 ts_tablet_manager.cc:1916] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.679114 1190 raft_consensus.cc:2243] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:08.680341 1190 pending_rounds.cc:70] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
W20260616 19:52:08.682403 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 964576d0910f4ef89fbf71e44b09ba9c has no consensus state
I20260616 19:52:08.685916 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7c5d4c5de0074eeab591e9440641ef8d" } new_table_name: "default.Table_77bee4c7341f48f3bb6e223680c5541b" modify_external_catalogs: true
I20260616 19:52:08.680477 1190 pending_rounds.cc:77] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595498533105664 op_type: NO_OP noop_request { }
I20260616 19:52:08.686470 1190 raft_consensus.cc:2889] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:08.686615 1190 raft_consensus.cc:2272] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.687356 1190 ts_tablet_manager.cc:1916] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.689254 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 19b9248b88434a6e9ef7a3d602eee70c with delete_type TABLET_DATA_DELETED (replaced by tablet 415ad9d0c3564453825c4b30c0ad64fa) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:08.693795 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5bf7b099549418b982ea0dfc916e57e consensus state has no leader
I20260616 19:52:08.696200 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1d538611df134f06bf8db007545c11e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.696257 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_83154e1a68504df5b9e99369cdb4c876"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.696949 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d538611df134f06bf8db007545c11e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.697726 1198 tablet_bootstrap.cc:492] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:08.697985 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d3a16a3fb0be4caabdf0f9e1685869c7" } modify_external_catalogs: true
I20260616 19:52:08.698031 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_52d50dabb1b2498f88d5a07f62f7d058" } new_table_name: "default.Table_992b7795e9584cdc84514004082b6975" modify_external_catalogs: true
I20260616 19:52:08.698195 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d3a16a3fb0be4caabdf0f9e1685869c7" } modify_external_catalogs: true
I20260616 19:52:08.698853 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f1bb97d3ca244915b45c1f1d931cc97e" } modify_external_catalogs: true
I20260616 19:52:08.699427 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f1bb97d3ca244915b45c1f1d931cc97e" } modify_external_catalogs: true
I20260616 19:52:08.702543 1192 tablet_bootstrap.cc:492] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
W20260616 19:52:08.704099 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d44aed473e44e2eaa0d166f164c9309 consensus state has no leader
I20260616 19:52:08.704968 1192 ts_tablet_manager.cc:1403] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.000s
I20260616 19:52:08.705907 1196 tablet_bootstrap.cc:492] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:08.706089 1196 ts_tablet_manager.cc:1403] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.004s
I20260616 19:52:08.706895 1196 raft_consensus.cc:359] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.707144 1196 raft_consensus.cc:385] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.707260 1196 raft_consensus.cc:740] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.707526 1196 consensus_queue.cc:260] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.708247 1196 ts_tablet_manager.cc:1434] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260616 19:52:08.709197 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83154e1a68504df5b9e99369cdb4c876 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.710261 1196 tablet_bootstrap.cc:492] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:08.711262 1192 raft_consensus.cc:359] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.711432 1192 raft_consensus.cc:385] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.711489 1192 raft_consensus.cc:740] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.711735 1192 consensus_queue.cc:260] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.715463 751 tablet_service.cc:1558] Processing DeleteTablet for tablet e91c377ae66441268351cd3592aa9dbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.715803 2121 raft_consensus.cc:493] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.715917 2121 raft_consensus.cc:515] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.716542 2121 leader_election.cc:290] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:08.717213 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65b0dc43b40649f29037f40d2ea9247e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:08.717281 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65b0dc43b40649f29037f40d2ea9247e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:08.717391 778 raft_consensus.cc:2468] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:08.717442 1058 raft_consensus.cc:2468] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:08.717895 858 leader_election.cc:304] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:08.719102 2121 raft_consensus.cc:2804] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:08.719182 2121 raft_consensus.cc:493] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:08.719273 2121 raft_consensus.cc:3060] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.720628 2102 consensus_queue.cc:1048] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:08.723560 2121 raft_consensus.cc:515] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.725848 455 master_service.cc:960] ReplaceTablet: received request to replace tablet e3c4e584fad94633ae49332872de0fc3 from {username='slave'} at 127.0.0.1:41696
W20260616 19:52:08.730172 860 consensus_peers.cc:597] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b34d497f9334e94b06cc9245fca04ed. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:08.732828 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65b0dc43b40649f29037f40d2ea9247e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:08.732964 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65b0dc43b40649f29037f40d2ea9247e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:08.733018 778 raft_consensus.cc:3060] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.733119 1057 raft_consensus.cc:3060] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.736019 2121 leader_election.cc:290] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:08.736176 2102 raft_consensus.cc:493] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.736290 2102 raft_consensus.cc:515] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.736378 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_06449d55572148c2ba81f10aac53e1da" } new_table_name: "default.Table_ca9ce87f84704b59a80c419c4b958ea3" modify_external_catalogs: true
I20260616 19:52:08.737288 2102 leader_election.cc:290] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:08.737623 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b9248b88434a6e9ef7a3d602eee70c" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:08.738205 718 leader_election.cc:343] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.738435 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b9248b88434a6e9ef7a3d602eee70c" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:08.738584 1055 raft_consensus.cc:2468] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:08.739293 1192 ts_tablet_manager.cc:1434] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260616 19:52:08.739982 719 leader_election.cc:304] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:08.740569 2102 raft_consensus.cc:2804] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:08.740677 2102 raft_consensus.cc:493] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:08.740747 2102 raft_consensus.cc:3060] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.740865 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8744a2db15fd49259e0900a69941415d" } modify_external_catalogs: true
I20260616 19:52:08.741017 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8744a2db15fd49259e0900a69941415d" } modify_external_catalogs: true
I20260616 19:52:08.750610 1196 tablet_bootstrap.cc:654] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.752388 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_96a5b2a9fdda4f5b82a47ae1dc7b190c" } new_table_name: "default.Table_88aaf292b9144d75a8bea47d896a63bf" modify_external_catalogs: true
I20260616 19:52:08.754676 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_11151a450eb946fda594d28bd1e72fa5" } modify_external_catalogs: true
I20260616 19:52:08.754845 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_11151a450eb946fda594d28bd1e72fa5" } modify_external_catalogs: true
I20260616 19:52:08.755425 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d09fa8a3ff9c4c749ce57d6a8c51fe4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.754607 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5378b2a86ed9456e9da1b5af2bb92ce7" } modify_external_catalogs: true
I20260616 19:52:08.756789 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5378b2a86ed9456e9da1b5af2bb92ce7" } modify_external_catalogs: true
W20260616 19:52:08.757979 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e2a3f93685146e9a7bf2713cc71dcb6 consensus state has no leader
W20260616 19:52:08.759291 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da039dbc1089426dba1226940e37469e consensus state has no leader
I20260616 19:52:08.763844 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1c9c9f90122442a298e318fcfa29121e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.765642 1192 tablet_bootstrap.cc:492] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:08.770180 458 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet df036f9d31ca4770bb00bc9cece46953 (table default.Table_58b6a6df64fe459ab7a7abb175850554 [id=548cacd5de984fa89aa96b1c659f9e38]). Expected version 4 got 0
I20260616 19:52:08.771548 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_41d3d83f28cb4ccbb5328dbe7700e9ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.776760 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41d3d83f28cb4ccbb5328dbe7700e9ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.778072 1196 tablet_bootstrap.cc:492] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:08.778213 1196 ts_tablet_manager.cc:1403] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.000s
I20260616 19:52:08.778352 2181 consensus_queue.cc:1048] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:08.779031 1196 raft_consensus.cc:359] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.779184 1196 raft_consensus.cc:385] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.779237 1196 raft_consensus.cc:740] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.779421 1196 consensus_queue.cc:260] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:08.779872 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d09fa8a3ff9c4c749ce57d6a8c51fe4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.779914 1196 ts_tablet_manager.cc:1434] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:08.780177 1196 tablet_bootstrap.cc:492] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:08.781507 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c9c9f90122442a298e318fcfa29121e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.789400 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet df036f9d31ca4770bb00bc9cece46953 (table default.Table_58b6a6df64fe459ab7a7abb175850554 [id=548cacd5de984fa89aa96b1c659f9e38]). Expected version 4 got 0
I20260616 19:52:08.790959 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_29ee389b873d4edbbbec5269e7e8735d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.791682 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29ee389b873d4edbbbec5269e7e8735d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.795600 751 tablet_service.cc:1558] Processing DeleteTablet for tablet cf136fa86c264f69a1703596cfd0e77a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.802414 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1cb80f9ffd2d455ea35974eb1ebea3ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.808161 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2a8f3a4767fb47a0908c8e8d410500a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.809036 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a8f3a4767fb47a0908c8e8d410500a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:08.810072 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cb80f9ffd2d455ea35974eb1ebea3ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.808377 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8a47476495fe4dd78cb8d298f98f2928"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.811331 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a47476495fe4dd78cb8d298f98f2928 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.827028 971 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
W20260616 19:52:08.838420 719 consensus_peers.cc:597] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79250767a94141cd900a9715e86128b8. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:08.841626 1193 ts_tablet_manager.cc:1929] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:08.841771 1193 log.cc:1199] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/d9c664f0386549d6867c407526ee45a0
I20260616 19:52:08.842007 1190 ts_tablet_manager.cc:1929] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:08.842113 1190 log.cc:1199] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/4ffce2dc22e24d1684e6eae92c487cea
I20260616 19:52:08.843645 458 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet df036f9d31ca4770bb00bc9cece46953 (table default.Table_58b6a6df64fe459ab7a7abb175850554 [id=548cacd5de984fa89aa96b1c659f9e38]). Expected version 4 got 0
I20260616 19:52:08.846529 1057 raft_consensus.cc:2468] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:08.847043 778 raft_consensus.cc:2468] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:08.844404 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c030c3487feb4377b9f094e2ab00e7ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:08.850744 1192 tablet_bootstrap.cc:654] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:08.850917 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c030c3487feb4377b9f094e2ab00e7ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.851723 1190 ts_tablet_manager.cc:1950] T 4ffce2dc22e24d1684e6eae92c487cea P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:08.852035 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 755) took 2841 ms. Trace:
I20260616 19:52:08.852106 1190 rpcz_store.cc:276] 0616 19:52:06.010079 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.010155 (+ 76us) service_pool.cc:224] Handling call
0616 19:52:08.657320 (+2647165us) ts_tablet_manager.cc:1151] Deleting tablet 4ffce2dc22e24d1684e6eae92c487cea
0616 19:52:08.657329 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.730399 (+ 73070us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.841948 (+111549us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.852020 (+ 10072us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2646958}
I20260616 19:52:08.852626 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 4ffce2dc22e24d1684e6eae92c487cea (table default.Table_ee130ae3817f41f8ac49a76361fd23ea [id=a69482262948439783492742dcbf0b43]) successfully deleted
I20260616 19:52:08.852955 1190 tablet_replica.cc:333] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:08.853132 1190 raft_consensus.cc:2243] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:08.853498 1190 raft_consensus.cc:2272] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.853845 860 leader_election.cc:304] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:08.854059 1190 ts_tablet_manager.cc:1916] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.855540 2121 raft_consensus.cc:2804] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:08.855692 2121 raft_consensus.cc:697] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:08.855921 2121 consensus_queue.cc:237] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.857275 454 master_service.cc:960] ReplaceTablet: received request to replace tablet fb1c2030b3a14c6aafaa961869606f31 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:08.857738 455 master_service.cc:960] ReplaceTablet: received request to replace tablet da51a682de41402cb537ab113f876a2d from {username='slave'} at 127.0.0.1:41696
W20260616 19:52:08.858819 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet b5bf7b099549418b982ea0dfc916e57e (table default.Table_77bee4c7341f48f3bb6e223680c5541b [id=db802e6b94734f51a7c0298a8c0535ee], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b5bf7b099549418b982ea0dfc916e57e consensus state has no leader
I20260616 19:52:08.861763 1191 ts_tablet_manager.cc:1929] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:08.861913 1191 log.cc:1199] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/fbb308b05bb04bc18ccaa9550a73d3e7
I20260616 19:52:08.875167 2169 tablet.cc:1724] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:52:08.877027 1191 ts_tablet_manager.cc:1950] T fbb308b05bb04bc18ccaa9550a73d3e7 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:08.877959 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 782) took 2503 ms. Trace:
I20260616 19:52:08.878048 1191 rpcz_store.cc:276] 0616 19:52:06.374743 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.374906 (+ 163us) service_pool.cc:224] Handling call
0616 19:52:08.671059 (+2296153us) ts_tablet_manager.cc:1151] Deleting tablet fbb308b05bb04bc18ccaa9550a73d3e7
0616 19:52:08.671070 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.744211 (+ 73141us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.861688 (+117477us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.877937 (+ 16249us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2295910}
I20260616 19:52:08.878490 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet fbb308b05bb04bc18ccaa9550a73d3e7 (table default.Table_fae6d52794914f15a61ce5057c2d51b5 [id=4ac9b907f9cf42478b9591bce31ccbcb]) successfully deleted
I20260616 19:52:08.878826 1191 tablet_replica.cc:333] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:08.879092 1191 raft_consensus.cc:2243] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:08.879321 1191 raft_consensus.cc:2272] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.879938 1191 ts_tablet_manager.cc:1916] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.883380 2161 raft_consensus.cc:493] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.883443 1192 tablet_bootstrap.cc:492] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:08.883574 1192 ts_tablet_manager.cc:1403] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.118s user 0.002s sys 0.002s
I20260616 19:52:08.883527 2161 raft_consensus.cc:515] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.884248 2161 leader_election.cc:290] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:08.884371 1192 raft_consensus.cc:359] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.884568 1192 raft_consensus.cc:385] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.884624 1192 raft_consensus.cc:740] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.884871 1192 consensus_queue.cc:260] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.885234 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9fe1afa2ee854800ab19aac1fb4c6048" } new_table_name: "default.Table_4f1675b0cae24ecea8b9f4efebb44772" modify_external_catalogs: true
I20260616 19:52:08.885401 1192 ts_tablet_manager.cc:1434] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:08.885437 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52b2c5ff6264ffe8d579cb3816fc253" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:08.885670 1192 tablet_bootstrap.cc:492] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:52:08.886411 996 leader_election.cc:343] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.887699 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52b2c5ff6264ffe8d579cb3816fc253" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:08.888202 993 leader_election.cc:343] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:08.888319 993 leader_election.cc:304] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:08.888864 2161 raft_consensus.cc:2749] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:08.888955 2214 tablet.cc:1724] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:52:08.891737 1193 ts_tablet_manager.cc:1950] T d9c664f0386549d6867c407526ee45a0 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:08.892019 1196 tablet_bootstrap.cc:654] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:08.892279 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84ce7bf3e0004ffaa2c5e314fa69322c consensus state has no leader
I20260616 19:52:08.896374 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6638da797c494fa3b2ea3d0e50a34f63" } new_table_name: "default.Table_d4d414b3d75449c5a328e01cd03ad768" modify_external_catalogs: true
I20260616 19:52:08.896718 1192 tablet_bootstrap.cc:654] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.903019 456 catalog_manager.cc:5696] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:08.903475 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 76d73be228664063822c41cbefafcab8 (table default.Table_16508a5420d3488088367681d9b55f03 [id=946fd4fcf5f244acafa1e82743e70af2]). Expected version 2 got 0
I20260616 19:52:08.903718 456 catalog_manager.cc:5696] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:08.904065 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]). Expected version 2 got 0
I20260616 19:52:08.904314 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 9c77fd138ce9463b8f2d6f4182a56559 (table default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17]). Expected version 1 got 0
I20260616 19:52:08.905620 886 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6e391baa574e7ba1052c3c1e34cf3b (DEFAULT_TABLE table=default.Table_ac1073c32224454fa8c4290c02d5e511 [id=99a5faa0367b44b28d6461203888ce92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.906711 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 34264036a635419fbc8f9e2c388a817b
I20260616 19:52:08.906721 751 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6e391baa574e7ba1052c3c1e34cf3b (DEFAULT_TABLE table=default.Table_ac1073c32224454fa8c4290c02d5e511 [id=99a5faa0367b44b28d6461203888ce92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.908535 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 34264036a635419fbc8f9e2c388a817b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.909384 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 34264036a635419fbc8f9e2c388a817b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.911016 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 34264036a635419fbc8f9e2c388a817b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.911405 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9695d9318e72487a92a1a812b47fa190"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.911888 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9695d9318e72487a92a1a812b47fa190 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.913582 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8a47476495fe4dd78cb8d298f98f2928" } new_table_name: "default.Table_10269fcb37e245679d0970467b2dcdde" modify_external_catalogs: true
I20260616 19:52:08.913708 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6e391baa574e7ba1052c3c1e34cf3b (DEFAULT_TABLE table=default.Table_ac1073c32224454fa8c4290c02d5e511 [id=99a5faa0367b44b28d6461203888ce92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.914991 750 tablet_service.cc:1511] Processing CreateTablet for tablet bb02ec3fe424408aa60f74517203146a (DEFAULT_TABLE table=default.Table_f7a41c7ea8ae42618e88dfbe92c30830 [id=38147f6cd5f7452b9ab203c2ae4023e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.915516 889 tablet_service.cc:1511] Processing CreateTablet for tablet bb02ec3fe424408aa60f74517203146a (DEFAULT_TABLE table=default.Table_f7a41c7ea8ae42618e88dfbe92c30830 [id=38147f6cd5f7452b9ab203c2ae4023e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.917858 758 tablet_service.cc:1511] Processing CreateTablet for tablet df14405fff32417da8e9069680100dbd (DEFAULT_TABLE table=default.Table_4791ad7d3cf045f6b0c8ae18d7977c59 [id=aad0061e2dca4e6faa8a7ebc7d0d5d75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.918318 458 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_58b6a6df64fe459ab7a7abb175850554 [id=548cacd5de984fa89aa96b1c659f9e38] alter complete (version 4)
I20260616 19:52:08.918634 1030 tablet_service.cc:1511] Processing CreateTablet for tablet bb02ec3fe424408aa60f74517203146a (DEFAULT_TABLE table=default.Table_f7a41c7ea8ae42618e88dfbe92c30830 [id=38147f6cd5f7452b9ab203c2ae4023e4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:08.918924 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0c281b936f2147b9989f03a3e1b6884e consensus state has no leader
I20260616 19:52:08.921329 890 tablet_service.cc:1511] Processing CreateTablet for tablet df14405fff32417da8e9069680100dbd (DEFAULT_TABLE table=default.Table_4791ad7d3cf045f6b0c8ae18d7977c59 [id=aad0061e2dca4e6faa8a7ebc7d0d5d75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.923825 753 tablet_service.cc:1511] Processing CreateTablet for tablet 861a73a46dad41b6b5eb59503d9e2ace (DEFAULT_TABLE table=default.Table_771c21e2e42f493baa45a3dd0c7df5e0 [id=bdd7cd308f2d45a7abd53c6cb985b41c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.924837 1034 tablet_service.cc:1511] Processing CreateTablet for tablet df14405fff32417da8e9069680100dbd (DEFAULT_TABLE table=default.Table_4791ad7d3cf045f6b0c8ae18d7977c59 [id=aad0061e2dca4e6faa8a7ebc7d0d5d75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.925535 891 tablet_service.cc:1511] Processing CreateTablet for tablet 861a73a46dad41b6b5eb59503d9e2ace (DEFAULT_TABLE table=default.Table_771c21e2e42f493baa45a3dd0c7df5e0 [id=bdd7cd308f2d45a7abd53c6cb985b41c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.927505 765 tablet_service.cc:1511] Processing CreateTablet for tablet 84b168fbd133466681c86513c4bacf8b (DEFAULT_TABLE table=default.Table_cca35e086f1b4097b41fbaa853cc2473 [id=03024acc64d74bd698a33c5f40cb8e95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.927512 2215 tablet.cc:1724] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:52:08.928297 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 4ce69dcb31fe41879e9feb3b01547dd9
I20260616 19:52:08.928858 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 40124cee94a445ed9175132d4e0c86d8
I20260616 19:52:08.929499 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet aee589880bac4eff98fa6edd32c0b92d
I20260616 19:52:08.930104 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ce69dcb31fe41879e9feb3b01547dd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.930418 903 tablet_service.cc:1558] Processing DeleteTablet for tablet aee589880bac4eff98fa6edd32c0b92d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.930455 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ce69dcb31fe41879e9feb3b01547dd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.930711 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 40124cee94a445ed9175132d4e0c86d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.930902 760 tablet_service.cc:1558] Processing DeleteTablet for tablet aee589880bac4eff98fa6edd32c0b92d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.932065 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 6677452bd2ce4ba5a07fdf67e9529830
I20260616 19:52:08.932574 903 tablet_service.cc:1558] Processing DeleteTablet for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b with delete_type TABLET_DATA_DELETED (replaced by tablet f54eef97f8db47449564b49be608902f) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.933275 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 6677452bd2ce4ba5a07fdf67e9529830 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:08.933552 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 6677452bd2ce4ba5a07fdf67e9529830 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.934202 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 40124cee94a445ed9175132d4e0c86d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.934540 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 861a73a46dad41b6b5eb59503d9e2ace (DEFAULT_TABLE table=default.Table_771c21e2e42f493baa45a3dd0c7df5e0 [id=bdd7cd308f2d45a7abd53c6cb985b41c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.935057 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet aee589880bac4eff98fa6edd32c0b92d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.935587 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 6677452bd2ce4ba5a07fdf67e9529830 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.932574 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 40124cee94a445ed9175132d4e0c86d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.934213 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ce69dcb31fe41879e9feb3b01547dd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:08.944943 902 tablet_service.cc:1558] Processing DeleteTablet for tablet d270afd0c0f3457aa6dd14721dca261d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:54 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.947450 2102 raft_consensus.cc:515] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.948137 2102 leader_election.cc:290] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:08.948573 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 65b0dc43b40649f29037f40d2ea9247e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.948721 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d80d9028184443da49623228259263d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:08.948660 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b9248b88434a6e9ef7a3d602eee70c" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:08.948855 1058 raft_consensus.cc:3060] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:08.949393 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861a73a46dad41b6b5eb59503d9e2ace. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:08.949437 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0313e65e6a3441abcd663110cfcd70d has no consensus state
I20260616 19:52:08.950358 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6e391baa574e7ba1052c3c1e34cf3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.950856 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df14405fff32417da8e9069680100dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.951243 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861a73a46dad41b6b5eb59503d9e2ace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.951634 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84b168fbd133466681c86513c4bacf8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.953774 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 84b168fbd133466681c86513c4bacf8b (DEFAULT_TABLE table=default.Table_cca35e086f1b4097b41fbaa853cc2473 [id=03024acc64d74bd698a33c5f40cb8e95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.955159 1036 tablet_service.cc:1511] Processing CreateTablet for tablet b87df2df43f64006b8555cb9e94f9806 (DEFAULT_TABLE table=default.Table_883e227c1e8f4e85b6265ea1dee66680 [id=22f99c73d37742b3857c6de1a026d1b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.955596 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6e391baa574e7ba1052c3c1e34cf3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.956107 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb02ec3fe424408aa60f74517203146a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.956569 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df14405fff32417da8e9069680100dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.961251 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 7d7cbf2234e8478fb472bf9d61e4eb0e (DEFAULT_TABLE table=default.Table_558d3e1cd5dd4d3dad3ba5d0a43bb76f [id=e516b85c5f5944cda58d5012dab36aba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.961619 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7cbf2234e8478fb472bf9d61e4eb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.964340 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e96176d8842641a9b655bab99c8b35f9" } new_table_name: "default.Table_cf9036705cd2493d8664413bca60859f" modify_external_catalogs: true
I20260616 19:52:08.969839 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7d7cbf2234e8478fb472bf9d61e4eb0e (DEFAULT_TABLE table=default.Table_558d3e1cd5dd4d3dad3ba5d0a43bb76f [id=e516b85c5f5944cda58d5012dab36aba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.964383 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_17aa3c8fef1e4aa4bcb957c7bda0c998" } new_table_name: "default.Table_b3559538aad547e3a85120356396f742" modify_external_catalogs: true
I20260616 19:52:08.970443 760 tablet_service.cc:1511] Processing CreateTablet for tablet b87df2df43f64006b8555cb9e94f9806 (DEFAULT_TABLE table=default.Table_883e227c1e8f4e85b6265ea1dee66680 [id=22f99c73d37742b3857c6de1a026d1b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.970961 1192 tablet_bootstrap.cc:492] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:08.971100 1192 ts_tablet_manager.cc:1403] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.000s
I20260616 19:52:08.971843 1192 raft_consensus.cc:359] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.972019 1192 raft_consensus.cc:385] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.972069 1192 raft_consensus.cc:740] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:08.972268 1192 consensus_queue.cc:260] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:08.972754 1192 ts_tablet_manager.cc:1434] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:52:08.973811 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cc988a195ec4bbf8691801421fed8bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:08.973858 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 92fcb0f60c474fbabce31a2c970ceb52 consensus state has no leader
I20260616 19:52:08.974197 892 tablet_service.cc:1511] Processing CreateTablet for tablet b87df2df43f64006b8555cb9e94f9806 (DEFAULT_TABLE table=default.Table_883e227c1e8f4e85b6265ea1dee66680 [id=22f99c73d37742b3857c6de1a026d1b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.974197 902 tablet_service.cc:1511] Processing CreateTablet for tablet 84b168fbd133466681c86513c4bacf8b (DEFAULT_TABLE table=default.Table_cca35e086f1b4097b41fbaa853cc2473 [id=03024acc64d74bd698a33c5f40cb8e95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.975121 903 tablet_service.cc:1511] Processing CreateTablet for tablet 7d7cbf2234e8478fb472bf9d61e4eb0e (DEFAULT_TABLE table=default.Table_558d3e1cd5dd4d3dad3ba5d0a43bb76f [id=e516b85c5f5944cda58d5012dab36aba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.975522 1192 tablet_bootstrap.cc:492] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:08.975728 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b9248b88434a6e9ef7a3d602eee70c" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:08.976933 1192 tablet_bootstrap.cc:654] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.978636 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb02ec3fe424408aa60f74517203146a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:08.980615 1908 raft_consensus.cc:493] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:08.980738 1908 raft_consensus.cc:515] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.981287 1908 leader_election.cc:290] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:08.982365 1021 tablet_service.cc:1511] Processing CreateTablet for tablet b30bdc71281f4087ab837cdd45baf136 (DEFAULT_TABLE table=default.Table_f7ccee58ecd349ceae600f3b097451c7 [id=5d3545983fe24a24af0a237cdf28bfec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.982502 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 0146e7a97662494e98c81b5a2af66513 (DEFAULT_TABLE table=default.Table_ec1c70e517834298a657d9b505317348 [id=79112095eb59405ba94ff20b44c6f2b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.982643 1023 tablet_service.cc:1511] Processing CreateTablet for tablet cbbbfa65120b4b9b98ef0fc30a13f2d3 (DEFAULT_TABLE table=default.Table_7044ef52a676420a8846f7d3abb520ee [id=a7010f7e9609465ba196fbbc26006853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.982903 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 7cae31969193439a9a99eac1a9f7aee9 (DEFAULT_TABLE table=default.Table_58cf14ca021e4270bac10dd0ef488b7e [id=5be0614a3eab406bb95c4e0684cf7afd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:08.982977 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 871) took 1187 ms. Trace:
I20260616 19:52:08.983052 1193 rpcz_store.cc:276] 0616 19:52:07.795315 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.795392 (+ 77us) service_pool.cc:224] Handling call
0616 19:52:08.557449 (+762057us) ts_tablet_manager.cc:1151] Deleting tablet d9c664f0386549d6867c407526ee45a0
0616 19:52:08.557466 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.724942 (+167476us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.841493 (+116551us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:08.982962 (+141469us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":761602}
I20260616 19:52:08.983357 1193 tablet_replica.cc:333] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:08.983505 1193 raft_consensus.cc:2243] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:08.983855 1193 pending_rounds.cc:70] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:08.983896 1193 pending_rounds.cc:77] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595506707021824 op_type: NO_OP noop_request { }
I20260616 19:52:08.983973 1193 raft_consensus.cc:2889] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:08.984042 1193 raft_consensus.cc:2272] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:08.984140 1198 ts_tablet_manager.cc:1403] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.347s user 0.018s sys 0.011s
I20260616 19:52:08.984817 1198 raft_consensus.cc:359] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.984968 1198 raft_consensus.cc:385] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:08.985018 1198 raft_consensus.cc:740] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
W20260616 19:52:08.984997 719 leader_election.cc:343] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: d270afd0c0f3457aa6dd14721dca261d
I20260616 19:52:08.985224 1198 consensus_queue.cc:260] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:08.985641 1198 ts_tablet_manager.cc:1434] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260616 19:52:08.985805 1193 ts_tablet_manager.cc:1916] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:08.987766 1198 tablet_bootstrap.cc:492] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:08.989024 1198 tablet_bootstrap.cc:654] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:08.991160 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ab39a467973c4df4aaac5fdd78aa2218"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.991778 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab39a467973c4df4aaac5fdd78aa2218 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:08.994935 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d7fcc73e3c06411b93fc748eb5b0ca34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:08.995488 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7fcc73e3c06411b93fc748eb5b0ca34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.000452 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8286cbce941848058f9f1d96424d16d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.001011 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8286cbce941848058f9f1d96424d16d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.002933 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet d9c664f0386549d6867c407526ee45a0 (table default.Table_8f93c0209c4d41ea9c714fe9ebed8588 [id=0cc25e520828404183490059b522eefb]) successfully deleted
I20260616 19:52:09.003484 763 tablet_service.cc:1511] Processing CreateTablet for tablet cbbbfa65120b4b9b98ef0fc30a13f2d3 (DEFAULT_TABLE table=default.Table_7044ef52a676420a8846f7d3abb520ee [id=a7010f7e9609465ba196fbbc26006853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.003528 754 tablet_service.cc:1511] Processing CreateTablet for tablet 7cae31969193439a9a99eac1a9f7aee9 (DEFAULT_TABLE table=default.Table_58cf14ca021e4270bac10dd0ef488b7e [id=5be0614a3eab406bb95c4e0684cf7afd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.003888 764 tablet_service.cc:1511] Processing CreateTablet for tablet 1106555fe0f44aa595f2ba00a19e914a (DEFAULT_TABLE table=default.Table_45f727fb97db43d3bdbf9b1046001a45 [id=8e9bb037176e401bb84e6f46749c3050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.008759 762 tablet_service.cc:1511] Processing CreateTablet for tablet b30bdc71281f4087ab837cdd45baf136 (DEFAULT_TABLE table=default.Table_f7ccee58ecd349ceae600f3b097451c7 [id=5d3545983fe24a24af0a237cdf28bfec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.009189 752 tablet_service.cc:1511] Processing CreateTablet for tablet 0146e7a97662494e98c81b5a2af66513 (DEFAULT_TABLE table=default.Table_ec1c70e517834298a657d9b505317348 [id=79112095eb59405ba94ff20b44c6f2b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.010324 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 1106555fe0f44aa595f2ba00a19e914a (DEFAULT_TABLE table=default.Table_45f727fb97db43d3bdbf9b1046001a45 [id=8e9bb037176e401bb84e6f46749c3050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.011358 1192 tablet_bootstrap.cc:492] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:09.011554 1192 ts_tablet_manager.cc:1403] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260616 19:52:09.012387 1192 raft_consensus.cc:359] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.012646 1192 raft_consensus.cc:385] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.012758 1192 raft_consensus.cc:740] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.013007 1192 consensus_queue.cc:260] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:52:09.014763 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a935e1df16dd4ceabb270cfeb75c9fb2 consensus state has no leader
I20260616 19:52:09.015964 1192 ts_tablet_manager.cc:1434] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
W20260616 19:52:09.017014 718 leader_election.cc:343] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:09.017366 887 tablet_service.cc:1511] Processing CreateTablet for tablet b30bdc71281f4087ab837cdd45baf136 (DEFAULT_TABLE table=default.Table_f7ccee58ecd349ceae600f3b097451c7 [id=5d3545983fe24a24af0a237cdf28bfec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.017539 897 tablet_service.cc:1511] Processing CreateTablet for tablet 0146e7a97662494e98c81b5a2af66513 (DEFAULT_TABLE table=default.Table_ec1c70e517834298a657d9b505317348 [id=79112095eb59405ba94ff20b44c6f2b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.017820 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 44493f0ffd064249a28628cf24895395 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:09.017923 1192 tablet_bootstrap.cc:492] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:09.017855 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d270afd0c0f3457aa6dd14721dca261d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:09.018234 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ff63920505544041b432b128eb784f02 (DEFAULT_TABLE table=default.Table_8c1e33ea95f14cea8bb1cb6e0d037b46 [id=537f2c8fd8cd469c95a1bfa459e2ee78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.018409 922 raft_consensus.cc:2468] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:09.018695 895 tablet_service.cc:1511] Processing CreateTablet for tablet cbbbfa65120b4b9b98ef0fc30a13f2d3 (DEFAULT_TABLE table=default.Table_7044ef52a676420a8846f7d3abb520ee [id=a7010f7e9609465ba196fbbc26006853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.019104 893 tablet_service.cc:1511] Processing CreateTablet for tablet 7cae31969193439a9a99eac1a9f7aee9 (DEFAULT_TABLE table=default.Table_58cf14ca021e4270bac10dd0ef488b7e [id=5be0614a3eab406bb95c4e0684cf7afd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.019251 1192 tablet_bootstrap.cc:654] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.020637 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1cc2efab7cde4a4c860319723167c913"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.021184 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cc2efab7cde4a4c860319723167c913 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.024194 1198 tablet_bootstrap.cc:492] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:09.024326 1198 ts_tablet_manager.cc:1403] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.000s
I20260616 19:52:09.024983 1198 raft_consensus.cc:359] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.025143 1198 raft_consensus.cc:385] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.025198 1198 raft_consensus.cc:740] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.025404 1198 consensus_queue.cc:260] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.025586 718 leader_election.cc:304] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:09.025867 1198 ts_tablet_manager.cc:1434] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260616 19:52:09.025883 894 tablet_service.cc:1511] Processing CreateTablet for tablet 1106555fe0f44aa595f2ba00a19e914a (DEFAULT_TABLE table=default.Table_45f727fb97db43d3bdbf9b1046001a45 [id=8e9bb037176e401bb84e6f46749c3050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.027410 901 tablet_service.cc:1511] Processing CreateTablet for tablet ff63920505544041b432b128eb784f02 (DEFAULT_TABLE table=default.Table_8c1e33ea95f14cea8bb1cb6e0d037b46 [id=537f2c8fd8cd469c95a1bfa459e2ee78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.027823 896 tablet_service.cc:1511] Processing CreateTablet for tablet c1978faeb31f43a1b0ac40c60cdfab9a (DEFAULT_TABLE table=default.Table_7af7e490f00745fb8ac2052e56b9d680 [id=ab9d848ca4b14dd88f248eafa391c7d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.028654 1032 tablet_service.cc:1511] Processing CreateTablet for tablet c1978faeb31f43a1b0ac40c60cdfab9a (DEFAULT_TABLE table=default.Table_7af7e490f00745fb8ac2052e56b9d680 [id=ab9d848ca4b14dd88f248eafa391c7d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.028892 904 tablet_service.cc:1511] Processing CreateTablet for tablet 7ffc15f90dc24de49455205d5de6b58e (DEFAULT_TABLE table=default.Table_c55c1fac1f784f91b12629f33809763c [id=2d2bd05671e448778ce8971b0dfa68ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.029000 2102 raft_consensus.cc:2804] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:09.029086 2102 raft_consensus.cc:493] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:09.029153 2102 raft_consensus.cc:3060] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:09.029808 747 tablet_service.cc:1511] Processing CreateTablet for tablet ff63920505544041b432b128eb784f02 (DEFAULT_TABLE table=default.Table_8c1e33ea95f14cea8bb1cb6e0d037b46 [id=537f2c8fd8cd469c95a1bfa459e2ee78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.030489 748 tablet_service.cc:1511] Processing CreateTablet for tablet c1978faeb31f43a1b0ac40c60cdfab9a (DEFAULT_TABLE table=default.Table_7af7e490f00745fb8ac2052e56b9d680 [id=ab9d848ca4b14dd88f248eafa391c7d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.031208 756 tablet_service.cc:1511] Processing CreateTablet for tablet 7ffc15f90dc24de49455205d5de6b58e (DEFAULT_TABLE table=default.Table_c55c1fac1f784f91b12629f33809763c [id=2d2bd05671e448778ce8971b0dfa68ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.034087 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:52:09.038753 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 7ffc15f90dc24de49455205d5de6b58e (DEFAULT_TABLE table=default.Table_c55c1fac1f784f91b12629f33809763c [id=2d2bd05671e448778ce8971b0dfa68ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.039144 749 tablet_service.cc:1511] Processing CreateTablet for tablet 964576d0910f4ef89fbf71e44b09ba9c (DEFAULT_TABLE table=default.Table_b81acb60dbc145f9ae6b0560b0f5ef8f [id=0c46938c90d2419fa65a9e32cfc449a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.039808 1198 tablet_bootstrap.cc:492] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:09.039755 900 tablet_service.cc:1511] Processing CreateTablet for tablet 964576d0910f4ef89fbf71e44b09ba9c (DEFAULT_TABLE table=default.Table_b81acb60dbc145f9ae6b0560b0f5ef8f [id=0c46938c90d2419fa65a9e32cfc449a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.042802 759 tablet_service.cc:1511] Processing CreateTablet for tablet 7d486a9c69954dc4a9b664d89d2bf28a (DEFAULT_TABLE table=default.Table_f5c1eb12b45345aabb7ab3c7a1854ead [id=c7d1624942fb42aa95ad085062052262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.043996 898 tablet_service.cc:1511] Processing CreateTablet for tablet 7d486a9c69954dc4a9b664d89d2bf28a (DEFAULT_TABLE table=default.Table_f5c1eb12b45345aabb7ab3c7a1854ead [id=c7d1624942fb42aa95ad085062052262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.045405 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 964576d0910f4ef89fbf71e44b09ba9c (DEFAULT_TABLE table=default.Table_b81acb60dbc145f9ae6b0560b0f5ef8f [id=0c46938c90d2419fa65a9e32cfc449a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.045468 755 tablet_service.cc:1511] Processing CreateTablet for tablet b949b3d1e16d49a6a1bce5ca21a268c3 (DEFAULT_TABLE table=default.Table_7a777a2aa2cd44d1b7f9db66e8367a32 [id=6db44bdac0784e08b52a4db869edb3d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.045501 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 7d486a9c69954dc4a9b664d89d2bf28a (DEFAULT_TABLE table=default.Table_f5c1eb12b45345aabb7ab3c7a1854ead [id=c7d1624942fb42aa95ad085062052262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.045724 2161 raft_consensus.cc:493] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:09.045845 2161 raft_consensus.cc:515] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.046443 2161 leader_election.cc:290] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:09.046646 746 tablet_service.cc:1511] Processing CreateTablet for tablet 2df86f867d1145948fda9fd5104af9fc (DEFAULT_TABLE table=default.Table_104c94f36fc243ba8d761682dae23716 [id=88c902039e2d40d78038a26a608a4ae2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.046739 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1c2030b3a14c6aafaa961869606f31" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:09.047099 1035 tablet_service.cc:1511] Processing CreateTablet for tablet b949b3d1e16d49a6a1bce5ca21a268c3 (DEFAULT_TABLE table=default.Table_7a777a2aa2cd44d1b7f9db66e8367a32 [id=6db44bdac0784e08b52a4db869edb3d3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:09.047230 993 leader_election.cc:343] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:09.047195 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1c2030b3a14c6aafaa961869606f31" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:09.047946 899 tablet_service.cc:1511] Processing CreateTablet for tablet b949b3d1e16d49a6a1bce5ca21a268c3 (DEFAULT_TABLE table=default.Table_7a777a2aa2cd44d1b7f9db66e8367a32 [id=6db44bdac0784e08b52a4db869edb3d3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:09.048450 996 leader_election.cc:343] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:09.048580 996 leader_election.cc:304] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:09.049813 1198 tablet_bootstrap.cc:654] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.051116 1192 tablet_bootstrap.cc:492] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:09.051313 1192 ts_tablet_manager.cc:1403] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260616 19:52:09.051309 2161 raft_consensus.cc:2749] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:09.052158 1192 raft_consensus.cc:359] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.052399 1192 raft_consensus.cc:385] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.052510 1192 raft_consensus.cc:740] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.052933 1192 consensus_queue.cc:260] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.053464 1192 ts_tablet_manager.cc:1434] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:09.053768 1192 tablet_bootstrap.cc:492] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:09.055927 1192 tablet_bootstrap.cc:654] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.056661 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bf59e5a025ec4779ba7d2638fad52eae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.057281 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf59e5a025ec4779ba7d2638fad52eae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.057085 888 tablet_service.cc:1511] Processing CreateTablet for tablet 2df86f867d1145948fda9fd5104af9fc (DEFAULT_TABLE table=default.Table_104c94f36fc243ba8d761682dae23716 [id=88c902039e2d40d78038a26a608a4ae2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.058415 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 2df86f867d1145948fda9fd5104af9fc (DEFAULT_TABLE table=default.Table_104c94f36fc243ba8d761682dae23716 [id=88c902039e2d40d78038a26a608a4ae2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.063242 761 tablet_service.cc:1511] Processing CreateTablet for tablet 3f18e61382a947d5aa635d3c83068f35 (DEFAULT_TABLE table=default.Table_14591625550c4aa5a5a46a183fb22a3f [id=37cecaa75c514f59849b474f32bcaa46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.063793 885 tablet_service.cc:1511] Processing CreateTablet for tablet 3f18e61382a947d5aa635d3c83068f35 (DEFAULT_TABLE table=default.Table_14591625550c4aa5a5a46a183fb22a3f [id=37cecaa75c514f59849b474f32bcaa46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.064757 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 3f18e61382a947d5aa635d3c83068f35 (DEFAULT_TABLE table=default.Table_14591625550c4aa5a5a46a183fb22a3f [id=37cecaa75c514f59849b474f32bcaa46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.065335 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6b9b5d4dc64e47099b96549b72d27b08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:09.065613 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bacc7a567d8949c4816c7683eae8a1ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.065927 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b9b5d4dc64e47099b96549b72d27b08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:09.066146 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bacc7a567d8949c4816c7683eae8a1ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.065416 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_074258c348d84152a5ce663069e0b96c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.068991 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_074258c348d84152a5ce663069e0b96c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.072716 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_73c66b0e09f54a7588be8629dc7a8492"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.073550 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73c66b0e09f54a7588be8629dc7a8492 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.083817 1192 tablet_bootstrap.cc:492] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:09.084101 1192 ts_tablet_manager.cc:1403] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.003s
I20260616 19:52:09.084931 1192 raft_consensus.cc:359] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.087042 1192 raft_consensus.cc:385] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.087185 1192 raft_consensus.cc:740] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.087806 1192 consensus_queue.cc:260] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.088397 1192 ts_tablet_manager.cc:1434] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260616 19:52:09.088801 1192 tablet_bootstrap.cc:492] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:09.090446 1192 tablet_bootstrap.cc:654] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.094100 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_558d3e1cd5dd4d3dad3ba5d0a43bb76f" } new_table_name: "default.Table_90a0fce338d9454489ce3d8024106ba7" modify_external_catalogs: true
I20260616 19:52:09.098003 2121 raft_consensus.cc:493] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:09.098133 2121 raft_consensus.cc:515] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.098764 2121 leader_election.cc:290] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:09.099754 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5dc1e6cde347fc9a34e555385dc646" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:09.100432 860 leader_election.cc:343] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:09.100787 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5dc1e6cde347fc9a34e555385dc646" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:09.100966 1057 raft_consensus.cc:2468] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:09.101413 858 leader_election.cc:304] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
W20260616 19:52:09.103832 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d7cbf2234e8478fb472bf9d61e4eb0e consensus state has no leader
I20260616 19:52:09.103931 2121 raft_consensus.cc:2804] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:09.103996 2121 raft_consensus.cc:493] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:09.104060 2121 raft_consensus.cc:3060] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:09.108722 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8c30a601851d42a3b5fed5a8fc6efd53" } modify_external_catalogs: true
I20260616 19:52:09.108934 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8c30a601851d42a3b5fed5a8fc6efd53" } modify_external_catalogs: true
I20260616 19:52:09.111003 1198 tablet_bootstrap.cc:492] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:09.111263 1198 ts_tablet_manager.cc:1403] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.072s user 0.005s sys 0.001s
I20260616 19:52:09.112108 1198 raft_consensus.cc:359] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.112344 1198 raft_consensus.cc:385] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.112938 1198 raft_consensus.cc:740] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.113253 1198 consensus_queue.cc:260] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.113924 1198 ts_tablet_manager.cc:1434] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:09.114230 1198 tablet_bootstrap.cc:492] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:09.115798 1198 tablet_bootstrap.cc:654] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.120611 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dc02731815934261a7e270a538ea7228" } new_table_name: "default.Table_ac4edcacb5dc4632aa548dbae2069d75" modify_external_catalogs: true
I20260616 19:52:09.132249 1192 tablet_bootstrap.cc:492] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:09.132404 1192 ts_tablet_manager.cc:1403] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.044s user 0.009s sys 0.006s
I20260616 19:52:09.133227 1192 raft_consensus.cc:359] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.133384 1192 raft_consensus.cc:385] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.133432 1192 raft_consensus.cc:740] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.133627 1192 consensus_queue.cc:260] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.134099 1192 ts_tablet_manager.cc:1434] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:09.134361 1192 tablet_bootstrap.cc:492] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:09.135871 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d8af0c5b53b4415cbd6ca1339547f477" } modify_external_catalogs: true
I20260616 19:52:09.136056 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d8af0c5b53b4415cbd6ca1339547f477" } modify_external_catalogs: true
I20260616 19:52:09.136714 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c2e1e7cdea7441a9908f57ba754d8696" } modify_external_catalogs: true
I20260616 19:52:09.136888 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c2e1e7cdea7441a9908f57ba754d8696" } modify_external_catalogs: true
I20260616 19:52:09.138096 1058 raft_consensus.cc:2468] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:09.138484 2121 raft_consensus.cc:515] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.139076 2121 leader_election.cc:290] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:09.140695 2102 raft_consensus.cc:515] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.141402 2102 leader_election.cc:290] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:09.142411 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6b9b5d4dc64e47099b96549b72d27b08" } modify_external_catalogs: true
I20260616 19:52:09.142624 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6b9b5d4dc64e47099b96549b72d27b08" } modify_external_catalogs: true
I20260616 19:52:09.145097 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b30bdc71281f4087ab837cdd45baf136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.145308 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1978faeb31f43a1b0ac40c60cdfab9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.145383 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_379b2dafdc1e47ec89c58c6a2f2eb755"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:09.145735 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6e391baa574e7ba1052c3c1e34cf3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.147611 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbbbfa65120b4b9b98ef0fc30a13f2d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.147967 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1106555fe0f44aa595f2ba00a19e914a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.148335 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cae31969193439a9a99eac1a9f7aee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.148540 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff63920505544041b432b128eb784f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.148543 719 leader_election.cc:304] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:09.148695 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df14405fff32417da8e9069680100dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.148926 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d486a9c69954dc4a9b664d89d2bf28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.148988 2102 raft_consensus.cc:2804] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:09.149077 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0146e7a97662494e98c81b5a2af66513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.149116 2102 raft_consensus.cc:697] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:09.149204 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7cbf2234e8478fb472bf9d61e4eb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.149362 2102 consensus_queue.cc:237] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.149837 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964576d0910f4ef89fbf71e44b09ba9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:09.149853 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_379b2dafdc1e47ec89c58c6a2f2eb755 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.150292 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84b168fbd133466681c86513c4bacf8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.150730 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861a73a46dad41b6b5eb59503d9e2ace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.151136 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f18e61382a947d5aa635d3c83068f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.151324 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ffc15f90dc24de49455205d5de6b58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.151356 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d270afd0c0f3457aa6dd14721dca261d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:09.151494 922 raft_consensus.cc:3060] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:09.151674 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df86f867d1145948fda9fd5104af9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.152019 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949b3d1e16d49a6a1bce5ca21a268c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.152175 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1c8339d31a3a4ba9b8678eee3e23edbd" } new_table_name: "default.Table_1b25ad7f911d4a3ea20352ebc3dd6236" modify_external_catalogs: true
I20260616 19:52:09.153589 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5dc1e6cde347fc9a34e555385dc646" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:09.153820 719 leader_election.cc:343] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: d270afd0c0f3457aa6dd14721dca261d
I20260616 19:52:09.154057 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb02ec3fe424408aa60f74517203146a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:09.154212 860 leader_election.cc:343] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:09.154572 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87df2df43f64006b8555cb9e94f9806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.155939 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5dc1e6cde347fc9a34e555385dc646" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:09.156131 1058 raft_consensus.cc:3060] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:09.156877 1908 raft_consensus.cc:493] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:09.156989 1908 raft_consensus.cc:515] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.157544 1908 leader_election.cc:290] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:09.158097 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf136fa86c264f69a1703596cfd0e77a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:09.158272 1057 raft_consensus.cc:2468] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:09.158284 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf136fa86c264f69a1703596cfd0e77a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:09.158547 1908 consensus_queue.cc:1048] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:09.158769 718 leader_election.cc:343] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:09.160926 1192 tablet_bootstrap.cc:654] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.162839 719 leader_election.cc:304] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:09.162770 1028 tablet_service.cc:1511] Processing CreateTablet for tablet f87e5606cabc44feb23285bd875c31d4 (DEFAULT_TABLE table=default.Table_3ed66cdb27fb445a80ad6cdfa884b795 [id=4b61e4e70c174ae69d64ad2ac67d6533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.163297 1908 raft_consensus.cc:2804] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:09.163388 1908 raft_consensus.cc:493] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:09.163471 1908 raft_consensus.cc:3060] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:09.171454 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f18e61382a947d5aa635d3c83068f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.174054 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7cbf2234e8478fb472bf9d61e4eb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.174674 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbbbfa65120b4b9b98ef0fc30a13f2d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.175192 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cae31969193439a9a99eac1a9f7aee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.175688 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1106555fe0f44aa595f2ba00a19e914a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.175825 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_081048b59d4d45719878e3c76725c5e7" } new_table_name: "default.Table_77a5c589d07a405e827f4dd9e7041913" modify_external_catalogs: true
I20260616 19:52:09.176234 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964576d0910f4ef89fbf71e44b09ba9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.176765 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d486a9c69954dc4a9b664d89d2bf28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.177166 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949b3d1e16d49a6a1bce5ca21a268c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.177547 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df86f867d1145948fda9fd5104af9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.177917 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0146e7a97662494e98c81b5a2af66513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.178331 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ffc15f90dc24de49455205d5de6b58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.178726 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1978faeb31f43a1b0ac40c60cdfab9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.179199 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87df2df43f64006b8555cb9e94f9806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.179638 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b30bdc71281f4087ab837cdd45baf136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.180123 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff63920505544041b432b128eb784f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.187018 1191 ts_tablet_manager.cc:1929] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:09.187151 1191 log.cc:1199] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/65b0dc43b40649f29037f40d2ea9247e
I20260616 19:52:09.187448 1191 ts_tablet_manager.cc:1950] T 65b0dc43b40649f29037f40d2ea9247e P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:09.187736 2181 consensus_queue.cc:1048] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:09.206872 922 raft_consensus.cc:2468] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:09.207422 718 leader_election.cc:304] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:09.207890 2181 raft_consensus.cc:2804] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:09.215025 886 tablet_service.cc:1511] Processing CreateTablet for tablet f87e5606cabc44feb23285bd875c31d4 (DEFAULT_TABLE table=default.Table_3ed66cdb27fb445a80ad6cdfa884b795 [id=4b61e4e70c174ae69d64ad2ac67d6533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.215507 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87e5606cabc44feb23285bd875c31d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.216692 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_59682c99c0fb454897cb23774423a837" } new_table_name: "default.Table_0f374c454bc04298ba16dc14edb7bc9e" modify_external_catalogs: true
I20260616 19:52:09.217986 2195 raft_consensus.cc:493] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:09.218109 2195 raft_consensus.cc:515] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.219089 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 9060de590fa84ea08dc7d39765bc9308 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:09.219138 2195 leader_election.cc:290] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:09.219254 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bd6fa49eff4400ca40c722e18cea951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:09.219578 887 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff29c13ab7044479893e09d6eec1e6f (DEFAULT_TABLE table=default.Table_f1e5bbbb9374450f8072f3a577243c63 [id=3cc8ff0a892e4843b5472894fc6b106f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.219906 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff29c13ab7044479893e09d6eec1e6f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:09.220242 858 leader_election.cc:343] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 1d80d9028184443da49623228259263d
W20260616 19:52:09.220521 860 leader_election.cc:343] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 1d80d9028184443da49623228259263d
I20260616 19:52:09.220626 860 leader_election.cc:304] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:09.220953 2195 raft_consensus.cc:2749] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:09.223129 894 tablet_service.cc:1511] Processing CreateTablet for tablet a70f6acb318049229bc8a6b4b340601c (DEFAULT_TABLE table=default.Table_b1c4351701974ad8945770a0482b8df5 [id=39cef94c32b64341805b1f2c5807d3bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.223474 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70f6acb318049229bc8a6b4b340601c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.228236 896 tablet_service.cc:1511] Processing CreateTablet for tablet 315c62f70754447c827f303e29168a5f (DEFAULT_TABLE table=default.Table_63d5b017cead47c3b7859cb97f00d64f [id=717004cd8b5c4b57974a561f2e5448fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.205993 1058 raft_consensus.cc:2468] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:09.234519 858 leader_election.cc:304] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:09.234930 2195 raft_consensus.cc:2804] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:09.235038 2195 raft_consensus.cc:697] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:09.235256 2195 consensus_queue.cc:237] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.237519 901 tablet_service.cc:1511] Processing CreateTablet for tablet 96bf58d365a54c24b5131416d95d2b6a (DEFAULT_TABLE table=default.Table_89ec43c7fc3847e1ae3dde1c2cc4682c [id=fcc3b8f341524d33afbdca53fa6b72f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.237792 1908 raft_consensus.cc:515] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.238904 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf136fa86c264f69a1703596cfd0e77a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:09.239094 1058 raft_consensus.cc:3060] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:09.245558 751 tablet_service.cc:1511] Processing CreateTablet for tablet f87e5606cabc44feb23285bd875c31d4 (DEFAULT_TABLE table=default.Table_3ed66cdb27fb445a80ad6cdfa884b795 [id=4b61e4e70c174ae69d64ad2ac67d6533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.229498 903 tablet_service.cc:1558] Processing DeleteTablet for tablet ca5dc1e6cde347fc9a34e555385dc646 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:09.261564 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bf58d365a54c24b5131416d95d2b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.262010 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315c62f70754447c827f303e29168a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.246052 1908 leader_election.cc:290] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:09.250880 753 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff29c13ab7044479893e09d6eec1e6f (DEFAULT_TABLE table=default.Table_f1e5bbbb9374450f8072f3a577243c63 [id=3cc8ff0a892e4843b5472894fc6b106f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.250888 761 tablet_service.cc:1511] Processing CreateTablet for tablet a70f6acb318049229bc8a6b4b340601c (DEFAULT_TABLE table=default.Table_b1c4351701974ad8945770a0482b8df5 [id=39cef94c32b64341805b1f2c5807d3bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.253743 765 tablet_service.cc:1511] Processing CreateTablet for tablet 315c62f70754447c827f303e29168a5f (DEFAULT_TABLE table=default.Table_63d5b017cead47c3b7859cb97f00d64f [id=717004cd8b5c4b57974a561f2e5448fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.267869 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf136fa86c264f69a1703596cfd0e77a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:09.275816 2181 raft_consensus.cc:697] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:09.276270 2181 consensus_queue.cc:237] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.281082 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff29c13ab7044479893e09d6eec1e6f (DEFAULT_TABLE table=default.Table_f1e5bbbb9374450f8072f3a577243c63 [id=3cc8ff0a892e4843b5472894fc6b106f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.300444 2195 raft_consensus.cc:493] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:09.300875 2195 raft_consensus.cc:515] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.302157 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc988a195ec4bbf8691801421fed8bb" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:09.302354 1055 raft_consensus.cc:2468] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:09.302867 858 leader_election.cc:304] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:09.303109 2121 raft_consensus.cc:2804] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:09.303166 2121 raft_consensus.cc:493] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:09.303218 2121 raft_consensus.cc:3060] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:09.306751 2195 leader_election.cc:290] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:09.309188 718 leader_election.cc:343] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:09.310393 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc988a195ec4bbf8691801421fed8bb" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:09.310976 860 leader_election.cc:343] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:09.331643 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70f6acb318049229bc8a6b4b340601c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.349792 2195 consensus_queue.cc:1048] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:09.352927 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff29c13ab7044479893e09d6eec1e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.355551 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84b168fbd133466681c86513c4bacf8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.356063 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87df2df43f64006b8555cb9e94f9806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.356482 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0146e7a97662494e98c81b5a2af66513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.357460 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f18e61382a947d5aa635d3c83068f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.357873 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1106555fe0f44aa595f2ba00a19e914a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.358281 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cae31969193439a9a99eac1a9f7aee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.358621 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1978faeb31f43a1b0ac40c60cdfab9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.358965 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87e5606cabc44feb23285bd875c31d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.359321 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbbbfa65120b4b9b98ef0fc30a13f2d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.359654 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff63920505544041b432b128eb784f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.360112 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df86f867d1145948fda9fd5104af9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.360571 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964576d0910f4ef89fbf71e44b09ba9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.361069 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949b3d1e16d49a6a1bce5ca21a268c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.361614 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d486a9c69954dc4a9b664d89d2bf28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.362090 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b30bdc71281f4087ab837cdd45baf136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.362526 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ffc15f90dc24de49455205d5de6b58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.375600 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 783) took 3000 ms. Trace:
I20260616 19:52:09.375800 1191 rpcz_store.cc:276] 0616 19:52:06.374998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.375051 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:08.878756 (+2503705us) ts_tablet_manager.cc:1151] Deleting tablet 65b0dc43b40649f29037f40d2ea9247e
0616 19:52:08.878767 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:08.949316 (+ 70549us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:09.186951 (+237635us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:09.375554 (+188603us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2503480}
I20260616 19:52:09.376353 1191 tablet_replica.cc:333] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:09.376874 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 65b0dc43b40649f29037f40d2ea9247e (table default.Table_8fff86d5c2344e2fb59db9872ee90b74 [id=06f5d602dcec42a884b5eb53f9d0a27c]) successfully deleted
I20260616 19:52:09.414058 2195 consensus_queue.cc:1048] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:09.423411 1191 raft_consensus.cc:2243] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:09.423710 1191 raft_consensus.cc:2272] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:09.424536 1191 ts_tablet_manager.cc:1916] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:09.428051 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff29c13ab7044479893e09d6eec1e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.428489 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315c62f70754447c827f303e29168a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.428753 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87e5606cabc44feb23285bd875c31d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.435171 2121 raft_consensus.cc:515] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.435992 2121 leader_election.cc:290] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:09.436540 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc988a195ec4bbf8691801421fed8bb" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
W20260616 19:52:09.437307 858 leader_election.cc:343] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: Tablet not RUNNING: STOPPED
I20260616 19:52:09.438212 2121 consensus_queue.cc:1048] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:09.467845 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 315c62f70754447c827f303e29168a5f (DEFAULT_TABLE table=default.Table_63d5b017cead47c3b7859cb97f00d64f [id=717004cd8b5c4b57974a561f2e5448fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.469683 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet fb1c2030b3a14c6aafaa961869606f31 with delete_type TABLET_DATA_DELETED (replaced by tablet c7f724dc23024a7297cfb8689f199600) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:09.470062 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 96bf58d365a54c24b5131416d95d2b6a (DEFAULT_TABLE table=default.Table_89ec43c7fc3847e1ae3dde1c2cc4682c [id=fcc3b8f341524d33afbdca53fa6b72f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.470444 1032 tablet_service.cc:1511] Processing CreateTablet for tablet a70f6acb318049229bc8a6b4b340601c (DEFAULT_TABLE table=default.Table_b1c4351701974ad8945770a0482b8df5 [id=39cef94c32b64341805b1f2c5807d3bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.496919 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e316e44693d473dad901eeb95299988 with delete_type TABLET_DATA_DELETED (replaced by tablet 93c940bd14a040ddba5ea058e732bf0c) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:09.499413 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 258188us
I20260616 19:52:09.502792 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 4481d9d481ee45449ac332ff19c06a54
I20260616 19:52:09.503643 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8a64df992f36453fae2a889da7d15b6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.504230 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a64df992f36453fae2a889da7d15b6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.504978 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 4481d9d481ee45449ac332ff19c06a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:09.512342 2235 raft_consensus.cc:493] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:09.515705 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9a77f8c5c40e4892831cb8af6c305c62
I20260616 19:52:09.516546 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_dc6b5507cf924390bbe34c207ec2cce3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.517107 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc6b5507cf924390bbe34c207ec2cce3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.518278 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet faf4a0e2d3a1415aafe22501d8ae88b4
I20260616 19:52:09.518960 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_84ff2b20490143b1b7372fce52224631"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.519405 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84ff2b20490143b1b7372fce52224631 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.521027 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_98df6f73169842f793087e98d434137e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.521474 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98df6f73169842f793087e98d434137e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:09.522501 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e90ea4190d3a42ac8082cd6869588490 consensus state has no leader
I20260616 19:52:09.522787 458 master_service.cc:960] ReplaceTablet: received request to replace tablet b0b4d05e770845e0aa8e6a30a86babe8 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:09.524351 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_51e7fb35630c4bcab85c4b278daacf2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.524909 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51e7fb35630c4bcab85c4b278daacf2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.532503 455 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 564b3757b59c4ceca9ce033af60717f7
I20260616 19:52:09.533051 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e538b8e003e64be28e91618c3e6a30cf" } new_table_name: "default.Table_8640034462d64b5d879d28e067fe1b14" modify_external_catalogs: true
I20260616 19:52:09.537704 892 tablet_service.cc:1558] Processing DeleteTablet for tablet faf4a0e2d3a1415aafe22501d8ae88b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:09.537704 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a77f8c5c40e4892831cb8af6c305c62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:09.543067 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5587d5aa8584cf49ef3cb113a1b64ca consensus state has no leader
I20260616 19:52:09.543565 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_da1e119412304472ac351bb95c1f8ce0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.544199 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da1e119412304472ac351bb95c1f8ce0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:09.548023 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cecf1e85135745ea98e9abf4cd2a9f79 consensus state has no leader
I20260616 19:52:09.549072 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_566443171e24470680ef72b6895d4ff2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.549908 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_566443171e24470680ef72b6895d4ff2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.560567 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a77f8c5c40e4892831cb8af6c305c62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:09.560813 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet faf4a0e2d3a1415aafe22501d8ae88b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:09.563438 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_090f3e0ccafb44a487aa44fd31777366"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.564424 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_090f3e0ccafb44a487aa44fd31777366 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.567871 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 4481d9d481ee45449ac332ff19c06a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:09.574169 1193 ts_tablet_manager.cc:1929] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:09.574348 1193 log.cc:1199] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/79250767a94141cd900a9715e86128b8
I20260616 19:52:09.574921 1193 ts_tablet_manager.cc:1950] T 79250767a94141cd900a9715e86128b8 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:09.575371 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 872) took 1771 ms. Trace:
I20260616 19:52:09.575532 1193 rpcz_store.cc:276] 0616 19:52:07.803687 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.803742 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:08.983318 (+1179576us) ts_tablet_manager.cc:1151] Deleting tablet 79250767a94141cd900a9715e86128b8
0616 19:52:08.983326 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:09.135944 (+152618us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:09.574093 (+438149us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:09.575352 (+ 1259us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1179420}
I20260616 19:52:09.575976 1193 tablet_replica.cc:333] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:09.576375 1193 raft_consensus.cc:2243] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:09.576658 1193 raft_consensus.cc:2272] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:09.577368 1193 ts_tablet_manager.cc:1916] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:09.591012 2242 raft_consensus.cc:493] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:09.591158 2242 raft_consensus.cc:515] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.591892 2242 leader_election.cc:290] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:09.592566 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9060de590fa84ea08dc7d39765bc9308" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:09.592784 1060 raft_consensus.cc:2468] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:09.593267 858 leader_election.cc:304] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:09.594381 2242 raft_consensus.cc:2804] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:09.594492 2242 raft_consensus.cc:493] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:09.594569 2242 raft_consensus.cc:3060] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:09.604162 1058 raft_consensus.cc:2468] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:09.604645 719 leader_election.cc:304] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:09.604908 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_40dee65f767b4e60b64e2befd004e90b" } modify_external_catalogs: true
I20260616 19:52:09.605049 2233 raft_consensus.cc:2804] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:09.605090 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_40dee65f767b4e60b64e2befd004e90b" } modify_external_catalogs: true
W20260616 19:52:09.621846 2067 log.cc:927] Time spent T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: Append to log took a long time: real 0.068s user 0.002s sys 0.000s
W20260616 19:52:09.622795 845 kernel_stack_watchdog.cc:198] Thread 1192 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 259ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7fb7c6c74980 (unknown) at ??:0
@ 0x9550a7 __sanitizer::internal_sched_yield() at ??:?
@ 0x8ba75d __interceptor_pthread_create at ??:?
@ 0x7fb7c3610221 kudu::Thread::StartThread() at ??:0
@ 0xa932a7 kudu::Thread::Create() at ??:?
@ 0x7fb7c362fc0b kudu::ThreadPool::CreateThread() at ??:0
@ 0x7fb7c362b62d kudu::ThreadPool::DoSubmit() at ??:0
@ 0x7fb7c363095f kudu::ThreadPool::Submit() at ??:0
@ 0x7fb7ceeb4b0d kudu::log::SegmentAllocator::AsyncAllocateSegmentUnlocked() at ??:0
@ 0x7fb7ceeb3aff kudu::log::SegmentAllocator::AllocateSegmentAndRollOver() at ??:0
@ 0x7fb7ceeb36be kudu::log::SegmentAllocator::Init() at ??:0
@ 0x7fb7ceebb735 kudu::log::Log::Init() at ??:0
@ 0x7fb7ceebaa91 kudu::log::Log::Open() at ??:0
@ 0x7fb7d090ad81 kudu::tablet::TabletBootstrap::OpenNewLog() at ??:0
@ 0x7fb7d09070ec kudu::tablet::TabletBootstrap::RunBootstrap() at ??:0
@ 0x7fb7d090586f kudu::tablet::TabletBootstrap::Bootstrap() at ??:0
I20260616 19:52:09.627516 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70f6acb318049229bc8a6b4b340601c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.627705 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315c62f70754447c827f303e29168a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.631145 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet b0b4d05e770845e0aa8e6a30a86babe8
I20260616 19:52:09.631793 458 catalog_manager.cc:6784] ReplaceTablet: tablet b0b4d05e770845e0aa8e6a30a86babe8 deleted and replaced by tablet 411f7ec4c490481f9857b3496c5e8748
I20260616 19:52:09.633071 893 tablet_service.cc:1558] Processing DeleteTablet for tablet b0b4d05e770845e0aa8e6a30a86babe8 with delete_type TABLET_DATA_DELETED (replaced by tablet 411f7ec4c490481f9857b3496c5e8748) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:09.634217 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d277058fb12749f5b6c12e3d9e16919f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:09.634938 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d277058fb12749f5b6c12e3d9e16919f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.637300 457 master_service.cc:960] ReplaceTablet: received request to replace tablet bc2006e262cc4bbb9b291a5bf52653cd from {username='slave'} at 127.0.0.1:41696
W20260616 19:52:09.640789 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76c48e233d184487b7651e9cb105c2cc consensus state has no leader
I20260616 19:52:09.263860 2234 raft_consensus.cc:493] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:09.646489 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bf58d365a54c24b5131416d95d2b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.647604 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 76d73be228664063822c41cbefafcab8 (table default.Table_16508a5420d3488088367681d9b55f03 [id=946fd4fcf5f244acafa1e82743e70af2]). Expected version 2 got 0
I20260616 19:52:09.648275 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 9c77fd138ce9463b8f2d6f4182a56559 (table default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17]). Expected version 1 got 0
I20260616 19:52:09.650416 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 4d3f47e767764032ae5a06e34e2de248 (table default.Table_1516f5dc3b2b4de48c2c4076d1cb1205 [id=af4aada43ecf46b8bacf0d9d1388e92e]). Expected version 1 got 0
I20260616 19:52:09.650715 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]). Expected version 2 got 0
I20260616 19:52:09.654325 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 5029a79e046a489aa9976eff948a3c5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:09.655222 1198 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.536s user 0.015s sys 0.035s
W20260616 19:52:09.655308 1198 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.536s user 0.015s sys 0.035s
I20260616 19:52:09.656693 1198 tablet_bootstrap.cc:492] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:09.656809 1198 ts_tablet_manager.cc:1403] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.543s user 0.015s sys 0.037s
I20260616 19:52:09.657498 1198 raft_consensus.cc:359] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.657640 1198 raft_consensus.cc:385] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.657681 1198 raft_consensus.cc:740] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.657859 1198 consensus_queue.cc:260] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.658012 2195 raft_consensus.cc:493] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:09.658186 2195 raft_consensus.cc:515] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.658331 1198 ts_tablet_manager.cc:1434] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260616 19:52:09.658579 1198 tablet_bootstrap.cc:492] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:09.658878 2195 leader_election.cc:290] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:09.660146 1198 tablet_bootstrap.cc:654] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.661393 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44493f0ffd064249a28628cf24895395" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:09.661564 1058 raft_consensus.cc:2468] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:09.661739 2242 raft_consensus.cc:515] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.661950 858 leader_election.cc:304] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:09.662161 2195 raft_consensus.cc:2804] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:09.662238 2195 raft_consensus.cc:493] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:09.662295 2195 raft_consensus.cc:3060] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:09.662712 2242 leader_election.cc:290] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:09.663177 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9060de590fa84ea08dc7d39765bc9308" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:09.663307 1058 raft_consensus.cc:3060] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:09.667057 1192 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.505s user 0.049s sys 0.084s
W20260616 19:52:09.667157 1192 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.505s user 0.049s sys 0.084s
I20260616 19:52:09.667974 1192 tablet_bootstrap.cc:492] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:09.668087 1192 ts_tablet_manager.cc:1403] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.534s user 0.051s sys 0.084s
I20260616 19:52:09.668872 1192 raft_consensus.cc:359] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.669047 1192 raft_consensus.cc:385] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.669096 1192 raft_consensus.cc:740] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.669317 1192 consensus_queue.cc:260] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.669817 1192 ts_tablet_manager.cc:1434] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:09.670082 1192 tablet_bootstrap.cc:492] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:09.671758 1192 tablet_bootstrap.cc:654] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.265841 758 tablet_service.cc:1511] Processing CreateTablet for tablet 96bf58d365a54c24b5131416d95d2b6a (DEFAULT_TABLE table=default.Table_89ec43c7fc3847e1ae3dde1c2cc4682c [id=fcc3b8f341524d33afbdca53fa6b72f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:09.674475 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet b0b4d05e770845e0aa8e6a30a86babe8 with delete_type TABLET_DATA_DELETED (replaced by tablet 411f7ec4c490481f9857b3496c5e8748) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:09.677488 1192 tablet_bootstrap.cc:492] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:09.677600 1192 ts_tablet_manager.cc:1403] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260616 19:52:09.678316 1192 raft_consensus.cc:359] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.678476 1192 raft_consensus.cc:385] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.678529 1192 raft_consensus.cc:740] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.678747 1192 consensus_queue.cc:260] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.681203 1192 ts_tablet_manager.cc:1434] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260616 19:52:09.681471 1192 tablet_bootstrap.cc:492] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:09.683039 1190 ts_tablet_manager.cc:1929] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:09.683139 1190 log.cc:1199] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/c44422ddb8ce45a48bb9aaeb6c209f21
I20260616 19:52:09.683478 1190 ts_tablet_manager.cc:1950] T c44422ddb8ce45a48bb9aaeb6c209f21 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:09.683876 2195 raft_consensus.cc:515] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.684429 2195 leader_election.cc:290] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:09.684645 1058 raft_consensus.cc:2468] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:09.683146 1192 tablet_bootstrap.cc:654] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.688827 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44493f0ffd064249a28628cf24895395" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:09.688966 858 leader_election.cc:304] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:09.689005 1058 raft_consensus.cc:3060] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:09.689186 2195 raft_consensus.cc:2804] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:09.689319 2195 raft_consensus.cc:697] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:09.689522 2195 consensus_queue.cc:237] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.692237 1058 raft_consensus.cc:2468] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:09.692793 858 leader_election.cc:304] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:09.693101 2121 raft_consensus.cc:2804] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:09.693338 2121 raft_consensus.cc:697] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:09.693691 2121 consensus_queue.cc:237] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.702780 1198 tablet_bootstrap.cc:492] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:09.702939 1198 ts_tablet_manager.cc:1403] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.003s
I20260616 19:52:09.703856 1198 raft_consensus.cc:359] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.704046 1198 raft_consensus.cc:385] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.704102 1198 raft_consensus.cc:740] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.704342 1198 consensus_queue.cc:260] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.706985 1198 ts_tablet_manager.cc:1434] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260616 19:52:09.707923 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c55c1fac1f784f91b12629f33809763c" } modify_external_catalogs: true
I20260616 19:52:09.708138 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c55c1fac1f784f91b12629f33809763c" } modify_external_catalogs: true
I20260616 19:52:09.719759 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 752) took 3710 ms. Trace:
I20260616 19:52:09.719882 1190 rpcz_store.cc:276] 0616 19:52:06.009251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.010176 (+ 925us) service_pool.cc:224] Handling call
0616 19:52:08.852901 (+2842725us) ts_tablet_manager.cc:1151] Deleting tablet c44422ddb8ce45a48bb9aaeb6c209f21
0616 19:52:08.852913 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:09.284604 (+431691us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:09.682971 (+398367us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:09.719721 (+ 36750us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2836211}
I20260616 19:52:09.720415 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet c44422ddb8ce45a48bb9aaeb6c209f21 (table default.Table_a70aca898ad449b481395f5ffc808a22 [id=ac53389fae904a0ea6ddcb9e82000d78]) successfully deleted
I20260616 19:52:09.722278 1192 tablet_bootstrap.cc:492] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:09.722424 1192 ts_tablet_manager.cc:1403] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.008s
I20260616 19:52:09.723326 1192 raft_consensus.cc:359] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.723506 1192 raft_consensus.cc:385] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.723572 1192 raft_consensus.cc:740] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.723855 1192 consensus_queue.cc:260] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:09.724419 1192 ts_tablet_manager.cc:1434] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:09.724754 1192 tablet_bootstrap.cc:492] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:09.726737 1192 tablet_bootstrap.cc:654] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.727375 1198 tablet_bootstrap.cc:492] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:09.729640 1198 tablet_bootstrap.cc:654] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.734582 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 758) took 3687 ms. Trace:
I20260616 19:52:09.734692 1190 rpcz_store.cc:276] 0616 19:52:06.047582 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.047698 (+ 116us) service_pool.cc:224] Handling call
0616 19:52:09.734405 (+3686707us) ts_tablet_manager.cc:1151] Deleting tablet 2a1e4310104a4b238d80116604a1af3a
0616 19:52:09.734416 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:09.734555 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3683938}
W20260616 19:52:09.735383 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 2a1e4310104a4b238d80116604a1af3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a1e4310104a4b238d80116604a1af3a already in progress: creating tablet
I20260616 19:52:09.737937 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3c5805a9d6b24b91818b5059b19c8605" } modify_external_catalogs: true
I20260616 19:52:09.738157 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3c5805a9d6b24b91818b5059b19c8605" } modify_external_catalogs: true
I20260616 19:52:09.738315 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d09fa8a3ff9c4c749ce57d6a8c51fe4f" } new_table_name: "default.Table_b0d605dac00648449c05e5d0ed2585c0" modify_external_catalogs: true
I20260616 19:52:09.738703 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_24447e65692d452a82a5ef91bdc6ab4f" } modify_external_catalogs: true
I20260616 19:52:09.738842 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_24447e65692d452a82a5ef91bdc6ab4f" } modify_external_catalogs: true
I20260616 19:52:09.739401 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ccdea01c9e6143c18e646fe317ea8128"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:09.739868 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c11b3c4a27ad4ff4859736ff527242ee" } modify_external_catalogs: true
I20260616 19:52:09.740032 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c11b3c4a27ad4ff4859736ff527242ee" } modify_external_catalogs: true
I20260616 19:52:09.740278 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fd6b8678fea647c791ab6cdd5765f37e" } new_table_name: "default.Table_7428cff2e2ca4e488f8edb0c41d0a589" modify_external_catalogs: true
W20260616 19:52:09.740044 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccdea01c9e6143c18e646fe317ea8128 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.752763 1192 tablet_bootstrap.cc:492] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:09.752956 1192 ts_tablet_manager.cc:1403] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.008s
I20260616 19:52:09.754079 1192 raft_consensus.cc:359] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.754323 1192 raft_consensus.cc:385] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.754387 1192 raft_consensus.cc:740] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.755127 1192 consensus_queue.cc:260] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.755832 1192 ts_tablet_manager.cc:1434] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:09.756309 1192 tablet_bootstrap.cc:492] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:09.758613 1192 tablet_bootstrap.cc:654] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.764115 2215 tablet.cc:1724] T 21408288aae545cba9aa65afbc29a0e3 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:09.769181 2260 tablet.cc:1724] T 21408288aae545cba9aa65afbc29a0e3 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:09.512518 2235 raft_consensus.cc:515] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.781359 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bf58d365a54c24b5131416d95d2b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.784340 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 79250767a94141cd900a9715e86128b8 (table default.Table_8d5fed2f6cff49c4b8a9cd2c5a907fa9 [id=4fdd38d3f8d747b0b6181ee77db8e90a]) successfully deleted
I20260616 19:52:09.781070 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc988a195ec4bbf8691801421fed8bb" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:09.780025 2234 raft_consensus.cc:515] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.790478 1191 ts_tablet_manager.cc:1929] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:09.790516 750 tablet_service.cc:1558] Processing DeleteTablet for tablet faf4a0e2d3a1415aafe22501d8ae88b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:09.790591 1191 log.cc:1199] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/6cc988a195ec4bbf8691801421fed8bb
I20260616 19:52:09.790714 750 tablet_service.cc:1558] Processing DeleteTablet for tablet b0b4d05e770845e0aa8e6a30a86babe8 with delete_type TABLET_DATA_DELETED (replaced by tablet 411f7ec4c490481f9857b3496c5e8748) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:09.790964 1191 ts_tablet_manager.cc:1950] T 6cc988a195ec4bbf8691801421fed8bb P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:09.790969 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]). Expected version 2 got 0
I20260616 19:52:09.791893 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 781) took 3417 ms. Trace:
I20260616 19:52:09.785140 2235 leader_election.cc:290] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:09.795313 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd1070277a14fd98af5fa45925e4f0f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:09.795481 1058 raft_consensus.cc:2468] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:09.795804 719 leader_election.cc:304] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:09.796034 2235 raft_consensus.cc:2804] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:09.796098 2235 raft_consensus.cc:493] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:09.796155 2235 raft_consensus.cc:3060] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:09.797366 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 19b9248b88434a6e9ef7a3d602eee70c with delete_type TABLET_DATA_DELETED (replaced by tablet 415ad9d0c3564453825c4b30c0ad64fa) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:09.799144 1192 tablet_bootstrap.cc:492] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:09.799266 1192 ts_tablet_manager.cc:1403] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.043s user 0.005s sys 0.000s
I20260616 19:52:09.800024 1192 raft_consensus.cc:359] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.800202 1192 raft_consensus.cc:385] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.800261 1192 raft_consensus.cc:740] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.800524 1192 consensus_queue.cc:260] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.801177 1192 ts_tablet_manager.cc:1434] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:09.803364 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a77f8c5c40e4892831cb8af6c305c62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:09.805510 896 tablet_service.cc:1558] Processing DeleteTablet for tablet d9c664f0386549d6867c407526ee45a0 with delete_type TABLET_DATA_DELETED (replaced by tablet 3c90eb04585c4fa992435d11015ffec7) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:09.809178 1196 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.914s user 0.006s sys 0.006s
W20260616 19:52:09.809266 1196 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.915s user 0.006s sys 0.006s
I20260616 19:52:09.810781 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]). Expected version 2 got 0
W20260616 19:52:09.810837 860 leader_election.cc:343] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:09.810971 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 4d3f47e767764032ae5a06e34e2de248 (table default.Table_1516f5dc3b2b4de48c2c4076d1cb1205 [id=af4aada43ecf46b8bacf0d9d1388e92e]). Expected version 1 got 0
I20260616 19:52:09.810961 860 leader_election.cc:304] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:09.811151 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 76d73be228664063822c41cbefafcab8 (table default.Table_16508a5420d3488088367681d9b55f03 [id=946fd4fcf5f244acafa1e82743e70af2]). Expected version 2 got 0
W20260616 19:52:09.811338 860 consensus_peers.cc:597] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:09.811569 1198 tablet_bootstrap.cc:492] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:09.811561 2195 raft_consensus.cc:2749] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260616 19:52:09.811692 1198 ts_tablet_manager.cc:1403] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.000s
I20260616 19:52:09.812125 2215 tablet.cc:1724] T 9c77fd138ce9463b8f2d6f4182a56559 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:09.812393 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ac1073c32224454fa8c4290c02d5e511" } new_table_name: "default.Table_15098e114a9f4ff49ab737893bfd2dab" modify_external_catalogs: true
I20260616 19:52:09.813055 1198 raft_consensus.cc:359] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.813285 1198 raft_consensus.cc:385] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:09.813347 1198 raft_consensus.cc:740] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:09.813632 1198 consensus_queue.cc:260] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.814232 1198 ts_tablet_manager.cc:1434] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:09.814555 1198 tablet_bootstrap.cc:492] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:09.816632 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd1070277a14fd98af5fa45925e4f0f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:09.817179 718 leader_election.cc:343] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:09.821295 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44493f0ffd064249a28628cf24895395" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:09.803211 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9060de590fa84ea08dc7d39765bc9308" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:09.821798 860 leader_election.cc:343] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:09.822111 860 leader_election.cc:343] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:09.824075 2264 tablet.cc:1724] T 9c77fd138ce9463b8f2d6f4182a56559 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:09.827987 1191 rpcz_store.cc:276] 0616 19:52:06.374626 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.375358 (+ 732us) service_pool.cc:224] Handling call
0616 19:52:09.376294 (+3000936us) ts_tablet_manager.cc:1151] Deleting tablet 6cc988a195ec4bbf8691801421fed8bb
0616 19:52:09.376307 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:09.678734 (+302427us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:09.790423 (+111689us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:09.791869 (+ 1446us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3000588}
I20260616 19:52:09.828548 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 6cc988a195ec4bbf8691801421fed8bb (table default.Table_097cc1cefc2845c9811c04a380239f0d [id=94c69bbe02ab4591b12325de17d718be]) successfully deleted
I20260616 19:52:09.829973 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 4481d9d481ee45449ac332ff19c06a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:09.830129 1198 tablet_bootstrap.cc:654] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:09.831836 1196 tablet_bootstrap.cc:492] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:09.831957 1196 ts_tablet_manager.cc:1403] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 1.052s user 0.008s sys 0.007s
I20260616 19:52:09.834226 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44493f0ffd064249a28628cf24895395" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:09.838265 1191 tablet_replica.cc:333] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:09.838481 1191 raft_consensus.cc:2243] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:09.838629 1191 raft_consensus.cc:2272] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:09.839242 1191 ts_tablet_manager.cc:1916] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:09.848541 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 761) took 3733 ms. Trace:
I20260616 19:52:09.848666 1190 rpcz_store.cc:276] 0616 19:52:06.115506 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.116099 (+ 593us) service_pool.cc:224] Handling call
0616 19:52:09.788796 (+3672697us) ts_tablet_manager.cc:1151] Deleting tablet b29cc69fd5234becb09a0b73919b461c
0616 19:52:09.848318 (+ 59522us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:09.848511 (+ 193us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3672472}
W20260616 19:52:09.849330 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet b29cc69fd5234becb09a0b73919b461c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b29cc69fd5234becb09a0b73919b461c already in progress: creating tablet
I20260616 19:52:09.849790 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 763) took 3651 ms. Trace:
I20260616 19:52:09.849867 1190 rpcz_store.cc:276] 0616 19:52:06.198369 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.202694 (+ 4325us) service_pool.cc:224] Handling call
0616 19:52:09.849169 (+3646475us) ts_tablet_manager.cc:1151] Deleting tablet 137c13d905eb4bf2937f730e5210266f
0616 19:52:09.849644 (+ 475us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:09.849772 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3533750}
W20260616 19:52:09.850170 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 137c13d905eb4bf2937f730e5210266f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 137c13d905eb4bf2937f730e5210266f already in progress: creating tablet
I20260616 19:52:09.850636 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 765) took 3591 ms. Trace:
I20260616 19:52:09.850733 1190 rpcz_store.cc:276] 0616 19:52:06.259370 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.259438 (+ 68us) service_pool.cc:224] Handling call
0616 19:52:09.850204 (+3590766us) ts_tablet_manager.cc:1151] Deleting tablet 32ce369f4db042a5841003e4ea1fcc69
0616 19:52:09.850491 (+ 287us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:09.850615 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3534767}
W20260616 19:52:09.851251 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 32ce369f4db042a5841003e4ea1fcc69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32ce369f4db042a5841003e4ea1fcc69 already in progress: creating tablet
I20260616 19:52:09.852628 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 766) took 3589 ms. Trace:
I20260616 19:52:09.852723 1190 rpcz_store.cc:276] 0616 19:52:06.262946 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.263004 (+ 58us) service_pool.cc:224] Handling call
0616 19:52:09.851304 (+3588300us) ts_tablet_manager.cc:1151] Deleting tablet 415ad9d0c3564453825c4b30c0ad64fa
0616 19:52:09.852501 (+ 1197us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:09.852608 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3535813}
W20260616 19:52:09.853072 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 415ad9d0c3564453825c4b30c0ad64fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 415ad9d0c3564453825c4b30c0ad64fa already in progress: creating tablet
I20260616 19:52:09.853168 1190 tablet_replica.cc:333] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:09.853402 1190 raft_consensus.cc:2243] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:09.853566 1190 raft_consensus.cc:2272] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:09.948758 2067 log.cc:927] Time spent T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: Append to log took a long time: real 0.069s user 0.002s sys 0.000s
W20260616 19:52:09.872646 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 964576d0910f4ef89fbf71e44b09ba9c (table default.Table_b81acb60dbc145f9ae6b0560b0f5ef8f [id=0c46938c90d2419fa65a9e32cfc449a9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 964576d0910f4ef89fbf71e44b09ba9c consensus state has no leader
W20260616 19:52:09.936709 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 893e24a61404499294ec3343d357bab2 has no consensus state
W20260616 19:52:09.937062 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2ca1a0a4c684d27bde1a09cf2d77c87 consensus state has no leader
I20260616 19:52:10.371810 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_104c94f36fc243ba8d761682dae23716" } new_table_name: "default.Table_c252d2eb25e9465e8c7f11613d315577" modify_external_catalogs: true
I20260616 19:52:10.372040 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5755f8bd67c64fe0bda9b32e30a326c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:10.372586 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5755f8bd67c64fe0bda9b32e30a326c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.854167 1190 ts_tablet_manager.cc:1916] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:09.992414 460 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]). Expected version 2 got 0
I20260616 19:52:10.373669 460 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 49ab6193c479400da00e1fa80a5274a2 (table default.Table_8b66b38f443d4eaebf8391a80ef74818 [id=1f077f42ac19492597ea7cd3027cae10]). Expected version 1 got 0
I20260616 19:52:09.854662 1192 tablet_bootstrap.cc:492] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:09.866056 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e91c377ae66441268351cd3592aa9dbc" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:09.857926 2161 raft_consensus.cc:493] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:09.864835 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9060de590fa84ea08dc7d39765bc9308" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:09.994805 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b6e391baa574e7ba1052c3c1e34cf3b consensus state has no leader
W20260616 19:52:09.878106 756 consensus_meta.cc:287] T 7ffc15f90dc24de49455205d5de6b58e P 7245e7dab0ec474a876537be514c8767: Time spent flushing consensus metadata: real 0.551s user 0.004s sys 0.000s
I20260616 19:52:10.376753 459 master_service.cc:960] ReplaceTablet: received request to replace tablet 0b249e29f69943f287411783b84c6817 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:10.376819 756 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45106 (request call id 918) took 1346 ms. Trace:
I20260616 19:52:10.376950 455 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_77a5c589d07a405e827f4dd9e7041913 [id=0342973a46bc4b93b84b0220163e9975] alter complete (version 3)
I20260616 19:52:10.376937 751 tablet_service.cc:1511] Processing CreateTablet for tablet 03098d9d34484d5cbdd488264adbd3cf (DEFAULT_TABLE table=default.Table_73c66b0e09f54a7588be8629dc7a8492 [id=21a24073878a4cd2a6f9d129c41f7846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.376894 756 rpcz_store.cc:276] 0616 19:52:09.030816 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.031018 (+ 202us) service_pool.cc:224] Handling call
0616 19:52:09.031359 (+ 341us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:09.031377 (+ 18us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:09.326994 (+295617us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:10.376652 (+1049658us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:10.376805 (+ 153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260616 19:52:09.886258 778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s user 0.035s sys 0.033s
W20260616 19:52:10.377090 778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.079s user 0.035s sys 0.033s
I20260616 19:52:10.377264 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03098d9d34484d5cbdd488264adbd3cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:09.889591 2181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s user 0.029s sys 0.034s
I20260616 19:52:10.377296 756 tablet_service.cc:1511] Processing CreateTablet for tablet adf5010b9025406bb1da70e6875213c6 (DEFAULT_TABLE table=default.Table_b30509a276f0479580ea240dee3f98bd [id=015a8e2f7b914b8ea41c6b94c4a2bab8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:10.377355 2181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.100s user 0.029s sys 0.034s
I20260616 19:52:10.377575 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf5010b9025406bb1da70e6875213c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.377735 758 tablet_service.cc:1511] Processing CreateTablet for tablet 77b94f54c5f24fd68ab56b6a89479a9e (DEFAULT_TABLE table=default.Table_bacc7a567d8949c4816c7683eae8a1ab [id=126edb2d755244c785ecf48b48ddb8d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.377717 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4a8217e50ef644eca9671056b7d93ea5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:10.378015 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b94f54c5f24fd68ab56b6a89479a9e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.378146 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a8217e50ef644eca9671056b7d93ea5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:09.940690 2121 raft_consensus.cc:493] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.379053 2121 raft_consensus.cc:515] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.379637 2121 leader_election.cc:290] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.001890 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 608c26854fdf4dcd8cec2604d23a0dec
I20260616 19:52:10.380110 452 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:41696 (request call id 1166) took 1244 ms. Trace:
I20260616 19:52:09.865329 2234 leader_election.cc:290] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:09.882288 2102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s user 0.074s sys 0.159s
W20260616 19:52:10.380571 2102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.230s user 0.074s sys 0.159s
I20260616 19:52:10.380702 746 tablet_service.cc:1511] Processing CreateTablet for tablet b82dd2c060dc45a781831dde1f67184a (DEFAULT_TABLE table=default.Table_6ae99f784fee4c47b163e188e692ead7 [id=9b2b4c15daa7407ba145b95946711da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.381009 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b82dd2c060dc45a781831dde1f67184a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.380192 452 rpcz_store.cc:276] 0616 19:52:09.135270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.604721 (+469451us) service_pool.cc:224] Handling call
0616 19:52:09.605187 (+ 466us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0616 19:52:09.605339 (+ 152us) catalog_manager.cc:2840] Modifying in-memory table state
0616 19:52:09.605432 (+ 93us) catalog_manager.cc:2849] Locking tablets
0616 19:52:09.992701 (+387269us) catalog_manager.cc:2863] Removing table and tablets from system table
0616 19:52:10.001725 (+ 9024us) catalog_manager.cc:2881] Removing table from by-name map
0616 19:52:10.001819 (+ 94us) catalog_manager.cc:2897] Committing in-memory state
0616 19:52:10.001860 (+ 41us) catalog_manager.cc:2901] Aborting table tasks
0616 19:52:10.380094 (+378234us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:09.993673 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:09.993786 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:09.993790 (+ 4us) write_op.cc:435] Acquired schema lock
0616 19:52:09.993792 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:09.993889 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:09.993900 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:09.993904 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:09.993987 (+ 83us) tablet.cc:701] Row locks acquired
0616 19:52:09.993989 (+ 2us) write_op.cc:260] PREPARE: finished
0616 19:52:09.994018 (+ 29us) write_op.cc:270] Start()
0616 19:52:09.994041 (+ 23us) write_op.cc:276] Timestamp: P: 1781639529993996 usec, L: 0
0616 19:52:09.994044 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:09.994188 (+ 144us) log.cc:844] Serialized 731 byte log entry
0616 19:52:10.000750 (+ 6562us) op_driver.cc:464] REPLICATION: finished
0616 19:52:10.000860 (+ 110us) write_op.cc:301] APPLY: starting
0616 19:52:10.000873 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:10.000913 (+ 40us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:10.000947 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:10.001013 (+ 66us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:10.001050 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0616 19:52:10.001061 (+ 11us) write_op.cc:312] APPLY: finished
0616 19:52:10.001124 (+ 63us) log.cc:844] Serialized 29 byte log entry
0616 19:52:10.001180 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:10.001198 (+ 18us) write_op.cc:454] Released schema lock
0616 19:52:10.001204 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:10.001295 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:10.001300 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":54,"apply.run_cpu_time_us":427,"apply.run_wall_time_us":426,"num_ops":2,"prepare.queue_time_us":271,"prepare.run_cpu_time_us":601,"prepare.run_wall_time_us":601,"replication_time_us":6678}]]}
W20260616 19:52:09.898553 754 consensus_meta.cc:287] T 7cae31969193439a9a99eac1a9f7aee9 P 7245e7dab0ec474a876537be514c8767: Time spent flushing consensus metadata: real 0.599s user 0.002s sys 0.000s
I20260616 19:52:10.381671 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_12dd6ee353994f578f73b458e9b4d5e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:10.381752 754 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45106 (request call id 914) took 1378 ms. Trace:
I20260616 19:52:10.381832 754 rpcz_store.cc:276] 0616 19:52:09.003276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.003327 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:09.003791 (+ 464us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:09.003807 (+ 16us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:09.299777 (+295970us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:10.381618 (+1081841us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:10.381740 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260616 19:52:10.382077 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12dd6ee353994f578f73b458e9b4d5e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:10.382143 754 tablet_service.cc:1511] Processing CreateTablet for tablet 8f67e5add64244629cbe8694223bd00e (DEFAULT_TABLE table=default.Table_2e3589134c4b473a97c49a3e99b90589 [id=20ea83aae3094fc7b8880b71a7d52cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.382398 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f67e5add64244629cbe8694223bd00e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:09.890121 1908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s user 0.004s sys 0.005s
I20260616 19:52:09.911755 1196 raft_consensus.cc:359] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:52:09.918155 764 consensus_meta.cc:287] T 1106555fe0f44aa595f2ba00a19e914a P 7245e7dab0ec474a876537be514c8767: Time spent flushing consensus metadata: real 0.614s user 0.003s sys 0.000s
W20260616 19:52:10.383296 1908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.117s user 0.004s sys 0.005s
I20260616 19:52:10.383543 764 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45106 (request call id 915) took 1380 ms. Trace:
I20260616 19:52:10.005949 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 30f47e639195478f9cda4ab8f8b33798
I20260616 19:52:10.383613 764 rpcz_store.cc:276] 0616 19:52:09.003355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.003724 (+ 369us) service_pool.cc:224] Handling call
0616 19:52:09.004541 (+ 817us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:09.004562 (+ 21us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:09.303731 (+299169us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:10.383414 (+1079683us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:10.383530 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260616 19:52:10.383965 764 tablet_service.cc:1511] Processing CreateTablet for tablet 32bc62e689e64af0a24cbd6cd5859a06 (DEFAULT_TABLE table=default.Table_0f25c7f0e55b413b8979e51adc294a9e [id=980f044bb81948bc8209622ae724e070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.384248 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32bc62e689e64af0a24cbd6cd5859a06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.009752 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7ffc15f90dc24de49455205d5de6b58e
I20260616 19:52:09.906288 2235 raft_consensus.cc:515] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.384991 2235 leader_election.cc:290] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:10.385000 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5bdf4f6d0abf4415bd063f13e2c112e1" } new_table_name: "default.Table_8c5e28a5bd6a4912821898da563df270" modify_external_catalogs: true
W20260616 19:52:09.907503 755 consensus_meta.cc:287] T b949b3d1e16d49a6a1bce5ca21a268c3 P 7245e7dab0ec474a876537be514c8767: Time spent flushing consensus metadata: real 0.592s user 0.003s sys 0.000s
I20260616 19:52:10.386314 755 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45106 (request call id 921) took 1341 ms. Trace:
I20260616 19:52:10.386399 755 rpcz_store.cc:276] 0616 19:52:09.045195 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.045283 (+ 88us) service_pool.cc:224] Handling call
0616 19:52:09.045611 (+ 328us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:09.045635 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:09.315519 (+269884us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:10.386152 (+1070633us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:10.386299 (+ 147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260616 19:52:10.010121 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet afc58b2bda2a43f18f157469b591854b
I20260616 19:52:10.386821 755 tablet_service.cc:1511] Processing CreateTablet for tablet 9505120dd9f049c19cf2b84cabe021a6 (DEFAULT_TABLE table=default.Table_8d5418c55a5b4b00bdf64e1d72483b58 [id=216c7160d7b34530a9760c48e502f31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.387179 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9505120dd9f049c19cf2b84cabe021a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.387413 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a8354e2f3e934d6ea13177ddeaec7732"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:09.923492 2233 raft_consensus.cc:697] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
W20260616 19:52:10.387816 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8354e2f3e934d6ea13177ddeaec7732 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:10.387867 2233 consensus_queue.cc:237] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:09.932613 757 consensus_meta.cc:287] T 7d7cbf2234e8478fb472bf9d61e4eb0e P 7245e7dab0ec474a876537be514c8767: Time spent flushing consensus metadata: real 0.600s user 0.003s sys 0.000s
I20260616 19:52:10.388710 757 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45106 (request call id 910) took 1419 ms. Trace:
W20260616 19:52:09.941973 784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s user 0.009s sys 0.005s
W20260616 19:52:09.936056 749 consensus_meta.cc:287] T 964576d0910f4ef89fbf71e44b09ba9c P 7245e7dab0ec474a876537be514c8767: Time spent flushing consensus metadata: real 0.628s user 0.004s sys 0.000s
W20260616 19:52:10.388828 784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.038s user 0.009s sys 0.006s
I20260616 19:52:10.000619 894 tablet_service.cc:1511] Processing CreateTablet for tablet 03098d9d34484d5cbdd488264adbd3cf (DEFAULT_TABLE table=default.Table_73c66b0e09f54a7588be8629dc7a8492 [id=21a24073878a4cd2a6f9d129c41f7846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.389061 784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.130:52585 (request call id 226) took 1038 ms. Trace:
I20260616 19:52:10.389073 749 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45106 (request call id 919) took 1350 ms. Trace:
I20260616 19:52:10.389187 749 rpcz_store.cc:276] 0616 19:52:09.038797 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.038883 (+ 86us) service_pool.cc:224] Handling call
0616 19:52:09.039370 (+ 487us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:09.039402 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:09.307819 (+268417us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:10.388947 (+1081128us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:10.389060 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260616 19:52:10.389364 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03098d9d34484d5cbdd488264adbd3cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:09.944020 1193 ts_tablet_manager.cc:1929] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260616 19:52:10.389560 1193 log.cc:1199] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/eb04ccc26e64484a9a29c515d4b954fe
I20260616 19:52:10.389528 749 tablet_service.cc:1511] Processing CreateTablet for tablet c2aef4e720784161927386e48b79286e (DEFAULT_TABLE table=default.Table_1c9c9f90122442a298e318fcfa29121e [id=4e995cac26624c2d93bc976fc88cc02d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.377312 778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.130:52585 (request call id 223) took 1080 ms. Trace:
I20260616 19:52:10.369410 753 tablet_service.cc:1511] Processing CreateTablet for tablet 9e32a093750146249ea3cb971826a53f (DEFAULT_TABLE table=default.Table_d7fcc73e3c06411b93fc748eb5b0ca34 [id=f860c9d34aeb48feb401d8bb4ef21446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.389952 1193 ts_tablet_manager.cc:1950] T eb04ccc26e64484a9a29c515d4b954fe P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:10.369745 760 tablet_service.cc:1511] Processing CreateTablet for tablet d68a784f43554b4a88a864ba7bfc2db6 (DEFAULT_TABLE table=default.Table_ab39a467973c4df4aaac5fdd78aa2218 [id=74e2ee9a32c44c5ca66e3db9de7d63b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.369504 763 tablet_service.cc:1511] Processing CreateTablet for tablet 3140c1dc472b44bd935a799e27bf4fe8 (DEFAULT_TABLE table=default.Table_9695d9318e72487a92a1a812b47fa190 [id=a91b9521ff3c4829b6639cf09ce5adf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.369865 761 tablet_service.cc:1511] Processing CreateTablet for tablet 944b29ae4fb340de890dbdfc1e46f141 (DEFAULT_TABLE table=default.Table_c030c3487feb4377b9f094e2ab00e7ee [id=318096a5068244bdb57f588e3f6376f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.383317 1196 raft_consensus.cc:385] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:10.390321 1196 raft_consensus.cc:740] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:10.389752 778 rpcz_store.cc:276] 0616 19:52:09.296854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.296909 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:09.297087 (+ 178us) raft_consensus.cc:1471] Updating replica for 1 ops
0616 19:52:09.297208 (+ 121us) raft_consensus.cc:1534] Early marking committed up to index 0
0616 19:52:09.297212 (+ 4us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0616 19:52:09.297349 (+ 137us) alter_schema_op.cc:128] START. Timestamp: 1781639529240837
0616 19:52:09.297625 (+ 276us) log.cc:844] Serialized 173 byte log entry
0616 19:52:10.377202 (+1079577us) raft_consensus.cc:1645] Marking committed up to 1
0616 19:52:10.377215 (+ 13us) raft_consensus.cc:1697] Filling consensus response to leader.
0616 19:52:10.377237 (+ 22us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0616 19:52:10.377248 (+ 11us) raft_consensus.cc:1685] finished
0616 19:52:10.377250 (+ 2us) raft_consensus.cc:1691] UpdateReplicas() finished
0616 19:52:10.377296 (+ 46us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:09.297877 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0616 19:52:09.297998 (+ 121us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0616 19:52:09.298011 (+ 13us) alter_schema_op.cc:66] Acquired schema lock
0616 19:52:09.298018 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
Metrics: {"thread_start_us":1079483,"threads_started":1,"wal-append.queue_time_us":588696,"child_traces":[["op",{"prepare.queue_time_us":430,"prepare.run_cpu_time_us":160,"prepare.run_wall_time_us":161}]]}
I20260616 19:52:10.010478 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet de16c3feb7374077bc9817c703e5127c
I20260616 19:52:10.390477 1196 consensus_queue.cc:260] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:10.370035 765 tablet_service.cc:1511] Processing CreateTablet for tablet a0313e65e6a3441abcd663110cfcd70d (DEFAULT_TABLE table=default.Table_10269fcb37e245679d0970467b2dcdde [id=faf2d410d4444988af85b55e7832ec0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.370136 759 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0c9dff56274c3ba889ccf919965b61 (DEFAULT_TABLE table=default.Table_1cb80f9ffd2d455ea35974eb1ebea3ed [id=41e7ad31eb43407d84050b501acd9a3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.370337 747 tablet_service.cc:1511] Processing CreateTablet for tablet c1c2bc4741f3413c82928ec446904f14 (DEFAULT_TABLE table=default.Table_9c4283b5023f48ce914506250ea80e4b [id=232cb95de06d49e4944834fbbe257679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.370311 748 tablet_service.cc:1511] Processing CreateTablet for tablet ac675d72e0614ebaaf6b477e22691dc4 (DEFAULT_TABLE table=default.Table_2a8f3a4767fb47a0908c8e8d410500a9 [id=e654aacd32a74d43822ab7c78f6c9591]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.370571 762 tablet_service.cc:1511] Processing CreateTablet for tablet 3613a48774fb4eedb450794532749a7b (DEFAULT_TABLE table=default.Table_41d3d83f28cb4ccbb5328dbe7700e9ff [id=aa018b7ab9f5432686a541a46aecd0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.370851 750 tablet_service.cc:1511] Processing CreateTablet for tablet 9d169982e30c456a88762587c4cd46c9 (DEFAULT_TABLE table=default.Table_215a9cb092a94f93ab94bd88d433a976 [id=c5ed643eccdc4015899387c3e342b51b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.390972 1196 ts_tablet_manager.cc:1434] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.559s user 0.001s sys 0.001s
I20260616 19:52:10.369951 752 tablet_service.cc:1511] Processing CreateTablet for tablet 8c21ccda106e4c7a9906861f409a6151 (DEFAULT_TABLE table=default.Table_29ee389b873d4edbbbec5269e7e8735d [id=ea83a18487744823a193d1371b6e2363]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.388794 757 rpcz_store.cc:276] 0616 19:52:08.969545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.969599 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:08.970031 (+ 432us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:08.970054 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:09.331554 (+361500us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:10.388587 (+1057033us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:10.388696 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260616 19:52:10.391058 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_940fc810caf149278afeaf466865440a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:10.389132 784 rpcz_store.cc:276] 0616 19:52:09.350591 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.350638 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:09.350750 (+ 112us) raft_consensus.cc:1471] Updating replica for 1 ops
0616 19:52:09.350866 (+ 116us) raft_consensus.cc:1534] Early marking committed up to index 0
0616 19:52:09.350871 (+ 5us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0616 19:52:09.351019 (+ 148us) log.cc:844] Serialized 26 byte log entry
0616 19:52:10.388947 (+1037928us) raft_consensus.cc:1645] Marking committed up to 0
0616 19:52:10.388960 (+ 13us) raft_consensus.cc:1697] Filling consensus response to leader.
0616 19:52:10.388995 (+ 35us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0616 19:52:10.389004 (+ 9us) raft_consensus.cc:1685] finished
0616 19:52:10.389006 (+ 2us) raft_consensus.cc:1691] UpdateReplicas() finished
0616 19:52:10.389048 (+ 42us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":302,"raft.run_cpu_time_us":41,"raft.run_wall_time_us":41,"thread_start_us":1037837,"threads_started":1,"wal-append.queue_time_us":591140}
W20260616 19:52:09.866734 719 leader_election.cc:343] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: e91c377ae66441268351cd3592aa9dbc
W20260616 19:52:10.391371 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 524600us
I20260616 19:52:10.391417 757 tablet_service.cc:1511] Processing CreateTablet for tablet 893e24a61404499294ec3343d357bab2 (DEFAULT_TABLE table=default.Table_b0d605dac00648449c05e5d0ed2585c0 [id=3fe9fe37661d42c294ba59113422886a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:10.391484 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_940fc810caf149278afeaf466865440a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:10.391050 1196 ts_tablet_manager.cc:1467] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767: Tablet startup took 559ms
W20260616 19:52:10.392578 1196 ts_tablet_manager.cc:1469] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767: Trace:
0616 19:51:54.812951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:54.813043 (+ 92us) service_pool.cc:224] Handling call
0616 19:51:54.814586 (+ 1543us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:51:54.814610 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:51:54.870992 (+ 56382us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:54.984650 (+113658us) tablet_replica.cc:206] Creating consensus instance
0616 19:51:54.984785 (+ 135us) inbound_call.cc:177] Queueing success response
0616 19:52:08.780076 (+13795291us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0616 19:52:09.832016 (+1051940us) ts_tablet_manager.cc:1435] Starting tablet replica
0616 19:52:09.911202 (+ 79186us) tablet_replica.cc:261] Starting instrumentation
0616 19:52:09.911364 (+ 162us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":73,"raft.run_cpu_time_us":38,"raft.run_wall_time_us":38,"tablet-open.queue_time_us":13795323}
I20260616 19:52:10.036860 2273 tablet.cc:1724] T 21408288aae545cba9aa65afbc29a0e3 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:10.002492 896 tablet_service.cc:1511] Processing CreateTablet for tablet 77b94f54c5f24fd68ab56b6a89479a9e (DEFAULT_TABLE table=default.Table_bacc7a567d8949c4816c7683eae8a1ab [id=126edb2d755244c785ecf48b48ddb8d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.393971 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b94f54c5f24fd68ab56b6a89479a9e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.395727 719 consensus_peers.cc:597] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d270afd0c0f3457aa6dd14721dca261d. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:10.396751 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_88539f40d59d4e51ac2000dd59eee749"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:10.397346 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88539f40d59d4e51ac2000dd59eee749 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:10.007015 886 tablet_service.cc:1511] Processing CreateTablet for tablet 9e32a093750146249ea3cb971826a53f (DEFAULT_TABLE table=default.Table_d7fcc73e3c06411b93fc748eb5b0ca34 [id=f860c9d34aeb48feb401d8bb4ef21446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.011240 893 tablet_service.cc:1511] Processing CreateTablet for tablet d68a784f43554b4a88a864ba7bfc2db6 (DEFAULT_TABLE table=default.Table_ab39a467973c4df4aaac5fdd78aa2218 [id=74e2ee9a32c44c5ca66e3db9de7d63b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.012699 892 tablet_service.cc:1511] Processing CreateTablet for tablet 3140c1dc472b44bd935a799e27bf4fe8 (DEFAULT_TABLE table=default.Table_9695d9318e72487a92a1a812b47fa190 [id=a91b9521ff3c4829b6639cf09ce5adf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.014314 887 tablet_service.cc:1511] Processing CreateTablet for tablet 944b29ae4fb340de890dbdfc1e46f141 (DEFAULT_TABLE table=default.Table_c030c3487feb4377b9f094e2ab00e7ee [id=318096a5068244bdb57f588e3f6376f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.017560 890 tablet_service.cc:1511] Processing CreateTablet for tablet a0313e65e6a3441abcd663110cfcd70d (DEFAULT_TABLE table=default.Table_10269fcb37e245679d0970467b2dcdde [id=faf2d410d4444988af85b55e7832ec0f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:09.866760 860 consensus_peers.cc:597] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:10.398124 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e32a093750146249ea3cb971826a53f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.398187 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 531414us
I20260616 19:52:10.398846 2283 raft_consensus.cc:493] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.026046 889 tablet_service.cc:1511] Processing CreateTablet for tablet ac675d72e0614ebaaf6b477e22691dc4 (DEFAULT_TABLE table=default.Table_2a8f3a4767fb47a0908c8e8d410500a9 [id=e654aacd32a74d43822ab7c78f6c9591]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.398940 2121 raft_consensus.cc:493] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.398949 2283 raft_consensus.cc:515] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.399049 2121 raft_consensus.cc:515] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.399259 2284 raft_consensus.cc:493] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.399345 2284 raft_consensus.cc:515] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.399477 2283 leader_election.cc:290] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.399559 2121 leader_election.cc:290] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.399799 2284 leader_election.cc:290] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.034113 888 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0c9dff56274c3ba889ccf919965b61 (DEFAULT_TABLE table=default.Table_1cb80f9ffd2d455ea35974eb1ebea3ed [id=41e7ad31eb43407d84050b501acd9a3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.035183 899 tablet_service.cc:1511] Processing CreateTablet for tablet 3613a48774fb4eedb450794532749a7b (DEFAULT_TABLE table=default.Table_41d3d83f28cb4ccbb5328dbe7700e9ff [id=aa018b7ab9f5432686a541a46aecd0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.036751 901 tablet_service.cc:1511] Processing CreateTablet for tablet 8c21ccda106e4c7a9906861f409a6151 (DEFAULT_TABLE table=default.Table_29ee389b873d4edbbbec5269e7e8735d [id=ea83a18487744823a193d1371b6e2363]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.039378 897 tablet_service.cc:1511] Processing CreateTablet for tablet b82dd2c060dc45a781831dde1f67184a (DEFAULT_TABLE table=default.Table_6ae99f784fee4c47b163e188e692ead7 [id=9b2b4c15daa7407ba145b95946711da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.400170 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3140c1dc472b44bd935a799e27bf4fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.400381 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b82dd2c060dc45a781831dde1f67184a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.400424 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2aef4e720784161927386e48b79286e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.400643 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0313e65e6a3441abcd663110cfcd70d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.040621 885 tablet_service.cc:1511] Processing CreateTablet for tablet c1c2bc4741f3413c82928ec446904f14 (DEFAULT_TABLE table=default.Table_9c4283b5023f48ce914506250ea80e4b [id=232cb95de06d49e4944834fbbe257679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.401665 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c2bc4741f3413c82928ec446904f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.403656 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944b29ae4fb340de890dbdfc1e46f141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.042418 904 tablet_service.cc:1511] Processing CreateTablet for tablet 9d169982e30c456a88762587c4cd46c9 (DEFAULT_TABLE table=default.Table_215a9cb092a94f93ab94bd88d433a976 [id=c5ed643eccdc4015899387c3e342b51b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.048094 902 tablet_service.cc:1511] Processing CreateTablet for tablet adf5010b9025406bb1da70e6875213c6 (DEFAULT_TABLE table=default.Table_b30509a276f0479580ea240dee3f98bd [id=015a8e2f7b914b8ea41c6b94c4a2bab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.404663 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf5010b9025406bb1da70e6875213c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.406452 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0c9dff56274c3ba889ccf919965b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.051916 903 tablet_service.cc:1511] Processing CreateTablet for tablet 8f67e5add64244629cbe8694223bd00e (DEFAULT_TABLE table=default.Table_2e3589134c4b473a97c49a3e99b90589 [id=20ea83aae3094fc7b8880b71a7d52cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.052987 898 tablet_service.cc:1511] Processing CreateTablet for tablet 32bc62e689e64af0a24cbd6cd5859a06 (DEFAULT_TABLE table=default.Table_0f25c7f0e55b413b8979e51adc294a9e [id=980f044bb81948bc8209622ae724e070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.054153 895 tablet_service.cc:1511] Processing CreateTablet for tablet 9505120dd9f049c19cf2b84cabe021a6 (DEFAULT_TABLE table=default.Table_8d5418c55a5b4b00bdf64e1d72483b58 [id=216c7160d7b34530a9760c48e502f31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.055285 900 tablet_service.cc:1511] Processing CreateTablet for tablet c2aef4e720784161927386e48b79286e (DEFAULT_TABLE table=default.Table_1c9c9f90122442a298e318fcfa29121e [id=4e995cac26624c2d93bc976fc88cc02d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.062002 891 tablet_service.cc:1511] Processing CreateTablet for tablet 893e24a61404499294ec3343d357bab2 (DEFAULT_TABLE table=default.Table_b0d605dac00648449c05e5d0ed2585c0 [id=3fe9fe37661d42c294ba59113422886a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.180591 2195 consensus_queue.cc:1048] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:10.245636 845 kernel_stack_watchdog.cc:198] Thread 860 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/outbound_call.cc:307 for 157ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7fb7c6c74980 (unknown) at ??:0
@ 0x7fb7c6c6e9c6 __GI___pthread_rwlock_wrlock at ??:0
@ 0x7fb7c0878904 google::LogMessage::Flush() at ??:0
@ 0x7fb7c0878a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7fb7cf4fe4ce kudu::consensus::Peer::ProcessResponseErrorUnlocked() at ??:0
@ 0x7fb7cf4fd58f kudu::consensus::Peer::ProcessResponse() at ??:0
@ 0x7fb7cf4fdcc5 kudu::consensus::Peer::ProcessSingleResponse() at ??:0
@ 0x7fb7cf505851 kudu::consensus::Peer::SendNextRequest()::$_6::operator()() at ??:0
@ 0x7fb7cf50565e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
@ 0x7fb7ca5ea76f kudu::rpc::Proxy::AsyncRequest()::$_1::operator()() at ??:0
@ 0x7fb7ca5ea34e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
@ 0x7fb7ca5d5bf0 kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7fb7ca5d610f kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7fb7ca56cc34 kudu::rpc::Connection::HandleCallResponse() at ??:0
I20260616 19:52:10.409477 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5029a79e046a489aa9976eff948a3c5b" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:10.410491 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e32a093750146249ea3cb971826a53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.411072 1196 tablet_bootstrap.cc:492] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:10.407779 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f67e5add64244629cbe8694223bd00e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.422325 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32bc62e689e64af0a24cbd6cd5859a06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.326597 2285 raft_consensus.cc:493] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.424584 2285 raft_consensus.cc:515] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:10.425127 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d68a784f43554b4a88a864ba7bfc2db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.425338 2285 leader_election.cc:290] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:10.251487 2242 raft_consensus.cc:493] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.425527 2242 raft_consensus.cc:515] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.426146 2242 leader_election.cc:290] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.407945 2161 raft_consensus.cc:515] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:09.954918 1191 ts_tablet_manager.cc:1929] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:10.426396 1191 log.cc:1199] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/44493f0ffd064249a28628cf24895395
I20260616 19:52:10.426704 1191 ts_tablet_manager.cc:1950] T 44493f0ffd064249a28628cf24895395 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:10.426940 2161 leader_election.cc:290] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.426982 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 784) took 4051 ms. Trace:
I20260616 19:52:10.427050 1191 rpcz_store.cc:276] 0616 19:52:06.375876 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.375966 (+ 90us) service_pool.cc:224] Handling call
0616 19:52:09.838201 (+3462235us) ts_tablet_manager.cc:1151] Deleting tablet 44493f0ffd064249a28628cf24895395
0616 19:52:09.838215 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:09.918972 (+ 80757us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:09.954854 (+ 35882us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:10.426967 (+472113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3462100}
I20260616 19:52:10.427389 1191 tablet_replica.cc:333] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:09.961103 2248 raft_consensus.cc:493] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.428273 2248 raft_consensus.cc:515] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.428680 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d169982e30c456a88762587c4cd46c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.428932 2248 leader_election.cc:290] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:09.977341 2271 raft_consensus.cc:493] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.429118 2271 raft_consensus.cc:515] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.429670 2271 leader_election.cc:290] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.002290 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 03098d9d34484d5cbdd488264adbd3cf (DEFAULT_TABLE table=default.Table_73c66b0e09f54a7588be8629dc7a8492 [id=21a24073878a4cd2a6f9d129c41f7846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.430068 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03098d9d34484d5cbdd488264adbd3cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.430977 755 tablet_service.cc:1511] Processing CreateTablet for tablet 0406a15db8a642e59555cca38bfa5fbf (DEFAULT_TABLE table=default.Table_7fdf897f4b914166b13a672f25c44393 [id=330e334f41b94c41b6fab79ed0f37660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.431298 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0406a15db8a642e59555cca38bfa5fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.431806 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9505120dd9f049c19cf2b84cabe021a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.006582 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 77b94f54c5f24fd68ab56b6a89479a9e (DEFAULT_TABLE table=default.Table_bacc7a567d8949c4816c7683eae8a1ab [id=126edb2d755244c785ecf48b48ddb8d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.412860 779 raft_consensus.cc:2468] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
W20260616 19:52:10.417465 718 leader_election.cc:343] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.432591 718 leader_election.cc:304] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:10.432703 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b94f54c5f24fd68ab56b6a89479a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.433187 2230 raft_consensus.cc:2749] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:10.011588 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 9e32a093750146249ea3cb971826a53f (DEFAULT_TABLE table=default.Table_d7fcc73e3c06411b93fc748eb5b0ca34 [id=f860c9d34aeb48feb401d8bb4ef21446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.436793 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e32a093750146249ea3cb971826a53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.011986 1038 tablet_service.cc:1511] Processing CreateTablet for tablet d68a784f43554b4a88a864ba7bfc2db6 (DEFAULT_TABLE table=default.Table_ab39a467973c4df4aaac5fdd78aa2218 [id=74e2ee9a32c44c5ca66e3db9de7d63b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.440922 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d68a784f43554b4a88a864ba7bfc2db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.442494 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b57bceabff64533ae3a49b8afda614d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:10.442771 860 leader_election.cc:343] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.443190 2195 consensus_queue.cc:1048] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:10.443928 460 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_ac09eee5e58a4e2681a0643f2d8b7b9b [id=f26741a3387e47f2905c06b1d7eecb17] alter complete (version 1)
I20260616 19:52:10.014084 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 3140c1dc472b44bd935a799e27bf4fe8 (DEFAULT_TABLE table=default.Table_9695d9318e72487a92a1a812b47fa190 [id=a91b9521ff3c4829b6639cf09ce5adf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.444749 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3140c1dc472b44bd935a799e27bf4fe8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.445122 860 consensus_peers.cc:597] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:10.445884 860 leader_election.cc:343] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.446839 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd6fa49eff4400ca40c722e18cea951" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:10.448675 860 leader_election.cc:343] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.449129 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e316e44693d473dad901eeb95299988" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:10.449431 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a09d62e68148349b337c5075763672" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:10.016855 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 944b29ae4fb340de890dbdfc1e46f141 (DEFAULT_TABLE table=default.Table_c030c3487feb4377b9f094e2ab00e7ee [id=318096a5068244bdb57f588e3f6376f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.449558 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8160ad4cf74f16a586ae59291ce7d1" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:10.449893 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944b29ae4fb340de890dbdfc1e46f141. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.449887 860 leader_election.cc:343] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: a170db3d27fd40c1b74deab29e9a033f
I20260616 19:52:10.450254 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf136fa86c264f69a1703596cfd0e77a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:10.452404 860 leader_election.cc:343] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.028908 1024 tablet_service.cc:1511] Processing CreateTablet for tablet a0313e65e6a3441abcd663110cfcd70d (DEFAULT_TABLE table=default.Table_10269fcb37e245679d0970467b2dcdde [id=faf2d410d4444988af85b55e7832ec0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.452797 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0313e65e6a3441abcd663110cfcd70d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.453056 993 leader_election.cc:343] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:10.453352 993 leader_election.cc:343] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:10.453511 993 leader_election.cc:343] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:10.453454 860 leader_election.cc:343] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: d9c664f0386549d6867c407526ee45a0
W20260616 19:52:10.454304 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2df86f867d1145948fda9fd5104af9fc consensus state has no leader
I20260616 19:52:10.033347 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ac675d72e0614ebaaf6b477e22691dc4 (DEFAULT_TABLE table=default.Table_2a8f3a4767fb47a0908c8e8d410500a9 [id=e654aacd32a74d43822ab7c78f6c9591]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.456748 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac675d72e0614ebaaf6b477e22691dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.034442 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0c9dff56274c3ba889ccf919965b61 (DEFAULT_TABLE table=default.Table_1cb80f9ffd2d455ea35974eb1ebea3ed [id=41e7ad31eb43407d84050b501acd9a3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.460717 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0c9dff56274c3ba889ccf919965b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.036128 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 3613a48774fb4eedb450794532749a7b (DEFAULT_TABLE table=default.Table_41d3d83f28cb4ccbb5328dbe7700e9ff [id=aa018b7ab9f5432686a541a46aecd0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.464274 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3613a48774fb4eedb450794532749a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.464829 457 master_service.cc:960] ReplaceTablet: received request to replace tablet a817b1d4c7b640db8894bc801878caae from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:10.465854 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 44493f0ffd064249a28628cf24895395 (table default.Table_718b661372f441feb171907daff44e2d [id=a5404ca6c40f44b8b881ef582d703fd5]) successfully deleted
I20260616 19:52:10.037992 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 8c21ccda106e4c7a9906861f409a6151 (DEFAULT_TABLE table=default.Table_29ee389b873d4edbbbec5269e7e8735d [id=ea83a18487744823a193d1371b6e2363]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.467577 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e316e44693d473dad901eeb95299988" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:10.467905 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c21ccda106e4c7a9906861f409a6151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.467926 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b57bceabff64533ae3a49b8afda614d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:10.468209 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a09d62e68148349b337c5075763672" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:10.469544 755 tablet_service.cc:1511] Processing CreateTablet for tablet 49f85f7727e447c88eb0287b19005b1b (DEFAULT_TABLE table=default.Table_1d538611df134f06bf8db007545c11e0 [id=1a14eab021da4b06a92693023a8a51cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.469874 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f85f7727e447c88eb0287b19005b1b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.471601 996 leader_election.cc:343] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.471705 996 leader_election.cc:304] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:10.472033 996 leader_election.cc:343] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.472105 996 leader_election.cc:304] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:10.472388 2248 raft_consensus.cc:2749] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:10.040063 1036 tablet_service.cc:1511] Processing CreateTablet for tablet b82dd2c060dc45a781831dde1f67184a (DEFAULT_TABLE table=default.Table_6ae99f784fee4c47b163e188e692ead7 [id=9b2b4c15daa7407ba145b95946711da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.472632 2248 raft_consensus.cc:2749] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:10.472720 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b82dd2c060dc45a781831dde1f67184a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.041509 1040 tablet_service.cc:1511] Processing CreateTablet for tablet c1c2bc4741f3413c82928ec446904f14 (DEFAULT_TABLE table=default.Table_9c4283b5023f48ce914506250ea80e4b [id=232cb95de06d49e4944834fbbe257679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.476706 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c2bc4741f3413c82928ec446904f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.479121 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_82583d6aa4374c5abcc1925437af30ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:10.048161 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 9d169982e30c456a88762587c4cd46c9 (DEFAULT_TABLE table=default.Table_215a9cb092a94f93ab94bd88d433a976 [id=c5ed643eccdc4015899387c3e342b51b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.480008 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d169982e30c456a88762587c4cd46c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.480329 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a585dc2cbde74ec68c6abe440508eb07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:10.480794 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a585dc2cbde74ec68c6abe440508eb07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:10.051327 1035 tablet_service.cc:1511] Processing CreateTablet for tablet adf5010b9025406bb1da70e6875213c6 (DEFAULT_TABLE table=default.Table_b30509a276f0479580ea240dee3f98bd [id=015a8e2f7b914b8ea41c6b94c4a2bab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.483189 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf5010b9025406bb1da70e6875213c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.485459 455 master_service.cc:960] ReplaceTablet: received request to replace tablet daf86e5d5f2341c78705f78c02695c17 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:10.485872 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 613c869d4ac84ee0aa952718ba74917b from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:10.486256 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 79250767a94141cd900a9715e86128b8 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:10.052412 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 8f67e5add64244629cbe8694223bd00e (DEFAULT_TABLE table=default.Table_2e3589134c4b473a97c49a3e99b90589 [id=20ea83aae3094fc7b8880b71a7d52cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.487064 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f67e5add64244629cbe8694223bd00e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.488860 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cce749336e6146dda490587b01e071f0 consensus state has no leader
I20260616 19:52:10.053537 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 32bc62e689e64af0a24cbd6cd5859a06 (DEFAULT_TABLE table=default.Table_0f25c7f0e55b413b8979e51adc294a9e [id=980f044bb81948bc8209622ae724e070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.054726 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 9505120dd9f049c19cf2b84cabe021a6 (DEFAULT_TABLE table=default.Table_8d5418c55a5b4b00bdf64e1d72483b58 [id=216c7160d7b34530a9760c48e502f31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.056380 1037 tablet_service.cc:1511] Processing CreateTablet for tablet c2aef4e720784161927386e48b79286e (DEFAULT_TABLE table=default.Table_1c9c9f90122442a298e318fcfa29121e [id=4e995cac26624c2d93bc976fc88cc02d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.062565 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 893e24a61404499294ec3343d357bab2 (DEFAULT_TABLE table=default.Table_b0d605dac00648449c05e5d0ed2585c0 [id=3fe9fe37661d42c294ba59113422886a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.209722 2272 raft_consensus.cc:493] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.492728 2272 raft_consensus.cc:515] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.492748 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32bc62e689e64af0a24cbd6cd5859a06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.493327 2272 leader_election.cc:290] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.246687 2279 raft_consensus.cc:493] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.393354 2287 raft_consensus.cc:493] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.493492 2279 raft_consensus.cc:515] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.493528 2287 raft_consensus.cc:515] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.493997 2287 leader_election.cc:290] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.494036 2279 leader_election.cc:290] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.394623 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd1070277a14fd98af5fa45925e4f0f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:09.867906 1198 tablet_bootstrap.cc:492] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:10.494155 1059 raft_consensus.cc:3060] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:10.494210 1198 ts_tablet_manager.cc:1403] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.680s user 0.002s sys 0.002s
I20260616 19:52:10.494854 1198 raft_consensus.cc:359] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.494984 1198 raft_consensus.cc:385] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:10.495028 1198 raft_consensus.cc:740] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:10.495179 1198 consensus_queue.cc:260] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.495522 1198 ts_tablet_manager.cc:1434] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260616 19:52:10.495792 1198 tablet_bootstrap.cc:492] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:10.495818 1191 raft_consensus.cc:2243] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:10.496225 1191 raft_consensus.cc:2272] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:10.419226 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf136fa86c264f69a1703596cfd0e77a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:10.496569 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893e24a61404499294ec3343d357bab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.496639 1058 raft_consensus.cc:2393] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:10.497175 1191 ts_tablet_manager.cc:1916] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:10.497510 1198 tablet_bootstrap.cc:654] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:10.499020 758 tablet_service.cc:1511] Processing CreateTablet for tablet a096672b8aec4c22b846ab793e9affd6 (DEFAULT_TABLE table=default.Table_074258c348d84152a5ce663069e0b96c [id=3cb8c37a6bce4a94996f1cd7a5218d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.499356 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a096672b8aec4c22b846ab793e9affd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.500561 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2aef4e720784161927386e48b79286e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.501588 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d800b4e2c2d42279c102e4e061f5530" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:10.501760 918 raft_consensus.cc:2468] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
W20260616 19:52:10.501952 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82583d6aa4374c5abcc1925437af30ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:10.502302 993 leader_election.cc:304] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:52:10.502462 993 raft_consensus.cc:2686] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:52:10.504592 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9505120dd9f049c19cf2b84cabe021a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.492424 755 tablet_service.cc:1511] Processing CreateTablet for tablet a59409d014404ee6b446c5b405c04bc1 (DEFAULT_TABLE table=default.Table_28a18e68feba4a7789a6693a706adb55 [id=ea74deef4414498aa90648737384f261]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.508639 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ab6193c479400da00e1fa80a5274a2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:10.509013 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90205213ba5f49a2931e68839cefb2d2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:10.509146 993 leader_election.cc:343] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.509313 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893e24a61404499294ec3343d357bab2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.509446 993 leader_election.cc:343] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.509645 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a59409d014404ee6b446c5b405c04bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.509783 1190 ts_tablet_manager.cc:1929] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:10.509900 1190 log.cc:1199] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/13e4e52fae124d4085b15e143e98a7e4
I20260616 19:52:10.510223 1190 ts_tablet_manager.cc:1950] T 13e4e52fae124d4085b15e143e98a7e4 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:10.512039 2273 tablet.cc:1724] T 9c77fd138ce9463b8f2d6f4182a56559 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:10.512576 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac675d72e0614ebaaf6b477e22691dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.513664 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d800b4e2c2d42279c102e4e061f5530" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:10.513800 996 leader_election.cc:343] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.513887 996 leader_election.cc:304] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:10.514034 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ab6193c479400da00e1fa80a5274a2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:10.514317 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90205213ba5f49a2931e68839cefb2d2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:10.514559 2279 raft_consensus.cc:2749] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:10.515703 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c21ccda106e4c7a9906861f409a6151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.519301 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2aef4e720784161927386e48b79286e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.520581 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3613a48774fb4eedb450794532749a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.520568 751 tablet_service.cc:1511] Processing CreateTablet for tablet c65e82fdc0be47e3b03876f036af8a53 (DEFAULT_TABLE table=default.Table_9437f0573ab044458aa96d4291c6efdf [id=74f8b880e86d407ba39f7fc296da459b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.523430 746 tablet_service.cc:1511] Processing CreateTablet for tablet f0e8b3f69ae84516846045bf0025e850 (DEFAULT_TABLE table=default.Table_bf59e5a025ec4779ba7d2638fad52eae [id=ef0152e4df4a41ab93c5fb7583740853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.417755 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd6fa49eff4400ca40c722e18cea951" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:10.523772 1060 raft_consensus.cc:2468] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:10.409121 1192 tablet_bootstrap.cc:654] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:10.418007 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd1070277a14fd98af5fa45925e4f0f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:10.418483 921 raft_consensus.cc:3060] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:10.525518 718 leader_election.cc:343] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.528084 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65e82fdc0be47e3b03876f036af8a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.528506 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e8b3f69ae84516846045bf0025e850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.496569 1059 raft_consensus.cc:2468] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:10.529467 1198 tablet_bootstrap.cc:492] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:10.529587 1198 ts_tablet_manager.cc:1403] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20260616 19:52:10.530303 1198 raft_consensus.cc:359] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.530457 1198 raft_consensus.cc:385] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:10.530508 1198 raft_consensus.cc:740] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:10.530695 1198 consensus_queue.cc:260] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.531176 1198 ts_tablet_manager.cc:1434] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:10.531633 719 leader_election.cc:304] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:10.531982 2230 raft_consensus.cc:2804] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:10.532083 2230 raft_consensus.cc:697] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:10.532793 1192 tablet_bootstrap.cc:492] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:10.532902 1192 ts_tablet_manager.cc:1403] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.678s user 0.003s sys 0.000s
I20260616 19:52:10.533530 1192 raft_consensus.cc:359] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.533677 1192 raft_consensus.cc:385] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:10.533736 1192 raft_consensus.cc:740] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:10.533895 1192 consensus_queue.cc:260] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.534400 1192 ts_tablet_manager.cc:1434] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260616 19:52:10.534623 1192 tablet_bootstrap.cc:492] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:10.535897 1192 tablet_bootstrap.cc:654] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:10.537190 756 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea06e51835f457b8bcb4de9b9d5f992 (DEFAULT_TABLE table=default.Table_83154e1a68504df5b9e99369cdb4c876 [id=81e59ed521fd45e999b8cc063a1e2fce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.532295 2230 consensus_queue.cc:237] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.542774 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea06e51835f457b8bcb4de9b9d5f992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.547559 1196 tablet_bootstrap.cc:654] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:10.550590 1192 tablet_bootstrap.cc:492] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:10.550792 1192 ts_tablet_manager.cc:1403] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
I20260616 19:52:10.551177 753 tablet_service.cc:1511] Processing CreateTablet for tablet fae2f430cf904db09b2f18a37d3d9f7f (DEFAULT_TABLE table=default.Table_8286cbce941848058f9f1d96424d16d5 [id=f3ecb0643b57427da85bc508061f83be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.551522 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae2f430cf904db09b2f18a37d3d9f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.551882 1192 raft_consensus.cc:359] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.552115 1192 raft_consensus.cc:385] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:10.552186 1192 raft_consensus.cc:740] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:10.555013 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 4d3f47e767764032ae5a06e34e2de248 (table default.Table_1516f5dc3b2b4de48c2c4076d1cb1205 [id=af4aada43ecf46b8bacf0d9d1388e92e]). Expected version 1 got 0
I20260616 19:52:10.555284 892 tablet_service.cc:1511] Processing CreateTablet for tablet 0406a15db8a642e59555cca38bfa5fbf (DEFAULT_TABLE table=default.Table_7fdf897f4b914166b13a672f25c44393 [id=330e334f41b94c41b6fab79ed0f37660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.558432 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0406a15db8a642e59555cca38bfa5fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.559198 885 tablet_service.cc:1511] Processing CreateTablet for tablet 49f85f7727e447c88eb0287b19005b1b (DEFAULT_TABLE table=default.Table_1d538611df134f06bf8db007545c11e0 [id=1a14eab021da4b06a92693023a8a51cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.559355 902 tablet_service.cc:1511] Processing CreateTablet for tablet a59409d014404ee6b446c5b405c04bc1 (DEFAULT_TABLE table=default.Table_28a18e68feba4a7789a6693a706adb55 [id=ea74deef4414498aa90648737384f261]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.559496 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f85f7727e447c88eb0287b19005b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.559655 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a59409d014404ee6b446c5b405c04bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.560659 897 tablet_service.cc:1511] Processing CreateTablet for tablet a096672b8aec4c22b846ab793e9affd6 (DEFAULT_TABLE table=default.Table_074258c348d84152a5ce663069e0b96c [id=3cb8c37a6bce4a94996f1cd7a5218d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.560926 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a096672b8aec4c22b846ab793e9affd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.562867 886 tablet_service.cc:1511] Processing CreateTablet for tablet c65e82fdc0be47e3b03876f036af8a53 (DEFAULT_TABLE table=default.Table_9437f0573ab044458aa96d4291c6efdf [id=74f8b880e86d407ba39f7fc296da459b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.563153 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65e82fdc0be47e3b03876f036af8a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.566864 896 tablet_service.cc:1511] Processing CreateTablet for tablet f0e8b3f69ae84516846045bf0025e850 (DEFAULT_TABLE table=default.Table_bf59e5a025ec4779ba7d2638fad52eae [id=ef0152e4df4a41ab93c5fb7583740853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.567152 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e8b3f69ae84516846045bf0025e850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.567281 894 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea06e51835f457b8bcb4de9b9d5f992 (DEFAULT_TABLE table=default.Table_83154e1a68504df5b9e99369cdb4c876 [id=81e59ed521fd45e999b8cc063a1e2fce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.567564 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea06e51835f457b8bcb4de9b9d5f992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.568943 892 tablet_service.cc:1511] Processing CreateTablet for tablet fae2f430cf904db09b2f18a37d3d9f7f (DEFAULT_TABLE table=default.Table_8286cbce941848058f9f1d96424d16d5 [id=f3ecb0643b57427da85bc508061f83be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.569422 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae2f430cf904db09b2f18a37d3d9f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.553779 1192 consensus_queue.cc:260] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.571281 904 tablet_service.cc:1511] Processing CreateTablet for tablet eeed41f4bcad4336975540b165b8d473 (DEFAULT_TABLE table=default.Table_1cc2efab7cde4a4c860319723167c913 [id=d633d4a6e9054acca8b632c97ee8c561]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.577236 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeed41f4bcad4336975540b165b8d473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.578090 1192 ts_tablet_manager.cc:1434] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260616 19:52:10.580085 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e8160ad4cf74f16a586ae59291ce7d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:10.580325 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d800b4e2c2d42279c102e4e061f5530 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:10.580502 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 608c26854fdf4dcd8cec2604d23a0dec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:10.531199 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 49f85f7727e447c88eb0287b19005b1b (DEFAULT_TABLE table=default.Table_1d538611df134f06bf8db007545c11e0 [id=1a14eab021da4b06a92693023a8a51cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.504588 1191 ts_tablet_manager.cc:1929] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:10.931609 1191 log.cc:1199] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/9d800b4e2c2d42279c102e4e061f5530
I20260616 19:52:10.931864 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f85f7727e447c88eb0287b19005b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.931983 1191 ts_tablet_manager.cc:1950] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:10.606448 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e7524e978a4d44589fe23bb6f394e922"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:10.932487 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 779) took 4558 ms. Trace:
I20260616 19:52:10.932569 1191 rpcz_store.cc:276] 0616 19:52:06.373818 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.389907 (+ 16089us) service_pool.cc:224] Handling call
0616 19:52:10.427348 (+4037441us) ts_tablet_manager.cc:1151] Deleting tablet 9d800b4e2c2d42279c102e4e061f5530
0616 19:52:10.427357 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:10.496148 (+ 68791us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x6160000d1b54. stack: 00007f92671a0086 00007f926719fe40 00007f92661593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f92731d47e0 00007f9274520933 00007f92770e3ae7 00007f9277116bb4 00007f92770f75d0 00007f92770f735d 0000000000aa681c 00007f92671e5f6f 00007f92671e928b 00007f92671e9108
0616 19:52:10.499747 (+ 3599us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:10.504544 (+ 4797us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:10.932436 (+427892us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157004672,"tablet-delete.queue_time_us":4037153}
I20260616 19:52:10.932931 1191 tablet_replica.cc:333] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:10.933058 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7524e978a4d44589fe23bb6f394e922 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:10.933116 1191 raft_consensus.cc:2243] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:10.933267 1191 raft_consensus.cc:2272] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:10.933782 1191 ts_tablet_manager.cc:1916] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:10.591850 1908 consensus_queue.cc:1048] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:10.580659 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f47e639195478f9cda4ab8f8b33798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:10.606544 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f608b05a8839481680d93f4e7797cd8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:10.935290 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f608b05a8839481680d93f4e7797cd8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:10.539196 1040 tablet_service.cc:1511] Processing CreateTablet for tablet a096672b8aec4c22b846ab793e9affd6 (DEFAULT_TABLE table=default.Table_074258c348d84152a5ce663069e0b96c [id=3cb8c37a6bce4a94996f1cd7a5218d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.546859 1021 tablet_service.cc:1511] Processing CreateTablet for tablet f0e8b3f69ae84516846045bf0025e850 (DEFAULT_TABLE table=default.Table_bf59e5a025ec4779ba7d2638fad52eae [id=ef0152e4df4a41ab93c5fb7583740853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.565021 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea06e51835f457b8bcb4de9b9d5f992 (DEFAULT_TABLE table=default.Table_83154e1a68504df5b9e99369cdb4c876 [id=81e59ed521fd45e999b8cc063a1e2fce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.579131 1039 tablet_service.cc:1511] Processing CreateTablet for tablet eeed41f4bcad4336975540b165b8d473 (DEFAULT_TABLE table=default.Table_1cc2efab7cde4a4c860319723167c913 [id=d633d4a6e9054acca8b632c97ee8c561]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.937238 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a096672b8aec4c22b846ab793e9affd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.937390 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeed41f4bcad4336975540b165b8d473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.597417 756 tablet_service.cc:1511] Processing CreateTablet for tablet eeed41f4bcad4336975540b165b8d473 (DEFAULT_TABLE table=default.Table_1cc2efab7cde4a4c860319723167c913 [id=d633d4a6e9054acca8b632c97ee8c561]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.581727 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 767) took 4278 ms. Trace:
I20260616 19:52:10.939749 1190 rpcz_store.cc:276] 0616 19:52:06.303673 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.303723 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:09.853116 (+3549393us) ts_tablet_manager.cc:1151] Deleting tablet 13e4e52fae124d4085b15e143e98a7e4
0616 19:52:09.853128 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:10.376105 (+522977us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:10.509738 (+133633us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:10.581707 (+ 71969us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3537591}
I20260616 19:52:10.940373 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 764) took 4713 ms. Trace:
I20260616 19:52:10.940454 1190 rpcz_store.cc:276] 0616 19:52:06.227393 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.237540 (+ 10147us) service_pool.cc:224] Handling call
0616 19:52:10.940201 (+4702661us) ts_tablet_manager.cc:1151] Deleting tablet 71a23c82ace248b48c7086dcbabe3649
0616 19:52:10.940215 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:10.940350 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4624590}
I20260616 19:52:10.940841 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e8b3f69ae84516846045bf0025e850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.940869 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 768) took 4479 ms. Trace:
I20260616 19:52:10.940948 1190 rpcz_store.cc:276] 0616 19:52:06.461405 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.461587 (+ 182us) service_pool.cc:224] Handling call
0616 19:52:10.940737 (+4479150us) ts_tablet_manager.cc:1151] Deleting tablet 9446df9472e34ac79ec24cce89e3f5e5
0616 19:52:10.940747 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:10.940832 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4478957}
I20260616 19:52:10.941238 1190 tablet_replica.cc:333] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:10.941488 1190 raft_consensus.cc:2243] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:10.941658 1190 raft_consensus.cc:2272] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:10.602771 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet de16c3feb7374077bc9817c703e5127c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:10.607028 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 90205213ba5f49a2931e68839cefb2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:10.608830 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a09d62e68148349b337c5075763672 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:10.941991 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea06e51835f457b8bcb4de9b9d5f992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.942250 1190 ts_tablet_manager.cc:1916] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:10.634816 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5a1b414e058f427e9bb10ce0b4b789bd" } new_table_name: "default.Table_3b70c7a16c9f4b17837aadaeffea6140" modify_external_catalogs: true
I20260616 19:52:10.945873 2287 raft_consensus.cc:493] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.945992 2287 raft_consensus.cc:515] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.598690 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 608c26854fdf4dcd8cec2604d23a0dec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:10.946605 2287 leader_election.cc:290] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.946969 755 tablet_service.cc:1511] Processing CreateTablet for tablet 26f89b3c9aeb45b0bc096673c11b988e (DEFAULT_TABLE table=default.Table_d277058fb12749f5b6c12e3d9e16919f [id=428cea8853084adca1ebfcd002f60eb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.583707 1192 tablet_bootstrap.cc:492] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:10.608121 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ffc15f90dc24de49455205d5de6b58e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:10.618822 858 leader_election.cc:343] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 5029a79e046a489aa9976eff948a3c5b
I20260616 19:52:10.947575 858 leader_election.cc:304] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
W20260616 19:52:10.947925 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 329108us
I20260616 19:52:10.948020 2195 raft_consensus.cc:2749] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:10.948217 858 consensus_peers.cc:597] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65b0dc43b40649f29037f40d2ea9247e. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:10.948438 858 leader_election.cc:304] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
W20260616 19:52:10.948637 858 raft_consensus.cc:2686] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:52:10.948920 858 leader_election.cc:304] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:10.949175 2195 raft_consensus.cc:2804] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:10.638648 2297 raft_consensus.cc:493] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.949291 2195 raft_consensus.cc:493] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:10.949405 2195 raft_consensus.cc:3060] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:10.949373 2297 raft_consensus.cc:515] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.531443 1198 tablet_bootstrap.cc:492] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:10.584713 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f47e639195478f9cda4ab8f8b33798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:10.617610 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8160ad4cf74f16a586ae59291ce7d1" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:10.950027 1059 raft_consensus.cc:2468] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:10.950114 2297 leader_election.cc:290] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.541889 1029 tablet_service.cc:1511] Processing CreateTablet for tablet c65e82fdc0be47e3b03876f036af8a53 (DEFAULT_TABLE table=default.Table_9437f0573ab044458aa96d4291c6efdf [id=74f8b880e86d407ba39f7fc296da459b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.950467 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65e82fdc0be47e3b03876f036af8a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.951397 1198 tablet_bootstrap.cc:654] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:10.952023 2195 raft_consensus.cc:515] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.635306 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c152425c57194fcfb3477de6f8beb86a" } modify_external_catalogs: true
I20260616 19:52:10.952327 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c152425c57194fcfb3477de6f8beb86a" } modify_external_catalogs: true
I20260616 19:52:10.611182 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c2bc4741f3413c82928ec446904f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.639871 903 tablet_service.cc:1558] Processing DeleteTablet for tablet afc58b2bda2a43f18f157469b591854b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:10.952775 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d169982e30c456a88762587c4cd46c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.640313 890 tablet_service.cc:1558] Processing DeleteTablet for tablet de16c3feb7374077bc9817c703e5127c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:10.602169 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet afc58b2bda2a43f18f157469b591854b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:10.535221 1023 tablet_service.cc:1511] Processing CreateTablet for tablet a59409d014404ee6b446c5b405c04bc1 (DEFAULT_TABLE table=default.Table_28a18e68feba4a7789a6693a706adb55 [id=ea74deef4414498aa90648737384f261]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.955869 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a59409d014404ee6b446c5b405c04bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.956576 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac675d72e0614ebaaf6b477e22691dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.635738 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ee33e081bec640ffb218fc7912367a71" } modify_external_catalogs: true
I20260616 19:52:10.956761 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ee33e081bec640ffb218fc7912367a71" } modify_external_catalogs: true
I20260616 19:52:10.611441 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f47e639195478f9cda4ab8f8b33798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:10.957515 764 tablet_service.cc:1511] Processing CreateTablet for tablet f1a31ad567ca48f897d3cae5532283d3 (DEFAULT_TABLE table=default.Table_379b2dafdc1e47ec89c58c6a2f2eb755 [id=9a1ac8044669463bb7921c6d25ffa981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.957826 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a31ad567ca48f897d3cae5532283d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.582134 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 608c26854fdf4dcd8cec2604d23a0dec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:10.736604 904 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5efc4005fa447091cbc9aa28ac3922 (DEFAULT_TABLE table=default.Table_090f3e0ccafb44a487aa44fd31777366 [id=07133f96af04409b9f7d4be049bced8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.960573 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d68a784f43554b4a88a864ba7bfc2db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.586370 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ffc15f90dc24de49455205d5de6b58e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:10.610622 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 0406a15db8a642e59555cca38bfa5fbf (DEFAULT_TABLE table=default.Table_7fdf897f4b914166b13a672f25c44393 [id=330e334f41b94c41b6fab79ed0f37660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.960807 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5efc4005fa447091cbc9aa28ac3922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.960922 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0406a15db8a642e59555cca38bfa5fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.577471 1033 tablet_service.cc:1511] Processing CreateTablet for tablet fae2f430cf904db09b2f18a37d3d9f7f (DEFAULT_TABLE table=default.Table_8286cbce941848058f9f1d96424d16d5 [id=f3ecb0643b57427da85bc508061f83be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.743294 885 tablet_service.cc:1511] Processing CreateTablet for tablet 1b3c170ea2a34e72824dc90f15534745 (DEFAULT_TABLE table=default.Table_566443171e24470680ef72b6895d4ff2 [id=0e28b05d15284baa9bd118ebeaf56805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.963716 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3c170ea2a34e72824dc90f15534745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.964565 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3140c1dc472b44bd935a799e27bf4fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.965427 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae2f430cf904db09b2f18a37d3d9f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.636108 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_95e22ec4d7a84936891845fe5e39f547" } modify_external_catalogs: true
I20260616 19:52:10.966475 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_95e22ec4d7a84936891845fe5e39f547" } modify_external_catalogs: true
I20260616 19:52:10.612370 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ffc15f90dc24de49455205d5de6b58e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:10.967242 749 tablet_service.cc:1511] Processing CreateTablet for tablet 466ed8ccc94243ef86f192016473d8fc (DEFAULT_TABLE table=default.Table_dc6b5507cf924390bbe34c207ec2cce3 [id=23c643c7cd9d4c2d8b14499553f2ad03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.967558 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466ed8ccc94243ef86f192016473d8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.749625 896 tablet_service.cc:1511] Processing CreateTablet for tablet b450218bc75848459f539d7be8bec026 (DEFAULT_TABLE table=default.Table_da1e119412304472ac351bb95c1f8ce0 [id=9e88963affaf4b2fb71dc20dd7a3cbe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.968803 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b450218bc75848459f539d7be8bec026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.970265 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0313e65e6a3441abcd663110cfcd70d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.533259 996 leader_election.cc:343] T 9d800b4e2c2d42279c102e4e061f5530 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.972563 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893e24a61404499294ec3343d357bab2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.973053 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 439758us
W20260616 19:52:10.973287 996 leader_election.cc:343] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.973371 996 leader_election.cc:304] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:10.973677 996 leader_election.cc:343] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:10.973755 996 leader_election.cc:304] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:10.973937 2296 raft_consensus.cc:2749] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:10.974082 2296 raft_consensus.cc:2749] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:10.756026 899 tablet_service.cc:1511] Processing CreateTablet for tablet 26f89b3c9aeb45b0bc096673c11b988e (DEFAULT_TABLE table=default.Table_d277058fb12749f5b6c12e3d9e16919f [id=428cea8853084adca1ebfcd002f60eb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.975900 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f89b3c9aeb45b0bc096673c11b988e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.636530 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_67e9e36e50e4455fa01d01db4ab1e5aa" } modify_external_catalogs: true
I20260616 19:52:10.976734 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_67e9e36e50e4455fa01d01db4ab1e5aa" } modify_external_catalogs: true
I20260616 19:52:10.612653 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 865) took 2821 ms. Trace:
I20260616 19:52:10.612376 754 tablet_service.cc:1558] Processing DeleteTablet for tablet afc58b2bda2a43f18f157469b591854b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:10.977175 1193 rpcz_store.cc:276] 0616 19:52:07.791586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.817804 (+ 26218us) service_pool.cc:224] Handling call
0616 19:52:09.575931 (+1758127us) ts_tablet_manager.cc:1151] Deleting tablet eb04ccc26e64484a9a29c515d4b954fe
0616 19:52:09.575940 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:09.914246 (+338306us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:09.943956 (+ 29710us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:10.612636 (+668680us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1756035}
I20260616 19:52:10.977533 1193 tablet_replica.cc:333] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:10.977506 754 tablet_service.cc:1511] Processing CreateTablet for tablet 0877856fc6d14cd99cf49ce418518f95 (DEFAULT_TABLE table=default.Table_98df6f73169842f793087e98d434137e [id=32ab8b0a4aa7442dbb8fa84994df3078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.977712 1193 raft_consensus.cc:2243] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:10.977844 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0877856fc6d14cd99cf49ce418518f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.977941 1193 raft_consensus.cc:2272] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:10.978427 1193 ts_tablet_manager.cc:1916] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:10.978734 757 tablet_service.cc:1511] Processing CreateTablet for tablet 4f4eafb272324f0db993dc4063760fe5 (DEFAULT_TABLE table=default.Table_8a64df992f36453fae2a889da7d15b6d [id=9678403da051443bb9aa6f95eefe81c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.979028 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f4eafb272324f0db993dc4063760fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.979780 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0c9dff56274c3ba889ccf919965b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.761713 889 tablet_service.cc:1511] Processing CreateTablet for tablet f1a31ad567ca48f897d3cae5532283d3 (DEFAULT_TABLE table=default.Table_379b2dafdc1e47ec89c58c6a2f2eb755 [id=9a1ac8044669463bb7921c6d25ffa981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.668840 776 raft_consensus.cc:3060] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:10.980582 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a31ad567ca48f897d3cae5532283d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.672631 753 tablet_service.cc:1558] Processing DeleteTablet for tablet de16c3feb7374077bc9817c703e5127c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:10.693751 1196 tablet_bootstrap.cc:492] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:10.983428 1196 ts_tablet_manager.cc:1403] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.572s user 0.011s sys 0.015s
I20260616 19:52:10.983599 753 tablet_service.cc:1511] Processing CreateTablet for tablet b0eb2237ba864169872d26a688f35363 (DEFAULT_TABLE table=default.Table_ccdea01c9e6143c18e646fe317ea8128 [id=e3410064365643d9a05075d1ed38078b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.983973 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0eb2237ba864169872d26a688f35363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.984228 1196 raft_consensus.cc:359] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.984372 1196 raft_consensus.cc:385] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:10.984417 1196 raft_consensus.cc:740] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:10.750977 2279 raft_consensus.cc:493] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:10.984633 2279 raft_consensus.cc:515] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:10.985227 2279 leader_election.cc:290] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.773435 893 tablet_service.cc:1511] Processing CreateTablet for tablet 466ed8ccc94243ef86f192016473d8fc (DEFAULT_TABLE table=default.Table_dc6b5507cf924390bbe34c207ec2cce3 [id=23c643c7cd9d4c2d8b14499553f2ad03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.986032 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466ed8ccc94243ef86f192016473d8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.986536 2195 leader_election.cc:290] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.636981 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_268e03dfbe624ecda3c79e40904e6299" } new_table_name: "default.Table_c37631d3a430429c9372b1f09c2898d6" modify_external_catalogs: true
I20260616 19:52:10.777379 902 tablet_service.cc:1511] Processing CreateTablet for tablet 0877856fc6d14cd99cf49ce418518f95 (DEFAULT_TABLE table=default.Table_98df6f73169842f793087e98d434137e [id=32ab8b0a4aa7442dbb8fa84994df3078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.785450 897 tablet_service.cc:1511] Processing CreateTablet for tablet b0eb2237ba864169872d26a688f35363 (DEFAULT_TABLE table=default.Table_ccdea01c9e6143c18e646fe317ea8128 [id=e3410064365643d9a05075d1ed38078b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.792045 891 tablet_service.cc:1511] Processing CreateTablet for tablet 3436e046181c4c01b2ccb956684824ad (DEFAULT_TABLE table=default.Table_84ff2b20490143b1b7372fce52224631 [id=fbae0d7d2acb449da028912bc68ab176]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.795226 898 tablet_service.cc:1511] Processing CreateTablet for tablet 7d4d05b550f645e3a4b156bd79a58456 (DEFAULT_TABLE table=default.Table_51e7fb35630c4bcab85c4b278daacf2c [id=b258af8c37f94dd19f777eea37ef0dcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.796175 901 tablet_service.cc:1511] Processing CreateTablet for tablet 411f7ec4c490481f9857b3496c5e8748 (DEFAULT_TABLE table=default.Table_f39fe2b06c8c47e3bd6617baa83fe439 [id=ddb85d15124240789d29d3b021acda02]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:10.902350 860 consensus_peers.cc:597] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:10.949292 858 leader_election.cc:343] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: d9c664f0386549d6867c407526ee45a0
I20260616 19:52:10.988817 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0877856fc6d14cd99cf49ce418518f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.988896 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c21ccda106e4c7a9906861f409a6151. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.988873 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 86526.5us
I20260616 19:52:10.989658 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed22bbef8ef479dad179b96ba850d26" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:10.990417 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3436e046181c4c01b2ccb956684824ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.735510 751 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5efc4005fa447091cbc9aa28ac3922 (DEFAULT_TABLE table=default.Table_090f3e0ccafb44a487aa44fd31777366 [id=07133f96af04409b9f7d4be049bced8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.992749 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5efc4005fa447091cbc9aa28ac3922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.993803 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944b29ae4fb340de890dbdfc1e46f141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.994333 754 tablet_service.cc:1511] Processing CreateTablet for tablet 7d4d05b550f645e3a4b156bd79a58456 (DEFAULT_TABLE table=default.Table_51e7fb35630c4bcab85c4b278daacf2c [id=b258af8c37f94dd19f777eea37ef0dcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.994642 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d4d05b550f645e3a4b156bd79a58456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.995755 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d4d05b550f645e3a4b156bd79a58456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.778640 887 tablet_service.cc:1511] Processing CreateTablet for tablet 4f4eafb272324f0db993dc4063760fe5 (DEFAULT_TABLE table=default.Table_8a64df992f36453fae2a889da7d15b6d [id=9678403da051443bb9aa6f95eefe81c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.988874 858 leader_election.cc:304] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:10.996740 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f4eafb272324f0db993dc4063760fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:10.996766 2195 raft_consensus.cc:2749] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:10.996836 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 47562.7us
I20260616 19:52:10.997032 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3613a48774fb4eedb450794532749a7b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:10.997058 858 leader_election.cc:343] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: a170db3d27fd40c1b74deab29e9a033f
I20260616 19:52:10.997170 858 leader_election.cc:304] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:10.997623 2285 raft_consensus.cc:2749] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:10.722056 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0b249e29f69943f287411783b84c6817
I20260616 19:52:11.000679 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 411f7ec4c490481f9857b3496c5e8748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.001107 459 catalog_manager.cc:6784] ReplaceTablet: tablet 0b249e29f69943f287411783b84c6817 deleted and replaced by tablet c3d71d78c92f45f1a6c0af3589026b10
I20260616 19:52:11.001262 459 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:41696 (request call id 1196) took 1167 ms. Trace:
I20260616 19:52:11.001348 459 rpcz_store.cc:276] 0616 19:52:09.833694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.376682 (+542988us) service_pool.cc:224] Handling call
0616 19:52:11.001207 (+624525us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:10.716993 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:10.717116 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:10.717121 (+ 5us) write_op.cc:435] Acquired schema lock
0616 19:52:10.717125 (+ 4us) tablet.cc:662] Decoding operations
0616 19:52:10.717217 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:10.717228 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:10.717232 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:10.717300 (+ 68us) tablet.cc:701] Row locks acquired
0616 19:52:10.717303 (+ 3us) write_op.cc:260] PREPARE: finished
0616 19:52:10.717334 (+ 31us) write_op.cc:270] Start()
0616 19:52:10.717364 (+ 30us) write_op.cc:276] Timestamp: P: 1781639530717301 usec, L: 0
0616 19:52:10.717370 (+ 6us) op_driver.cc:348] REPLICATION: starting
0616 19:52:10.717510 (+ 140us) log.cc:844] Serialized 628 byte log entry
0616 19:52:10.721217 (+ 3707us) op_driver.cc:464] REPLICATION: finished
0616 19:52:10.721318 (+ 101us) write_op.cc:301] APPLY: starting
0616 19:52:10.721331 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:10.721384 (+ 53us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:10.721417 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:10.721512 (+ 95us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:10.721571 (+ 59us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0616 19:52:10.721578 (+ 7us) write_op.cc:312] APPLY: finished
0616 19:52:10.721642 (+ 64us) log.cc:844] Serialized 29 byte log entry
0616 19:52:10.721704 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:10.721724 (+ 20us) write_op.cc:454] Released schema lock
0616 19:52:10.721731 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:10.721801 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:10.721807 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":53,"apply.run_cpu_time_us":472,"apply.run_wall_time_us":471,"num_ops":2,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":606,"prepare.run_wall_time_us":606,"raft.queue_time_us":374,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":253,"replication_time_us":3817}]]}
I20260616 19:52:10.741633 758 tablet_service.cc:1511] Processing CreateTablet for tablet 1b3c170ea2a34e72824dc90f15534745 (DEFAULT_TABLE table=default.Table_566443171e24470680ef72b6895d4ff2 [id=0e28b05d15284baa9bd118ebeaf56805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.003679 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3c170ea2a34e72824dc90f15534745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.004684 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0eb2237ba864169872d26a688f35363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.005791 765 tablet_service.cc:1511] Processing CreateTablet for tablet 411f7ec4c490481f9857b3496c5e8748 (DEFAULT_TABLE table=default.Table_f39fe2b06c8c47e3bd6617baa83fe439 [id=ddb85d15124240789d29d3b021acda02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.006088 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 411f7ec4c490481f9857b3496c5e8748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.011152 1191 ts_tablet_manager.cc:1929] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:11.021669 2195 consensus_queue.cc:1048] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:11.011274 1191 log.cc:1199] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/4bd6fa49eff4400ca40c722e18cea951
I20260616 19:52:11.026787 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731556662b62419dae76149b22469ebd" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:11.029985 1191 ts_tablet_manager.cc:1950] T 4bd6fa49eff4400ca40c722e18cea951 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:11.027310 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b249e29f69943f287411783b84c6817 with delete_type TABLET_DATA_DELETED (replaced by tablet c3d71d78c92f45f1a6c0af3589026b10) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:10.744590 746 tablet_service.cc:1511] Processing CreateTablet for tablet b450218bc75848459f539d7be8bec026 (DEFAULT_TABLE table=default.Table_da1e119412304472ac351bb95c1f8ce0 [id=9e88963affaf4b2fb71dc20dd7a3cbe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:10.734210 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
I20260616 19:52:11.030841 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 785) took 4607 ms. Trace:
I20260616 19:52:11.030923 1191 rpcz_store.cc:276] 0616 19:52:06.423218 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.423441 (+ 223us) service_pool.cc:224] Handling call
0616 19:52:10.932888 (+4509447us) ts_tablet_manager.cc:1151] Deleting tablet 4bd6fa49eff4400ca40c722e18cea951
0616 19:52:10.932897 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:10.936681 (+ 3784us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.011093 (+ 74412us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.030820 (+ 19727us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4509232}
I20260616 19:52:11.031315 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 786) took 4574 ms. Trace:
I20260616 19:52:11.031406 1191 rpcz_store.cc:276] 0616 19:52:06.457279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.458049 (+ 770us) service_pool.cc:224] Handling call
0616 19:52:11.031178 (+4573129us) ts_tablet_manager.cc:1151] Deleting tablet 9446df9472e34ac79ec24cce89e3f5e5
0616 19:52:11.031189 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.031293 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4572925}
I20260616 19:52:11.031721 1191 tablet_replica.cc:333] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:11.031942 1191 raft_consensus.cc:2243] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:11.032099 1191 raft_consensus.cc:2272] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:11.032768 1191 ts_tablet_manager.cc:1916] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.032771 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8b66b38f443d4eaebf8391a80ef74818" } modify_external_catalogs: true
I20260616 19:52:11.032996 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8b66b38f443d4eaebf8391a80ef74818" } modify_external_catalogs: true
W20260616 19:52:10.894090 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 24278ccfca6742aa8972d2b3d2c612d4 (table default.Table_6ff69aa268bc43f99b003e8db11d759c [id=13bb6e4c945447fdbc89d2dfb185a01c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 24278ccfca6742aa8972d2b3d2c612d4 consensus state has no leader
I20260616 19:52:11.033938 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet eb04ccc26e64484a9a29c515d4b954fe (table default.Table_093bd1c50f834db49bf52da0c66fae6d [id=87e3217093844e81ac448e2e9d8fa3ec]) successfully deleted
I20260616 19:52:11.019723 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed22bbef8ef479dad179b96ba850d26" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:11.028045 858 leader_election.cc:304] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:11.021865 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd6fa49eff4400ca40c722e18cea951" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:11.022362 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeed41f4bcad4336975540b165b8d473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.035553 2195 raft_consensus.cc:2804] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:11.035691 2195 raft_consensus.cc:493] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:11.035789 2195 raft_consensus.cc:3060] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:11.035908 860 leader_election.cc:343] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.036597 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b450218bc75848459f539d7be8bec026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.038604 2195 raft_consensus.cc:515] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.039322 2195 leader_election.cc:290] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:11.040586 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8160ad4cf74f16a586ae59291ce7d1" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:11.041064 860 leader_election.cc:343] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.023267 759 tablet_service.cc:1511] Processing CreateTablet for tablet 3436e046181c4c01b2ccb956684824ad (DEFAULT_TABLE table=default.Table_84ff2b20490143b1b7372fce52224631 [id=fbae0d7d2acb449da028912bc68ab176]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.043185 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3436e046181c4c01b2ccb956684824ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.024204 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b9248b88434a6e9ef7a3d602eee70c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:11.044798 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f89b3c9aeb45b0bc096673c11b988e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.060655 1196 consensus_queue.cc:260] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.061174 1196 ts_tablet_manager.cc:1434] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.078s user 0.001s sys 0.000s
I20260616 19:52:11.061419 1196 tablet_bootstrap.cc:492] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:11.062959 1196 tablet_bootstrap.cc:654] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.074549 971 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:52:11.079245 2287 raft_consensus.cc:493] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.079393 2287 raft_consensus.cc:515] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.079993 2287 leader_election.cc:290] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:10.949396 1192 tablet_bootstrap.cc:654] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.082773 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6ef1c5dde9574dd0abbeab5e4fa9586d" } new_table_name: "default.Table_ce3905f6aa13493295bd76511ff3eb6b" modify_external_catalogs: true
I20260616 19:52:11.086187 454 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 76d73be228664063822c41cbefafcab8 (table default.Table_16508a5420d3488088367681d9b55f03 [id=946fd4fcf5f244acafa1e82743e70af2]). Expected version 2 got 0
I20260616 19:52:11.018261 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 9d800b4e2c2d42279c102e4e061f5530 (table default.Table_fab39b1a6f2940f4955f9d3b9dd78a79 [id=444a660aa02c4f17a70407bd7d57b590]) successfully deleted
W20260616 19:52:11.090576 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 72267.7us
I20260616 19:52:11.024762 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 13e4e52fae124d4085b15e143e98a7e4 (table default.Table_08665ae0b3d543ee85db56ca306c7f4b [id=ee62532e9e6148ac830ee9efe0a88a24]) successfully deleted
W20260616 19:52:11.091507 445 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 66711.3us
W20260616 19:52:11.091708 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 71a23c82ace248b48c7086dcbabe3649 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71a23c82ace248b48c7086dcbabe3649 already in progress: creating tablet
I20260616 19:52:11.093261 898 tablet_service.cc:1558] Processing DeleteTablet for tablet e91c377ae66441268351cd3592aa9dbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.093533 885 tablet_service.cc:1558] Processing DeleteTablet for tablet fbb308b05bb04bc18ccaa9550a73d3e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:10.873047 982 kernel_stack_watchdog.cc:198] Thread 996 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/outbound_call.cc:307 for 118ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f926a828980 (unknown) at ??:0
@ 0x7f926a8229c6 __GI___pthread_rwlock_wrlock at ??:0
@ 0x7f926442c904 google::LogMessage::Flush() at ??:0
@ 0x7f926442ca11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f9273124953 kudu::consensus::LeaderElection::VoteResponseRpcCallback() at ??:0
@ 0x7f92731274ca kudu::consensus::LeaderElection::Run()::$_0::operator()() at ??:0
@ 0x7f927312728e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
@ 0x7f926e19e76f kudu::rpc::Proxy::AsyncRequest()::$_1::operator()() at ??:0
@ 0x7f926e19e34e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
@ 0x7f926e189bf0 kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f926e18a10f kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f926e120c34 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f926e11f546 kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f926e136a25 ev::base<>::method_thunk<>() at ??:0
W20260616 19:52:11.026460 993 leader_election.cc:343] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:11.094151 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 67702.7us
W20260616 19:52:11.094498 993 leader_election.cc:343] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.095729 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8160ad4cf74f16a586ae59291ce7d1" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:11.095885 1055 raft_consensus.cc:3060] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:11.096297 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b9248b88434a6e9ef7a3d602eee70c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:11.097662 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17029c1ba36644e9847200b54bf9094c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:11.098126 993 leader_election.cc:343] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.098412 1055 raft_consensus.cc:2468] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:11.100582 2287 raft_consensus.cc:493] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.100729 2287 raft_consensus.cc:515] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:11.100893 858 consensus_peers.cc:597] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44493f0ffd064249a28628cf24895395. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:11.101215 459 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 76d73be228664063822c41cbefafcab8 (table default.Table_16508a5420d3488088367681d9b55f03 [id=946fd4fcf5f244acafa1e82743e70af2]). Expected version 2 got 0
I20260616 19:52:11.101385 858 leader_election.cc:304] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:11.101549 459 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 4d3f47e767764032ae5a06e34e2de248 (table default.Table_1516f5dc3b2b4de48c2c4076d1cb1205 [id=af4aada43ecf46b8bacf0d9d1388e92e]). Expected version 1 got 0
W20260616 19:52:11.102054 858 leader_election.cc:343] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 4bd6fa49eff4400ca40c722e18cea951
I20260616 19:52:11.102265 858 leader_election.cc:304] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:11.103631 1192 tablet_bootstrap.cc:492] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:11.103775 1192 ts_tablet_manager.cc:1403] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.520s user 0.003s sys 0.000s
I20260616 19:52:11.104564 1192 raft_consensus.cc:359] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.104749 1192 raft_consensus.cc:385] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.104815 1192 raft_consensus.cc:740] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.105098 1192 consensus_queue.cc:260] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.105556 1192 ts_tablet_manager.cc:1434] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:11.105676 2297 consensus_queue.cc:1048] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:11.105849 1192 tablet_bootstrap.cc:492] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:11.106109 2297 raft_consensus.cc:2749] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:11.106298 2297 raft_consensus.cc:2749] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260616 19:52:11.106767 2287 leader_election.cc:290] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:11.107430 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa72e00b0a3a423f96bdd7abb6013810" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:11.107878 1192 tablet_bootstrap.cc:654] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:11.107962 993 leader_election.cc:343] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.108290 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 1b3c170ea2a34e72824dc90f15534745 (DEFAULT_TABLE table=default.Table_566443171e24470680ef72b6895d4ff2 [id=0e28b05d15284baa9bd118ebeaf56805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.108734 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3c170ea2a34e72824dc90f15534745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.109874 858 leader_election.cc:304] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:11.110209 2195 raft_consensus.cc:2804] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:11.110446 2195 raft_consensus.cc:697] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:11.110724 2195 consensus_queue.cc:237] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.113600 1025 tablet_service.cc:1511] Processing CreateTablet for tablet b450218bc75848459f539d7be8bec026 (DEFAULT_TABLE table=default.Table_da1e119412304472ac351bb95c1f8ce0 [id=9e88963affaf4b2fb71dc20dd7a3cbe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.113835 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 466ed8ccc94243ef86f192016473d8fc (DEFAULT_TABLE table=default.Table_dc6b5507cf924390bbe34c207ec2cce3 [id=23c643c7cd9d4c2d8b14499553f2ad03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.114091 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b450218bc75848459f539d7be8bec026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.114312 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466ed8ccc94243ef86f192016473d8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.115792 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 26f89b3c9aeb45b0bc096673c11b988e (DEFAULT_TABLE table=default.Table_d277058fb12749f5b6c12e3d9e16919f [id=428cea8853084adca1ebfcd002f60eb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.116153 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f89b3c9aeb45b0bc096673c11b988e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.116726 1021 tablet_service.cc:1511] Processing CreateTablet for tablet f1a31ad567ca48f897d3cae5532283d3 (DEFAULT_TABLE table=default.Table_379b2dafdc1e47ec89c58c6a2f2eb755 [id=9a1ac8044669463bb7921c6d25ffa981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.117007 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a31ad567ca48f897d3cae5532283d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.117424 1032 tablet_service.cc:1511] Processing CreateTablet for tablet b0eb2237ba864169872d26a688f35363 (DEFAULT_TABLE table=default.Table_ccdea01c9e6143c18e646fe317ea8128 [id=e3410064365643d9a05075d1ed38078b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.117591 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 3436e046181c4c01b2ccb956684824ad (DEFAULT_TABLE table=default.Table_84ff2b20490143b1b7372fce52224631 [id=fbae0d7d2acb449da028912bc68ab176]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.117709 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0eb2237ba864169872d26a688f35363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.117969 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3436e046181c4c01b2ccb956684824ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.120714 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 0877856fc6d14cd99cf49ce418518f95 (DEFAULT_TABLE table=default.Table_98df6f73169842f793087e98d434137e [id=32ab8b0a4aa7442dbb8fa84994df3078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.120867 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 7d4d05b550f645e3a4b156bd79a58456 (DEFAULT_TABLE table=default.Table_51e7fb35630c4bcab85c4b278daacf2c [id=b258af8c37f94dd19f777eea37ef0dcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.120980 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0877856fc6d14cd99cf49ce418518f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.121228 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d4d05b550f645e3a4b156bd79a58456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.121377 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 4f4eafb272324f0db993dc4063760fe5 (DEFAULT_TABLE table=default.Table_8a64df992f36453fae2a889da7d15b6d [id=9678403da051443bb9aa6f95eefe81c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.121637 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f4eafb272324f0db993dc4063760fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.125036 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 731556662b62419dae76149b22469ebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.125168 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 411f7ec4c490481f9857b3496c5e8748 (DEFAULT_TABLE table=default.Table_f39fe2b06c8c47e3bd6617baa83fe439 [id=ddb85d15124240789d29d3b021acda02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.125440 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 411f7ec4c490481f9857b3496c5e8748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.129688 1192 tablet_bootstrap.cc:492] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:11.130146 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b249e29f69943f287411783b84c6817 with delete_type TABLET_DATA_DELETED (replaced by tablet c3d71d78c92f45f1a6c0af3589026b10) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.130228 1192 ts_tablet_manager.cc:1403] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.005s
I20260616 19:52:11.134066 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731556662b62419dae76149b22469ebd" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:11.134845 1192 raft_consensus.cc:359] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.135761 1192 raft_consensus.cc:385] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.136152 1192 raft_consensus.cc:740] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.137403 1192 consensus_queue.cc:260] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.142009 1192 ts_tablet_manager.cc:1434] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.011s user 0.000s sys 0.003s
I20260616 19:52:11.143852 2233 raft_consensus.cc:493] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.143982 1192 tablet_bootstrap.cc:492] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:11.143988 2233 raft_consensus.cc:515] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.144690 2233 leader_election.cc:290] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:11.145406 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc988a195ec4bbf8691801421fed8bb" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:11.145612 922 raft_consensus.cc:2393] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
I20260616 19:52:11.155020 1192 tablet_bootstrap.cc:654] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.159116 1198 tablet_bootstrap.cc:492] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:11.159265 1198 ts_tablet_manager.cc:1403] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.628s user 0.001s sys 0.001s
I20260616 19:52:11.160189 1198 raft_consensus.cc:359] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.160392 1198 raft_consensus.cc:385] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.160451 1198 raft_consensus.cc:740] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.160964 1198 consensus_queue.cc:260] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.161556 1198 ts_tablet_manager.cc:1434] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:52:11.161872 1198 tablet_bootstrap.cc:492] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:11.163609 1198 tablet_bootstrap.cc:654] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.172384 1192 tablet_bootstrap.cc:492] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:11.173477 1192 ts_tablet_manager.cc:1403] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.006s
I20260616 19:52:11.174072 1035 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 970) took 1109 ms. Trace:
I20260616 19:52:11.174186 1035 rpcz_store.cc:276] 0616 19:52:10.064711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.530961 (+466250us) service_pool.cc:224] Handling call
0616 19:52:10.931620 (+400659us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:10.931655 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:11.051475 (+119820us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.173892 (+122417us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:11.174052 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260616 19:52:11.176222 2287 raft_consensus.cc:493] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.176502 2287 raft_consensus.cc:515] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.177245 2287 leader_election.cc:290] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:11.177975 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c35e4c8e9304e798c9031469877b70e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:11.178634 993 leader_election.cc:343] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.195140 1192 raft_consensus.cc:359] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.196771 1192 raft_consensus.cc:385] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.197391 1192 raft_consensus.cc:740] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.199070 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 44493f0ffd064249a28628cf24895395 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.199607 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5efc4005fa447091cbc9aa28ac3922 (DEFAULT_TABLE table=default.Table_090f3e0ccafb44a487aa44fd31777366 [id=07133f96af04409b9f7d4be049bced8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.200018 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5efc4005fa447091cbc9aa28ac3922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.199246 1192 consensus_queue.cc:260] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.203794 1192 ts_tablet_manager.cc:1434] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.030s user 0.000s sys 0.003s
I20260616 19:52:11.206319 1192 tablet_bootstrap.cc:492] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:11.207744 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa72e00b0a3a423f96bdd7abb6013810" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:11.208340 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17029c1ba36644e9847200b54bf9094c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:11.208978 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 4bd6fa49eff4400ca40c722e18cea951 (table default.Table_ae1d446a11f34a77bd9bcdafbef99127 [id=b401e2a905f842579b3b60e5d20815aa]) successfully deleted
W20260616 19:52:11.209751 996 leader_election.cc:343] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.209875 996 leader_election.cc:304] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:11.221678 2279 raft_consensus.cc:2749] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:11.222604 996 leader_election.cc:343] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.222720 996 leader_election.cc:304] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:11.222602 1192 tablet_bootstrap.cc:654] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.223244 1193 ts_tablet_manager.cc:1929] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260616 19:52:11.223376 1193 log.cc:1199] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/3de0e62cfd33410490a0b460fd5f69e9
I20260616 19:52:11.223728 1193 ts_tablet_manager.cc:1950] T 3de0e62cfd33410490a0b460fd5f69e9 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:11.224050 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 876) took 3350 ms. Trace:
I20260616 19:52:11.224371 2323 raft_consensus.cc:493] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.224558 2323 raft_consensus.cc:515] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.225358 2323 leader_election.cc:290] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:11.226500 858 leader_election.cc:343] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 79250767a94141cd900a9715e86128b8
I20260616 19:52:11.227797 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c917659aef8241b98ffa4caa9c7b96a5" } new_table_name: "default.Table_b9c56c0c18cf40b6be9c36fb8e7bec46" modify_external_catalogs: true
W20260616 19:52:11.231540 860 leader_election.cc:343] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 79250767a94141cd900a9715e86128b8
I20260616 19:52:11.231671 860 leader_election.cc:304] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:11.232115 2242 raft_consensus.cc:2749] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:11.232685 2287 raft_consensus.cc:2749] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:11.233044 996 leader_election.cc:343] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.233166 996 leader_election.cc:304] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:11.233481 2279 raft_consensus.cc:2749] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:11.235258 1190 ts_tablet_manager.cc:1929] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:11.235364 1190 log.cc:1199] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/cf136fa86c264f69a1703596cfd0e77a
I20260616 19:52:11.235713 1190 ts_tablet_manager.cc:1950] T cf136fa86c264f69a1703596cfd0e77a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:11.224138 1193 rpcz_store.cc:276] 0616 19:52:07.873412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.873502 (+ 90us) service_pool.cc:224] Handling call
0616 19:52:10.977487 (+3103985us) ts_tablet_manager.cc:1151] Deleting tablet 3de0e62cfd33410490a0b460fd5f69e9
0616 19:52:10.977496 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.106685 (+129189us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.223169 (+116484us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.224032 (+ 863us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3103686}
I20260616 19:52:11.249307 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 3de0e62cfd33410490a0b460fd5f69e9 (table default.Table_f5c1eb12b45345aabb7ab3c7a1854ead [id=c7d1624942fb42aa95ad085062052262]) successfully deleted
I20260616 19:52:11.249866 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 879) took 3168 ms. Trace:
W20260616 19:52:11.254611 996 leader_election.cc:343] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.256564 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b249e29f69943f287411783b84c6817 with delete_type TABLET_DATA_DELETED (replaced by tablet c3d71d78c92f45f1a6c0af3589026b10) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.262832 1193 rpcz_store.cc:276] 0616 19:52:08.081550 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.081596 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:11.249717 (+3168121us) ts_tablet_manager.cc:1151] Deleting tablet 10b02ac0fa4744e48529b35a4ca78567
0616 19:52:11.249728 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.249845 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3167947}
W20260616 19:52:11.263394 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 10b02ac0fa4744e48529b35a4ca78567 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10b02ac0fa4744e48529b35a4ca78567 already in progress: creating tablet
I20260616 19:52:11.263803 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 880) took 3181 ms. Trace:
I20260616 19:52:11.266341 1193 rpcz_store.cc:276] 0616 19:52:08.082011 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.082072 (+ 61us) service_pool.cc:224] Handling call
0616 19:52:11.263682 (+3181610us) ts_tablet_manager.cc:1151] Deleting tablet fdb74517ce5443a8bfea100ca364db1d
0616 19:52:11.263693 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.263787 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3181480}
W20260616 19:52:11.266775 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet fdb74517ce5443a8bfea100ca364db1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdb74517ce5443a8bfea100ca364db1d already in progress: creating tablet
I20260616 19:52:11.267131 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 881) took 3128 ms. Trace:
I20260616 19:52:11.267195 1193 rpcz_store.cc:276] 0616 19:52:08.138707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.138764 (+ 57us) service_pool.cc:224] Handling call
0616 19:52:11.267014 (+3128250us) ts_tablet_manager.cc:1151] Deleting tablet 7e2fb4a0198342edaf87eb1b1f6406fb
0616 19:52:11.267023 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.267105 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3124605}
W20260616 19:52:11.267571 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 7e2fb4a0198342edaf87eb1b1f6406fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e2fb4a0198342edaf87eb1b1f6406fb already in progress: creating tablet
I20260616 19:52:11.268362 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 883) took 3126 ms. Trace:
I20260616 19:52:11.268432 1193 rpcz_store.cc:276] 0616 19:52:08.141601 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.141660 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:11.268268 (+3126608us) ts_tablet_manager.cc:1151] Deleting tablet 9fd39dba6d6f4ff892bfd0ff462b74bd
0616 19:52:11.268276 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.268348 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3125752}
W20260616 19:52:11.268839 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 9fd39dba6d6f4ff892bfd0ff462b74bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fd39dba6d6f4ff892bfd0ff462b74bd already in progress: creating tablet
I20260616 19:52:11.269639 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 769) took 4808 ms. Trace:
I20260616 19:52:11.269737 1190 rpcz_store.cc:276] 0616 19:52:06.461534 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.461826 (+ 292us) service_pool.cc:224] Handling call
0616 19:52:10.941174 (+4479348us) ts_tablet_manager.cc:1151] Deleting tablet cf136fa86c264f69a1703596cfd0e77a
0616 19:52:10.941182 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.168532 (+227350us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.235181 (+ 66649us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.269594 (+ 34413us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4479237}
I20260616 19:52:11.270166 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet cf136fa86c264f69a1703596cfd0e77a (table default.Table_16ebbe6e3c3b4fd185b78b20b1098bd5 [id=6cd87cc1155f42719f9c324c487799ff]) successfully deleted
I20260616 19:52:11.270840 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 777) took 4674 ms. Trace:
I20260616 19:52:11.270920 1190 rpcz_store.cc:276] 0616 19:52:06.596477 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.597273 (+ 796us) service_pool.cc:224] Handling call
0616 19:52:11.270658 (+4673385us) ts_tablet_manager.cc:1151] Deleting tablet 0d8b9d6b95a74dbe97461b4bc9984fe3
0616 19:52:11.270667 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.270807 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7872,"tablet-delete.queue_time_us":4673196}
W20260616 19:52:11.271426 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 already in progress: creating tablet
I20260616 19:52:11.273787 1198 tablet_bootstrap.cc:492] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:11.273918 1198 ts_tablet_manager.cc:1403] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.112s user 0.002s sys 0.004s
I20260616 19:52:11.277716 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 882) took 3136 ms. Trace:
I20260616 19:52:11.277801 1193 rpcz_store.cc:276] 0616 19:52:08.140763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.140830 (+ 67us) service_pool.cc:224] Handling call
0616 19:52:11.277593 (+3136763us) ts_tablet_manager.cc:1151] Deleting tablet 1eacae5ee28947a9a4fb2315165c4df2
0616 19:52:11.277604 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.277696 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3135028}
W20260616 19:52:11.278375 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1eacae5ee28947a9a4fb2315165c4df2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1eacae5ee28947a9a4fb2315165c4df2 already in progress: creating tablet
I20260616 19:52:11.278987 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 888) took 2782 ms. Trace:
I20260616 19:52:11.279058 1193 rpcz_store.cc:276] 0616 19:52:08.496205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.496407 (+ 202us) service_pool.cc:224] Handling call
0616 19:52:11.278361 (+2781954us) ts_tablet_manager.cc:1151] Deleting tablet 966fabee5ae34c5da6a35d74caef244f
0616 19:52:11.278372 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.278971 (+ 599us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2781713}
W20260616 19:52:11.279443 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 966fabee5ae34c5da6a35d74caef244f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 966fabee5ae34c5da6a35d74caef244f already in progress: creating tablet
I20260616 19:52:11.280391 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 778) took 4683 ms. Trace:
I20260616 19:52:11.280582 1190 rpcz_store.cc:276] 0616 19:52:06.596559 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.601108 (+ 4549us) service_pool.cc:224] Handling call
0616 19:52:11.280226 (+4679118us) ts_tablet_manager.cc:1151] Deleting tablet 613c869d4ac84ee0aa952718ba74917b
0616 19:52:11.280237 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.280346 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4740,"tablet-delete.queue_time_us":4678953}
W20260616 19:52:11.281019 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 613c869d4ac84ee0aa952718ba74917b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 613c869d4ac84ee0aa952718ba74917b already in progress: creating tablet
I20260616 19:52:11.254848 996 leader_election.cc:304] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:11.282083 1198 raft_consensus.cc:359] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.283903 1198 raft_consensus.cc:385] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.283965 1198 raft_consensus.cc:740] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.284199 1198 consensus_queue.cc:260] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.284950 1198 ts_tablet_manager.cc:1434] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260616 19:52:11.285672 1198 tablet_bootstrap.cc:492] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:11.287184 2279 raft_consensus.cc:2749] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:11.287413 1192 tablet_bootstrap.cc:492] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:11.287550 1192 ts_tablet_manager.cc:1403] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.082s user 0.004s sys 0.001s
I20260616 19:52:11.288403 1192 raft_consensus.cc:359] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.288611 1192 raft_consensus.cc:385] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.288699 1192 raft_consensus.cc:740] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.288957 1192 consensus_queue.cc:260] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.301072 1192 ts_tablet_manager.cc:1434] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260616 19:52:11.303047 1192 tablet_bootstrap.cc:492] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:11.305140 2067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: Bootstrap replayed 1/1 log segments. Stats: ops{read=550 overwritten=0 applied=516 ignored=0} inserts{seen=476 ignored=0} mutations{seen=603 ignored=0} orphaned_commits=0. Pending: 34 replicates
I20260616 19:52:11.306008 2067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: Bootstrap complete.
I20260616 19:52:11.312203 2195 raft_consensus.cc:493] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.312364 2195 raft_consensus.cc:515] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.313061 2195 leader_election.cc:290] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:11.314456 860 leader_election.cc:343] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 73a754c728b5408eb47f91de93554ec5
I20260616 19:52:11.314046 2067 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Replica starting. Triggering 34 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
W20260616 19:52:11.315515 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b127b94a7e948798efc4e93512dc691 consensus state has no leader
W20260616 19:52:11.317754 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 733f956d45d84506bfb666832a9aaedf consensus state has no leader
I20260616 19:52:11.331135 2067 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8fb7a8523741a2b7a5e75d8b415be0, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.335498 2067 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 516, Last appended: 2.550, Last appended by leader: 550, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:52:11.367863 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 889) took 2871 ms. Trace:
I20260616 19:52:11.528550 1193 rpcz_store.cc:276] 0616 19:52:08.496346 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.496700 (+ 354us) service_pool.cc:224] Handling call
0616 19:52:11.367714 (+2871014us) ts_tablet_manager.cc:1151] Deleting tablet 9614f1b2704749c1a4590303c7efc1d8
0616 19:52:11.367727 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.367840 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2870876}
I20260616 19:52:11.358583 1191 ts_tablet_manager.cc:1929] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:11.529004 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 890) took 2989 ms. Trace:
I20260616 19:52:11.529060 1191 log.cc:1199] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/cf136fa86c264f69a1703596cfd0e77a
I20260616 19:52:11.529083 1193 rpcz_store.cc:276] 0616 19:52:08.539594 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.539742 (+ 148us) service_pool.cc:224] Handling call
0616 19:52:11.528856 (+2989114us) ts_tablet_manager.cc:1151] Deleting tablet 2f1e12555be64192860eab59b3aeb562
0616 19:52:11.528869 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.528985 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2988924}
I20260616 19:52:11.529367 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 891) took 2980 ms. Trace:
I20260616 19:52:11.529451 1191 ts_tablet_manager.cc:1950] T cf136fa86c264f69a1703596cfd0e77a P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:11.529424 1193 rpcz_store.cc:276] 0616 19:52:08.549097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.549175 (+ 78us) service_pool.cc:224] Handling call
0616 19:52:11.529277 (+2980102us) ts_tablet_manager.cc:1151] Deleting tablet 733f4f262ed64a01a5f5f4c68ba37872
0616 19:52:11.529284 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.529355 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2979875}
I20260616 19:52:11.529621 1193 tablet_replica.cc:333] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:11.529783 1193 raft_consensus.cc:2243] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:11.529930 1193 raft_consensus.cc:2272] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:11.530092 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 788) took 5071 ms. Trace:
I20260616 19:52:11.530164 1191 rpcz_store.cc:276] 0616 19:52:06.458830 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.459223 (+ 393us) service_pool.cc:224] Handling call
0616 19:52:11.031655 (+4572432us) ts_tablet_manager.cc:1151] Deleting tablet cf136fa86c264f69a1703596cfd0e77a
0616 19:52:11.031666 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.206080 (+174414us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.358523 (+152443us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.530076 (+171553us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4572261}
I20260616 19:52:11.530473 1193 ts_tablet_manager.cc:1916] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.530567 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 800) took 4922 ms. Trace:
I20260616 19:52:11.530622 1191 rpcz_store.cc:276] 0616 19:52:06.607768 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.607824 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:11.530451 (+4922627us) ts_tablet_manager.cc:1151] Deleting tablet 2171eb55560f44dd91ad52e0b5b49408
0616 19:52:11.530464 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.530554 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4922391}
I20260616 19:52:11.530933 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 797) took 4923 ms. Trace:
I20260616 19:52:11.530982 1191 rpcz_store.cc:276] 0616 19:52:06.607489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.619701 (+ 12212us) service_pool.cc:224] Handling call
0616 19:52:11.530841 (+4911140us) ts_tablet_manager.cc:1151] Deleting tablet 0d8b9d6b95a74dbe97461b4bc9984fe3
0616 19:52:11.530850 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.530914 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4910984}
I20260616 19:52:11.531246 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 798) took 4923 ms. Trace:
I20260616 19:52:11.531308 1191 rpcz_store.cc:276] 0616 19:52:06.607594 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.619924 (+ 12330us) service_pool.cc:224] Handling call
0616 19:52:11.531166 (+4911242us) ts_tablet_manager.cc:1151] Deleting tablet 613c869d4ac84ee0aa952718ba74917b
0616 19:52:11.531173 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.531232 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4911139}
I20260616 19:52:11.531597 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 799) took 4923 ms. Trace:
I20260616 19:52:11.531652 1191 rpcz_store.cc:276] 0616 19:52:06.607690 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.620050 (+ 12360us) service_pool.cc:224] Handling call
0616 19:52:11.531513 (+4911463us) ts_tablet_manager.cc:1151] Deleting tablet c30900c999934b17bab83a54944e4ddf
0616 19:52:11.531521 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.531583 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4911347}
I20260616 19:52:11.531865 1191 tablet_replica.cc:333] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:11.532037 1191 raft_consensus.cc:2243] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:11.532145 1191 raft_consensus.cc:2272] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:11.367600 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd7a70654d8e46fba2bd837a64af9064 consensus state has no leader
I20260616 19:52:11.362723 1198 tablet_bootstrap.cc:654] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.362703 1036 tablet_service.cc:1511] Processing CreateTablet for tablet fd82851896c14b1181864bb19827ced3 (DEFAULT_TABLE table=default.Table_82583d6aa4374c5abcc1925437af30ee [id=3ce050f060494a10b0d0600aec706b92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.533627 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd82851896c14b1181864bb19827ced3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.535071 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3afcb15aef0649c4953a07a0d5b2cb34" } new_table_name: "default.Table_69c1ff37830a4442b0f2b0daf5e92e6d" modify_external_catalogs: true
I20260616 19:52:11.340926 2353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:52:11.536273 2353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:52:11.337500 2195 raft_consensus.cc:493] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.338022 889 tablet_service.cc:1511] Processing CreateTablet for tablet fdbda1b60df64a90af0e28f818a0c29e (DEFAULT_TABLE table=default.Table_940fc810caf149278afeaf466865440a [id=28817d3b482d4089933489c17ee4e78c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.385598 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c35e4c8e9304e798c9031469877b70e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:11.339270 1192 tablet_bootstrap.cc:654] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.536794 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbda1b60df64a90af0e28f818a0c29e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:11.375314 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd020407d4f8470e99045206ca16c6d2 consensus state has no leader
I20260616 19:52:11.537284 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6b844c4a5e574d50b5009e9808740cda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:11.537793 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b844c4a5e574d50b5009e9808740cda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.538262 1192 tablet_bootstrap.cc:492] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:11.538373 1192 ts_tablet_manager.cc:1403] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.236s user 0.002s sys 0.002s
I20260616 19:52:11.343322 2067 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: configured and running, proceeding with master startup.
I20260616 19:52:11.539067 1192 raft_consensus.cc:359] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.539227 1192 raft_consensus.cc:385] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.539271 1192 raft_consensus.cc:740] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.363260 1039 tablet_service.cc:1511] Processing CreateTablet for tablet fdbda1b60df64a90af0e28f818a0c29e (DEFAULT_TABLE table=default.Table_940fc810caf149278afeaf466865440a [id=28817d3b482d4089933489c17ee4e78c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:11.383363 719 leader_election.cc:343] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 6cc988a195ec4bbf8691801421fed8bb
I20260616 19:52:11.543382 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbda1b60df64a90af0e28f818a0c29e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.543442 719 leader_election.cc:304] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:11.543676 1908 raft_consensus.cc:3060] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:11.543747 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 160385us
I20260616 19:52:11.377256 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_92ba13ce312d41f29620ddcca694a28d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:11.545105 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92ba13ce312d41f29620ddcca694a28d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.408340 1972 raft_consensus.cc:1217] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.514->[2.515-2.961] Dedup: 2.550->[2.551-2.961]
I20260616 19:52:11.546275 1908 raft_consensus.cc:2749] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:11.378376 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_aab4483460054e109ca794c6ee40add1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:11.546749 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aab4483460054e109ca794c6ee40add1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.539425 1192 consensus_queue.cc:260] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.339648 904 tablet_service.cc:1511] Processing CreateTablet for tablet 59dbf72f58d74c269eed40e480d869ec (DEFAULT_TABLE table=default.Table_88539f40d59d4e51ac2000dd59eee749 [id=7eb3b93072ec41468a04efcb42aca43b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.547401 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59dbf72f58d74c269eed40e480d869ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.547438 1192 ts_tablet_manager.cc:1434] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260616 19:52:11.380740 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_77fdcd738d884951bfea81e0e2265982"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:11.547715 1192 tablet_bootstrap.cc:492] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:52:11.547943 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77fdcd738d884951bfea81e0e2265982 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.363684 1031 tablet_service.cc:1511] Processing CreateTablet for tablet edb4db63418d46e0942241c0a6c0c7fc (DEFAULT_TABLE table=default.Table_12dd6ee353994f578f73b458e9b4d5e9 [id=0286b148a5204a488a5c839203279ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.429544 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet aa989f24b81b4c148069d1d8176dad8b
I20260616 19:52:11.548849 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb4db63418d46e0942241c0a6c0c7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.549443 1192 tablet_bootstrap.cc:654] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.551801 452 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 4d3f47e767764032ae5a06e34e2de248 (table default.Table_1516f5dc3b2b4de48c2c4076d1cb1205 [id=af4aada43ecf46b8bacf0d9d1388e92e]). Expected version 1 got 0
I20260616 19:52:11.339900 896 tablet_service.cc:1511] Processing CreateTablet for tablet d1320de936ef4bfead3921e03c574fae (DEFAULT_TABLE table=default.Table_5755f8bd67c64fe0bda9b32e30a326c9 [id=28f28617dbbe4481b0c47cf9ba967b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.429795 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 89432adb0a4b442bbc5e46ee43a3e1b2
I20260616 19:52:11.387840 751 tablet_service.cc:1511] Processing CreateTablet for tablet c3d71d78c92f45f1a6c0af3589026b10 (DEFAULT_TABLE table=default.Table_838d3611ece94aee9524fc9a2d485353 [id=eb0ea3ba9ba04c76b890aac44b32c082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.552732 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1320de936ef4bfead3921e03c574fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.553001 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d71d78c92f45f1a6c0af3589026b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.553169 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c7a80871babd4a3a98abd7eb593b3fa4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:11.553639 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7a80871babd4a3a98abd7eb593b3fa4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.430002 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet df1ee0d1e1514c86802cdce5ae0756eb
I20260616 19:52:11.555078 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8bc1bce7c32848eca622d264e538c55d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:11.555519 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bc1bce7c32848eca622d264e538c55d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.429795 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c204a0af6eac4bc2897b48be50070860
I20260616 19:52:11.445369 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 49ab6193c479400da00e1fa80a5274a2
I20260616 19:52:11.340065 899 tablet_service.cc:1511] Processing CreateTablet for tablet edb4db63418d46e0942241c0a6c0c7fc (DEFAULT_TABLE table=default.Table_12dd6ee353994f578f73b458e9b4d5e9 [id=0286b148a5204a488a5c839203279ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.556843 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb4db63418d46e0942241c0a6c0c7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.364144 1026 tablet_service.cc:1511] Processing CreateTablet for tablet d1320de936ef4bfead3921e03c574fae (DEFAULT_TABLE table=default.Table_5755f8bd67c64fe0bda9b32e30a326c9 [id=28f28617dbbe4481b0c47cf9ba967b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.557065 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1932c06b086a4a5999bd9df382ca4e09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:11.557333 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1320de936ef4bfead3921e03c574fae. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:11.557508 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1932c06b086a4a5999bd9df382ca4e09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.558825 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c232a13fb3a34692a151a6cf74da9ae3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:11.559229 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c232a13fb3a34692a151a6cf74da9ae3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.340217 887 tablet_service.cc:1511] Processing CreateTablet for tablet fd82851896c14b1181864bb19827ced3 (DEFAULT_TABLE table=default.Table_82583d6aa4374c5abcc1925437af30ee [id=3ce050f060494a10b0d0600aec706b92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.560755 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd82851896c14b1181864bb19827ced3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.560978 888 tablet_service.cc:1558] Processing DeleteTablet for tablet aa989f24b81b4c148069d1d8176dad8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:10 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.561177 900 tablet_service.cc:1558] Processing DeleteTablet for tablet df1ee0d1e1514c86802cdce5ae0756eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:10 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.561369 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 49ab6193c479400da00e1fa80a5274a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.541976 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet cf136fa86c264f69a1703596cfd0e77a (table default.Table_16ebbe6e3c3b4fd185b78b20b1098bd5 [id=6cd87cc1155f42719f9c324c487799ff]) successfully deleted
W20260616 19:52:11.542418 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 9614f1b2704749c1a4590303c7efc1d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9614f1b2704749c1a4590303c7efc1d8 already in progress: creating tablet
W20260616 19:52:11.561676 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2171eb55560f44dd91ad52e0b5b49408 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2171eb55560f44dd91ad52e0b5b49408 already in progress: creating tablet
W20260616 19:52:11.561728 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 2f1e12555be64192860eab59b3aeb562 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f1e12555be64192860eab59b3aeb562 already in progress: creating tablet
W20260616 19:52:11.561892 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 already in progress: creating tablet
W20260616 19:52:11.561957 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 733f4f262ed64a01a5f5f4c68ba37872 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 733f4f262ed64a01a5f5f4c68ba37872 already in progress: creating tablet
W20260616 19:52:11.562060 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 613c869d4ac84ee0aa952718ba74917b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 613c869d4ac84ee0aa952718ba74917b already in progress: creating tablet
I20260616 19:52:11.388223 746 tablet_service.cc:1511] Processing CreateTablet for tablet 59dbf72f58d74c269eed40e480d869ec (DEFAULT_TABLE table=default.Table_88539f40d59d4e51ac2000dd59eee749 [id=7eb3b93072ec41468a04efcb42aca43b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:11.562243 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c30900c999934b17bab83a54944e4ddf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c30900c999934b17bab83a54944e4ddf already in progress: creating tablet
I20260616 19:52:11.562518 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59dbf72f58d74c269eed40e480d869ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.563330 763 tablet_service.cc:1558] Processing DeleteTablet for tablet c204a0af6eac4bc2897b48be50070860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.563395 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 89432adb0a4b442bbc5e46ee43a3e1b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:10 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.563565 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 49ab6193c479400da00e1fa80a5274a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.563331 762 tablet_service.cc:1558] Processing DeleteTablet for tablet aa989f24b81b4c148069d1d8176dad8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:10 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.342195 893 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8ee572626a42909f31874a55b5cbb6 (DEFAULT_TABLE table=default.Table_4a8217e50ef644eca9671056b7d93ea5 [id=4332d3a52cbe407f93994b09d4abafac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.367023 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 59dbf72f58d74c269eed40e480d869ec (DEFAULT_TABLE table=default.Table_88539f40d59d4e51ac2000dd59eee749 [id=7eb3b93072ec41468a04efcb42aca43b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.564734 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8ee572626a42909f31874a55b5cbb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.565028 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59dbf72f58d74c269eed40e480d869ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.565486 886 tablet_service.cc:1558] Processing DeleteTablet for tablet c204a0af6eac4bc2897b48be50070860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.567831 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cc988a195ec4bbf8691801421fed8bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.568089 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 89432adb0a4b442bbc5e46ee43a3e1b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:10 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.388511 758 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8ee572626a42909f31874a55b5cbb6 (DEFAULT_TABLE table=default.Table_4a8217e50ef644eca9671056b7d93ea5 [id=4332d3a52cbe407f93994b09d4abafac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.568545 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8ee572626a42909f31874a55b5cbb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.568575 754 tablet_service.cc:1558] Processing DeleteTablet for tablet df1ee0d1e1514c86802cdce5ae0756eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:10 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.570981 1193 ts_tablet_manager.cc:1929] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:11.571067 1193 log.cc:1199] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/65b0dc43b40649f29037f40d2ea9247e
I20260616 19:52:11.571383 1193 ts_tablet_manager.cc:1950] T 65b0dc43b40649f29037f40d2ea9247e P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:11.345484 885 tablet_service.cc:1511] Processing CreateTablet for tablet 277085ae6c9e4af4a072d669c18ae4da (DEFAULT_TABLE table=default.Table_a585dc2cbde74ec68c6abe440508eb07 [id=9a46f931644b46239d21f24a892236ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.572810 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277085ae6c9e4af4a072d669c18ae4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.574427 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 892) took 2997 ms. Trace:
I20260616 19:52:11.574626 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ea877235c11b47e9b05186321e824f1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:11.576036 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea877235c11b47e9b05186321e824f1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.367344 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8ee572626a42909f31874a55b5cbb6 (DEFAULT_TABLE table=default.Table_4a8217e50ef644eca9671056b7d93ea5 [id=4332d3a52cbe407f93994b09d4abafac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.577059 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8ee572626a42909f31874a55b5cbb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.574497 1193 rpcz_store.cc:276] 0616 19:52:08.576807 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.576851 (+ 44us) service_pool.cc:224] Handling call
0616 19:52:11.529586 (+2952735us) ts_tablet_manager.cc:1151] Deleting tablet 65b0dc43b40649f29037f40d2ea9247e
0616 19:52:11.529593 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.558311 (+ 28718us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.570939 (+ 12628us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.574408 (+ 3469us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2952571}
I20260616 19:52:11.580374 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 65b0dc43b40649f29037f40d2ea9247e (table default.Table_8fff86d5c2344e2fb59db9872ee90b74 [id=06f5d602dcec42a884b5eb53f9d0a27c]) successfully deleted
I20260616 19:52:11.388916 756 tablet_service.cc:1511] Processing CreateTablet for tablet 8c78e3d1b9614a1b9b4bf9180903fd91 (DEFAULT_TABLE table=default.Table_a8354e2f3e934d6ea13177ddeaec7732 [id=afc94e8ffc364174b265fad7f2235164]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.580781 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c78e3d1b9614a1b9b4bf9180903fd91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.581517 1193 tablet_replica.cc:333] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:11.581687 1193 raft_consensus.cc:2243] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:11.582001 1193 raft_consensus.cc:2272] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:11.582515 1193 ts_tablet_manager.cc:1916] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.347782 898 tablet_service.cc:1511] Processing CreateTablet for tablet c3d71d78c92f45f1a6c0af3589026b10 (DEFAULT_TABLE table=default.Table_838d3611ece94aee9524fc9a2d485353 [id=eb0ea3ba9ba04c76b890aac44b32c082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.358264 2323 raft_consensus.cc:493] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:52:11.364152 858 leader_election.cc:343] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 73a754c728b5408eb47f91de93554ec5
I20260616 19:52:11.368222 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 779) took 4771 ms. Trace:
I20260616 19:52:11.584595 2323 raft_consensus.cc:515] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.374257 897 tablet_service.cc:1558] Processing DeleteTablet for tablet cbd1070277a14fd98af5fa45925e4f0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.584759 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d71d78c92f45f1a6c0af3589026b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.376626 901 tablet_service.cc:1558] Processing DeleteTablet for tablet aabf57dd6d704645b6bf97b730dbe964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.376820 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 47b548b6b7f746fe9fd67c2e6563e961 with delete_type TABLET_DATA_DELETED (replaced by tablet bcc5116ef5df4140a96f03c003337c68) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.448280 2242 raft_consensus.cc:493] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.585021 2242 raft_consensus.cc:515] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.585249 2323 leader_election.cc:290] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:11.585530 2242 leader_election.cc:290] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:11.584679 858 leader_election.cc:304] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
W20260616 19:52:11.585969 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 221835us
I20260616 19:52:11.588608 2297 raft_consensus.cc:2749] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:11.367623 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 277085ae6c9e4af4a072d669c18ae4da (DEFAULT_TABLE table=default.Table_a585dc2cbde74ec68c6abe440508eb07 [id=9a46f931644b46239d21f24a892236ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.367897 1027 tablet_service.cc:1511] Processing CreateTablet for tablet c3d71d78c92f45f1a6c0af3589026b10 (DEFAULT_TABLE table=default.Table_838d3611ece94aee9524fc9a2d485353 [id=eb0ea3ba9ba04c76b890aac44b32c082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.372592 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:52:11.589134 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277085ae6c9e4af4a072d669c18ae4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.589300 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d71d78c92f45f1a6c0af3589026b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.389206 749 tablet_service.cc:1511] Processing CreateTablet for tablet edb4db63418d46e0942241c0a6c0c7fc (DEFAULT_TABLE table=default.Table_12dd6ee353994f578f73b458e9b4d5e9 [id=0286b148a5204a488a5c839203279ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.589708 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb4db63418d46e0942241c0a6c0c7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.500340 890 tablet_service.cc:1511] Processing CreateTablet for tablet d1cdb8a6af2c41d19e02086550b64b45 (DEFAULT_TABLE table=default.Table_e7524e978a4d44589fe23bb6f394e922 [id=21ffa193cb434eb7a6639c452b905aba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.584677 1190 rpcz_store.cc:276] 0616 19:52:06.596638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.601287 (+ 4649us) service_pool.cc:224] Handling call
0616 19:52:11.368077 (+4766790us) ts_tablet_manager.cc:1151] Deleting tablet c30900c999934b17bab83a54944e4ddf
0616 19:52:11.368088 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.368172 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4633,"tablet-delete.queue_time_us":4766643}
I20260616 19:52:11.592805 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1cdb8a6af2c41d19e02086550b64b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.593007 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 780) took 4996 ms. Trace:
I20260616 19:52:11.593075 1190 rpcz_store.cc:276] 0616 19:52:06.596717 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.601445 (+ 4728us) service_pool.cc:224] Handling call
0616 19:52:11.592877 (+4991432us) ts_tablet_manager.cc:1151] Deleting tablet 2171eb55560f44dd91ad52e0b5b49408
0616 19:52:11.592885 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.592988 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4533,"tablet-delete.queue_time_us":4991315}
I20260616 19:52:11.593410 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 786) took 4911 ms. Trace:
I20260616 19:52:11.593472 1190 rpcz_store.cc:276] 0616 19:52:06.681853 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.685030 (+ 3177us) service_pool.cc:224] Handling call
0616 19:52:11.593321 (+4908291us) ts_tablet_manager.cc:1151] Deleting tablet d6707acac4ee4283b138fb44e4e82ce5
0616 19:52:11.593328 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.593397 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4908110}
I20260616 19:52:11.593724 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 796) took 4761 ms. Trace:
I20260616 19:52:11.593780 1190 rpcz_store.cc:276] 0616 19:52:06.832134 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.832200 (+ 66us) service_pool.cc:224] Handling call
0616 19:52:11.593644 (+4761444us) ts_tablet_manager.cc:1151] Deleting tablet 26b044bb36c84f64a32c774515a339c4
0616 19:52:11.593651 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.593711 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4761236}
I20260616 19:52:11.594024 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 797) took 4757 ms. Trace:
I20260616 19:52:11.594076 1190 rpcz_store.cc:276] 0616 19:52:06.836389 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.836444 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:11.593946 (+4757502us) ts_tablet_manager.cc:1151] Deleting tablet a7cc0edadc1948ffbe15febbebb27b45
0616 19:52:11.593954 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.594013 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4757297}
I20260616 19:52:11.594333 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 802) took 4740 ms. Trace:
I20260616 19:52:11.594394 1190 rpcz_store.cc:276] 0616 19:52:06.853994 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.856522 (+ 2528us) service_pool.cc:224] Handling call
0616 19:52:11.594250 (+4737728us) ts_tablet_manager.cc:1151] Deleting tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7
0616 19:52:11.594257 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.594318 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4737559}
I20260616 19:52:11.594640 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 805) took 4723 ms. Trace:
I20260616 19:52:11.594691 1190 rpcz_store.cc:276] 0616 19:52:06.870938 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.870994 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:11.594567 (+4723573us) ts_tablet_manager.cc:1151] Deleting tablet d7c3e760d24247a5bc2b17a610ff49dc
0616 19:52:11.594575 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.594629 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4723368}
I20260616 19:52:11.594944 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 807) took 4687 ms. Trace:
I20260616 19:52:11.595002 1190 rpcz_store.cc:276] 0616 19:52:06.907294 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.907346 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:11.594851 (+4687505us) ts_tablet_manager.cc:1151] Deleting tablet d522cc4b346241d1bac695f9a1d40fbb
0616 19:52:11.594858 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.594921 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4687302}
I20260616 19:52:11.595248 1190 tablet_replica.cc:333] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:11.595402 1190 raft_consensus.cc:2243] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:11.595548 1190 raft_consensus.cc:2272] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:11.596171 1190 ts_tablet_manager.cc:1916] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.374953 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 8c78e3d1b9614a1b9b4bf9180903fd91 (DEFAULT_TABLE table=default.Table_a8354e2f3e934d6ea13177ddeaec7732 [id=afc94e8ffc364174b265fad7f2235164]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.596801 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c78e3d1b9614a1b9b4bf9180903fd91. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:11.598011 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c30900c999934b17bab83a54944e4ddf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c30900c999934b17bab83a54944e4ddf already in progress: creating tablet
W20260616 19:52:11.598361 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 2171eb55560f44dd91ad52e0b5b49408 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2171eb55560f44dd91ad52e0b5b49408 already in progress: creating tablet
W20260616 19:52:11.598567 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d6707acac4ee4283b138fb44e4e82ce5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6707acac4ee4283b138fb44e4e82ce5 already in progress: creating tablet
W20260616 19:52:11.598780 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 26b044bb36c84f64a32c774515a339c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26b044bb36c84f64a32c774515a339c4 already in progress: creating tablet
W20260616 19:52:11.599004 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a7cc0edadc1948ffbe15febbebb27b45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7cc0edadc1948ffbe15febbebb27b45 already in progress: creating tablet
W20260616 19:52:11.599225 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7 already in progress: creating tablet
W20260616 19:52:11.599429 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d7c3e760d24247a5bc2b17a610ff49dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7c3e760d24247a5bc2b17a610ff49dc already in progress: creating tablet
W20260616 19:52:11.599643 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d522cc4b346241d1bac695f9a1d40fbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d522cc4b346241d1bac695f9a1d40fbb already in progress: creating tablet
I20260616 19:52:11.389619 764 tablet_service.cc:1511] Processing CreateTablet for tablet fdbda1b60df64a90af0e28f818a0c29e (DEFAULT_TABLE table=default.Table_940fc810caf149278afeaf466865440a [id=28817d3b482d4089933489c17ee4e78c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.600746 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbda1b60df64a90af0e28f818a0c29e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.601939 1193 ts_tablet_manager.cc:1929] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:11.602339 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf57dd6d704645b6bf97b730dbe964" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:11.602540 1056 raft_consensus.cc:2468] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:11.503219 903 tablet_service.cc:1511] Processing CreateTablet for tablet 8f0c470bb3294342bd2f0a1302cb51ec (DEFAULT_TABLE table=default.Table_f608b05a8839481680d93f4e7797cd8c [id=d2800198e1db42108396b277e42d5a11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.522284 2285 raft_consensus.cc:493] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.604570 2285 raft_consensus.cc:515] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.604729 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0c470bb3294342bd2f0a1302cb51ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.605188 2285 leader_election.cc:290] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:11.339444 902 tablet_service.cc:1511] Processing CreateTablet for tablet 8c78e3d1b9614a1b9b4bf9180903fd91 (DEFAULT_TABLE table=default.Table_a8354e2f3e934d6ea13177ddeaec7732 [id=afc94e8ffc364174b265fad7f2235164]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.605520 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c78e3d1b9614a1b9b4bf9180903fd91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.606818 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b548b6b7f746fe9fd67c2e6563e961" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:11.606972 1056 raft_consensus.cc:2468] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:11.541574 2195 raft_consensus.cc:515] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.392989 2296 raft_consensus.cc:493] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.608584 2296 raft_consensus.cc:515] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.608932 2195 leader_election.cc:290] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:11.609149 2296 leader_election.cc:290] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:11.393770 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 102f322eb98f4224acb8637f8c29ac19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.500141 1033 tablet_service.cc:1511] Processing CreateTablet for tablet d1cdb8a6af2c41d19e02086550b64b45 (DEFAULT_TABLE table=default.Table_e7524e978a4d44589fe23bb6f394e922 [id=21ffa193cb434eb7a6639c452b905aba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.610890 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1cdb8a6af2c41d19e02086550b64b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.611382 858 leader_election.cc:304] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:11.611613 858 leader_election.cc:304] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:52:11.611825 858 leader_election.cc:343] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: fbb308b05bb04bc18ccaa9550a73d3e7
W20260616 19:52:11.611961 858 leader_election.cc:343] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: e91c377ae66441268351cd3592aa9dbc
I20260616 19:52:11.502233 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 8f0c470bb3294342bd2f0a1302cb51ec (DEFAULT_TABLE table=default.Table_f608b05a8839481680d93f4e7797cd8c [id=d2800198e1db42108396b277e42d5a11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.616122 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0c470bb3294342bd2f0a1302cb51ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:11.541721 996 leader_election.cc:343] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.616859 996 leader_election.cc:304] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:11.617159 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 75448.5us
I20260616 19:52:11.618409 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet d5c82b71969e4cbcb890d16e1cdd5348 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.618759 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet c204a0af6eac4bc2897b48be50070860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.619026 2287 raft_consensus.cc:2749] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:11.619463 2195 raft_consensus.cc:2804] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:11.619549 2195 raft_consensus.cc:493] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:11.619611 2195 raft_consensus.cc:3060] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:11.620375 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 89432adb0a4b442bbc5e46ee43a3e1b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:10 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.620865 1190 ts_tablet_manager.cc:1929] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:11.620955 1190 log.cc:1199] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/a170db3d27fd40c1b74deab29e9a033f
I20260616 19:52:11.620539 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 49ab6193c479400da00e1fa80a5274a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.620018 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet df1ee0d1e1514c86802cdce5ae0756eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:10 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.621245 1190 ts_tablet_manager.cc:1950] T a170db3d27fd40c1b74deab29e9a033f P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:11.621738 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c82b71969e4cbcb890d16e1cdd5348" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:11.619938 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet aa989f24b81b4c148069d1d8176dad8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:10 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.622109 2195 raft_consensus.cc:515] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.622627 2195 leader_election.cc:290] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:11.622766 2195 raft_consensus.cc:2804] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:11.622824 2195 raft_consensus.cc:493] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:11.622879 2195 raft_consensus.cc:3060] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:11.625051 993 leader_election.cc:343] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.631081 1198 tablet_bootstrap.cc:492] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:11.631211 1198 ts_tablet_manager.cc:1403] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.346s user 0.001s sys 0.002s
I20260616 19:52:11.631880 1198 raft_consensus.cc:359] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.632061 1198 raft_consensus.cc:385] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.632117 1198 raft_consensus.cc:740] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.632177 2195 raft_consensus.cc:515] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:11.635170 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a889b7dea504e8192d1c81a79a975dd consensus state has no leader
I20260616 19:52:11.637251 2242 raft_consensus.cc:493] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.637393 2242 raft_consensus.cc:515] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.637885 2242 leader_election.cc:290] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:11.637249 2195 leader_election.cc:290] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:11.642071 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf57dd6d704645b6bf97b730dbe964" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:11.632349 1198 consensus_queue.cc:260] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.642220 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b548b6b7f746fe9fd67c2e6563e961" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:11.642331 1056 raft_consensus.cc:3060] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:11.642361 1059 raft_consensus.cc:3060] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:11.642700 1198 ts_tablet_manager.cc:1434] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260616 19:52:11.645138 1059 raft_consensus.cc:2468] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:11.645300 1056 raft_consensus.cc:2468] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:11.645838 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 814) took 4635 ms. Trace:
I20260616 19:52:11.645929 1190 rpcz_store.cc:276] 0616 19:52:07.010872 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.010927 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:11.595183 (+4584256us) ts_tablet_manager.cc:1151] Deleting tablet a170db3d27fd40c1b74deab29e9a033f
0616 19:52:11.595220 (+ 37us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.613657 (+ 18437us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.620812 (+ 7155us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.645739 (+ 24927us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x61800000ed18. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7c35d49bd 00007fb7c35d5a2e 00007fb7d74251ad 00007fb7d73a41d3 00007fb7d352ff53 00007fb7d3562bb4 00007fb7d35435d0 00007fb7d354335d 0000000000aa681c 00007fb7c3631f6f
0616 19:52:11.645819 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46959360,"tablet-delete.queue_time_us":4584067}
I20260616 19:52:11.646332 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 820) took 4566 ms. Trace:
I20260616 19:52:11.646414 1190 rpcz_store.cc:276] 0616 19:52:07.080083 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.080150 (+ 67us) service_pool.cc:224] Handling call
0616 19:52:11.646226 (+4566076us) ts_tablet_manager.cc:1151] Deleting tablet 272838af35d840faa7b11217456533c2
0616 19:52:11.646236 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.646316 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4461653}
I20260616 19:52:11.646793 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 821) took 4551 ms. Trace:
I20260616 19:52:11.646888 1190 rpcz_store.cc:276] 0616 19:52:07.095355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.095413 (+ 58us) service_pool.cc:224] Handling call
0616 19:52:11.646680 (+4551267us) ts_tablet_manager.cc:1151] Deleting tablet f4095b92df9a422e85e38513e19eabc7
0616 19:52:11.646699 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.646772 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4457205}
I20260616 19:52:11.647217 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 822) took 4547 ms. Trace:
I20260616 19:52:11.647296 1190 rpcz_store.cc:276] 0616 19:52:07.100153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.100210 (+ 57us) service_pool.cc:224] Handling call
0616 19:52:11.647127 (+4546917us) ts_tablet_manager.cc:1151] Deleting tablet f872a8860a4b421483441d71814be4fc
0616 19:52:11.647136 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.647201 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4457535}
I20260616 19:52:11.647614 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 819) took 4570 ms. Trace:
I20260616 19:52:11.647703 1190 rpcz_store.cc:276] 0616 19:52:07.077362 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.080552 (+ 3190us) service_pool.cc:224] Handling call
0616 19:52:11.647525 (+4566973us) ts_tablet_manager.cc:1151] Deleting tablet 6396397965c44e07850a6cc42cefab09
0616 19:52:11.647534 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.647597 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4454675}
I20260616 19:52:11.648016 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 828) took 4482 ms. Trace:
I20260616 19:52:11.648098 1190 rpcz_store.cc:276] 0616 19:52:07.165448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.165512 (+ 64us) service_pool.cc:224] Handling call
0616 19:52:11.647924 (+4482412us) ts_tablet_manager.cc:1151] Deleting tablet cfbc5c9485b94928b6ae9a1f206c9c45
0616 19:52:11.647934 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.648002 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4367628}
I20260616 19:52:11.648399 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 832) took 4330 ms. Trace:
I20260616 19:52:11.390668 757 tablet_service.cc:1511] Processing CreateTablet for tablet fd82851896c14b1181864bb19827ced3 (DEFAULT_TABLE table=default.Table_82583d6aa4374c5abcc1925437af30ee [id=3ce050f060494a10b0d0600aec706b92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.651439 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd82851896c14b1181864bb19827ced3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.646416 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet a170db3d27fd40c1b74deab29e9a033f (table default.Table_b03768997ca94dd897aed95bee7efc2b [id=6ab2bb094a714f089de17dd9c6742619]) successfully deleted
W20260616 19:52:11.652917 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 272838af35d840faa7b11217456533c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 272838af35d840faa7b11217456533c2 already in progress: creating tablet
W20260616 19:52:11.653120 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet f4095b92df9a422e85e38513e19eabc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4095b92df9a422e85e38513e19eabc7 already in progress: creating tablet
W20260616 19:52:11.653741 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet f872a8860a4b421483441d71814be4fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f872a8860a4b421483441d71814be4fc already in progress: creating tablet
W20260616 19:52:11.653966 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 6396397965c44e07850a6cc42cefab09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6396397965c44e07850a6cc42cefab09 already in progress: creating tablet
W20260616 19:52:11.654146 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet cfbc5c9485b94928b6ae9a1f206c9c45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cfbc5c9485b94928b6ae9a1f206c9c45 already in progress: creating tablet
I20260616 19:52:11.405608 747 tablet_service.cc:1511] Processing CreateTablet for tablet 277085ae6c9e4af4a072d669c18ae4da (DEFAULT_TABLE table=default.Table_a585dc2cbde74ec68c6abe440508eb07 [id=9a46f931644b46239d21f24a892236ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.656051 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277085ae6c9e4af4a072d669c18ae4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.656666 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f5e8ac7e1cca41ed936c24c7356a3b78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:11.657233 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5e8ac7e1cca41ed936c24c7356a3b78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.657616 1190 rpcz_store.cc:276] 0616 19:52:07.318396 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.330324 (+ 11928us) service_pool.cc:224] Handling call
0616 19:52:11.648310 (+4317986us) ts_tablet_manager.cc:1151] Deleting tablet 3a4a2f467b5b4121ae9a9973c153c69f
0616 19:52:11.648318 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.648383 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4298695}
I20260616 19:52:11.658360 1191 ts_tablet_manager.cc:1916] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:11.410154 718 consensus_peers.cc:597] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf136fa86c264f69a1703596cfd0e77a. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:11.661952 718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 251829us
I20260616 19:52:11.414734 1196 tablet_bootstrap.cc:492] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:11.663213 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b548b6b7f746fe9fd67c2e6563e961" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:11.663405 1196 ts_tablet_manager.cc:1403] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.602s user 0.002s sys 0.015s
W20260616 19:52:11.663724 860 leader_election.cc:343] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 31592a5ffb04429c9315a4fd72308f28
W20260616 19:52:11.663945 860 leader_election.cc:343] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.664181 1196 raft_consensus.cc:359] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.664326 1196 raft_consensus.cc:385] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.664383 1196 raft_consensus.cc:740] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.664590 1196 consensus_queue.cc:260] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.665066 1196 ts_tablet_manager.cc:1434] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:11.665099 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 834) took 4318 ms. Trace:
I20260616 19:52:11.665365 1196 tablet_bootstrap.cc:492] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:11.667052 1196 tablet_bootstrap.cc:654] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.668249 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf57dd6d704645b6bf97b730dbe964" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:11.668661 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b548b6b7f746fe9fd67c2e6563e961" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:11.668946 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb308b05bb04bc18ccaa9550a73d3e7" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:11.669262 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e91c377ae66441268351cd3592aa9dbc" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:11.669395 783 raft_consensus.cc:2468] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:11.665207 1190 rpcz_store.cc:276] 0616 19:52:07.346632 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.348049 (+ 1417us) service_pool.cc:224] Handling call
0616 19:52:11.664107 (+4316058us) ts_tablet_manager.cc:1151] Deleting tablet b1771a4ed9d649558fed580992af1f96
0616 19:52:11.664118 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.665074 (+ 956us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4314413}
I20260616 19:52:11.669879 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf57dd6d704645b6bf97b730dbe964" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:11.669863 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 835) took 4315 ms. Trace:
I20260616 19:52:11.671443 1190 rpcz_store.cc:276] 0616 19:52:07.354363 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.356629 (+ 2266us) service_pool.cc:224] Handling call
0616 19:52:11.669720 (+4313091us) ts_tablet_manager.cc:1151] Deleting tablet ce114bf2907945889f8f1050d63d3965
0616 19:52:11.669733 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.669842 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4312891}
I20260616 19:52:11.671868 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 836) took 4264 ms. Trace:
I20260616 19:52:11.671942 1190 rpcz_store.cc:276] 0616 19:52:07.407406 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.407956 (+ 550us) service_pool.cc:224] Handling call
0616 19:52:11.671741 (+4263785us) ts_tablet_manager.cc:1151] Deleting tablet db750fc9641f492494fdb167de86f6df
0616 19:52:11.671753 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.671849 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4263561}
I20260616 19:52:11.672264 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 833) took 4351 ms. Trace:
I20260616 19:52:11.672331 1190 rpcz_store.cc:276] 0616 19:52:07.320844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.409121 (+ 88277us) service_pool.cc:224] Handling call
0616 19:52:11.672154 (+4263033us) ts_tablet_manager.cc:1151] Deleting tablet 3fcdc7ae19874ca794ae71d228e6ab27
0616 19:52:11.672163 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.672249 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4262882}
I20260616 19:52:11.672658 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 844) took 4013 ms. Trace:
I20260616 19:52:11.672725 1190 rpcz_store.cc:276] 0616 19:52:07.659535 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.659719 (+ 184us) service_pool.cc:224] Handling call
0616 19:52:11.672558 (+4012839us) ts_tablet_manager.cc:1151] Deleting tablet 990ea67ce4664c27857a15bac92d0d42
0616 19:52:11.672568 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.672642 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4012663}
I20260616 19:52:11.672962 1190 tablet_replica.cc:333] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:11.673161 1190 raft_consensus.cc:2243] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:11.673447 1190 raft_consensus.cc:2272] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:11.500041 759 tablet_service.cc:1511] Processing CreateTablet for tablet d1cdb8a6af2c41d19e02086550b64b45 (DEFAULT_TABLE table=default.Table_e7524e978a4d44589fe23bb6f394e922 [id=21ffa193cb434eb7a6639c452b905aba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.673906 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1cdb8a6af2c41d19e02086550b64b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.674135 1190 ts_tablet_manager.cc:1916] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.674817 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 915267e7ff3c439385a861dfb954b852 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:11.675298 454 master_service.cc:960] ReplaceTablet: received request to replace tablet a20701ab3a5d43df92c471bd6013ac6c from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:11.502090 765 tablet_service.cc:1511] Processing CreateTablet for tablet 8f0c470bb3294342bd2f0a1302cb51ec (DEFAULT_TABLE table=default.Table_f608b05a8839481680d93f4e7797cd8c [id=d2800198e1db42108396b277e42d5a11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.679040 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0c470bb3294342bd2f0a1302cb51ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.680089 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_36702e35975c49f2b9dd011e40692255" } new_table_name: "default.Table_90329eb7dd804622ad9806f2e1af2f10" modify_external_catalogs: true
I20260616 19:52:11.680812 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_587bb493250b4187bd27457037ae32ab" } new_table_name: "default.Table_7ffffaef50044d8ba89e6df198946113" modify_external_catalogs: true
I20260616 19:52:11.682061 459 master_service.cc:960] ReplaceTablet: received request to replace tablet c37aeb69afa040eeb9db1f8bdc60bb99 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:11.389866 755 tablet_service.cc:1511] Processing CreateTablet for tablet d1320de936ef4bfead3921e03c574fae (DEFAULT_TABLE table=default.Table_5755f8bd67c64fe0bda9b32e30a326c9 [id=28f28617dbbe4481b0c47cf9ba967b4e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:11.621219 719 consensus_peers.cc:597] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf136fa86c264f69a1703596cfd0e77a. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:11.684648 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 63477.3us
I20260616 19:52:11.684823 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1320de936ef4bfead3921e03c574fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.620752 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c82b71969e4cbcb890d16e1cdd5348" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:11.685302 2233 consensus_queue.cc:1048] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:11.685734 996 leader_election.cc:343] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.685853 996 leader_election.cc:304] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:11.686329 2296 raft_consensus.cc:2749] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:11.701121 922 raft_consensus.cc:3060] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:11.704661 860 leader_election.cc:343] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:11.704967 860 leader_election.cc:343] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.705116 1190 ts_tablet_manager.cc:1929] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260616 19:52:11.705193 860 leader_election.cc:343] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.705236 1190 log.cc:1199] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/5b34d497f9334e94b06cc9245fca04ed
I20260616 19:52:11.705261 860 leader_election.cc:304] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:11.705585 860 leader_election.cc:304] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:11.705687 1190 ts_tablet_manager.cc:1950] T 5b34d497f9334e94b06cc9245fca04ed P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
W20260616 19:52:11.705989 860 leader_election.cc:343] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.706013 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 845) took 4046 ms. Trace:
I20260616 19:52:11.706080 1190 rpcz_store.cc:276] 0616 19:52:07.659664 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.659925 (+ 261us) service_pool.cc:224] Handling call
0616 19:52:11.672919 (+4012994us) ts_tablet_manager.cc:1151] Deleting tablet 5b34d497f9334e94b06cc9245fca04ed
0616 19:52:11.672927 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.677058 (+ 4131us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.705055 (+ 27997us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.706001 (+ 946us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4012866}
I20260616 19:52:11.706333 2297 raft_consensus.cc:2749] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:11.706424 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 850) took 4010 ms. Trace:
I20260616 19:52:11.706496 1190 rpcz_store.cc:276] 0616 19:52:07.695836 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.695888 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:11.706316 (+4010428us) ts_tablet_manager.cc:1151] Deleting tablet 3b57bceabff64533ae3a49b8afda614d
0616 19:52:11.706324 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.706409 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4010271}
I20260616 19:52:11.706435 2285 raft_consensus.cc:2804] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:11.706657 2285 raft_consensus.cc:493] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:11.706710 2285 raft_consensus.cc:3060] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:11.706779 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 858) took 3951 ms. Trace:
I20260616 19:52:11.706848 1190 rpcz_store.cc:276] 0616 19:52:07.755311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.755474 (+ 163us) service_pool.cc:224] Handling call
0616 19:52:11.706712 (+3951238us) ts_tablet_manager.cc:1151] Deleting tablet 99b211692aca478bb40f0f2c3f50ca44
0616 19:52:11.706719 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.706766 (+ 47us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3950921}
I20260616 19:52:11.707074 1190 tablet_replica.cc:333] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:11.707237 1190 raft_consensus.cc:2243] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:11.707355 1190 raft_consensus.cc:2272] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:11.707882 1190 ts_tablet_manager.cc:1916] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.709036 2285 raft_consensus.cc:515] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.709792 2285 leader_election.cc:290] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:11.712347 1198 tablet_bootstrap.cc:492] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:11.713425 1908 consensus_queue.cc:1048] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:11.713757 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e91c377ae66441268351cd3592aa9dbc" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:11.713943 781 raft_consensus.cc:3060] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:11.714344 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 64aa32856ca34743933931fb51f2bd7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.715493 1198 tablet_bootstrap.cc:654] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:11.719491 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 3a4a2f467b5b4121ae9a9973c153c69f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a4a2f467b5b4121ae9a9973c153c69f already in progress: creating tablet
W20260616 19:52:11.720201 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet b1771a4ed9d649558fed580992af1f96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1771a4ed9d649558fed580992af1f96 already in progress: creating tablet
I20260616 19:52:11.720891 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 5029a79e046a489aa9976eff948a3c5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.721647 1190 ts_tablet_manager.cc:1929] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260616 19:52:11.721912 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet ce114bf2907945889f8f1050d63d3965 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce114bf2907945889f8f1050d63d3965 already in progress: creating tablet
I20260616 19:52:11.720937 781 raft_consensus.cc:2468] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:11.722801 1190 log.cc:1199] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/73a754c728b5408eb47f91de93554ec5
W20260616 19:52:11.723008 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet db750fc9641f492494fdb167de86f6df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db750fc9641f492494fdb167de86f6df already in progress: creating tablet
I20260616 19:52:11.723266 1190 ts_tablet_manager.cc:1950] T 73a754c728b5408eb47f91de93554ec5 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:11.723996 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 857) took 3968 ms. Trace:
I20260616 19:52:11.722534 860 leader_election.cc:304] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:11.724479 1190 rpcz_store.cc:276] 0616 19:52:07.755235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.755817 (+ 582us) service_pool.cc:224] Handling call
0616 19:52:11.707037 (+3951220us) ts_tablet_manager.cc:1151] Deleting tablet 73a754c728b5408eb47f91de93554ec5
0616 19:52:11.707045 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.714483 (+ 7438us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.721600 (+ 7117us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.723979 (+ 2379us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3951022}
I20260616 19:52:11.725449 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 855) took 3970 ms. Trace:
I20260616 19:52:11.725889 2296 raft_consensus.cc:493] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.726025 2296 raft_consensus.cc:515] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.725823 1190 rpcz_store.cc:276] 0616 19:52:07.755035 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.756046 (+ 1011us) service_pool.cc:224] Handling call
0616 19:52:11.725349 (+3969303us) ts_tablet_manager.cc:1151] Deleting tablet fdc6222db09d4cd987cbdf70e4d40f70
0616 19:52:11.725362 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.725431 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3968984}
I20260616 19:52:11.726603 1190 tablet_replica.cc:333] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:11.726668 2296 leader_election.cc:290] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:11.727039 1190 raft_consensus.cc:2243] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:11.727255 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 3fcdc7ae19874ca794ae71d228e6ab27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fcdc7ae19874ca794ae71d228e6ab27 already in progress: creating tablet
I20260616 19:52:11.727490 1190 raft_consensus.cc:2272] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:11.727820 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102f322eb98f4224acb8637f8c29ac19" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:11.727881 858 leader_election.cc:343] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 31592a5ffb04429c9315a4fd72308f28
I20260616 19:52:11.727968 858 leader_election.cc:304] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
W20260616 19:52:11.729113 996 leader_election.cc:343] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:11.729498 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 990ea67ce4664c27857a15bac92d0d42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 990ea67ce4664c27857a15bac92d0d42 already in progress: creating tablet
I20260616 19:52:11.730289 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 5b34d497f9334e94b06cc9245fca04ed (table default.Table_7a777a2aa2cd44d1b7f9db66e8367a32 [id=6db44bdac0784e08b52a4db869edb3d3]) successfully deleted
I20260616 19:52:11.730846 2285 raft_consensus.cc:2804] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:11.730973 858 leader_election.cc:304] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:11.731020 2285 raft_consensus.cc:697] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:11.731184 2242 raft_consensus.cc:2749] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:11.731318 858 leader_election.cc:304] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:11.731391 2242 raft_consensus.cc:2804] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:11.731469 2242 raft_consensus.cc:697] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:11.731518 2297 raft_consensus.cc:2804] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:11.731618 2297 raft_consensus.cc:697] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:11.731676 2242 consensus_queue.cc:237] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.731842 2297 consensus_queue.cc:237] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:11.732055 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 3b57bceabff64533ae3a49b8afda614d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b57bceabff64533ae3a49b8afda614d already in progress: creating tablet
W20260616 19:52:11.732249 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 99b211692aca478bb40f0f2c3f50ca44 because the tablet was not found. No further retry: Not found: Tablet not found: 99b211692aca478bb40f0f2c3f50ca44
I20260616 19:52:11.732544 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 73a754c728b5408eb47f91de93554ec5 (table default.Table_5f98dbc56e0e44ba93e5e67cb2a74652 [id=c6d68b5708374d73be79937542dc39a4]) successfully deleted
W20260616 19:52:11.732761 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet fdc6222db09d4cd987cbdf70e4d40f70 because the tablet was not found. No further retry: Not found: Tablet not found: fdc6222db09d4cd987cbdf70e4d40f70
I20260616 19:52:11.731366 2285 consensus_queue.cc:237] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.735482 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102f322eb98f4224acb8637f8c29ac19" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:11.728408 1190 ts_tablet_manager.cc:1916] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.744084 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1cc2efab7cde4a4c860319723167c913" } new_table_name: "default.Table_effe158037a240ed856545ba1c321a14" modify_external_catalogs: true
I20260616 19:52:11.745980 2296 raft_consensus.cc:493] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.746115 2296 raft_consensus.cc:515] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.746676 2296 leader_election.cc:290] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:11.747145 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64aa32856ca34743933931fb51f2bd7b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:11.747745 996 leader_election.cc:343] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:11.749614 860 consensus_peers.cc:597] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65b0dc43b40649f29037f40d2ea9247e. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:11.750744 832 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
W20260616 19:52:11.753978 993 leader_election.cc:343] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.754122 993 leader_election.cc:304] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:11.754343 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9ce10fb69c4a461c8bfedd883535ba2b" } new_table_name: "default.Table_f369debb579f481e8b6b311ac65097a7" modify_external_catalogs: true
I20260616 19:52:11.754746 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64aa32856ca34743933931fb51f2bd7b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:11.754969 923 raft_consensus.cc:2468] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:11.755687 2296 raft_consensus.cc:2749] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:11.756959 1196 tablet_bootstrap.cc:492] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:11.757139 1196 ts_tablet_manager.cc:1403] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.092s user 0.003s sys 0.000s
I20260616 19:52:11.757915 1196 raft_consensus.cc:359] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.758157 1196 raft_consensus.cc:385] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.758253 1196 raft_consensus.cc:740] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.758533 1196 consensus_queue.cc:260] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.759881 993 leader_election.cc:304] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:11.760136 2296 raft_consensus.cc:2804] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:11.760197 2296 raft_consensus.cc:493] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:11.760262 2296 raft_consensus.cc:3060] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:11.763271 2296 raft_consensus.cc:515] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.763878 2296 leader_election.cc:290] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:11.764137 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64aa32856ca34743933931fb51f2bd7b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:11.764376 1196 ts_tablet_manager.cc:1434] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
W20260616 19:52:11.764621 996 leader_election.cc:343] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.764703 1196 tablet_bootstrap.cc:492] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:11.766191 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64aa32856ca34743933931fb51f2bd7b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:11.766383 923 raft_consensus.cc:3060] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:11.766535 1196 tablet_bootstrap.cc:654] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.767287 1193 log.cc:1199] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/d270afd0c0f3457aa6dd14721dca261d
I20260616 19:52:11.767715 1193 ts_tablet_manager.cc:1950] T d270afd0c0f3457aa6dd14721dca261d P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:11.768040 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 893) took 3178 ms. Trace:
I20260616 19:52:11.768141 1193 rpcz_store.cc:276] 0616 19:52:08.589604 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.589723 (+ 119us) service_pool.cc:224] Handling call
0616 19:52:11.581474 (+2991751us) ts_tablet_manager.cc:1151] Deleting tablet d270afd0c0f3457aa6dd14721dca261d
0616 19:52:11.581482 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.594692 (+ 13210us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.601895 (+ 7203us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.768026 (+166131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2991565}
I20260616 19:52:11.768718 1193 tablet_replica.cc:333] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:11.768983 1193 raft_consensus.cc:2243] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:11.769089 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet d270afd0c0f3457aa6dd14721dca261d (table default.Table_ea860bf78ecb48ebb09d584767ab3f41 [id=014e024d22a94b42b4e61fac211f07e9]) successfully deleted
I20260616 19:52:11.769189 1193 pending_rounds.cc:70] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:11.769233 1193 pending_rounds.cc:77] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595517101477888 op_type: NO_OP noop_request { }
I20260616 19:52:11.769322 1193 raft_consensus.cc:2889] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:11.769701 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8f195aaf0b9c47169f6c04a5e380bd22" } modify_external_catalogs: true
I20260616 19:52:11.769894 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8f195aaf0b9c47169f6c04a5e380bd22" } modify_external_catalogs: true
I20260616 19:52:11.770521 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 17029c1ba36644e9847200b54bf9094c with delete_type TABLET_DATA_DELETED (replaced by tablet 29df38f273494a079bdc76a915d43dab) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.771638 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b9c56c0c18cf40b6be9c36fb8e7bec46" } modify_external_catalogs: true
I20260616 19:52:11.771840 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b9c56c0c18cf40b6be9c36fb8e7bec46" } modify_external_catalogs: true
I20260616 19:52:11.772221 1192 tablet_bootstrap.cc:492] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:11.772351 1192 ts_tablet_manager.cc:1403] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.225s user 0.004s sys 0.012s
I20260616 19:52:11.773309 1192 raft_consensus.cc:359] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.773484 1192 raft_consensus.cc:385] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.773540 1192 raft_consensus.cc:740] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.773725 1192 consensus_queue.cc:260] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.774060 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4d37635717d84d3e9891538926193745" } modify_external_catalogs: true
I20260616 19:52:11.774250 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4d37635717d84d3e9891538926193745" } modify_external_catalogs: true
I20260616 19:52:11.774642 1192 ts_tablet_manager.cc:1434] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:11.774974 1192 tablet_bootstrap.cc:492] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:11.779704 1196 tablet_bootstrap.cc:492] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:11.779927 1196 ts_tablet_manager.cc:1403] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.006s
I20260616 19:52:11.780965 1196 raft_consensus.cc:359] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.781255 1196 raft_consensus.cc:385] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.781363 1196 raft_consensus.cc:740] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.781675 1196 consensus_queue.cc:260] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.782447 1196 ts_tablet_manager.cc:1434] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:11.782859 1196 tablet_bootstrap.cc:492] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:11.784770 1196 tablet_bootstrap.cc:654] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.791694 1193 raft_consensus.cc:2272] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:11.792367 1193 ts_tablet_manager.cc:1916] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.776292 923 raft_consensus.cc:2468] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:11.802500 993 leader_election.cc:304] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:11.802850 2296 raft_consensus.cc:2804] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:11.802982 2296 raft_consensus.cc:697] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:11.803211 2296 consensus_queue.cc:237] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.803669 1191 ts_tablet_manager.cc:1929] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:11.803813 1191 log.cc:1199] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/aa72e00b0a3a423f96bdd7abb6013810
I20260616 19:52:11.804222 1191 ts_tablet_manager.cc:1950] T aa72e00b0a3a423f96bdd7abb6013810 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:11.806300 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 802) took 5198 ms. Trace:
I20260616 19:52:11.806453 1191 rpcz_store.cc:276] 0616 19:52:06.607943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.620507 (+ 12564us) service_pool.cc:224] Handling call
0616 19:52:11.531830 (+4911323us) ts_tablet_manager.cc:1151] Deleting tablet aa72e00b0a3a423f96bdd7abb6013810
0616 19:52:11.531838 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.715806 (+183968us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.803614 (+ 87808us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.806281 (+ 2667us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4911155}
I20260616 19:52:11.807054 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet aa72e00b0a3a423f96bdd7abb6013810 (table default.Table_4635b5a6e60140b9acd169b569531ffd [id=13855ad4407546ea81ea615a1cdc0438]) successfully deleted
I20260616 19:52:11.807271 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 808) took 5099 ms. Trace:
I20260616 19:52:11.807410 1191 rpcz_store.cc:276] 0616 19:52:06.708254 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.793027 (+ 84773us) service_pool.cc:224] Handling call
0616 19:52:11.807051 (+5014024us) ts_tablet_manager.cc:1151] Deleting tablet d6707acac4ee4283b138fb44e4e82ce5
0616 19:52:11.807065 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.807187 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5013781}
W20260616 19:52:11.807982 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d6707acac4ee4283b138fb44e4e82ce5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6707acac4ee4283b138fb44e4e82ce5 already in progress: creating tablet
I20260616 19:52:11.808081 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 818) took 4975 ms. Trace:
I20260616 19:52:11.808281 1191 rpcz_store.cc:276] 0616 19:52:06.832274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.832325 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:11.807904 (+4975579us) ts_tablet_manager.cc:1151] Deleting tablet 26b044bb36c84f64a32c774515a339c4
0616 19:52:11.807916 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.808063 (+ 147us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4975373}
W20260616 19:52:11.808748 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 26b044bb36c84f64a32c774515a339c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26b044bb36c84f64a32c774515a339c4 already in progress: creating tablet
I20260616 19:52:11.808941 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 819) took 4972 ms. Trace:
I20260616 19:52:11.809060 1191 rpcz_store.cc:276] 0616 19:52:06.836626 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.836679 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:11.808759 (+4972080us) ts_tablet_manager.cc:1151] Deleting tablet a7cc0edadc1948ffbe15febbebb27b45
0616 19:52:11.808771 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.808924 (+ 153us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4971921}
I20260616 19:52:11.809424 1192 tablet_bootstrap.cc:654] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:11.809474 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a7cc0edadc1948ffbe15febbebb27b45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7cc0edadc1948ffbe15febbebb27b45 already in progress: creating tablet
I20260616 19:52:11.809562 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 824) took 4914 ms. Trace:
I20260616 19:52:11.809670 1191 rpcz_store.cc:276] 0616 19:52:06.895397 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.895443 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:11.809456 (+4914013us) ts_tablet_manager.cc:1151] Deleting tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7
0616 19:52:11.809467 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.809547 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4913796}
W20260616 19:52:11.810122 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eebe4fa5d3cf4c3bbb03d4faf0f1a8a7 already in progress: creating tablet
I20260616 19:52:11.810322 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 828) took 4889 ms. Trace:
I20260616 19:52:11.810443 1191 rpcz_store.cc:276] 0616 19:52:06.920786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.920840 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:11.810152 (+4889312us) ts_tablet_manager.cc:1151] Deleting tablet d7c3e760d24247a5bc2b17a610ff49dc
0616 19:52:11.810164 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.810304 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4889086}
W20260616 19:52:11.810932 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d7c3e760d24247a5bc2b17a610ff49dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7c3e760d24247a5bc2b17a610ff49dc already in progress: creating tablet
I20260616 19:52:11.814158 2383 tablet.cc:1724] T d5741b92cafb4d53987dbeeef66ccd56 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260616 19:52:11.791560 858 leader_election.cc:343] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: e91c377ae66441268351cd3592aa9dbc
I20260616 19:52:11.783308 1190 ts_tablet_manager.cc:1929] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:11.828485 1190 log.cc:1199] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/5ba2eefdfed14791b5a41decc34dce44
I20260616 19:52:11.828931 1190 ts_tablet_manager.cc:1950] T 5ba2eefdfed14791b5a41decc34dce44 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:11.829373 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 859) took 4073 ms. Trace:
I20260616 19:52:11.829520 1190 rpcz_store.cc:276] 0616 19:52:07.755426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.756434 (+ 1008us) service_pool.cc:224] Handling call
0616 19:52:11.726551 (+3970117us) ts_tablet_manager.cc:1151] Deleting tablet 5ba2eefdfed14791b5a41decc34dce44
0616 19:52:11.726563 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.780450 (+ 53887us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.783261 (+ 2811us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.829356 (+ 46095us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3969762}
I20260616 19:52:11.830040 1190 tablet_replica.cc:333] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:11.830278 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 5ba2eefdfed14791b5a41decc34dce44 (table default.Table_1a330c132b3f4982b52e492c2ded8be7 [id=975461e7d8954e8fbe998142fb2783e9]) successfully deleted
I20260616 19:52:11.840890 1190 raft_consensus.cc:2243] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:11.841280 1190 pending_rounds.cc:70] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:52:11.841410 1190 pending_rounds.cc:77] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595504490311680 op_type: NO_OP noop_request { }
I20260616 19:52:11.841562 1190 raft_consensus.cc:2889] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:11.841701 1190 raft_consensus.cc:2272] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:11.842255 1190 ts_tablet_manager.cc:1916] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.845402 1198 tablet_bootstrap.cc:492] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:11.847290 1198 ts_tablet_manager.cc:1403] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.135s user 0.008s sys 0.006s
I20260616 19:52:11.848639 1198 raft_consensus.cc:359] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.854557 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fd020407d4f8470e99045206ca16c6d2
I20260616 19:52:11.855314 2377 tablet.cc:1724] T d5741b92cafb4d53987dbeeef66ccd56 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:11.858238 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4791ad7d3cf045f6b0c8ae18d7977c59" } modify_external_catalogs: true
I20260616 19:52:11.858430 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4791ad7d3cf045f6b0c8ae18d7977c59" } modify_external_catalogs: true
W20260616 19:52:11.859592 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d0e9ed8303274b5f8ec3a2bd0a070b48 consensus state has no leader
I20260616 19:52:11.859939 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8edbc6ccbac744a6892039a2c31f4372" } modify_external_catalogs: true
I20260616 19:52:11.860075 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8edbc6ccbac744a6892039a2c31f4372" } modify_external_catalogs: true
W20260616 19:52:11.860556 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 41f2d259a31c4f4eaeceaba57fb978b2 consensus state has no leader
I20260616 19:52:11.860877 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7044ef52a676420a8846f7d3abb520ee" } new_table_name: "default.Table_856c35c00b504ecfaeb47c24739826b1" modify_external_catalogs: true
I20260616 19:52:11.861007 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d800b4e2c2d42279c102e4e061f5530 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:11.861980 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eeed41f4bcad4336975540b165b8d473 consensus state has no leader
I20260616 19:52:11.862288 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c37aeb69afa040eeb9db1f8bdc60bb99
I20260616 19:52:11.862668 459 catalog_manager.cc:6784] ReplaceTablet: tablet c37aeb69afa040eeb9db1f8bdc60bb99 deleted and replaced by tablet 5bc9e90f53094eb48cfb003d45aa5290
I20260616 19:52:11.863005 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet e896d5aa87f14e5593d01085bb6d434f
I20260616 19:52:11.863619 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a20701ab3a5d43df92c471bd6013ac6c
I20260616 19:52:11.864100 454 catalog_manager.cc:6784] ReplaceTablet: tablet a20701ab3a5d43df92c471bd6013ac6c deleted and replaced by tablet 17d5740c8bc14441a4f5d7c509791679
I20260616 19:52:11.864663 757 tablet_service.cc:1558] Processing DeleteTablet for tablet fd020407d4f8470e99045206ca16c6d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.867345 759 tablet_service.cc:1558] Processing DeleteTablet for tablet a20701ab3a5d43df92c471bd6013ac6c with delete_type TABLET_DATA_DELETED (replaced by tablet 17d5740c8bc14441a4f5d7c509791679) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.868729 751 tablet_service.cc:1558] Processing DeleteTablet for tablet e896d5aa87f14e5593d01085bb6d434f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:11.869196 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2dfa92a1ce0448c1ba877319cdd4e9b5 consensus state has no leader
W20260616 19:52:11.871636 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cbbbfa65120b4b9b98ef0fc30a13f2d3 consensus state has no leader
I20260616 19:52:11.872208 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet df14405fff32417da8e9069680100dbd
I20260616 19:52:11.875072 751 tablet_service.cc:1558] Processing DeleteTablet for tablet df14405fff32417da8e9069680100dbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.876657 898 tablet_service.cc:1558] Processing DeleteTablet for tablet fd020407d4f8470e99045206ca16c6d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.877918 458 master_service.cc:960] ReplaceTablet: received request to replace tablet c6be4a4739464be7b246a54b7a33adaf from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:11.878357 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a3cb602d8c514961b4d948e21c3fd48a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:11.878858 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3cb602d8c514961b4d948e21c3fd48a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.880303 757 tablet_service.cc:1558] Processing DeleteTablet for tablet c37aeb69afa040eeb9db1f8bdc60bb99 with delete_type TABLET_DATA_DELETED (replaced by tablet 5bc9e90f53094eb48cfb003d45aa5290) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.854944 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 830) took 4883 ms. Trace:
I20260616 19:52:11.858928 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet fd020407d4f8470e99045206ca16c6d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.863056 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet c37aeb69afa040eeb9db1f8bdc60bb99 with delete_type TABLET_DATA_DELETED (replaced by tablet 5bc9e90f53094eb48cfb003d45aa5290) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.881489 1191 rpcz_store.cc:276] 0616 19:52:06.927317 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.927784 (+ 467us) service_pool.cc:224] Handling call
0616 19:52:11.810931 (+4883147us) ts_tablet_manager.cc:1151] Deleting tablet d522cc4b346241d1bac695f9a1d40fbb
0616 19:52:11.810942 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.811022 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4882900}
W20260616 19:52:11.882027 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d522cc4b346241d1bac695f9a1d40fbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d522cc4b346241d1bac695f9a1d40fbb already in progress: creating tablet
I20260616 19:52:11.882378 1191 tablet_replica.cc:333] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:11.882591 1191 raft_consensus.cc:2243] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:11.882846 1191 raft_consensus.cc:2272] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:11.883585 1191 ts_tablet_manager.cc:1916] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.864352 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet e896d5aa87f14e5593d01085bb6d434f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.864750 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet c6939d108a7948bb9e56311a34d95486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.865072 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet a20701ab3a5d43df92c471bd6013ac6c with delete_type TABLET_DATA_DELETED (replaced by tablet 17d5740c8bc14441a4f5d7c509791679) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.873482 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet df14405fff32417da8e9069680100dbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.886998 1190 ts_tablet_manager.cc:1929] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:11.887180 1190 log.cc:1199] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/1bc181171b134de2b946376f468aec72
I20260616 19:52:11.887305 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_29352ec1bc7d4d1bb8cfed469b161c97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:11.887593 1190 ts_tablet_manager.cc:1950] T 1bc181171b134de2b946376f468aec72 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:11.887516 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c2c67f979a81481abf747ff078acd0b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:11.887871 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29352ec1bc7d4d1bb8cfed469b161c97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.887897 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 856) took 4132 ms. Trace:
W20260616 19:52:11.888020 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2c67f979a81481abf747ff078acd0b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.887959 1190 rpcz_store.cc:276] 0616 19:52:07.755153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.756844 (+ 1691us) service_pool.cc:224] Handling call
0616 19:52:11.829997 (+4073153us) ts_tablet_manager.cc:1151] Deleting tablet 1bc181171b134de2b946376f468aec72
0616 19:52:11.830007 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.874824 (+ 44817us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.886939 (+ 12115us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.887879 (+ 940us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4073001}
I20260616 19:52:11.888298 1190 tablet_replica.cc:333] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:11.888652 1190 raft_consensus.cc:2243] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:11.888711 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1ca42bb7fe334d8194ffafa0c3cfcfbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:11.889119 1190 raft_consensus.cc:2272] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:11.889171 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ca42bb7fe334d8194ffafa0c3cfcfbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.889218 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_19d0a2bac9d24c37be1eb4c961016b03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:11.889644 1190 ts_tablet_manager.cc:1916] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:11.890133 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19d0a2bac9d24c37be1eb4c961016b03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.892232 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9155a2bee4b44dcc89a4732cfbd04ab0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:11.892737 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9155a2bee4b44dcc89a4732cfbd04ab0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.893790 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bc97998e16fb4032acc3f1a702877fb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:11.894199 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc97998e16fb4032acc3f1a702877fb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.894223 757 tablet_service.cc:1511] Processing CreateTablet for tablet 3fea425b08e2452fbe30de2d64c00dde (DEFAULT_TABLE table=default.Table_6b844c4a5e574d50b5009e9808740cda [id=cf4da502792a427fa74bb728c25ddee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.894665 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 3fea425b08e2452fbe30de2d64c00dde (DEFAULT_TABLE table=default.Table_6b844c4a5e574d50b5009e9808740cda [id=cf4da502792a427fa74bb728c25ddee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.894672 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_03f32450daa54bdeb536825ee2bec211"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:11.895064 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fea425b08e2452fbe30de2d64c00dde. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:11.895078 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03f32450daa54bdeb536825ee2bec211 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.901702 898 tablet_service.cc:1558] Processing DeleteTablet for tablet c37aeb69afa040eeb9db1f8bdc60bb99 with delete_type TABLET_DATA_DELETED (replaced by tablet 5bc9e90f53094eb48cfb003d45aa5290) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.902056 898 tablet_service.cc:1558] Processing DeleteTablet for tablet e896d5aa87f14e5593d01085bb6d434f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.902379 898 tablet_service.cc:1558] Processing DeleteTablet for tablet a20701ab3a5d43df92c471bd6013ac6c with delete_type TABLET_DATA_DELETED (replaced by tablet 17d5740c8bc14441a4f5d7c509791679) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:11.903419 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet d0e9ed8303274b5f8ec3a2bd0a070b48 (table default.Table_90329eb7dd804622ad9806f2e1af2f10 [id=f1801498fba14f14886c1c550e426b1b], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d0e9ed8303274b5f8ec3a2bd0a070b48 consensus state has no leader
I20260616 19:52:11.903831 2287 raft_consensus.cc:493] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:11.903955 2287 raft_consensus.cc:515] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.904531 2287 leader_election.cc:290] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:11.905108 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6939d108a7948bb9e56311a34d95486" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:11.905251 1191 ts_tablet_manager.cc:1929] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:11.905361 1191 log.cc:1199] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/1c35e4c8e9304e798c9031469877b70e
I20260616 19:52:11.905658 1191 ts_tablet_manager.cc:1950] T 1c35e4c8e9304e798c9031469877b70e P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:11.905769 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6939d108a7948bb9e56311a34d95486" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:11.909797 898 tablet_service.cc:1558] Processing DeleteTablet for tablet df14405fff32417da8e9069680100dbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.910404 898 tablet_service.cc:1511] Processing CreateTablet for tablet 3fea425b08e2452fbe30de2d64c00dde (DEFAULT_TABLE table=default.Table_6b844c4a5e574d50b5009e9808740cda [id=cf4da502792a427fa74bb728c25ddee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:11.910764 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fea425b08e2452fbe30de2d64c00dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.913292 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 1bc181171b134de2b946376f468aec72 (table default.Table_daf95e025c454ee1b78a61861cc1a23d [id=625dfecea84f40369353e2b7a6408e01]) successfully deleted
I20260616 19:52:11.914347 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0510b4247a0d451484e1c7b5b8a4d42d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:11.916221 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 5e8c37e4293a4f2fa4f54397686c5dfc
I20260616 19:52:11.916416 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 87ca1b3a712845f9a93653faa0e95291
I20260616 19:52:11.917564 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e8c37e4293a4f2fa4f54397686c5dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.917578 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 87ca1b3a712845f9a93653faa0e95291 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:11.919034 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0510b4247a0d451484e1c7b5b8a4d42d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:11.931260 1190 ts_tablet_manager.cc:1929] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260616 19:52:11.931452 1190 log.cc:1199] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/eb04ccc26e64484a9a29c515d4b954fe
I20260616 19:52:11.931885 1190 ts_tablet_manager.cc:1950] T eb04ccc26e64484a9a29c515d4b954fe P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:11.932263 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 860) took 4170 ms. Trace:
I20260616 19:52:11.932394 1190 rpcz_store.cc:276] 0616 19:52:07.761734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.762519 (+ 785us) service_pool.cc:224] Handling call
0616 19:52:11.888250 (+4125731us) ts_tablet_manager.cc:1151] Deleting tablet eb04ccc26e64484a9a29c515d4b954fe
0616 19:52:11.888259 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.909028 (+ 20769us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.931198 (+ 22170us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.932245 (+ 1047us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4125379}
I20260616 19:52:11.932973 1190 tablet_replica.cc:333] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:11.933202 1190 raft_consensus.cc:2243] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:11.933405 1190 raft_consensus.cc:2272] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:11.933962 1190 ts_tablet_manager.cc:1916] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.935180 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ca5dc1e6cde347fc9a34e555385dc646 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:11.935750 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 87ca1b3a712845f9a93653faa0e95291 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.935998 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e8c37e4293a4f2fa4f54397686c5dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.936064 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet eb04ccc26e64484a9a29c515d4b954fe (table default.Table_093bd1c50f834db49bf52da0c66fae6d [id=87e3217093844e81ac448e2e9d8fa3ec]) successfully deleted
I20260616 19:52:11.941045 1192 tablet_bootstrap.cc:492] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:11.941233 1192 ts_tablet_manager.cc:1403] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.166s user 0.002s sys 0.002s
I20260616 19:52:11.942047 1192 raft_consensus.cc:359] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.942289 1192 raft_consensus.cc:385] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.942397 1192 raft_consensus.cc:740] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.942711 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 826) took 5033 ms. Trace:
I20260616 19:52:11.942673 1192 consensus_queue.cc:260] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.942965 898 tablet_service.cc:1558] Processing DeleteTablet for tablet f13d175adfe540b39fd55004a11c9aad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.943238 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fea425b08e2452fbe30de2d64c00dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:11.943949 1192 ts_tablet_manager.cc:1434] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:11.944271 1192 tablet_bootstrap.cc:492] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:11.946339 1193 ts_tablet_manager.cc:1929] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:11.947001 1191 rpcz_store.cc:276] 0616 19:52:06.909713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.993858 (+ 84145us) service_pool.cc:224] Handling call
0616 19:52:11.882331 (+4888473us) ts_tablet_manager.cc:1151] Deleting tablet 1c35e4c8e9304e798c9031469877b70e
0616 19:52:11.882341 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.901693 (+ 19352us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.905205 (+ 3512us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.942691 (+ 37486us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4888169}
I20260616 19:52:11.947540 1192 tablet_bootstrap.cc:654] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.905797 1198 raft_consensus.cc:385] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.951382 1198 raft_consensus.cc:740] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.951696 1198 consensus_queue.cc:260] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.952445 1198 ts_tablet_manager.cc:1434] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.105s user 0.002s sys 0.000s
I20260616 19:52:11.952795 1198 tablet_bootstrap.cc:492] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:11.954335 1198 tablet_bootstrap.cc:654] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:11.955138 1191 tablet_replica.cc:333] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:11.955295 1191 raft_consensus.cc:2243] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:11.905633 996 leader_election.cc:343] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.955420 1191 raft_consensus.cc:2272] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:11.955487 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 49860.2us
I20260616 19:52:11.956051 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 1c35e4c8e9304e798c9031469877b70e (table default.Table_940a8144c5014fc9b2fcb74257f85d89 [id=7278ea7c992e450d840d9174df3f1ca0]) successfully deleted
W20260616 19:52:11.956187 993 leader_election.cc:343] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:11.956308 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 87ca1b3a712845f9a93653faa0e95291 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.956421 993 leader_election.cc:304] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:11.956720 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 50194.5us
I20260616 19:52:11.957336 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e8c37e4293a4f2fa4f54397686c5dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.957772 1191 ts_tablet_manager.cc:1916] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.959708 898 tablet_service.cc:1558] Processing DeleteTablet for tablet aa72e00b0a3a423f96bdd7abb6013810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:11.961462 2287 raft_consensus.cc:2749] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:11.975430 457 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_a5a8fee8fc214408ae98d4e88d6f66a5 [id=ee6ce577050e45c5b9b014d3827e5046] alter complete (version 1)
I20260616 19:52:11.978327 1190 ts_tablet_manager.cc:1929] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:11.979663 1190 log.cc:1199] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/31592a5ffb04429c9315a4fd72308f28
I20260616 19:52:11.980146 1190 ts_tablet_manager.cc:1950] T 31592a5ffb04429c9315a4fd72308f28 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:11.984892 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 862) took 4216 ms. Trace:
I20260616 19:52:11.985036 1190 rpcz_store.cc:276] 0616 19:52:07.768855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.773173 (+ 4318us) service_pool.cc:224] Handling call
0616 19:52:11.932924 (+4159751us) ts_tablet_manager.cc:1151] Deleting tablet 31592a5ffb04429c9315a4fd72308f28
0616 19:52:11.932936 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.938284 (+ 5348us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.978272 (+ 39988us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.984873 (+ 6601us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4158832}
I20260616 19:52:11.985827 1190 tablet_replica.cc:333] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:11.986053 1190 raft_consensus.cc:2243] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:11.986281 1190 raft_consensus.cc:2272] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:11.981724 1192 tablet_bootstrap.cc:492] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:11.986675 1192 ts_tablet_manager.cc:1403] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.000s
I20260616 19:52:11.987601 1192 raft_consensus.cc:359] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:11.988233 1198 tablet_bootstrap.cc:492] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:11.988396 1198 ts_tablet_manager.cc:1403] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.001s
I20260616 19:52:11.986825 1190 ts_tablet_manager.cc:1916] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:11.989327 1198 raft_consensus.cc:359] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.989565 1198 raft_consensus.cc:385] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:11.989660 1198 raft_consensus.cc:740] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:11.990135 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a718fefe07141119b7ef7edcbf61123 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:11.990222 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 31592a5ffb04429c9315a4fd72308f28 (table default.Table_6a6d8516df114593b27d86140407b724 [id=d104c5ac8acc4a6f9ed7cc87879d661b]) successfully deleted
I20260616 19:52:11.990334 1198 consensus_queue.cc:260] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:11.992641 1198 ts_tablet_manager.cc:1434] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260616 19:52:11.997517 2402 tablet.cc:1724] T d5741b92cafb4d53987dbeeef66ccd56 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:12.002310 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet e6530753b4184cfe972ae3a43f23d589 with delete_type TABLET_DATA_DELETED (replaced by tablet f89a0c065a4a4fb7afa8cab29d78c2e5) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.003460 1198 tablet_bootstrap.cc:492] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:12.008301 1193 log.cc:1199] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/cbd1070277a14fd98af5fa45925e4f0f
I20260616 19:52:12.008531 1192 raft_consensus.cc:385] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.009444 1193 ts_tablet_manager.cc:1950] T cbd1070277a14fd98af5fa45925e4f0f P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:12.009851 1191 ts_tablet_manager.cc:1929] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:12.009954 1191 log.cc:1199] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/9060de590fa84ea08dc7d39765bc9308
I20260616 19:52:12.010298 1191 ts_tablet_manager.cc:1950] T 9060de590fa84ea08dc7d39765bc9308 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:12.011023 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 837) took 4924 ms. Trace:
I20260616 19:52:12.018121 1191 rpcz_store.cc:276] 0616 19:52:07.086398 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.089412 (+ 3014us) service_pool.cc:224] Handling call
0616 19:52:11.955088 (+4865676us) ts_tablet_manager.cc:1151] Deleting tablet 9060de590fa84ea08dc7d39765bc9308
0616 19:52:11.955098 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.993849 (+ 38751us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.009792 (+ 15943us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.011003 (+ 1211us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4865491}
I20260616 19:52:12.018558 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 842) took 4888 ms. Trace:
I20260616 19:52:12.018635 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 9060de590fa84ea08dc7d39765bc9308 (table default.Table_7713a34d9f7e4031a42f66ee98382545 [id=6f77a88fd07a47cfbef0a061968dda5c]) successfully deleted
I20260616 19:52:12.018653 1191 rpcz_store.cc:276] 0616 19:52:07.129941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.129995 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:12.018426 (+4888431us) ts_tablet_manager.cc:1151] Deleting tablet 6396397965c44e07850a6cc42cefab09
0616 19:52:12.018437 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.018541 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4888244}
I20260616 19:52:12.018988 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 843) took 4888 ms. Trace:
W20260616 19:52:12.019070 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 6396397965c44e07850a6cc42cefab09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6396397965c44e07850a6cc42cefab09 already in progress: creating tablet
I20260616 19:52:12.019068 1191 rpcz_store.cc:276] 0616 19:52:07.130047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.130097 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:12.018883 (+4888786us) ts_tablet_manager.cc:1151] Deleting tablet 272838af35d840faa7b11217456533c2
0616 19:52:12.018892 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.018972 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4888623}
I20260616 19:52:12.019387 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 844) took 4889 ms. Trace:
W20260616 19:52:12.019445 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 272838af35d840faa7b11217456533c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 272838af35d840faa7b11217456533c2 already in progress: creating tablet
I20260616 19:52:12.019462 1191 rpcz_store.cc:276] 0616 19:52:07.130389 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.130432 (+ 43us) service_pool.cc:224] Handling call
0616 19:52:12.019299 (+4888867us) ts_tablet_manager.cc:1151] Deleting tablet f4095b92df9a422e85e38513e19eabc7
0616 19:52:12.019307 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.019373 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4888733}
I20260616 19:52:12.019758 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 845) took 4888 ms. Trace:
W20260616 19:52:12.019824 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet f4095b92df9a422e85e38513e19eabc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4095b92df9a422e85e38513e19eabc7 already in progress: creating tablet
I20260616 19:52:12.019836 1191 rpcz_store.cc:276] 0616 19:52:07.130828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.130872 (+ 44us) service_pool.cc:224] Handling call
0616 19:52:12.019665 (+4888793us) ts_tablet_manager.cc:1151] Deleting tablet f872a8860a4b421483441d71814be4fc
0616 19:52:12.019675 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.019744 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4888667}
I20260616 19:52:12.020146 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 851) took 4809 ms. Trace:
I20260616 19:52:12.020217 1191 rpcz_store.cc:276] 0616 19:52:07.210642 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.220763 (+ 10121us) service_pool.cc:224] Handling call
0616 19:52:12.020042 (+4799279us) ts_tablet_manager.cc:1151] Deleting tablet cfbc5c9485b94928b6ae9a1f206c9c45
0616 19:52:12.020051 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.020131 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4799087}
I20260616 19:52:12.017434 1198 tablet_bootstrap.cc:654] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.021782 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 894) took 3354 ms. Trace:
W20260616 19:52:12.022150 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet f872a8860a4b421483441d71814be4fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f872a8860a4b421483441d71814be4fc already in progress: creating tablet
W20260616 19:52:12.022432 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet cfbc5c9485b94928b6ae9a1f206c9c45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cfbc5c9485b94928b6ae9a1f206c9c45 already in progress: creating tablet
I20260616 19:52:12.021945 1193 rpcz_store.cc:276] 0616 19:52:08.666929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.667049 (+ 120us) service_pool.cc:224] Handling call
0616 19:52:11.768666 (+3101617us) ts_tablet_manager.cc:1151] Deleting tablet cbd1070277a14fd98af5fa45925e4f0f
0616 19:52:11.768678 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:11.796169 (+ 27491us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:11.946290 (+150121us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.021754 (+ 75464us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3101358}
I20260616 19:52:12.023360 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet cbd1070277a14fd98af5fa45925e4f0f (table default.Table_60ef6fc2bcf94a838594d3da8ec82c32 [id=72296d61a39e47389db261a68e679483]) successfully deleted
I20260616 19:52:12.023835 1193 tablet_replica.cc:333] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:12.024113 1198 tablet_bootstrap.cc:492] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:12.024101 1193 raft_consensus.cc:2243] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:12.024327 1198 ts_tablet_manager.cc:1403] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260616 19:52:12.024456 1193 raft_consensus.cc:2272] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.025269 1192 raft_consensus.cc:740] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.025574 1193 ts_tablet_manager.cc:1916] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.025604 1198 raft_consensus.cc:359] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.025810 1198 raft_consensus.cc:385] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.025750 1192 consensus_queue.cc:260] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.025892 1198 raft_consensus.cc:740] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.026212 1198 consensus_queue.cc:260] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.026793 1196 tablet_bootstrap.cc:492] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.026957 1196 ts_tablet_manager.cc:1403] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.244s user 0.027s sys 0.030s
I20260616 19:52:12.027892 1196 raft_consensus.cc:359] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.020455 1191 tablet_replica.cc:333] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:12.028584 1196 raft_consensus.cc:385] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.028740 1196 raft_consensus.cc:740] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.029078 1196 consensus_queue.cc:260] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.032107 1191 raft_consensus.cc:2243] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.033783 1192 ts_tablet_manager.cc:1434] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.047s user 0.001s sys 0.001s
I20260616 19:52:12.033783 1191 raft_consensus.cc:2272] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.034071 1192 tablet_bootstrap.cc:492] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:12.034415 1191 ts_tablet_manager.cc:1916] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.036047 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bd6fa49eff4400ca40c722e18cea951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.036816 1190 ts_tablet_manager.cc:1929] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:12.037185 1196 ts_tablet_manager.cc:1434] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260616 19:52:12.038864 1190 log.cc:1199] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/79250767a94141cd900a9715e86128b8
I20260616 19:52:12.038935 1198 ts_tablet_manager.cc:1434] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260616 19:52:12.039271 1190 ts_tablet_manager.cc:1950] T 79250767a94141cd900a9715e86128b8 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:12.040402 1191 ts_tablet_manager.cc:1929] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:12.042459 1191 log.cc:1199] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/f13d175adfe540b39fd55004a11c9aad
I20260616 19:52:12.042811 1191 ts_tablet_manager.cc:1950] T f13d175adfe540b39fd55004a11c9aad P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:12.043519 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 855) took 4755 ms. Trace:
I20260616 19:52:12.043651 1191 rpcz_store.cc:276] 0616 19:52:07.288352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.288424 (+ 72us) service_pool.cc:224] Handling call
0616 19:52:12.020417 (+4731993us) ts_tablet_manager.cc:1151] Deleting tablet f13d175adfe540b39fd55004a11c9aad
0616 19:52:12.020425 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.037343 (+ 16918us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.040355 (+ 3012us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.043500 (+ 3145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3630,"tablet-delete.queue_time_us":4731781}
I20260616 19:52:12.042373 1198 tablet_bootstrap.cc:492] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:12.045310 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet f13d175adfe540b39fd55004a11c9aad (table default.Table_630c32eab3fb4372a3a7de16f0f7916c [id=f7089c8c9b504f13949fd8db2c11c45c]) successfully deleted
I20260616 19:52:12.045666 1198 tablet_bootstrap.cc:654] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.045915 1196 tablet_bootstrap.cc:492] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:12.046317 1192 tablet_bootstrap.cc:654] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.046703 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 858) took 4699 ms. Trace:
I20260616 19:52:12.046828 1191 rpcz_store.cc:276] 0616 19:52:07.347097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.347332 (+ 235us) service_pool.cc:224] Handling call
0616 19:52:12.046594 (+4699262us) ts_tablet_manager.cc:1151] Deleting tablet b1771a4ed9d649558fed580992af1f96
0616 19:52:12.046602 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.046688 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4699091}
I20260616 19:52:12.047281 1191 tablet_replica.cc:333] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:12.047284 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet b1771a4ed9d649558fed580992af1f96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1771a4ed9d649558fed580992af1f96 already in progress: creating tablet
I20260616 19:52:12.047509 1191 raft_consensus.cc:2243] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.047662 1191 pending_rounds.cc:70] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2: Trying to abort 1 pending ops.
I20260616 19:52:12.047736 1191 pending_rounds.cc:77] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595517101477888 op_type: NO_OP noop_request { }
I20260616 19:52:12.047865 1191 raft_consensus.cc:2889] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:12.048004 1191 raft_consensus.cc:2272] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.048671 1191 ts_tablet_manager.cc:1916] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.049628 459 master_service.cc:960] ReplaceTablet: received request to replace tablet a170db3d27fd40c1b74deab29e9a033f from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:12.053359 1196 tablet_bootstrap.cc:654] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.053586 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 861) took 4284 ms. Trace:
I20260616 19:52:12.056243 1190 rpcz_store.cc:276] 0616 19:52:07.768680 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.774462 (+ 5782us) service_pool.cc:224] Handling call
0616 19:52:11.985784 (+4211322us) ts_tablet_manager.cc:1151] Deleting tablet 79250767a94141cd900a9715e86128b8
0616 19:52:11.985793 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.002392 (+ 16599us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.036769 (+ 34377us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.053565 (+ 16796us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10112,"tablet-delete.queue_time_us":4211135}
I20260616 19:52:12.057343 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 79250767a94141cd900a9715e86128b8 (table default.Table_8d5fed2f6cff49c4b8a9cd2c5a907fa9 [id=4fdd38d3f8d747b0b6181ee77db8e90a]) successfully deleted
I20260616 19:52:12.057762 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 864) took 4281 ms. Trace:
I20260616 19:52:12.057875 1190 rpcz_store.cc:276] 0616 19:52:07.776705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.777187 (+ 482us) service_pool.cc:224] Handling call
0616 19:52:12.057637 (+4280450us) ts_tablet_manager.cc:1151] Deleting tablet ebe069dd3e414b48b27769cd281b579d
0616 19:52:12.057647 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.057746 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4280181}
W20260616 19:52:12.058341 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet ebe069dd3e414b48b27769cd281b579d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebe069dd3e414b48b27769cd281b579d already in progress: creating tablet
I20260616 19:52:12.058712 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 863) took 4282 ms. Trace:
I20260616 19:52:12.058820 1190 rpcz_store.cc:276] 0616 19:52:07.776590 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.777516 (+ 926us) service_pool.cc:224] Handling call
0616 19:52:12.058608 (+4281092us) ts_tablet_manager.cc:1151] Deleting tablet 63bb0e724ba04f79809850febc966c66
0616 19:52:12.058616 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.058684 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4280877}
W20260616 19:52:12.059275 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 63bb0e724ba04f79809850febc966c66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63bb0e724ba04f79809850febc966c66 already in progress: creating tablet
I20260616 19:52:12.059567 1191 ts_tablet_manager.cc:1929] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:12.059713 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 865) took 4282 ms. Trace:
I20260616 19:52:12.060882 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_95acdb157bf74ea0935b272ecc403881"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.062163 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95acdb157bf74ea0935b272ecc403881 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.062284 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_80cdd5c8e7c245798a9bfe9ba16072f7" } new_table_name: "default.Table_bfbf1a44762849e783649a69e17c311d" modify_external_catalogs: true
I20260616 19:52:12.059798 1190 rpcz_store.cc:276] 0616 19:52:07.776841 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.794770 (+ 17929us) service_pool.cc:224] Handling call
0616 19:52:12.059602 (+4264832us) ts_tablet_manager.cc:1151] Deleting tablet 099199fa60b94308acb423f04d988f65
0616 19:52:12.059611 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.059687 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4264614}
I20260616 19:52:12.064138 1190 tablet_replica.cc:333] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:12.064895 1190 raft_consensus.cc:2243] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.065488 1190 raft_consensus.cc:2272] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.067104 1198 tablet_bootstrap.cc:492] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:12.067296 1198 ts_tablet_manager.cc:1403] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.004s
I20260616 19:52:12.067442 1192 tablet_bootstrap.cc:492] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:12.068508 1198 raft_consensus.cc:359] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.069072 1198 raft_consensus.cc:385] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.069132 1198 raft_consensus.cc:740] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.069362 1198 consensus_queue.cc:260] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.070636 1198 ts_tablet_manager.cc:1434] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260616 19:52:12.070741 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f858ecd77984b1c9f729e201b099e66 consensus state has no leader
I20260616 19:52:12.070943 1191 log.cc:1199] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/cbd1070277a14fd98af5fa45925e4f0f
I20260616 19:52:12.071317 1191 ts_tablet_manager.cc:1950] T cbd1070277a14fd98af5fa45925e4f0f P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:12.072144 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0a5aa20660b44678bdc1f462591bcf31" } new_table_name: "default.Table_0257f215c3234e4ab78e89967a9e7463" modify_external_catalogs: true
I20260616 19:52:12.072295 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2e3589134c4b473a97c49a3e99b90589" } new_table_name: "default.Table_a65d5f0f5a9347a3a06b75a7174ab415" modify_external_catalogs: true
I20260616 19:52:12.067708 1192 ts_tablet_manager.cc:1403] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.003s
I20260616 19:52:12.073315 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b30509a276f0479580ea240dee3f98bd" } modify_external_catalogs: true
I20260616 19:52:12.073493 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b30509a276f0479580ea240dee3f98bd" } modify_external_catalogs: true
I20260616 19:52:12.073957 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4a8217e50ef644eca9671056b7d93ea5" } new_table_name: "default.Table_febc1327d859443d8643ab1e5a58f6b8" modify_external_catalogs: true
I20260616 19:52:12.074024 2242 raft_consensus.cc:493] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.074141 2242 raft_consensus.cc:515] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.074486 1190 ts_tablet_manager.cc:1916] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.074709 2242 leader_election.cc:290] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:12.077486 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c030c3487feb4377b9f094e2ab00e7ee" } new_table_name: "default.Table_e66084d00ded45b1996fa09663da39e7" modify_external_catalogs: true
I20260616 19:52:12.077811 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13d175adfe540b39fd55004a11c9aad" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:12.078388 860 leader_election.cc:343] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.078584 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f4c478c0faaf444197285c44970b7d04" } modify_external_catalogs: true
I20260616 19:52:12.078751 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f4c478c0faaf444197285c44970b7d04" } modify_external_catalogs: true
I20260616 19:52:12.079320 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_db705d0c498b4a0ea5d58ef3ba508b30" } modify_external_catalogs: true
I20260616 19:52:12.079495 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_db705d0c498b4a0ea5d58ef3ba508b30" } modify_external_catalogs: true
I20260616 19:52:12.080328 1192 raft_consensus.cc:359] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.080641 1192 raft_consensus.cc:385] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.080780 1192 raft_consensus.cc:740] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.081147 1192 consensus_queue.cc:260] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.081828 971 heartbeater.cc:344] Connected to a master server at 127.0.105.189:43055
I20260616 19:52:12.082078 1192 ts_tablet_manager.cc:1434] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260616 19:52:12.082572 1192 tablet_bootstrap.cc:492] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:12.089964 1190 ts_tablet_manager.cc:1929] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260616 19:52:12.090123 1190 log.cc:1199] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/3de0e62cfd33410490a0b460fd5f69e9
W20260616 19:52:12.094173 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 25e12ce6f3cc4ee1924c061b71ae2bf3 consensus state has no leader
W20260616 19:52:12.094586 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8e8ee572626a42909f31874a55b5cbb6 consensus state has no leader
W20260616 19:52:12.094921 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 944b29ae4fb340de890dbdfc1e46f141 consensus state has no leader
W20260616 19:52:12.096686 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8f67e5add64244629cbe8694223bd00e consensus state has no leader
W20260616 19:52:12.099160 858 leader_election.cc:343] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: f13d175adfe540b39fd55004a11c9aad
I20260616 19:52:12.099304 858 leader_election.cc:304] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:12.099699 2297 raft_consensus.cc:2749] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.100039 460 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 84ce7bf3e0004ffaa2c5e314fa69322c (table default.Table_4f1675b0cae24ecea8b9f4efebb44772 [id=4f2b128cff5248f98e3506bb72a39391]). Expected version 3 got 0
I20260616 19:52:12.107362 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet cf1ab0a125cf46e9a1afc625297db7af
I20260616 19:52:12.107858 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet adf5010b9025406bb1da70e6875213c6
W20260616 19:52:12.063678 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 099199fa60b94308acb423f04d988f65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 099199fa60b94308acb423f04d988f65 already in progress: creating tablet
W20260616 19:52:12.108393 445 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 44717us
I20260616 19:52:12.105427 757 tablet_service.cc:1511] Processing CreateTablet for tablet 8fbe5a6b44a3444ebdd185962058a861 (DEFAULT_TABLE table=default.Table_ea877235c11b47e9b05186321e824f1a [id=94b0bbdd60c144db82302fe135018fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.109970 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fbe5a6b44a3444ebdd185962058a861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.110306 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet cf1ab0a125cf46e9a1afc625297db7af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.112532 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet adf5010b9025406bb1da70e6875213c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.113380 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 6c9066a57e784356aa27cfcac75c3bd2
I20260616 19:52:12.114264 759 tablet_service.cc:1558] Processing DeleteTablet for tablet adf5010b9025406bb1da70e6875213c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.114359 749 tablet_service.cc:1558] Processing DeleteTablet for tablet cf1ab0a125cf46e9a1afc625297db7af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.114506 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c9066a57e784356aa27cfcac75c3bd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.114711 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c9066a57e784356aa27cfcac75c3bd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.117151 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ed4536204745427fb6b47d9f6ec3b4de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:12.117422 1198 tablet_bootstrap.cc:492] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:52:12.117727 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed4536204745427fb6b47d9f6ec3b4de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.117843 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5155a017375748c783f9145caefc0fd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.118330 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5155a017375748c783f9145caefc0fd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.119022 1198 tablet_bootstrap.cc:654] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.122792 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 860) took 4742 ms. Trace:
I20260616 19:52:12.122872 1191 rpcz_store.cc:276] 0616 19:52:07.380649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.380728 (+ 79us) service_pool.cc:224] Handling call
0616 19:52:12.047242 (+4666514us) ts_tablet_manager.cc:1151] Deleting tablet cbd1070277a14fd98af5fa45925e4f0f
0616 19:52:12.047250 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.051766 (+ 4516us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.059515 (+ 7749us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.122773 (+ 63258us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4666185}
I20260616 19:52:12.123281 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 861) took 4715 ms. Trace:
I20260616 19:52:12.123348 1191 rpcz_store.cc:276] 0616 19:52:07.407938 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.408898 (+ 960us) service_pool.cc:224] Handling call
0616 19:52:12.123158 (+4714260us) ts_tablet_manager.cc:1151] Deleting tablet db750fc9641f492494fdb167de86f6df
0616 19:52:12.123168 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.123267 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4714083}
I20260616 19:52:12.123617 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 859) took 4769 ms. Trace:
I20260616 19:52:12.123734 1193 ts_tablet_manager.cc:1929] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:12.123680 1191 rpcz_store.cc:276] 0616 19:52:07.354538 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.421256 (+ 66718us) service_pool.cc:224] Handling call
0616 19:52:12.123535 (+4702279us) ts_tablet_manager.cc:1151] Deleting tablet ce114bf2907945889f8f1050d63d3965
0616 19:52:12.123542 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.123604 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4702109}
I20260616 19:52:12.123826 1193 log.cc:1199] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/19b9248b88434a6e9ef7a3d602eee70c
I20260616 19:52:12.123895 1191 tablet_replica.cc:333] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:12.124068 1191 raft_consensus.cc:2243] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.124158 1193 ts_tablet_manager.cc:1950] T 19b9248b88434a6e9ef7a3d602eee70c P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:12.124208 1191 raft_consensus.cc:2272] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.124791 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 84ce7bf3e0004ffaa2c5e314fa69322c (table default.Table_4f1675b0cae24ecea8b9f4efebb44772 [id=4f2b128cff5248f98e3506bb72a39391]). Expected version 3 got 0
I20260616 19:52:12.125676 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0e8a5c6334524a4e97813b34c6ead7e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:12.125928 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet cbd1070277a14fd98af5fa45925e4f0f (table default.Table_60ef6fc2bcf94a838594d3da8ec82c32 [id=72296d61a39e47389db261a68e679483]) successfully deleted
W20260616 19:52:12.126178 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e8a5c6334524a4e97813b34c6ead7e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:12.126183 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet db750fc9641f492494fdb167de86f6df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db750fc9641f492494fdb167de86f6df already in progress: creating tablet
W20260616 19:52:12.126564 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ce114bf2907945889f8f1050d63d3965 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce114bf2907945889f8f1050d63d3965 already in progress: creating tablet
I20260616 19:52:12.126633 1191 ts_tablet_manager.cc:1916] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.127317 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_475293cd66a246eb8371da761e3a1200"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.127787 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_475293cd66a246eb8371da761e3a1200 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.128885 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_95acdb157bf74ea0935b272ecc403881" } modify_external_catalogs: true
I20260616 19:52:12.129050 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_95acdb157bf74ea0935b272ecc403881" } modify_external_catalogs: true
I20260616 19:52:12.129288 1196 tablet_bootstrap.cc:492] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.129417 1196 ts_tablet_manager.cc:1403] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.084s user 0.001s sys 0.001s
I20260616 19:52:12.130301 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1b8bba2a2d5b418e90b1f08ed8249a10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.130812 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b8bba2a2d5b418e90b1f08ed8249a10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.130334 1196 raft_consensus.cc:359] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.131314 1196 raft_consensus.cc:385] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.131378 1196 raft_consensus.cc:740] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.131572 1196 consensus_queue.cc:260] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.132017 1196 ts_tablet_manager.cc:1434] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:12.132117 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 802d30c340494490896c8da33d110708 with delete_type TABLET_DATA_DELETED (replaced by tablet c5047956478f488dbb4734bbaa138c00) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.132292 1196 tablet_bootstrap.cc:492] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:12.133381 2287 raft_consensus.cc:493] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.133502 2287 raft_consensus.cc:515] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.133838 1196 tablet_bootstrap.cc:654] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.134083 2287 leader_election.cc:290] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:12.134582 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6530753b4184cfe972ae3a43f23d589" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:12.135150 996 leader_election.cc:343] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.135298 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e320a0e61e09447aa8206a307dd2c425" } modify_external_catalogs: true
I20260616 19:52:12.135319 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6530753b4184cfe972ae3a43f23d589" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.135473 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e320a0e61e09447aa8206a307dd2c425" } modify_external_catalogs: true
W20260616 19:52:12.135862 993 leader_election.cc:343] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.135952 993 leader_election.cc:304] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:12.137650 2287 raft_consensus.cc:2749] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.138455 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e2673166695846d9b5207926e41723a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.138939 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2673166695846d9b5207926e41723a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.141919 1191 ts_tablet_manager.cc:1929] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:12.142377 1191 log.cc:1199] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/19b9248b88434a6e9ef7a3d602eee70c
I20260616 19:52:12.142843 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 895) took 3453 ms. Trace:
I20260616 19:52:12.142935 1193 rpcz_store.cc:276] 0616 19:52:08.689114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.689176 (+ 62us) service_pool.cc:224] Handling call
0616 19:52:12.023772 (+3334596us) ts_tablet_manager.cc:1151] Deleting tablet 19b9248b88434a6e9ef7a3d602eee70c
0616 19:52:12.023786 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.121125 (+ 97339us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.123687 (+ 2562us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.142821 (+ 19134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3334350}
I20260616 19:52:12.143257 1193 tablet_replica.cc:333] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:12.143455 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 19b9248b88434a6e9ef7a3d602eee70c (table default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4 [id=7c1cbcd4d250459cba3590b94f9c8519]) successfully deleted
I20260616 19:52:12.142884 1191 ts_tablet_manager.cc:1950] T 19b9248b88434a6e9ef7a3d602eee70c P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:12.144013 1193 raft_consensus.cc:2243] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.144169 1193 raft_consensus.cc:2272] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.144690 1193 ts_tablet_manager.cc:1916] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.145804 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_88300869cc934881b02e8e152209d02f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.146294 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88300869cc934881b02e8e152209d02f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.146441 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 862) took 4720 ms. Trace:
I20260616 19:52:12.147243 1191 rpcz_store.cc:276] 0616 19:52:07.426183 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.426657 (+ 474us) service_pool.cc:224] Handling call
0616 19:52:12.123859 (+4697202us) ts_tablet_manager.cc:1151] Deleting tablet 19b9248b88434a6e9ef7a3d602eee70c
0616 19:52:12.123867 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.132320 (+ 8453us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.141868 (+ 9548us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.146423 (+ 4555us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4696952}
I20260616 19:52:12.146062 751 tablet_service.cc:1558] Processing DeleteTablet for tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b with delete_type TABLET_DATA_DELETED (replaced by tablet f54eef97f8db47449564b49be608902f) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.147907 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 19b9248b88434a6e9ef7a3d602eee70c (table default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4 [id=7c1cbcd4d250459cba3590b94f9c8519]) successfully deleted
I20260616 19:52:12.148101 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 857) took 4818 ms. Trace:
I20260616 19:52:12.149183 1191 rpcz_store.cc:276] 0616 19:52:07.329186 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.427406 (+ 98220us) service_pool.cc:224] Handling call
0616 19:52:12.147989 (+4720583us) ts_tablet_manager.cc:1151] Deleting tablet 3fcdc7ae19874ca794ae71d228e6ab27
0616 19:52:12.147998 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.148084 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4720253}
I20260616 19:52:12.149187 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f56d9704ddc841ecb86a4e8303e471e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.149753 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f56d9704ddc841ecb86a4e8303e471e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:12.149919 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 3fcdc7ae19874ca794ae71d228e6ab27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fcdc7ae19874ca794ae71d228e6ab27 already in progress: creating tablet
I20260616 19:52:12.151633 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 856) took 4822 ms. Trace:
I20260616 19:52:12.155954 1191 rpcz_store.cc:276] 0616 19:52:07.329102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.430530 (+101428us) service_pool.cc:224] Handling call
0616 19:52:12.151527 (+4720997us) ts_tablet_manager.cc:1151] Deleting tablet 3a4a2f467b5b4121ae9a9973c153c69f
0616 19:52:12.151536 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.151617 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4720801}
W20260616 19:52:12.156605 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 3a4a2f467b5b4121ae9a9973c153c69f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a4a2f467b5b4121ae9a9973c153c69f already in progress: creating tablet
I20260616 19:52:12.156665 1191 tablet_replica.cc:333] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:12.157109 1191 raft_consensus.cc:2243] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.158335 1190 ts_tablet_manager.cc:1950] T 3de0e62cfd33410490a0b460fd5f69e9 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:12.158375 1191 raft_consensus.cc:2272] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.159843 898 tablet_service.cc:1558] Processing DeleteTablet for tablet cf1ab0a125cf46e9a1afc625297db7af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.159845 1198 tablet_bootstrap.cc:492] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:12.159991 1198 ts_tablet_manager.cc:1403] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.043s user 0.005s sys 0.004s
I20260616 19:52:12.161172 1198 raft_consensus.cc:359] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.161399 1198 raft_consensus.cc:385] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.161478 1198 raft_consensus.cc:740] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.161703 1198 consensus_queue.cc:260] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.162340 1198 ts_tablet_manager.cc:1434] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:12.158835 1191 ts_tablet_manager.cc:1916] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.162711 1198 tablet_bootstrap.cc:492] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:12.163086 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b57bceabff64533ae3a49b8afda614d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.163281 898 tablet_service.cc:1558] Processing DeleteTablet for tablet adf5010b9025406bb1da70e6875213c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.164722 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c9066a57e784356aa27cfcac75c3bd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.165678 1198 tablet_bootstrap.cc:654] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.167037 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 869) took 4295 ms. Trace:
I20260616 19:52:12.167068 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d9c89216995430188b1eed4c6b26d1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.167138 1190 rpcz_store.cc:276] 0616 19:52:07.871310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.871363 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:12.063911 (+4192548us) ts_tablet_manager.cc:1151] Deleting tablet 3de0e62cfd33410490a0b460fd5f69e9
0616 19:52:12.064014 (+ 103us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.077388 (+ 13374us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.089911 (+ 12523us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.167021 (+ 77110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4192349}
I20260616 19:52:12.167502 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 871) took 4191 ms. Trace:
I20260616 19:52:12.167572 1190 rpcz_store.cc:276] 0616 19:52:07.976022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.997995 (+ 21973us) service_pool.cc:224] Handling call
0616 19:52:12.167392 (+4169397us) ts_tablet_manager.cc:1151] Deleting tablet 10b02ac0fa4744e48529b35a4ca78567
0616 19:52:12.167401 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.167486 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4167435}
I20260616 19:52:12.167865 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 872) took 4123 ms. Trace:
I20260616 19:52:12.168726 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 3de0e62cfd33410490a0b460fd5f69e9 (table default.Table_f5c1eb12b45345aabb7ab3c7a1854ead [id=c7d1624942fb42aa95ad085062052262]) successfully deleted
W20260616 19:52:12.168994 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 10b02ac0fa4744e48529b35a4ca78567 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10b02ac0fa4744e48529b35a4ca78567 already in progress: creating tablet
I20260616 19:52:12.167927 1190 rpcz_store.cc:276] 0616 19:52:08.044420 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.044506 (+ 86us) service_pool.cc:224] Handling call
0616 19:52:12.167771 (+4123265us) ts_tablet_manager.cc:1151] Deleting tablet fdb74517ce5443a8bfea100ca364db1d
0616 19:52:12.167780 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.167850 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4123073}
I20260616 19:52:12.170282 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 875) took 4061 ms. Trace:
I20260616 19:52:12.170353 1190 rpcz_store.cc:276] 0616 19:52:08.108887 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.108937 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:12.170183 (+4061246us) ts_tablet_manager.cc:1151] Deleting tablet 1eacae5ee28947a9a4fb2315165c4df2
0616 19:52:12.170191 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.170267 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4061056}
I20260616 19:52:12.170646 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 876) took 4060 ms. Trace:
W20260616 19:52:12.171245 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet fdb74517ce5443a8bfea100ca364db1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdb74517ce5443a8bfea100ca364db1d already in progress: creating tablet
W20260616 19:52:12.171531 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 1eacae5ee28947a9a4fb2315165c4df2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1eacae5ee28947a9a4fb2315165c4df2 already in progress: creating tablet
I20260616 19:52:12.174438 452 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 7301fd3cd9ba46e58d23207b8ecf33ff
I20260616 19:52:12.176049 898 tablet_service.cc:1558] Processing DeleteTablet for tablet f52b2c5ff6264ffe8d579cb3816fc253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.177889 1196 tablet_bootstrap.cc:492] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.170714 1190 rpcz_store.cc:276] 0616 19:52:08.109976 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.110056 (+ 80us) service_pool.cc:224] Handling call
0616 19:52:12.170546 (+4060490us) ts_tablet_manager.cc:1151] Deleting tablet 9fd39dba6d6f4ff892bfd0ff462b74bd
0616 19:52:12.170554 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.170632 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4060299}
W20260616 19:52:12.179694 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 9fd39dba6d6f4ff892bfd0ff462b74bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fd39dba6d6f4ff892bfd0ff462b74bd already in progress: creating tablet
I20260616 19:52:12.182585 898 tablet_service.cc:1511] Processing CreateTablet for tablet 8fbe5a6b44a3444ebdd185962058a861 (DEFAULT_TABLE table=default.Table_ea877235c11b47e9b05186321e824f1a [id=94b0bbdd60c144db82302fe135018fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.182586 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 8fbe5a6b44a3444ebdd185962058a861 (DEFAULT_TABLE table=default.Table_ea877235c11b47e9b05186321e824f1a [id=94b0bbdd60c144db82302fe135018fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.183105 757 tablet_service.cc:1511] Processing CreateTablet for tablet 0d6dd71e76624a14898326b12637ccec (DEFAULT_TABLE table=default.Table_c7a80871babd4a3a98abd7eb593b3fa4 [id=43605e3e37224ba2a330b98ba18f486e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.183481 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6dd71e76624a14898326b12637ccec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.185297 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d55200fc438d407e9930400424b88024
I20260616 19:52:12.186503 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet d55200fc438d407e9930400424b88024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.187024 890 tablet_service.cc:1558] Processing DeleteTablet for tablet d55200fc438d407e9930400424b88024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.188059 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 874) took 4080 ms. Trace:
I20260616 19:52:12.188158 1190 rpcz_store.cc:276] 0616 19:52:08.107611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.111718 (+ 4107us) service_pool.cc:224] Handling call
0616 19:52:12.179334 (+4067616us) ts_tablet_manager.cc:1151] Deleting tablet 7e2fb4a0198342edaf87eb1b1f6406fb
0616 19:52:12.187930 (+ 8596us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.188041 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4067391}
I20260616 19:52:12.188582 751 tablet_service.cc:1558] Processing DeleteTablet for tablet d55200fc438d407e9930400424b88024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:12.188817 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 7e2fb4a0198342edaf87eb1b1f6406fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e2fb4a0198342edaf87eb1b1f6406fb already in progress: creating tablet
I20260616 19:52:12.189554 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 881) took 3696 ms. Trace:
I20260616 19:52:12.190562 1196 ts_tablet_manager.cc:1403] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.058s user 0.006s sys 0.000s
I20260616 19:52:12.191306 1196 raft_consensus.cc:359] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.191464 1196 raft_consensus.cc:385] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.191509 1196 raft_consensus.cc:740] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.191686 1196 consensus_queue.cc:260] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.193233 1192 tablet_bootstrap.cc:654] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.196166 1196 ts_tablet_manager.cc:1434] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260616 19:52:12.197914 1196 tablet_bootstrap.cc:492] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:12.199465 1196 tablet_bootstrap.cc:654] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.200067 1190 rpcz_store.cc:276] 0616 19:52:08.493228 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.493411 (+ 183us) service_pool.cc:224] Handling call
0616 19:52:12.188402 (+3694991us) ts_tablet_manager.cc:1151] Deleting tablet 966fabee5ae34c5da6a35d74caef244f
0616 19:52:12.189447 (+ 1045us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.189538 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3694791}
W20260616 19:52:12.202073 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 966fabee5ae34c5da6a35d74caef244f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 966fabee5ae34c5da6a35d74caef244f already in progress: creating tablet
W20260616 19:52:12.203168 860 consensus_peers.cc:597] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:12.203437 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 882) took 3707 ms. Trace:
I20260616 19:52:12.203532 1190 rpcz_store.cc:276] 0616 19:52:08.493348 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.493412 (+ 64us) service_pool.cc:224] Handling call
0616 19:52:12.200371 (+3706959us) ts_tablet_manager.cc:1151] Deleting tablet 9614f1b2704749c1a4590303c7efc1d8
0616 19:52:12.200381 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.200487 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3706194}
I20260616 19:52:12.203868 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 883) took 3665 ms. Trace:
I20260616 19:52:12.203940 1190 rpcz_store.cc:276] 0616 19:52:08.538747 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.538806 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:12.203756 (+3664950us) ts_tablet_manager.cc:1151] Deleting tablet 2f1e12555be64192860eab59b3aeb562
0616 19:52:12.203765 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.203840 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3634528}
I20260616 19:52:12.204228 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 884) took 3656 ms. Trace:
I20260616 19:52:12.204293 1190 rpcz_store.cc:276] 0616 19:52:08.548221 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.548286 (+ 65us) service_pool.cc:224] Handling call
0616 19:52:12.204126 (+3655840us) ts_tablet_manager.cc:1151] Deleting tablet 733f4f262ed64a01a5f5f4c68ba37872
0616 19:52:12.204132 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.204203 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3631271}
I20260616 19:52:12.204558 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 886) took 3293 ms. Trace:
I20260616 19:52:12.204625 1190 rpcz_store.cc:276] 0616 19:52:08.910931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.910974 (+ 43us) service_pool.cc:224] Handling call
0616 19:52:12.204449 (+3293475us) ts_tablet_manager.cc:1151] Deleting tablet 34264036a635419fbc8f9e2c388a817b
0616 19:52:12.204456 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.204529 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3293311}
I20260616 19:52:12.204875 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 892) took 3274 ms. Trace:
I20260616 19:52:12.204936 1190 rpcz_store.cc:276] 0616 19:52:08.930189 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.930360 (+ 171us) service_pool.cc:224] Handling call
0616 19:52:12.204793 (+3274433us) ts_tablet_manager.cc:1151] Deleting tablet aee589880bac4eff98fa6edd32c0b92d
0616 19:52:12.204800 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.204851 (+ 51us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3274226}
I20260616 19:52:12.205142 1190 tablet_replica.cc:333] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:12.205302 1190 raft_consensus.cc:2243] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.205453 1190 raft_consensus.cc:2272] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.207366 1190 ts_tablet_manager.cc:1916] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:12.207655 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 9614f1b2704749c1a4590303c7efc1d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9614f1b2704749c1a4590303c7efc1d8 already in progress: creating tablet
W20260616 19:52:12.207890 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 2f1e12555be64192860eab59b3aeb562 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f1e12555be64192860eab59b3aeb562 already in progress: creating tablet
W20260616 19:52:12.208077 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 733f4f262ed64a01a5f5f4c68ba37872 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 733f4f262ed64a01a5f5f4c68ba37872 already in progress: creating tablet
W20260616 19:52:12.208269 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 34264036a635419fbc8f9e2c388a817b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34264036a635419fbc8f9e2c388a817b already in progress: creating tablet
W20260616 19:52:12.208498 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet aee589880bac4eff98fa6edd32c0b92d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aee589880bac4eff98fa6edd32c0b92d already in progress: creating tablet
I20260616 19:52:12.215828 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8d28df6ecf2f4da3806d394095e83a0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:12.216244 890 tablet_service.cc:1511] Processing CreateTablet for tablet 0d6dd71e76624a14898326b12637ccec (DEFAULT_TABLE table=default.Table_c7a80871babd4a3a98abd7eb593b3fa4 [id=43605e3e37224ba2a330b98ba18f486e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:12.216365 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d28df6ecf2f4da3806d394095e83a0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.207267 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 9060de590fa84ea08dc7d39765bc9308 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.217626 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 0d6dd71e76624a14898326b12637ccec (DEFAULT_TABLE table=default.Table_c7a80871babd4a3a98abd7eb593b3fa4 [id=43605e3e37224ba2a330b98ba18f486e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.219889 751 tablet_service.cc:1511] Processing CreateTablet for tablet 9e4e49b3ac2a4c28bd01f0df3712f97a (DEFAULT_TABLE table=default.Table_c232a13fb3a34692a151a6cf74da9ae3 [id=13878fa773f34803a9293e00eb805c1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.220278 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e4e49b3ac2a4c28bd01f0df3712f97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.223590 2233 raft_consensus.cc:493] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.223708 2233 raft_consensus.cc:515] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.224270 2233 leader_election.cc:290] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.224843 1196 tablet_bootstrap.cc:492] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.224962 1196 ts_tablet_manager.cc:1403] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.004s
I20260616 19:52:12.225323 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5dc1e6cde347fc9a34e555385dc646" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.225862 1196 raft_consensus.cc:359] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.225992 1196 raft_consensus.cc:385] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.226032 1196 raft_consensus.cc:740] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.226238 1196 consensus_queue.cc:260] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.226763 1196 ts_tablet_manager.cc:1434] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:52:12.230216 1191 ts_tablet_manager.cc:1929] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:12.230330 1191 log.cc:1199] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/b718514e4fbd4601afeb021ed35643e6
I20260616 19:52:12.230611 1191 ts_tablet_manager.cc:1950] T b718514e4fbd4601afeb021ed35643e6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:12.231142 889 tablet_service.cc:1511] Processing CreateTablet for tablet 9e4e49b3ac2a4c28bd01f0df3712f97a (DEFAULT_TABLE table=default.Table_c232a13fb3a34692a151a6cf74da9ae3 [id=13878fa773f34803a9293e00eb805c1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.232852 1196 tablet_bootstrap.cc:492] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:12.237701 1193 ts_tablet_manager.cc:1929] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:12.237818 1193 log.cc:1199] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/e91c377ae66441268351cd3592aa9dbc
I20260616 19:52:12.238113 1193 ts_tablet_manager.cc:1950] T e91c377ae66441268351cd3592aa9dbc P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:12.238849 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 896) took 3523 ms. Trace:
I20260616 19:52:12.238938 1193 rpcz_store.cc:276] 0616 19:52:08.715361 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.715416 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:12.143215 (+3427799us) ts_tablet_manager.cc:1151] Deleting tablet e91c377ae66441268351cd3592aa9dbc
0616 19:52:12.143223 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.154998 (+ 11775us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.237645 (+ 82647us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.238828 (+ 1183us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3427535}
I20260616 19:52:12.239403 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet e91c377ae66441268351cd3592aa9dbc (table default.Table_44015174890646ee876b8d08923fc342 [id=0bc90fd55c8e4d5b8ac18717e00cea54]) successfully deleted
I20260616 19:52:12.240347 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 17029c1ba36644e9847200b54bf9094c with delete_type TABLET_DATA_DELETED (replaced by tablet 29df38f273494a079bdc76a915d43dab) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.242731 1196 tablet_bootstrap.cc:654] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.251745 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 9e4e49b3ac2a4c28bd01f0df3712f97a (DEFAULT_TABLE table=default.Table_c232a13fb3a34692a151a6cf74da9ae3 [id=13878fa773f34803a9293e00eb805c1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.253072 751 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8e4b136a6d49559281da308e8f782a (DEFAULT_TABLE table=default.Table_aab4483460054e109ca794c6ee40add1 [id=540a1b966c54442696bafb4618c2a1f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.253592 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8e4b136a6d49559281da308e8f782a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.257263 1193 tablet_replica.cc:333] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:12.258507 1193 raft_consensus.cc:2243] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:12.259042 1193 pending_rounds.cc:70] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:12.261840 885 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8e4b136a6d49559281da308e8f782a (DEFAULT_TABLE table=default.Table_aab4483460054e109ca794c6ee40add1 [id=540a1b966c54442696bafb4618c2a1f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.263634 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8e4b136a6d49559281da308e8f782a (DEFAULT_TABLE table=default.Table_aab4483460054e109ca794c6ee40add1 [id=540a1b966c54442696bafb4618c2a1f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.264114 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fbe5a6b44a3444ebdd185962058a861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.259187 1196 tablet_bootstrap.cc:492] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.264530 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8e4b136a6d49559281da308e8f782a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.264421 1196 ts_tablet_manager.cc:1403] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.002s
I20260616 19:52:12.269253 903 tablet_service.cc:1511] Processing CreateTablet for tablet 5398ab93f0c041ea8959e38cafd1b49a (DEFAULT_TABLE table=default.Table_8bc1bce7c32848eca622d264e538c55d [id=280d3164b2e2413eadf12bc0eda61412]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.267381 749 tablet_service.cc:1511] Processing CreateTablet for tablet 5398ab93f0c041ea8959e38cafd1b49a (DEFAULT_TABLE table=default.Table_8bc1bce7c32848eca622d264e538c55d [id=280d3164b2e2413eadf12bc0eda61412]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.269618 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5398ab93f0c041ea8959e38cafd1b49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.269821 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5398ab93f0c041ea8959e38cafd1b49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.271158 2287 raft_consensus.cc:493] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.271281 2287 raft_consensus.cc:515] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.271853 2287 leader_election.cc:290] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:12.272396 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e4e49b3ac2a4c28bd01f0df3712f97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.272678 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ce7bf3e0004ffaa2c5e314fa69322c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.272902 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ce7bf3e0004ffaa2c5e314fa69322c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:12.273203 993 leader_election.cc:343] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:12.273356 996 leader_election.cc:343] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.273428 996 leader_election.cc:304] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:12.273717 2287 raft_consensus.cc:2749] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.276108 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d7fcc73e3c06411b93fc748eb5b0ca34" } new_table_name: "default.Table_eda75c7c8bba4573a05dedda332ecd81" modify_external_catalogs: true
I20260616 19:52:12.276585 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6dd71e76624a14898326b12637ccec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.284935 1196 raft_consensus.cc:359] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.286449 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 5398ab93f0c041ea8959e38cafd1b49a (DEFAULT_TABLE table=default.Table_8bc1bce7c32848eca622d264e538c55d [id=280d3164b2e2413eadf12bc0eda61412]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.286549 1196 raft_consensus.cc:385] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.264227 1193 pending_rounds.cc:77] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595516471328768 op_type: NO_OP noop_request { }
I20260616 19:52:12.286749 1193 raft_consensus.cc:2889] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260616 19:52:12.286803 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e32a093750146249ea3cb971826a53f consensus state has no leader
I20260616 19:52:12.286955 1193 raft_consensus.cc:2272] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.286628 1196 raft_consensus.cc:740] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.287703 1196 consensus_queue.cc:260] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.288355 1196 ts_tablet_manager.cc:1434] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260616 19:52:12.288815 1193 ts_tablet_manager.cc:1916] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.289134 1196 tablet_bootstrap.cc:492] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:12.294086 1196 tablet_bootstrap.cc:654] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.297701 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_29ee389b873d4edbbbec5269e7e8735d" } new_table_name: "default.Table_9810eaebc13d4be7982c010c4988788e" modify_external_catalogs: true
I20260616 19:52:12.298580 1196 tablet_bootstrap.cc:492] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.299113 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8f2d9ccc00284b5faaed69198782b56c" } new_table_name: "default.Table_0398b3ce2d9046568832ba69cf46a959" modify_external_catalogs: true
I20260616 19:52:12.299530 1196 ts_tablet_manager.cc:1403] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260616 19:52:12.300896 1196 raft_consensus.cc:359] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.301277 1196 raft_consensus.cc:385] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.301440 1196 raft_consensus.cc:740] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.301816 1196 consensus_queue.cc:260] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.302651 1196 ts_tablet_manager.cc:1434] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260616 19:52:12.302791 2233 raft_consensus.cc:493] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.303088 2233 raft_consensus.cc:515] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.303633 2233 leader_election.cc:290] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.304584 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9060de590fa84ea08dc7d39765bc9308" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.305677 1196 tablet_bootstrap.cc:492] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:12.307441 719 leader_election.cc:343] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 9060de590fa84ea08dc7d39765bc9308
I20260616 19:52:12.307546 719 leader_election.cc:304] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:12.307627 858 consensus_peers.cc:597] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9060de590fa84ea08dc7d39765bc9308. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:12.308068 2233 raft_consensus.cc:2749] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.308044 2297 consensus_queue.cc:1048] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:12.308662 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5dc1e6cde347fc9a34e555385dc646" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:12.309226 781 raft_consensus.cc:3060] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.309638 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 863) took 4825 ms. Trace:
I20260616 19:52:12.309759 1191 rpcz_store.cc:276] 0616 19:52:07.484362 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.484413 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:12.156620 (+4672207us) ts_tablet_manager.cc:1151] Deleting tablet b718514e4fbd4601afeb021ed35643e6
0616 19:52:12.156631 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.169222 (+ 12591us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.230143 (+ 60921us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.306711 (+ 76568us) spinlock_profiling.cc:243] Waited 66.2 ms on lock 0x61800000ed18. stack: 00007f92671a0086 00007f926719fe40 00007f92661593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f92671889bd 00007f9267189a2e 00007f927afd91ad 00007f927af581d3 00007f92770e3f53 00007f9277116bb4 00007f92770f75d0 00007f92770f735d 0000000000aa681c 00007f92671e5f6f
0616 19:52:12.309616 (+ 2905us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152182912,"tablet-delete.queue_time_us":4665119}
I20260616 19:52:12.310161 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 871) took 4662 ms. Trace:
I20260616 19:52:12.310240 1191 rpcz_store.cc:276] 0616 19:52:07.647457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.647517 (+ 60us) service_pool.cc:224] Handling call
0616 19:52:12.310045 (+4662528us) ts_tablet_manager.cc:1151] Deleting tablet 990ea67ce4664c27857a15bac92d0d42
0616 19:52:12.310056 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.310145 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4502435}
I20260616 19:52:12.310487 1191 tablet_replica.cc:333] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:12.310658 1191 raft_consensus.cc:2243] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.310823 1191 raft_consensus.cc:2272] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.310962 1196 tablet_bootstrap.cc:654] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.311386 1191 ts_tablet_manager.cc:1916] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.312884 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e4e49b3ac2a4c28bd01f0df3712f97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.313659 1193 ts_tablet_manager.cc:1929] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:12.315656 1193 log.cc:1199] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/cf136fa86c264f69a1703596cfd0e77a
I20260616 19:52:12.316144 1193 ts_tablet_manager.cc:1950] T cf136fa86c264f69a1703596cfd0e77a P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:12.316849 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet b718514e4fbd4601afeb021ed35643e6 (table default.Table_9eedef731fd84c70a73a66128d239708 [id=b4da8c337e114065ad1498aa33588d55]) successfully deleted
W20260616 19:52:12.317206 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 990ea67ce4664c27857a15bac92d0d42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 990ea67ce4664c27857a15bac92d0d42 already in progress: creating tablet
I20260616 19:52:12.318460 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 898) took 3523 ms. Trace:
I20260616 19:52:12.318639 1191 ts_tablet_manager.cc:1929] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:12.318786 1191 log.cc:1199] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/5b34d497f9334e94b06cc9245fca04ed
I20260616 19:52:12.319180 1191 ts_tablet_manager.cc:1950] T 5b34d497f9334e94b06cc9245fca04ed P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:12.319530 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 872) took 4668 ms. Trace:
I20260616 19:52:12.319618 1191 rpcz_store.cc:276] 0616 19:52:07.651046 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.651099 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:12.310440 (+4659341us) ts_tablet_manager.cc:1151] Deleting tablet 5b34d497f9334e94b06cc9245fca04ed
0616 19:52:12.310447 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.314639 (+ 4192us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.318585 (+ 3946us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.319510 (+ 925us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4502788}
I20260616 19:52:12.320052 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fbe5a6b44a3444ebdd185962058a861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.320238 1193 rpcz_store.cc:276] 0616 19:52:08.795464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.795517 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:12.257187 (+3461670us) ts_tablet_manager.cc:1151] Deleting tablet cf136fa86c264f69a1703596cfd0e77a
0616 19:52:12.257206 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.291867 (+ 34661us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.313610 (+ 21743us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.318438 (+ 4828us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3461444}
I20260616 19:52:12.320627 2195 raft_consensus.cc:493] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.320796 2195 raft_consensus.cc:515] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.321439 2195 leader_election.cc:290] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:12.322755 860 leader_election.cc:343] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 1d80d9028184443da49623228259263d
W20260616 19:52:12.323676 858 leader_election.cc:343] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 1d80d9028184443da49623228259263d
I20260616 19:52:12.323733 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8e4b136a6d49559281da308e8f782a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.323768 858 leader_election.cc:304] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:12.324143 2195 raft_consensus.cc:2749] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.325523 1196 tablet_bootstrap.cc:492] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.326273 1196 ts_tablet_manager.cc:1403] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.003s
I20260616 19:52:12.325822 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 900) took 3417 ms. Trace:
I20260616 19:52:12.327369 1193 rpcz_store.cc:276] 0616 19:52:08.908426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.908491 (+ 65us) service_pool.cc:224] Handling call
0616 19:52:12.325712 (+3417221us) ts_tablet_manager.cc:1151] Deleting tablet 34264036a635419fbc8f9e2c388a817b
0616 19:52:12.325721 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.325808 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3417047}
I20260616 19:52:12.327955 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 905) took 3397 ms. Trace:
I20260616 19:52:12.328312 1193 rpcz_store.cc:276] 0616 19:52:08.930092 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.930395 (+ 303us) service_pool.cc:224] Handling call
0616 19:52:12.327852 (+3397457us) ts_tablet_manager.cc:1151] Deleting tablet 4ce69dcb31fe41879e9feb3b01547dd9
0616 19:52:12.327861 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.327939 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3397230}
I20260616 19:52:12.328779 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5398ab93f0c041ea8959e38cafd1b49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.331167 2287 raft_consensus.cc:493] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.331322 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 885) took 4549 ms. Trace:
I20260616 19:52:12.331302 2287 raft_consensus.cc:515] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.331918 2287 leader_election.cc:290] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:12.332800 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6dd71e76624a14898326b12637ccec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.333659 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52b2c5ff6264ffe8d579cb3816fc253" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.333828 922 raft_consensus.cc:2468] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:12.334231 993 leader_election.cc:304] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:12.334488 2287 raft_consensus.cc:2804] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:12.334561 2287 raft_consensus.cc:493] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:12.334626 2287 raft_consensus.cc:3060] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.335798 2401 raft_consensus.cc:493] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.335914 2401 raft_consensus.cc:515] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.336424 2401 leader_election.cc:290] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:12.336390 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 5b34d497f9334e94b06cc9245fca04ed (table default.Table_7a777a2aa2cd44d1b7f9db66e8367a32 [id=6db44bdac0784e08b52a4db869edb3d3]) successfully deleted
I20260616 19:52:12.337116 2287 raft_consensus.cc:515] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.331395 1191 rpcz_store.cc:276] 0616 19:52:07.781479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.807687 (+ 26208us) service_pool.cc:224] Handling call
0616 19:52:12.331215 (+4523528us) ts_tablet_manager.cc:1151] Deleting tablet ebe069dd3e414b48b27769cd281b579d
0616 19:52:12.331224 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.331305 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4523367}
I20260616 19:52:12.338304 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52b2c5ff6264ffe8d579cb3816fc253" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:12.338482 923 raft_consensus.cc:3060] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.338505 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c89216995430188b1eed4c6b26d1e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.337621 2287 leader_election.cc:290] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:12.339006 993 leader_election.cc:343] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.338754 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 886) took 4557 ms. Trace:
I20260616 19:52:12.339442 1191 rpcz_store.cc:276] 0616 19:52:07.781588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.807865 (+ 26277us) service_pool.cc:224] Handling call
0616 19:52:12.338627 (+4530762us) ts_tablet_manager.cc:1151] Deleting tablet 099199fa60b94308acb423f04d988f65
0616 19:52:12.338636 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.338736 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4530634}
I20260616 19:52:12.339843 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 884) took 4558 ms. Trace:
I20260616 19:52:12.339969 1191 rpcz_store.cc:276] 0616 19:52:07.781387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.807642 (+ 26255us) service_pool.cc:224] Handling call
0616 19:52:12.339743 (+4532101us) ts_tablet_manager.cc:1151] Deleting tablet 63bb0e724ba04f79809850febc966c66
0616 19:52:12.339754 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.339826 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4531464}
I20260616 19:52:12.340350 1191 tablet_replica.cc:333] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:12.340585 1191 raft_consensus.cc:2243] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.340785 1191 raft_consensus.cc:2272] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.341084 923 raft_consensus.cc:2468] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:12.333073 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52b2c5ff6264ffe8d579cb3816fc253" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:12.338044 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c89216995430188b1eed4c6b26d1e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:12.341485 993 leader_election.cc:304] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:12.338231 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52b2c5ff6264ffe8d579cb3816fc253" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:12.341712 2287 raft_consensus.cc:2804] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
W20260616 19:52:12.341804 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ebe069dd3e414b48b27769cd281b579d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebe069dd3e414b48b27769cd281b579d already in progress: creating tablet
I20260616 19:52:12.341913 2287 raft_consensus.cc:697] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
W20260616 19:52:12.342043 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 099199fa60b94308acb423f04d988f65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 099199fa60b94308acb423f04d988f65 already in progress: creating tablet
W20260616 19:52:12.342120 996 leader_election.cc:343] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:12.342245 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 63bb0e724ba04f79809850febc966c66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63bb0e724ba04f79809850febc966c66 already in progress: creating tablet
I20260616 19:52:12.342142 2287 consensus_queue.cc:237] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:12.342479 996 leader_election.cc:343] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.342581 996 leader_election.cc:304] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:12.342912 996 leader_election.cc:343] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.343153 2401 raft_consensus.cc:2749] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.343214 1191 ts_tablet_manager.cc:1916] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.343990 1196 raft_consensus.cc:359] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.344434 1196 raft_consensus.cc:385] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.344723 1196 raft_consensus.cc:740] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.345168 1196 consensus_queue.cc:260] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.346303 1196 ts_tablet_manager.cc:1434] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.020s user 0.000s sys 0.001s
W20260616 19:52:12.346988 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d428cbc3b40e4f36a3ec338070e3d550 consensus state has no leader
W20260616 19:52:12.347852 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c21ccda106e4c7a9906861f409a6151 consensus state has no leader
I20260616 19:52:12.351285 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet cf136fa86c264f69a1703596cfd0e77a (table default.Table_16ebbe6e3c3b4fd185b78b20b1098bd5 [id=6cd87cc1155f42719f9c324c487799ff]) successfully deleted
W20260616 19:52:12.351518 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 34264036a635419fbc8f9e2c388a817b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34264036a635419fbc8f9e2c388a817b already in progress: creating tablet
I20260616 19:52:12.351631 1191 ts_tablet_manager.cc:1929] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:12.351747 1191 log.cc:1199] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/3b57bceabff64533ae3a49b8afda614d
W20260616 19:52:12.351756 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 4ce69dcb31fe41879e9feb3b01547dd9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ce69dcb31fe41879e9feb3b01547dd9 already in progress: creating tablet
I20260616 19:52:12.352054 1191 ts_tablet_manager.cc:1950] T 3b57bceabff64533ae3a49b8afda614d P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:12.352366 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 876) took 4656 ms. Trace:
I20260616 19:52:12.352444 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_566443171e24470680ef72b6895d4ff2" } modify_external_catalogs: true
I20260616 19:52:12.352644 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_566443171e24470680ef72b6895d4ff2" } modify_external_catalogs: true
I20260616 19:52:12.352766 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c814e66f4bcc4f49bc9858bae34ed4df" } modify_external_catalogs: true
I20260616 19:52:12.352919 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c814e66f4bcc4f49bc9858bae34ed4df" } modify_external_catalogs: true
I20260616 19:52:12.354288 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a1db6293d2e041c9900a691731c2ca4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.354851 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1db6293d2e041c9900a691731c2ca4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.356415 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d47c0fc456964736901f20477b062604"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.356878 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d47c0fc456964736901f20477b062604 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.358651 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_10269fcb37e245679d0970467b2dcdde" } modify_external_catalogs: true
I20260616 19:52:12.359261 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_10269fcb37e245679d0970467b2dcdde" } modify_external_catalogs: true
I20260616 19:52:12.360239 1190 ts_tablet_manager.cc:1929] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:12.360357 1190 log.cc:1199] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/da74f89b7ff44f49b8e2f2c2cbcbdb0b
I20260616 19:52:12.361017 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_58b6a6df64fe459ab7a7abb175850554" } new_table_name: "default.Table_753c560ec30d4346bf6b8590dc7ee3f8" modify_external_catalogs: true
I20260616 19:52:12.364769 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1b3c170ea2a34e72824dc90f15534745
I20260616 19:52:12.365496 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 4faa62f03c2a4588a776883dc54d0426
I20260616 19:52:12.368669 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 906) took 3438 ms. Trace:
I20260616 19:52:12.368772 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b3c170ea2a34e72824dc90f15534745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.368825 1193 rpcz_store.cc:276] 0616 19:52:08.930192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.930672 (+ 480us) service_pool.cc:224] Handling call
0616 19:52:12.343792 (+3413120us) ts_tablet_manager.cc:1151] Deleting tablet 40124cee94a445ed9175132d4e0c86d8
0616 19:52:12.368513 (+ 24721us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.368646 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3412966}
I20260616 19:52:12.369436 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 4faa62f03c2a4588a776883dc54d0426 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.369475 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 907) took 3439 ms. Trace:
I20260616 19:52:12.369601 1193 rpcz_store.cc:276] 0616 19:52:08.930327 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.930865 (+ 538us) service_pool.cc:224] Handling call
0616 19:52:12.369368 (+3438503us) ts_tablet_manager.cc:1151] Deleting tablet aee589880bac4eff98fa6edd32c0b92d
0616 19:52:12.369377 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.369461 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3438363}
I20260616 19:52:12.370100 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 908) took 3436 ms. Trace:
I20260616 19:52:12.370227 1193 rpcz_store.cc:276] 0616 19:52:08.933173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.933231 (+ 58us) service_pool.cc:224] Handling call
0616 19:52:12.370016 (+3436785us) ts_tablet_manager.cc:1151] Deleting tablet 6677452bd2ce4ba5a07fdf67e9529830
0616 19:52:12.370024 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.370089 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3436612}
I20260616 19:52:12.370429 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b3c170ea2a34e72824dc90f15534745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.370667 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 4faa62f03c2a4588a776883dc54d0426 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.370918 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 933) took 2587 ms. Trace:
I20260616 19:52:12.371045 1193 rpcz_store.cc:276] 0616 19:52:09.783814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.790460 (+ 6646us) service_pool.cc:224] Handling call
0616 19:52:12.370835 (+2580375us) ts_tablet_manager.cc:1151] Deleting tablet faf4a0e2d3a1415aafe22501d8ae88b4
0616 19:52:12.370843 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.370906 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2580174}
I20260616 19:52:12.371413 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b3c170ea2a34e72824dc90f15534745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.370617 1196 tablet_bootstrap.cc:492] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:12.371928 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 4faa62f03c2a4588a776883dc54d0426 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.372164 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 934) took 2588 ms. Trace:
W20260616 19:52:12.372350 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 40124cee94a445ed9175132d4e0c86d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40124cee94a445ed9175132d4e0c86d8 already in progress: creating tablet
I20260616 19:52:12.372516 1193 rpcz_store.cc:276] 0616 19:52:09.783871 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.790681 (+ 6810us) service_pool.cc:224] Handling call
0616 19:52:12.371311 (+2580630us) ts_tablet_manager.cc:1151] Deleting tablet b0b4d05e770845e0aa8e6a30a86babe8
0616 19:52:12.371318 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.372148 (+ 830us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2580503}
W20260616 19:52:12.372642 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet aee589880bac4eff98fa6edd32c0b92d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aee589880bac4eff98fa6edd32c0b92d already in progress: creating tablet
W20260616 19:52:12.372848 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 6677452bd2ce4ba5a07fdf67e9529830 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6677452bd2ce4ba5a07fdf67e9529830 already in progress: creating tablet
W20260616 19:52:12.373062 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet faf4a0e2d3a1415aafe22501d8ae88b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet faf4a0e2d3a1415aafe22501d8ae88b4 already in progress: creating tablet
W20260616 19:52:12.373487 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet b0b4d05e770845e0aa8e6a30a86babe8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0b4d05e770845e0aa8e6a30a86babe8 already in progress: creating tablet
I20260616 19:52:12.374382 1196 tablet_bootstrap.cc:654] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.374465 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 932) took 2589 ms. Trace:
I20260616 19:52:12.376920 1193 rpcz_store.cc:276] 0616 19:52:09.783747 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.786173 (+ 2426us) service_pool.cc:224] Handling call
0616 19:52:12.373164 (+2586991us) ts_tablet_manager.cc:1151] Deleting tablet 9a77f8c5c40e4892831cb8af6c305c62
0616 19:52:12.373174 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.373283 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2569699}
I20260616 19:52:12.377954 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 931) took 2594 ms. Trace:
I20260616 19:52:12.378080 1193 rpcz_store.cc:276] 0616 19:52:09.783674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.786242 (+ 2568us) service_pool.cc:224] Handling call
0616 19:52:12.377854 (+2591612us) ts_tablet_manager.cc:1151] Deleting tablet 4481d9d481ee45449ac332ff19c06a54
0616 19:52:12.377864 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.377938 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2547257}
I20260616 19:52:12.378587 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 964) took 1910 ms. Trace:
I20260616 19:52:12.378711 1193 rpcz_store.cc:276] 0616 19:52:10.467719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.598632 (+130913us) service_pool.cc:224] Handling call
0616 19:52:12.378486 (+1779854us) ts_tablet_manager.cc:1151] Deleting tablet 608c26854fdf4dcd8cec2604d23a0dec
0616 19:52:12.378494 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.378571 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1431833}
I20260616 19:52:12.379215 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 965) took 1911 ms. Trace:
I20260616 19:52:12.379969 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a0313e65e6a3441abcd663110cfcd70d
I20260616 19:52:12.380743 898 tablet_service.cc:1558] Processing DeleteTablet for tablet a0313e65e6a3441abcd663110cfcd70d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.381289 1198 tablet_bootstrap.cc:492] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:12.381475 1198 ts_tablet_manager.cc:1403] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.219s user 0.020s sys 0.003s
I20260616 19:52:12.381587 1193 rpcz_store.cc:276] 0616 19:52:10.467785 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.611376 (+143591us) service_pool.cc:224] Handling call
0616 19:52:12.379103 (+1767727us) ts_tablet_manager.cc:1151] Deleting tablet 30f47e639195478f9cda4ab8f8b33798
0616 19:52:12.379112 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.379185 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1421865}
I20260616 19:52:12.382483 1198 raft_consensus.cc:359] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.383052 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 966) took 1915 ms. Trace:
I20260616 19:52:12.383170 1193 rpcz_store.cc:276] 0616 19:52:10.467854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.612304 (+144450us) service_pool.cc:224] Handling call
0616 19:52:12.382955 (+1770651us) ts_tablet_manager.cc:1151] Deleting tablet 7ffc15f90dc24de49455205d5de6b58e
0616 19:52:12.382964 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.383037 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1416005}
I20260616 19:52:12.383690 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 967) took 1915 ms. Trace:
I20260616 19:52:12.383917 1193 rpcz_store.cc:276] 0616 19:52:10.467920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.612336 (+144416us) service_pool.cc:224] Handling call
0616 19:52:12.383598 (+1771262us) ts_tablet_manager.cc:1151] Deleting tablet afc58b2bda2a43f18f157469b591854b
0616 19:52:12.383606 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.383675 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1406353}
I20260616 19:52:12.384140 1198 raft_consensus.cc:385] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.384585 749 tablet_service.cc:1558] Processing DeleteTablet for tablet a0313e65e6a3441abcd663110cfcd70d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:12.385283 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 9a77f8c5c40e4892831cb8af6c305c62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a77f8c5c40e4892831cb8af6c305c62 already in progress: creating tablet
W20260616 19:52:12.385566 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 4481d9d481ee45449ac332ff19c06a54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4481d9d481ee45449ac332ff19c06a54 already in progress: creating tablet
W20260616 19:52:12.385836 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 608c26854fdf4dcd8cec2604d23a0dec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 608c26854fdf4dcd8cec2604d23a0dec already in progress: creating tablet
W20260616 19:52:12.386083 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 30f47e639195478f9cda4ab8f8b33798 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30f47e639195478f9cda4ab8f8b33798 already in progress: creating tablet
W20260616 19:52:12.386567 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 7ffc15f90dc24de49455205d5de6b58e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ffc15f90dc24de49455205d5de6b58e already in progress: creating tablet
I20260616 19:52:12.386808 1198 raft_consensus.cc:740] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
W20260616 19:52:12.386819 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet afc58b2bda2a43f18f157469b591854b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afc58b2bda2a43f18f157469b591854b already in progress: creating tablet
I20260616 19:52:12.384431 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 968) took 1916 ms. Trace:
I20260616 19:52:12.387295 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_741b674265134685a9c017247e4df71e" } modify_external_catalogs: true
I20260616 19:52:12.387498 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_741b674265134685a9c017247e4df71e" } modify_external_catalogs: true
I20260616 19:52:12.387130 1198 consensus_queue.cc:260] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.387610 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1e4e899fd0774fcea48561588b790c30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:12.387450 1193 rpcz_store.cc:276] 0616 19:52:10.468013 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.672567 (+204554us) service_pool.cc:224] Handling call
0616 19:52:12.384340 (+1711773us) ts_tablet_manager.cc:1151] Deleting tablet de16c3feb7374077bc9817c703e5127c
0616 19:52:12.384349 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.384417 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1400979}
W20260616 19:52:12.388250 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e4e899fd0774fcea48561588b790c30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.388813 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5030578ef2be4c15836c8043b7346740"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:12.389036 1193 tablet_replica.cc:333] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:12.389232 1193 raft_consensus.cc:2243] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:12.389297 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5030578ef2be4c15836c8043b7346740 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.389408 1193 raft_consensus.cc:2272] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.389611 2401 raft_consensus.cc:493] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.389714 2401 raft_consensus.cc:515] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:12.390174 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet de16c3feb7374077bc9817c703e5127c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de16c3feb7374077bc9817c703e5127c already in progress: creating tablet
I20260616 19:52:12.390511 2401 leader_election.cc:290] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:12.391060 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a2855b7dec4244a3fc52bdca7e7eb3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:12.391579 993 leader_election.cc:343] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.392124 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a2855b7dec4244a3fc52bdca7e7eb3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:12.392684 996 leader_election.cc:343] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.392782 996 leader_election.cc:304] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:12.393098 2401 raft_consensus.cc:2749] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.394022 1198 ts_tablet_manager.cc:1434] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260616 19:52:12.394351 1198 tablet_bootstrap.cc:492] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:12.397428 1193 ts_tablet_manager.cc:1916] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.401458 1198 tablet_bootstrap.cc:654] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.402966 1196 tablet_bootstrap.cc:492] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.403156 1196 ts_tablet_manager.cc:1403] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.003s
I20260616 19:52:12.403975 1196 raft_consensus.cc:359] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.404062 1192 tablet_bootstrap.cc:492] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:12.404206 1192 ts_tablet_manager.cc:1403] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.322s user 0.003s sys 0.010s
I20260616 19:52:12.404217 1196 raft_consensus.cc:385] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.404284 1196 raft_consensus.cc:740] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.404554 1196 consensus_queue.cc:260] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.405342 1196 ts_tablet_manager.cc:1434] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:12.405643 1196 tablet_bootstrap.cc:492] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:12.407248 1196 tablet_bootstrap.cc:654] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.412154 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet a0313e65e6a3441abcd663110cfcd70d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.413897 1192 raft_consensus.cc:359] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.390406 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_62b1eb40939947c7bd2d7f18665caf57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.415397 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62b1eb40939947c7bd2d7f18665caf57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.415524 1192 raft_consensus.cc:385] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.415618 1192 raft_consensus.cc:740] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.415643 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a4f840ab91814287af6012eba99963ff" } new_table_name: "default.Table_5f3897e02b7e415eabd91dd45f46ffcf" modify_external_catalogs: true
I20260616 19:52:12.416353 1192 consensus_queue.cc:260] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.406002 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet b65c52ad5b0d48caa5da88c75c60971c
I20260616 19:52:12.423696 898 tablet_service.cc:1558] Processing DeleteTablet for tablet b65c52ad5b0d48caa5da88c75c60971c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.424578 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet b65c52ad5b0d48caa5da88c75c60971c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.424963 898 tablet_service.cc:1558] Processing DeleteTablet for tablet d5c82b71969e4cbcb890d16e1cdd5348 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.414803 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e8160ad4cf74f16a586ae59291ce7d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.426883 2233 raft_consensus.cc:493] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.427003 2233 raft_consensus.cc:515] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.427567 2233 leader_election.cc:290] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.428524 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8160ad4cf74f16a586ae59291ce7d1" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.434556 1190 ts_tablet_manager.cc:1950] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:12.434970 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 893) took 3502 ms. Trace:
I20260616 19:52:12.435233 1190 rpcz_store.cc:276] 0616 19:52:08.932458 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.932530 (+ 72us) service_pool.cc:224] Handling call
0616 19:52:12.205083 (+3272553us) ts_tablet_manager.cc:1151] Deleting tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b
0616 19:52:12.205090 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.284374 (+ 79284us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.360159 (+ 75785us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.434953 (+ 74794us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3272374}
I20260616 19:52:12.436049 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 894) took 3502 ms. Trace:
I20260616 19:52:12.436345 1190 rpcz_store.cc:276] 0616 19:52:08.933268 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.933512 (+ 244us) service_pool.cc:224] Handling call
0616 19:52:12.435933 (+3502421us) ts_tablet_manager.cc:1151] Deleting tablet 6677452bd2ce4ba5a07fdf67e9529830
0616 19:52:12.435942 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.436033 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3502274}
I20260616 19:52:12.440538 2353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85d6b13547f2413c86ee07194ca74704. Latest consensus state: current_term: 2 leader_uuid: "85d6b13547f2413c86ee07194ca74704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:52:12.440809 2353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [sys.catalog]: This master's current role is: FOLLOWER
I20260616 19:52:12.441680 2409 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85d6b13547f2413c86ee07194ca74704)
I20260616 19:52:12.441944 2409 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:52:12.442878 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc9e90f53094eb48cfb003d45aa5290 (DEFAULT_TABLE table=default.Table_e986dba9a8714033911e828afac47182 [id=6a949b769989407c9c53da73c05c7ced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.443277 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc9e90f53094eb48cfb003d45aa5290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.417871 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b95df4211cf34d5e90161549b0e21196"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:12.352437 1191 rpcz_store.cc:276] 0616 19:52:07.695929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.695983 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:12.340306 (+4644323us) ts_tablet_manager.cc:1151] Deleting tablet 3b57bceabff64533ae3a49b8afda614d
0616 19:52:12.340319 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.349002 (+ 8683us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.351585 (+ 2583us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.352348 (+ 763us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4531517}
W20260616 19:52:12.447474 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b95df4211cf34d5e90161549b0e21196 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.447552 1191 tablet_replica.cc:333] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:12.447754 1191 raft_consensus.cc:2243] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:12.447983 1191 pending_rounds.cc:70] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2: Trying to abort 1 pending ops.
I20260616 19:52:12.447969 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 3b57bceabff64533ae3a49b8afda614d (table default.Table_9b86a6539e534ff4a58c2c7ad01e99a0 [id=e29060d6148a4e819d0e9c80cb32956b]) successfully deleted
I20260616 19:52:12.448035 1191 pending_rounds.cc:77] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595522268540928 op_type: NO_OP noop_request { }
I20260616 19:52:12.448132 1191 raft_consensus.cc:2889] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:12.448215 1191 raft_consensus.cc:2272] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.422708 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_253cae986d644063bf9fe7a2a9fb9ce9" } modify_external_catalogs: true
I20260616 19:52:12.448791 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_253cae986d644063bf9fe7a2a9fb9ce9" } modify_external_catalogs: true
I20260616 19:52:12.449059 1191 ts_tablet_manager.cc:1916] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.449075 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8160ad4cf74f16a586ae59291ce7d1" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:12.449720 719 leader_election.cc:304] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:12.450455 2233 raft_consensus.cc:2749] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.417469 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5f6a8f2248c34edb80817679ba78faf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.453615 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f6a8f2248c34edb80817679ba78faf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.461865 2409 leader_election.cc:290] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85d6b13547f2413c86ee07194ca74704 (127.0.105.190:35857), c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219)
I20260616 19:52:12.467594 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 891) took 3537 ms. Trace:
I20260616 19:52:12.467767 1190 rpcz_store.cc:276] 0616 19:52:08.930098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.932523 (+ 2425us) service_pool.cc:224] Handling call
0616 19:52:12.467431 (+3534908us) ts_tablet_manager.cc:1151] Deleting tablet 40124cee94a445ed9175132d4e0c86d8
0616 19:52:12.467446 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.467571 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3531079}
I20260616 19:52:12.468354 1190 tablet_replica.cc:333] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:12.468657 1190 raft_consensus.cc:2243] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.469277 1190 raft_consensus.cc:2272] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.469977 1190 ts_tablet_manager.cc:1916] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.447036 1192 ts_tablet_manager.cc:1434] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260616 19:52:12.424963 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_678e58d369004dd58c9fc0e0ced4ad20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:12.435842 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b (table default.Table_2349f63e2a7e4af4ae0a80e8ed86c6a9 [id=f37d0e612ff74a31842cf47ec47beb3f]) successfully deleted
W20260616 19:52:12.475410 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_678e58d369004dd58c9fc0e0ced4ad20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:12.475999 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 6677452bd2ce4ba5a07fdf67e9529830 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6677452bd2ce4ba5a07fdf67e9529830 already in progress: creating tablet
W20260616 19:52:12.476233 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 40124cee94a445ed9175132d4e0c86d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40124cee94a445ed9175132d4e0c86d8 already in progress: creating tablet
I20260616 19:52:12.477468 1972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53726 (request call id 0) took 6174 ms. Trace:
I20260616 19:52:12.477718 898 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc9e90f53094eb48cfb003d45aa5290 (DEFAULT_TABLE table=default.Table_e986dba9a8714033911e828afac47182 [id=6a949b769989407c9c53da73c05c7ced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.424750 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a5adefde605d4bfb86e0d089b619c69b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.478457 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5adefde605d4bfb86e0d089b619c69b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.480362 1192 tablet_bootstrap.cc:492] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:12.483829 1193 ts_tablet_manager.cc:1929] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:12.484016 1193 log.cc:1199] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/44493f0ffd064249a28628cf24895395
I20260616 19:52:12.484541 1193 ts_tablet_manager.cc:1950] T 44493f0ffd064249a28628cf24895395 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:12.484994 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 982) took 1287 ms. Trace:
I20260616 19:52:12.485149 1193 rpcz_store.cc:276] 0616 19:52:11.197319 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.199011 (+ 1692us) service_pool.cc:224] Handling call
0616 19:52:12.388992 (+1189981us) ts_tablet_manager.cc:1151] Deleting tablet 44493f0ffd064249a28628cf24895395
0616 19:52:12.389000 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.450392 (+ 61392us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.483753 (+ 33361us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.484974 (+ 1221us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1189768}
I20260616 19:52:12.487048 1198 tablet_bootstrap.cc:492] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:12.487272 1198 ts_tablet_manager.cc:1403] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.093s user 0.006s sys 0.000s
I20260616 19:52:12.488190 1198 raft_consensus.cc:359] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.488492 1198 raft_consensus.cc:385] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.488610 1198 raft_consensus.cc:740] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.489030 1198 consensus_queue.cc:260] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.489728 1198 ts_tablet_manager.cc:1434] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:12.490032 1198 tablet_bootstrap.cc:492] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:12.485757 749 tablet_service.cc:1558] Processing DeleteTablet for tablet b65c52ad5b0d48caa5da88c75c60971c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.486116 1196 tablet_bootstrap.cc:492] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.487046 759 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc9e90f53094eb48cfb003d45aa5290 (DEFAULT_TABLE table=default.Table_e986dba9a8714033911e828afac47182 [id=6a949b769989407c9c53da73c05c7ced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.495144 1196 ts_tablet_manager.cc:1403] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.090s user 0.003s sys 0.002s
I20260616 19:52:12.495435 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc9e90f53094eb48cfb003d45aa5290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.495867 1196 raft_consensus.cc:359] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.496032 1196 raft_consensus.cc:385] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.496096 1196 raft_consensus.cc:740] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.496328 1196 consensus_queue.cc:260] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.496996 1196 ts_tablet_manager.cc:1434] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:12.497262 1196 tablet_bootstrap.cc:492] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:12.498884 1196 tablet_bootstrap.cc:654] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.500324 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 17d5740c8bc14441a4f5d7c509791679 (DEFAULT_TABLE table=default.Table_8dfce4bb3f8d42fba854b68e675edf41 [id=8f80d945298f4753b1ab8de3ed95cf41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.500720 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d5740c8bc14441a4f5d7c509791679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.500801 885 tablet_service.cc:1511] Processing CreateTablet for tablet 6912ee85a31f45bebe43e81281d8f3b8 (DEFAULT_TABLE table=default.Table_f5e8ac7e1cca41ed936c24c7356a3b78 [id=a370c142ffc645c681b79867a9b0d2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.501940 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_80f6064bd3104b6699561f5e6cda71ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.502491 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80f6064bd3104b6699561f5e6cda71ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.502780 889 tablet_service.cc:1511] Processing CreateTablet for tablet 17d5740c8bc14441a4f5d7c509791679 (DEFAULT_TABLE table=default.Table_8dfce4bb3f8d42fba854b68e675edf41 [id=8f80d945298f4753b1ab8de3ed95cf41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.503895 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1d538611df134f06bf8db007545c11e0" } new_table_name: "default.Table_acc65356a0ab40718b59c65302fecca8" modify_external_catalogs: true
I20260616 19:52:12.504280 749 tablet_service.cc:1511] Processing CreateTablet for tablet 6912ee85a31f45bebe43e81281d8f3b8 (DEFAULT_TABLE table=default.Table_f5e8ac7e1cca41ed936c24c7356a3b78 [id=a370c142ffc645c681b79867a9b0d2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.504696 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6912ee85a31f45bebe43e81281d8f3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.509367 2297 raft_consensus.cc:493] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.509389 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 981) took 1452 ms. Trace:
I20260616 19:52:12.509510 2297 raft_consensus.cc:515] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.509485 1193 rpcz_store.cc:276] 0616 19:52:11.056987 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.256513 (+199526us) service_pool.cc:224] Handling call
0616 19:52:12.509232 (+1252719us) ts_tablet_manager.cc:1151] Deleting tablet 0b249e29f69943f287411783b84c6817
0616 19:52:12.509245 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.509365 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1252522}
I20260616 19:52:12.510190 2297 leader_election.cc:290] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:12.510510 1193 tablet_replica.cc:333] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:12.510758 1193 raft_consensus.cc:2243] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.511013 1193 raft_consensus.cc:2272] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.511214 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17029c1ba36644e9847200b54bf9094c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:12.511399 780 raft_consensus.cc:2468] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:12.511582 1193 ts_tablet_manager.cc:1916] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.512502 2233 raft_consensus.cc:493] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.512637 2233 raft_consensus.cc:515] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.513160 2233 leader_election.cc:290] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.513756 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be902fe29bb46a4bf71ee6384e6722a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:12.514070 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be902fe29bb46a4bf71ee6384e6722a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.514276 860 leader_election.cc:304] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:12.514588 718 leader_election.cc:304] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:12.514957 2233 raft_consensus.cc:2749] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.515509 2297 raft_consensus.cc:2804] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:12.515617 2297 raft_consensus.cc:493] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:12.515695 2297 raft_consensus.cc:3060] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.518293 2297 raft_consensus.cc:515] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.519429 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17029c1ba36644e9847200b54bf9094c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:12.519580 1055 raft_consensus.cc:3060] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.522058 1055 raft_consensus.cc:2468] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:12.522657 858 leader_election.cc:304] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:12.522897 2285 raft_consensus.cc:2804] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:12.522939 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17029c1ba36644e9847200b54bf9094c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:12.523006 2285 raft_consensus.cc:697] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:12.523097 780 raft_consensus.cc:3060] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.523226 2285 consensus_queue.cc:237] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.525801 780 raft_consensus.cc:2468] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:12.526831 775 raft_consensus.cc:3060] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.526875 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17029c1ba36644e9847200b54bf9094c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:12.527076 1059 raft_consensus.cc:2376] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1. Re-sending same reply.
I20260616 19:52:12.527712 1198 tablet_bootstrap.cc:654] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.532954 2297 leader_election.cc:290] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:12.534235 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 01d862f2ce2e4051bcbc71ba8f24846e from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:12.534272 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 44493f0ffd064249a28628cf24895395 (table default.Table_718b661372f441feb171907daff44e2d [id=a5404ca6c40f44b8b881ef582d703fd5]) successfully deleted
W20260616 19:52:12.535162 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0b249e29f69943f287411783b84c6817 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b249e29f69943f287411783b84c6817 already in progress: creating tablet
W20260616 19:52:12.535797 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c204a0af6eac4bc2897b48be50070860 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c204a0af6eac4bc2897b48be50070860 already in progress: creating tablet
W20260616 19:52:12.536520 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 89432adb0a4b442bbc5e46ee43a3e1b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89432adb0a4b442bbc5e46ee43a3e1b2 already in progress: creating tablet
W20260616 19:52:12.537415 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 49ab6193c479400da00e1fa80a5274a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49ab6193c479400da00e1fa80a5274a2 already in progress: creating tablet
W20260616 19:52:12.538300 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet aa989f24b81b4c148069d1d8176dad8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa989f24b81b4c148069d1d8176dad8b already in progress: creating tablet
I20260616 19:52:12.538542 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 6912ee85a31f45bebe43e81281d8f3b8 (DEFAULT_TABLE table=default.Table_f5e8ac7e1cca41ed936c24c7356a3b78 [id=a370c142ffc645c681b79867a9b0d2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.538970 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6912ee85a31f45bebe43e81281d8f3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.539172 1196 tablet_bootstrap.cc:492] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.539430 1196 ts_tablet_manager.cc:1403] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.001s
I20260616 19:52:12.540371 1196 raft_consensus.cc:359] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.540684 1196 raft_consensus.cc:385] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.540807 1196 raft_consensus.cc:740] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.541136 1196 consensus_queue.cc:260] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.541811 1196 ts_tablet_manager.cc:1434] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:12.542169 1196 tablet_bootstrap.cc:492] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:12.543735 1196 tablet_bootstrap.cc:654] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.547398 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a2855b7dec4244a3fc52bdca7e7eb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.548259 1198 tablet_bootstrap.cc:492] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:12.548439 1198 ts_tablet_manager.cc:1403] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.000s
I20260616 19:52:12.549216 1198 raft_consensus.cc:359] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.549441 1198 raft_consensus.cc:385] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.549554 1198 raft_consensus.cc:740] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.553764 1198 consensus_queue.cc:260] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.555866 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ee10d6f8fd5040aebd9c9592d84534fc
I20260616 19:52:12.557206 903 tablet_service.cc:1558] Processing DeleteTablet for tablet ee10d6f8fd5040aebd9c9592d84534fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.559991 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet ee10d6f8fd5040aebd9c9592d84534fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.562491 2297 raft_consensus.cc:493] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.562629 2297 raft_consensus.cc:515] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.563328 2297 leader_election.cc:290] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:12.563706 2401 raft_consensus.cc:493] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.563855 2401 raft_consensus.cc:515] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.564455 2401 leader_election.cc:290] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:12.565061 858 leader_election.cc:343] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 3b57bceabff64533ae3a49b8afda614d
I20260616 19:52:12.565337 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d30c340494490896c8da33d110708" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:12.565824 993 leader_election.cc:343] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.567411 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1696a3c9f24001a4aaf99725f73f62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.568602 1198 ts_tablet_manager.cc:1434] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260616 19:52:12.569244 1379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 961 } } ignore_live_leader: false dest_uuid: "c404c91cd2194cf6838fddd212f2f4ae" is_pre_election: true
I20260616 19:52:12.572557 1198 tablet_bootstrap.cc:492] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:12.572889 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 67ac2e31a1ba40b39145c26a1e4e0884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.579202 2233 raft_consensus.cc:493] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.579339 2233 raft_consensus.cc:515] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.579975 2233 leader_election.cc:290] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:12.581228 718 leader_election.cc:343] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: da74f89b7ff44f49b8e2f2c2cbcbdb0b
W20260616 19:52:12.581962 719 leader_election.cc:343] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: da74f89b7ff44f49b8e2f2c2cbcbdb0b
I20260616 19:52:12.582103 719 leader_election.cc:304] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:12.582903 2233 raft_consensus.cc:2749] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:12.583557 860 consensus_peers.cc:597] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:12.504280 751 tablet_service.cc:1511] Processing CreateTablet for tablet 17d5740c8bc14441a4f5d7c509791679 (DEFAULT_TABLE table=default.Table_8dfce4bb3f8d42fba854b68e675edf41 [id=8f80d945298f4753b1ab8de3ed95cf41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.565069 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d30c340494490896c8da33d110708" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:12.566470 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b57bceabff64533ae3a49b8afda614d" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:12.584378 1198 tablet_bootstrap.cc:654] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:12.584319 860 leader_election.cc:343] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.584439 860 leader_election.cc:304] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:12.584913 2297 raft_consensus.cc:2749] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:12.584969 996 leader_election.cc:343] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.585090 996 leader_election.cc:304] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:12.586191 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 961 } } ignore_live_leader: false dest_uuid: "85d6b13547f2413c86ee07194ca74704" is_pre_election: true
I20260616 19:52:12.586923 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d5740c8bc14441a4f5d7c509791679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.590262 2233 raft_consensus.cc:493] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.590382 2233 raft_consensus.cc:515] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.590668 903 tablet_service.cc:1511] Processing CreateTablet for tablet a12cd3744782442f94dc6e76727cca1c (DEFAULT_TABLE table=default.Table_1932c06b086a4a5999bd9df382ca4e09 [id=794152a3398c4fe99fb71026bb4c02cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.590931 2233 leader_election.cc:290] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.590950 1036 tablet_service.cc:1511] Processing CreateTablet for tablet a12cd3744782442f94dc6e76727cca1c (DEFAULT_TABLE table=default.Table_1932c06b086a4a5999bd9df382ca4e09 [id=794152a3398c4fe99fb71026bb4c02cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.591295 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12cd3744782442f94dc6e76727cca1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.591717 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5029a79e046a489aa9976eff948a3c5b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.591944 922 raft_consensus.cc:2468] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:12.592417 718 leader_election.cc:304] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:12.592736 2233 raft_consensus.cc:2804] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:12.592821 2233 raft_consensus.cc:493] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:12.592883 2233 raft_consensus.cc:3060] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.595474 2233 raft_consensus.cc:515] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:12.596203 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49f85f7727e447c88eb0287b19005b1b consensus state has no leader
I20260616 19:52:12.590037 459 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]). Expected version 2 got 0
I20260616 19:52:12.596611 775 raft_consensus.cc:3060] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:12.597147 719 leader_election.cc:343] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 5029a79e046a489aa9976eff948a3c5b
I20260616 19:52:12.597211 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 01d862f2ce2e4051bcbc71ba8f24846e
I20260616 19:52:12.597657 460 catalog_manager.cc:6784] ReplaceTablet: tablet 01d862f2ce2e4051bcbc71ba8f24846e deleted and replaced by tablet f12cafb741da4019aa39f0579db97d34
I20260616 19:52:12.598519 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 01d862f2ce2e4051bcbc71ba8f24846e with delete_type TABLET_DATA_DELETED (replaced by tablet f12cafb741da4019aa39f0579db97d34) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:12.599025 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81618a3f43ad40fc8173e266cc106899 consensus state has no leader
I20260616 19:52:12.599663 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 01d862f2ce2e4051bcbc71ba8f24846e with delete_type TABLET_DATA_DELETED (replaced by tablet f12cafb741da4019aa39f0579db97d34) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.600220 890 tablet_service.cc:1511] Processing CreateTablet for tablet afe118a94c3749078d8e5b919f71b04c (DEFAULT_TABLE table=default.Table_92ba13ce312d41f29620ddcca694a28d [id=cee303e08ea349a887210b0161ff35f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.601024 2287 raft_consensus.cc:2749] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.601653 2242 consensus_queue.cc:1048] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:12.477620 1972 rpcz_store.cc:276] 0616 19:52:06.304251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:06.304424 (+ 173us) service_pool.cc:224] Handling call
0616 19:52:11.343576 (+5039152us) raft_consensus.cc:1471] Updating replica for 447 ops
0616 19:52:11.546678 (+203102us) raft_consensus.cc:1534] Early marking committed up to index 550
0616 19:52:11.796696 (+250018us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:11.796705 (+ 9us) write_op.cc:454] Released schema lock
0616 19:52:11.814016 (+ 17311us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:11.814026 (+ 10us) write_op.cc:454] Released schema lock
0616 19:52:11.834295 (+ 20269us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:11.834304 (+ 9us) write_op.cc:454] Released schema lock
0616 19:52:11.835154 (+ 850us) raft_consensus.cc:1539] Triggering prepare for 411 ops
0616 19:52:11.941814 (+106660us) write_op.cc:270] Start()
0616 19:52:11.942010 (+ 196us) write_op.cc:276] Timestamp: P: 1781639519307839 usec, L: 0
0616 19:52:11.942819 (+ 809us) write_op.cc:270] Start()
0616 19:52:11.944329 (+ 1510us) write_op.cc:276] Timestamp: P: 1781639519311388 usec, L: 0
0616 19:52:11.950878 (+ 6549us) write_op.cc:270] Start()
0616 19:52:11.950903 (+ 25us) write_op.cc:276] Timestamp: P: 1781639519327057 usec, L: 0
0616 19:52:11.951720 (+ 817us) write_op.cc:270] Start()
0616 19:52:11.951744 (+ 24us) write_op.cc:276] Timestamp: P: 1781639519340701 usec, L: 0
0616 19:52:11.952269 (+ 525us) write_op.cc:270] Start()
0616 19:52:11.952289 (+ 20us) write_op.cc:276] Timestamp: P: 1781639519341681 usec, L: 0
0616 19:52:11.952794 (+ 505us) write_op.cc:270] Start()
0616 19:52:11.952816 (+ 22us) write_op.cc:276] Timestamp: P: 1781639519342520 usec, L: 0
0616 19:52:11.953276 (+ 460us) write_op.cc:270] Start()
0616 19:52:11.953296 (+ 20us) write_op.cc:276] Timestamp: P: 1781639519356582 usec, L: 0
0616 19:52:12.008106 (+ 54810us) write_op.cc:270] Start()
0616 19:52:12.008141 (+ 35us) write_op.cc:276] Timestamp: P: 1781639519367776 usec, L: 0
0616 19:52:12.009003 (+ 862us) write_op.cc:270] Start()
0616 19:52:12.009029 (+ 26us) write_op.cc:276] Timestamp: P: 1781639519379735 usec, L: 0
0616 19:52:12.017052 (+ 8023us) write_op.cc:270] Start()
0616 19:52:12.017089 (+ 37us) write_op.cc:276] Timestamp: P: 1781639519405547 usec, L: 0
0616 19:52:12.017928 (+ 839us) write_op.cc:270] Start()
0616 19:52:12.017964 (+ 36us) write_op.cc:276] Timestamp: P: 1781639519419381 usec, L: 0
0616 19:52:12.020117 (+ 2153us) write_op.cc:270] Start()
0616 19:52:12.020148 (+ 31us) write_op.cc:276] Timestamp: P: 1781639519434424 usec, L: 0
0616 19:52:12.052764 (+ 32616us) write_op.cc:270] Start()
0616 19:52:12.052802 (+ 38us) write_op.cc:276] Timestamp: P: 1781639519442453 usec, L: 0
0616 19:52:12.054330 (+ 1528us) write_op.cc:270] Start()
0616 19:52:12.054359 (+ 29us) write_op.cc:276] Timestamp: P: 1781639519451458 usec, L: 0
0616 19:52:12.054510 (+ 151us) write_op.cc:270] Start()
0616 19:52:12.054529 (+ 19us) write_op.cc:276] Timestamp: P: 1781639519457341 usec, L: 0
0616 19:52:12.062206 (+ 7677us) write_op.cc:270] Start()
0616 19:52:12.062239 (+ 33us) write_op.cc:276] Timestamp: P: 1781639519483953 usec, L: 0
0616 19:52:12.111178 (+ 48939us) write_op.cc:270] Start()
0616 19:52:12.111210 (+ 32us) write_op.cc:276] Timestamp: P: 1781639519505545 usec, L: 0
0616 19:52:12.112384 (+ 1174us) write_op.cc:270] Start()
0616 19:52:12.112411 (+ 27us) write_op.cc:276] Timestamp: P: 1781639519528163 usec, L: 0
0616 19:52:12.112588 (+ 177us) write_op.cc:270] Start()
0616 19:52:12.112610 (+ 22us) write_op.cc:276] Timestamp: P: 1781639519570040 usec, L: 0
0616 19:52:12.112751 (+ 141us) write_op.cc:270] Start()
0616 19:52:12.112769 (+ 18us) write_op.cc:276] Timestamp: P: 1781639519577400 usec, L: 0
0616 19:52:12.112893 (+ 124us) write_op.cc:270] Start()
0616 19:52:12.112938 (+ 45us) write_op.cc:276] Timestamp: P: 1781639519578496 usec, L: 0
0616 19:52:12.113044 (+ 106us) write_op.cc:270] Start()
0616 19:52:12.113060 (+ 16us) write_op.cc:276] Timestamp: P: 1781639519579069 usec, L: 0
0616 19:52:12.113205 (+ 145us) write_op.cc:270] Start()
0616 19:52:12.113223 (+ 18us) write_op.cc:276] Timestamp: P: 1781639519671204 usec, L: 0
0616 19:52:12.113394 (+ 171us) write_op.cc:270] Start()
0616 19:52:12.113420 (+ 26us) write_op.cc:276] Timestamp: P: 1781639519672364 usec, L: 0
0616 19:52:12.113589 (+ 169us) write_op.cc:270] Start()
0616 19:52:12.113612 (+ 23us) write_op.cc:276] Timestamp: P: 1781639519710565 usec, L: 0
0616 19:52:12.113761 (+ 149us) write_op.cc:270] Start()
0616 19:52:12.113786 (+ 25us) write_op.cc:276] Timestamp: P: 1781639519724626 usec, L: 0
0616 19:52:12.113938 (+ 152us) write_op.cc:270] Start()
0616 19:52:12.113959 (+ 21us) write_op.cc:276] Timestamp: P: 1781639519735209 usec, L: 0
0616 19:52:12.114119 (+ 160us) write_op.cc:270] Start()
0616 19:52:12.114139 (+ 20us) write_op.cc:276] Timestamp: P: 1781639519760673 usec, L: 0
0616 19:52:12.124671 (+ 10532us) write_op.cc:270] Start()
0616 19:52:12.124699 (+ 28us) write_op.cc:276] Timestamp: P: 1781639519774279 usec, L: 0
0616 19:52:12.124872 (+ 173us) write_op.cc:270] Start()
0616 19:52:12.124898 (+ 26us) write_op.cc:276] Timestamp: P: 1781639519792251 usec, L: 0
0616 19:52:12.125497 (+ 599us) write_op.cc:270] Start()
0616 19:52:12.125521 (+ 24us) write_op.cc:276] Timestamp: P: 1781639519803919 usec, L: 0
0616 19:52:12.125690 (+ 169us) write_op.cc:270] Start()
0616 19:52:12.125716 (+ 26us) write_op.cc:276] Timestamp: P: 1781639519824128 usec, L: 0
0616 19:52:12.125875 (+ 159us) write_op.cc:270] Start()
0616 19:52:12.125896 (+ 21us) write_op.cc:276] Timestamp: P: 1781639519844894 usec, L: 0
0616 19:52:12.126042 (+ 146us) write_op.cc:270] Start()
0616 19:52:12.126062 (+ 20us) write_op.cc:276] Timestamp: P: 1781639519851778 usec, L: 0
0616 19:52:12.126227 (+ 165us) write_op.cc:270] Start()
0616 19:52:12.126248 (+ 21us) write_op.cc:276] Timestamp: P: 1781639519863243 usec, L: 0
0616 19:52:12.126401 (+ 153us) write_op.cc:270] Start()
0616 19:52:12.126426 (+ 25us) write_op.cc:276] Timestamp: P: 1781639519875313 usec, L: 0
0616 19:52:12.126561 (+ 135us) write_op.cc:270] Start()
0616 19:52:12.126592 (+ 31us) write_op.cc:276] Timestamp: P: 1781639519887128 usec, L: 0
0616 19:52:12.126758 (+ 166us) write_op.cc:270] Start()
0616 19:52:12.126777 (+ 19us) write_op.cc:276] Timestamp: P: 1781639519899383 usec, L: 0
0616 19:52:12.126898 (+ 121us) write_op.cc:270] Start()
0616 19:52:12.126920 (+ 22us) write_op.cc:276] Timestamp: P: 1781639519920426 usec, L: 0
0616 19:52:12.127043 (+ 123us) write_op.cc:270] Start()
0616 19:52:12.127062 (+ 19us) write_op.cc:276] Timestamp: P: 1781639519933425 usec, L: 0
0616 19:52:12.127210 (+ 148us) write_op.cc:270] Start()
0616 19:52:12.127232 (+ 22us) write_op.cc:276] Timestamp: P: 1781639519945862 usec, L: 0
0616 19:52:12.127385 (+ 153us) write_op.cc:270] Start()
0616 19:52:12.127404 (+ 19us) write_op.cc:276] Timestamp: P: 1781639520009560 usec, L: 0
0616 19:52:12.127579 (+ 175us) write_op.cc:270] Start()
0616 19:52:12.127600 (+ 21us) write_op.cc:276] Timestamp: P: 1781639520036861 usec, L: 0
0616 19:52:12.127730 (+ 130us) write_op.cc:270] Start()
0616 19:52:12.127751 (+ 21us) write_op.cc:276] Timestamp: P: 1781639520115770 usec, L: 0
0616 19:52:12.127894 (+ 143us) write_op.cc:270] Start()
0616 19:52:12.127914 (+ 20us) write_op.cc:276] Timestamp: P: 1781639520122635 usec, L: 0
0616 19:52:12.128068 (+ 154us) write_op.cc:270] Start()
0616 19:52:12.128086 (+ 18us) write_op.cc:276] Timestamp: P: 1781639520124889 usec, L: 0
0616 19:52:12.128266 (+ 180us) write_op.cc:270] Start()
0616 19:52:12.128287 (+ 21us) write_op.cc:276] Timestamp: P: 1781639520126297 usec, L: 0
0616 19:52:12.128434 (+ 147us) write_op.cc:270] Start()
0616 19:52:12.128453 (+ 19us) write_op.cc:276] Timestamp: P: 1781639520129722 usec, L: 0
0616 19:52:12.137180 (+ 8727us) write_op.cc:270] Start()
0616 19:52:12.137208 (+ 28us) write_op.cc:276] Timestamp: P: 1781639520131235 usec, L: 0
0616 19:52:12.137365 (+ 157us) write_op.cc:270] Start()
0616 19:52:12.137385 (+ 20us) write_op.cc:276] Timestamp: P: 1781639520132876 usec, L: 0
0616 19:52:12.137516 (+ 131us) write_op.cc:270] Start()
0616 19:52:12.137534 (+ 18us) write_op.cc:276] Timestamp: P: 1781639520206870 usec, L: 0
0616 19:52:12.137656 (+ 122us) write_op.cc:270] Start()
0616 19:52:12.137674 (+ 18us) write_op.cc:276] Timestamp: P: 1781639520219986 usec, L: 0
0616 19:52:12.137815 (+ 141us) write_op.cc:270] Start()
0616 19:52:12.137839 (+ 24us) write_op.cc:276] Timestamp: P: 1781639520225053 usec, L: 0
0616 19:52:12.137978 (+ 139us) write_op.cc:270] Start()
0616 19:52:12.137998 (+ 20us) write_op.cc:276] Timestamp: P: 1781639520227256 usec, L: 0
0616 19:52:12.138163 (+ 165us) write_op.cc:270] Start()
0616 19:52:12.138185 (+ 22us) write_op.cc:276] Timestamp: P: 1781639520228859 usec, L: 0
0616 19:52:12.138319 (+ 134us) write_op.cc:270] Start()
0616 19:52:12.138339 (+ 20us) write_op.cc:276] Timestamp: P: 1781639520245365 usec, L: 0
0616 19:52:12.138533 (+ 194us) write_op.cc:270] Start()
0616 19:52:12.138555 (+ 22us) write_op.cc:276] Timestamp: P: 1781639520250880 usec, L: 0
0616 19:52:12.138686 (+ 131us) write_op.cc:270] Start()
0616 19:52:12.138706 (+ 20us) write_op.cc:276] Timestamp: P: 1781639520251928 usec, L: 0
0616 19:52:12.138845 (+ 139us) write_op.cc:270] Start()
0616 19:52:12.138864 (+ 19us) write_op.cc:276] Timestamp: P: 1781639520252786 usec, L: 0
0616 19:52:12.139009 (+ 145us) write_op.cc:270] Start()
0616 19:52:12.139028 (+ 19us) write_op.cc:276] Timestamp: P: 1781639520253842 usec, L: 0
0616 19:52:12.139200 (+ 172us) write_op.cc:270] Start()
0616 19:52:12.139218 (+ 18us) write_op.cc:276] Timestamp: P: 1781639520259109 usec, L: 0
0616 19:52:12.139346 (+ 128us) write_op.cc:270] Start()
0616 19:52:12.139369 (+ 23us) write_op.cc:276] Timestamp: P: 1781639520260867 usec, L: 0
0616 19:52:12.139518 (+ 149us) write_op.cc:270] Start()
0616 19:52:12.139538 (+ 20us) write_op.cc:276] Timestamp: P: 1781639520263359 usec, L: 0
0616 19:52:12.139719 (+ 181us) write_op.cc:270] Start()
0616 19:52:12.139740 (+ 21us) write_op.cc:276] Timestamp: P: 1781639520267284 usec, L: 0
0616 19:52:12.144966 (+ 5226us) write_op.cc:270] Start()
0616 19:52:12.144996 (+ 30us) write_op.cc:276] Timestamp: P: 1781639520270797 usec, L: 0
0616 19:52:12.145162 (+ 166us) write_op.cc:270] Start()
0616 19:52:12.145185 (+ 23us) write_op.cc:276] Timestamp: P: 1781639520271689 usec, L: 0
0616 19:52:12.145335 (+ 150us) write_op.cc:270] Start()
0616 19:52:12.145356 (+ 21us) write_op.cc:276] Timestamp: P: 1781639520302929 usec, L: 0
0616 19:52:12.145480 (+ 124us) write_op.cc:270] Start()
0616 19:52:12.145505 (+ 25us) write_op.cc:276] Timestamp: P: 1781639520318894 usec, L: 0
0616 19:52:12.145658 (+ 153us) write_op.cc:270] Start()
0616 19:52:12.145685 (+ 27us) write_op.cc:276] Timestamp: P: 1781639520328444 usec, L: 0
0616 19:52:12.145824 (+ 139us) write_op.cc:270] Start()
0616 19:52:12.145844 (+ 20us) write_op.cc:276] Timestamp: P: 1781639520394795 usec, L: 0
0616 19:52:12.149474 (+ 3630us) write_op.cc:270] Start()
0616 19:52:12.149504 (+ 30us) write_op.cc:276] Timestamp: P: 1781639520426047 usec, L: 0
0616 19:52:12.149675 (+ 171us) write_op.cc:270] Start()
0616 19:52:12.149698 (+ 23us) write_op.cc:276] Timestamp: P: 1781639520426652 usec, L: 0
0616 19:52:12.149866 (+ 168us) write_op.cc:270] Start()
0616 19:52:12.149887 (+ 21us) write_op.cc:276] Timestamp: P: 1781639520427200 usec, L: 0
0616 19:52:12.150048 (+ 161us) write_op.cc:270] Start()
0616 19:52:12.150070 (+ 22us) write_op.cc:276] Timestamp: P: 1781639520435382 usec, L: 0
0616 19:52:12.150237 (+ 167us) write_op.cc:270] Start()
0616 19:52:12.150265 (+ 28us) write_op.cc:276] Timestamp: P: 1781639520436056 usec, L: 0
0616 19:52:12.150410 (+ 145us) write_op.cc:270] Start()
0616 19:52:12.150431 (+ 21us) write_op.cc:276] Timestamp: P: 1781639520437760 usec, L: 0
0616 19:52:12.150557 (+ 126us) write_op.cc:270] Start()
0616 19:52:12.150576 (+ 19us) write_op.cc:276] Timestamp: P: 1781639520448276 usec, L: 0
0616 19:52:12.150714 (+ 138us) write_op.cc:270] Start()
0616 19:52:12.150733 (+ 19us) write_op.cc:276] Timestamp: P: 1781639520471863 usec, L: 0
0616 19:52:12.150857 (+ 124us) write_op.cc:270] Start()
0616 19:52:12.151369 (+ 512us) write_op.cc:276] Timestamp: P: 1781639520481523 usec, L: 0
0616 19:52:12.151510 (+ 141us) write_op.cc:270] Start()
0616 19:52:12.151528 (+ 18us) write_op.cc:276] Timestamp: P: 1781639520490434 usec, L: 0
0616 19:52:12.151643 (+ 115us) write_op.cc:270] Start()
0616 19:52:12.151660 (+ 17us) write_op.cc:276] Timestamp: P: 1781639520494494 usec, L: 0
0616 19:52:12.151798 (+ 138us) write_op.cc:270] Start()
0616 19:52:12.151814 (+ 16us) write_op.cc:276] Timestamp: P: 1781639520508485 usec, L: 0
0616 19:52:12.151924 (+ 110us) write_op.cc:270] Start()
0616 19:52:12.151939 (+ 15us) write_op.cc:276] Timestamp: P: 1781639520521507 usec, L: 0
0616 19:52:12.152040 (+ 101us) write_op.cc:270] Start()
0616 19:52:12.152056 (+ 16us) write_op.cc:276] Timestamp: P: 1781639520537104 usec, L: 0
0616 19:52:12.152171 (+ 115us) write_op.cc:270] Start()
0616 19:52:12.152187 (+ 16us) write_op.cc:276] Timestamp: P: 1781639520560713 usec, L: 0
0616 19:52:12.152319 (+ 132us) write_op.cc:270] Start()
0616 19:52:12.152338 (+ 19us) write_op.cc:276] Timestamp: P: 1781639520569718 usec, L: 0
0616 19:52:12.230860 (+ 78522us) write_op.cc:270] Start()
0616 19:52:12.230904 (+ 44us) write_op.cc:276] Timestamp: P: 1781639520583387 usec, L: 0
0616 19:52:12.231164 (+ 260us) write_op.cc:270] Start()
0616 19:52:12.231189 (+ 25us) write_op.cc:276] Timestamp: P: 1781639520602848 usec, L: 0
0616 19:52:12.231369 (+ 180us) write_op.cc:270] Start()
0616 19:52:12.231393 (+ 24us) write_op.cc:276] Timestamp: P: 1781639520624839 usec, L: 0
0616 19:52:12.231518 (+ 125us) write_op.cc:270] Start()
0616 19:52:12.231537 (+ 19us) write_op.cc:276] Timestamp: P: 1781639520642433 usec, L: 0
0616 19:52:12.231661 (+ 124us) write_op.cc:270] Start()
0616 19:52:12.231678 (+ 17us) write_op.cc:276] Timestamp: P: 1781639520653922 usec, L: 0
0616 19:52:12.231818 (+ 140us) write_op.cc:270] Start()
0616 19:52:12.231865 (+ 47us) write_op.cc:276] Timestamp: P: 1781639520666256 usec, L: 0
0616 19:52:12.231997 (+ 132us) write_op.cc:270] Start()
0616 19:52:12.232016 (+ 19us) write_op.cc:276] Timestamp: P: 1781639520703334 usec, L: 0
0616 19:52:12.239778 (+ 7762us) write_op.cc:270] Start()
0616 19:52:12.239811 (+ 33us) write_op.cc:276] Timestamp: P: 1781639520721084 usec, L: 0
0616 19:52:12.240029 (+ 218us) write_op.cc:270] Start()
0616 19:52:12.240051 (+ 22us) write_op.cc:276] Timestamp: P: 1781639520736642 usec, L: 0
0616 19:52:12.240176 (+ 125us) write_op.cc:270] Start()
0616 19:52:12.240192 (+ 16us) write_op.cc:276] Timestamp: P: 1781639520749860 usec, L: 0
0616 19:52:12.240337 (+ 145us) write_op.cc:270] Start()
0616 19:52:12.240395 (+ 58us) write_op.cc:276] Timestamp: P: 1781639520762539 usec, L: 0
0616 19:52:12.248941 (+ 8546us) write_op.cc:270] Start()
0616 19:52:12.248974 (+ 33us) write_op.cc:276] Timestamp: P: 1781639520774860 usec, L: 0
0616 19:52:12.249166 (+ 192us) write_op.cc:270] Start()
0616 19:52:12.249191 (+ 25us) write_op.cc:276] Timestamp: P: 1781639520794896 usec, L: 0
0616 19:52:12.249388 (+ 197us) write_op.cc:270] Start()
0616 19:52:12.249409 (+ 21us) write_op.cc:276] Timestamp: P: 1781639520818799 usec, L: 0
0616 19:52:12.249536 (+ 127us) write_op.cc:270] Start()
0616 19:52:12.249555 (+ 19us) write_op.cc:276] Timestamp: P: 1781639520858142 usec, L: 0
0616 19:52:12.249688 (+ 133us) write_op.cc:270] Start()
0616 19:52:12.249709 (+ 21us) write_op.cc:276] Timestamp: P: 1781639520875637 usec, L: 0
0616 19:52:12.249830 (+ 121us) write_op.cc:270] Start()
0616 19:52:12.249848 (+ 18us) write_op.cc:276] Timestamp: P: 1781639520886474 usec, L: 0
0616 19:52:12.249949 (+ 101us) write_op.cc:270] Start()
0616 19:52:12.249965 (+ 16us) write_op.cc:276] Timestamp: P: 1781639520902892 usec, L: 0
0616 19:52:12.250088 (+ 123us) write_op.cc:270] Start()
0616 19:52:12.250106 (+ 18us) write_op.cc:276] Timestamp: P: 1781639520923229 usec, L: 0
0616 19:52:12.250246 (+ 140us) write_op.cc:270] Start()
0616 19:52:12.250265 (+ 19us) write_op.cc:276] Timestamp: P: 1781639520935214 usec, L: 0
0616 19:52:12.250419 (+ 154us) write_op.cc:270] Start()
0616 19:52:12.250439 (+ 20us) write_op.cc:276] Timestamp: P: 1781639520948421 usec, L: 0
0616 19:52:12.250563 (+ 124us) write_op.cc:270] Start()
0616 19:52:12.250580 (+ 17us) write_op.cc:276] Timestamp: P: 1781639520950986 usec, L: 0
0616 19:52:12.250684 (+ 104us) write_op.cc:270] Start()
0616 19:52:12.250700 (+ 16us) write_op.cc:276] Timestamp: P: 1781639520971050 usec, L: 0
0616 19:52:12.250829 (+ 129us) write_op.cc:270] Start()
0616 19:52:12.250848 (+ 19us) write_op.cc:276] Timestamp: P: 1781639520982748 usec, L: 0
0616 19:52:12.250993 (+ 145us) write_op.cc:270] Start()
0616 19:52:12.251013 (+ 20us) write_op.cc:276] Timestamp: P: 1781639520990743 usec, L: 0
0616 19:52:12.251172 (+ 159us) write_op.cc:270] Start()
0616 19:52:12.251194 (+ 22us) write_op.cc:276] Timestamp: P: 1781639520994256 usec, L: 0
0616 19:52:12.251352 (+ 158us) write_op.cc:270] Start()
0616 19:52:12.251371 (+ 19us) write_op.cc:276] Timestamp: P: 1781639521005427 usec, L: 0
0616 19:52:12.251485 (+ 114us) write_op.cc:270] Start()
0616 19:52:12.251502 (+ 17us) write_op.cc:276] Timestamp: P: 1781639521035771 usec, L: 0
0616 19:52:12.251625 (+ 123us) write_op.cc:270] Start()
0616 19:52:12.251643 (+ 18us) write_op.cc:276] Timestamp: P: 1781639521074626 usec, L: 0
0616 19:52:12.251758 (+ 115us) write_op.cc:270] Start()
0616 19:52:12.251774 (+ 16us) write_op.cc:276] Timestamp: P: 1781639521098551 usec, L: 0
0616 19:52:12.251888 (+ 114us) write_op.cc:270] Start()
0616 19:52:12.251904 (+ 16us) write_op.cc:276] Timestamp: P: 1781639521120788 usec, L: 0
0616 19:52:12.252008 (+ 104us) write_op.cc:270] Start()
0616 19:52:12.252027 (+ 19us) write_op.cc:276] Timestamp: P: 1781639521121873 usec, L: 0
0616 19:52:12.252130 (+ 103us) write_op.cc:270] Start()
0616 19:52:12.252145 (+ 15us) write_op.cc:276] Timestamp: P: 1781639521123069 usec, L: 0
0616 19:52:12.252270 (+ 125us) write_op.cc:270] Start()
0616 19:52:12.252287 (+ 17us) write_op.cc:276] Timestamp: P: 1781639521138765 usec, L: 0
0616 19:52:12.252409 (+ 122us) write_op.cc:270] Start()
0616 19:52:12.252424 (+ 15us) write_op.cc:276] Timestamp: P: 1781639521173218 usec, L: 0
0616 19:52:12.287087 (+ 34663us) write_op.cc:270] Start()
0616 19:52:12.287127 (+ 40us) write_op.cc:276] Timestamp: P: 1781639521177419 usec, L: 0
0616 19:52:12.287321 (+ 194us) write_op.cc:270] Start()
0616 19:52:12.287342 (+ 21us) write_op.cc:276] Timestamp: P: 1781639521178672 usec, L: 0
0616 19:52:12.287494 (+ 152us) write_op.cc:270] Start()
0616 19:52:12.287515 (+ 21us) write_op.cc:276] Timestamp: P: 1781639521202557 usec, L: 0
0616 19:52:12.287795 (+ 280us) write_op.cc:270] Start()
0616 19:52:12.287819 (+ 24us) write_op.cc:276] Timestamp: P: 1781639521207041 usec, L: 0
0616 19:52:12.288004 (+ 185us) write_op.cc:270] Start()
0616 19:52:12.288025 (+ 21us) write_op.cc:276] Timestamp: P: 1781639521207910 usec, L: 0
0616 19:52:12.296772 (+ 8747us) write_op.cc:270] Start()
0616 19:52:12.296812 (+ 40us) write_op.cc:276] Timestamp: P: 1781639521209270 usec, L: 0
0616 19:52:12.297207 (+ 395us) write_op.cc:270] Start()
0616 19:52:12.297243 (+ 36us) write_op.cc:276] Timestamp: P: 1781639521214671 usec, L: 0
0616 19:52:12.297449 (+ 206us) write_op.cc:270] Start()
0616 19:52:12.297472 (+ 23us) write_op.cc:276] Timestamp: P: 1781639521301197 usec, L: 0
0616 19:52:12.297639 (+ 167us) write_op.cc:270] Start()
0616 19:52:12.297657 (+ 18us) write_op.cc:276] Timestamp: P: 1781639521301801 usec, L: 0
0616 19:52:12.297826 (+ 169us) write_op.cc:270] Start()
0616 19:52:12.297852 (+ 26us) write_op.cc:276] Timestamp: P: 1781639521302322 usec, L: 0
0616 19:52:12.298005 (+ 153us) write_op.cc:270] Start()
0616 19:52:12.298026 (+ 21us) write_op.cc:276] Timestamp: P: 1781639521302884 usec, L: 0
0616 19:52:12.298170 (+ 144us) write_op.cc:270] Start()
0616 19:52:12.298188 (+ 18us) write_op.cc:276] Timestamp: P: 1781639521303384 usec, L: 0
0616 19:52:12.298339 (+ 151us) write_op.cc:270] Start()
0616 19:52:12.298359 (+ 20us) write_op.cc:276] Timestamp: P: 1781639521303901 usec, L: 0
0616 19:52:12.298503 (+ 144us) write_op.cc:270] Start()
0616 19:52:12.298522 (+ 19us) write_op.cc:276] Timestamp: P: 1781639521311546 usec, L: 0
0616 19:52:12.298649 (+ 127us) write_op.cc:270] Start()
0616 19:52:12.298672 (+ 23us) write_op.cc:276] Timestamp: P: 1781639521350299 usec, L: 0
0616 19:52:12.298861 (+ 189us) write_op.cc:270] Start()
0616 19:52:12.298878 (+ 17us) write_op.cc:276] Timestamp: P: 1781639521351222 usec, L: 0
0616 19:52:12.299023 (+ 145us) write_op.cc:270] Start()
0616 19:52:12.299050 (+ 27us) write_op.cc:276] Timestamp: P: 1781639521361557 usec, L: 0
0616 19:52:12.305086 (+ 6036us) write_op.cc:270] Start()
0616 19:52:12.305117 (+ 31us) write_op.cc:276] Timestamp: P: 1781639521362255 usec, L: 0
0616 19:52:12.305309 (+ 192us) write_op.cc:270] Start()
0616 19:52:12.305334 (+ 25us) write_op.cc:276] Timestamp: P: 1781639521367353 usec, L: 0
0616 19:52:12.305491 (+ 157us) write_op.cc:270] Start()
0616 19:52:12.305511 (+ 20us) write_op.cc:276] Timestamp: P: 1781639521368116 usec, L: 0
0616 19:52:12.305667 (+ 156us) write_op.cc:270] Start()
0616 19:52:12.305690 (+ 23us) write_op.cc:276] Timestamp: P: 1781639521369751 usec, L: 0
0616 19:52:12.306823 (+ 1133us) write_op.cc:270] Start()
0616 19:52:12.306846 (+ 23us) write_op.cc:276] Timestamp: P: 1781639521384235 usec, L: 0
0616 19:52:12.306981 (+ 135us) write_op.cc:270] Start()
0616 19:52:12.307000 (+ 19us) write_op.cc:276] Timestamp: P: 1781639521487758 usec, L: 0
0616 19:52:12.307122 (+ 122us) write_op.cc:270] Start()
0616 19:52:12.307141 (+ 19us) write_op.cc:276] Timestamp: P: 1781639521490522 usec, L: 0
0616 19:52:12.307275 (+ 134us) write_op.cc:270] Start()
0616 19:52:12.307296 (+ 21us) write_op.cc:276] Timestamp: P: 1781639521494897 usec, L: 0
0616 19:52:12.307454 (+ 158us) write_op.cc:270] Start()
0616 19:52:12.307478 (+ 24us) write_op.cc:276] Timestamp: P: 1781639521495493 usec, L: 0
0616 19:52:12.307616 (+ 138us) write_op.cc:270] Start()
0616 19:52:12.307634 (+ 18us) write_op.cc:276] Timestamp: P: 1781639521496146 usec, L: 0
0616 19:52:12.307782 (+ 148us) write_op.cc:270] Start()
0616 19:52:12.307800 (+ 18us) write_op.cc:276] Timestamp: P: 1781639521498724 usec, L: 0
0616 19:52:12.307950 (+ 150us) write_op.cc:270] Start()
0616 19:52:12.307969 (+ 19us) write_op.cc:276] Timestamp: P: 1781639521499471 usec, L: 0
0616 19:52:12.308121 (+ 152us) write_op.cc:270] Start()
0616 19:52:12.308143 (+ 22us) write_op.cc:276] Timestamp: P: 1781639521500946 usec, L: 0
0616 19:52:12.308301 (+ 158us) write_op.cc:270] Start()
0616 19:52:12.308338 (+ 37us) write_op.cc:276] Timestamp: P: 1781639521505071 usec, L: 0
0616 19:52:12.308510 (+ 172us) write_op.cc:270] Start()
0616 19:52:12.308527 (+ 17us) write_op.cc:276] Timestamp: P: 1781639521542189 usec, L: 0
0616 19:52:12.308650 (+ 123us) write_op.cc:270] Start()
0616 19:52:12.308674 (+ 24us) write_op.cc:276] Timestamp: P: 1781639521554213 usec, L: 0
0616 19:52:12.308797 (+ 123us) write_op.cc:270] Start()
0616 19:52:12.308813 (+ 16us) write_op.cc:276] Timestamp: P: 1781639521570925 usec, L: 0
0616 19:52:12.308925 (+ 112us) write_op.cc:270] Start()
0616 19:52:12.308940 (+ 15us) write_op.cc:276] Timestamp: P: 1781639521601967 usec, L: 0
0616 19:52:12.309047 (+ 107us) write_op.cc:270] Start()
0616 19:52:12.309063 (+ 16us) write_op.cc:276] Timestamp: P: 1781639521620827 usec, L: 0
0616 19:52:12.309167 (+ 104us) write_op.cc:270] Start()
0616 19:52:12.309183 (+ 16us) write_op.cc:276] Timestamp: P: 1781639521621446 usec, L: 0
0616 19:52:12.309301 (+ 118us) write_op.cc:270] Start()
0616 19:52:12.309317 (+ 16us) write_op.cc:276] Timestamp: P: 1781639521621992 usec, L: 0
0616 19:52:12.309415 (+ 98us) write_op.cc:270] Start()
0616 19:52:12.309430 (+ 15us) write_op.cc:276] Timestamp: P: 1781639521622569 usec, L: 0
0616 19:52:12.327152 (+ 17722us) write_op.cc:270] Start()
0616 19:52:12.327199 (+ 47us) write_op.cc:276] Timestamp: P: 1781639521632881 usec, L: 0
0616 19:52:12.327408 (+ 209us) write_op.cc:270] Start()
0616 19:52:12.327429 (+ 21us) write_op.cc:276] Timestamp: P: 1781639521633888 usec, L: 0
0616 19:52:12.327598 (+ 169us) write_op.cc:270] Start()
0616 19:52:12.327642 (+ 44us) write_op.cc:276] Timestamp: P: 1781639521651704 usec, L: 0
0616 19:52:12.327832 (+ 190us) write_op.cc:270] Start()
0616 19:52:12.327859 (+ 27us) write_op.cc:276] Timestamp: P: 1781639521654181 usec, L: 0
0616 19:52:12.328000 (+ 141us) write_op.cc:270] Start()
0616 19:52:12.328023 (+ 23us) write_op.cc:276] Timestamp: P: 1781639521670603 usec, L: 0
0616 19:52:12.328206 (+ 183us) write_op.cc:270] Start()
0616 19:52:12.328233 (+ 27us) write_op.cc:276] Timestamp: P: 1781639521673688 usec, L: 0
0616 19:52:12.328380 (+ 147us) write_op.cc:270] Start()
0616 19:52:12.328551 (+ 171us) write_op.cc:276] Timestamp: P: 1781639521680082 usec, L: 0
0616 19:52:12.328772 (+ 221us) write_op.cc:270] Start()
0616 19:52:12.328792 (+ 20us) write_op.cc:276] Timestamp: P: 1781639521681784 usec, L: 0
0616 19:52:12.328917 (+ 125us) write_op.cc:270] Start()
0616 19:52:12.328933 (+ 16us) write_op.cc:276] Timestamp: P: 1781639521684049 usec, L: 0
0616 19:52:12.329042 (+ 109us) write_op.cc:270] Start()
0616 19:52:12.329058 (+ 16us) write_op.cc:276] Timestamp: P: 1781639521685151 usec, L: 0
0616 19:52:12.329162 (+ 104us) write_op.cc:270] Start()
0616 19:52:12.329177 (+ 15us) write_op.cc:276] Timestamp: P: 1781639521729272 usec, L: 0
0616 19:52:12.329278 (+ 101us) write_op.cc:270] Start()
0616 19:52:12.329293 (+ 15us) write_op.cc:276] Timestamp: P: 1781639521747484 usec, L: 0
0616 19:52:12.329384 (+ 91us) write_op.cc:270] Start()
0616 19:52:12.329399 (+ 15us) write_op.cc:276] Timestamp: P: 1781639521848592 usec, L: 0
0616 19:52:12.329505 (+ 106us) write_op.cc:270] Start()
0616 19:52:12.329520 (+ 15us) write_op.cc:276] Timestamp: P: 1781639521851742 usec, L: 0
0616 19:52:12.329661 (+ 141us) write_op.cc:270] Start()
0616 19:52:12.329677 (+ 16us) write_op.cc:276] Timestamp: P: 1781639521852349 usec, L: 0
0616 19:52:12.329783 (+ 106us) write_op.cc:270] Start()
0616 19:52:12.329807 (+ 24us) write_op.cc:276] Timestamp: P: 1781639521908899 usec, L: 0
0616 19:52:12.329929 (+ 122us) write_op.cc:270] Start()
0616 19:52:12.329945 (+ 16us) write_op.cc:276] Timestamp: P: 1781639521997563 usec, L: 0
0616 19:52:12.330046 (+ 101us) write_op.cc:270] Start()
0616 19:52:12.330061 (+ 15us) write_op.cc:276] Timestamp: P: 1781639522002434 usec, L: 0
0616 19:52:12.330170 (+ 109us) write_op.cc:270] Start()
0616 19:52:12.330186 (+ 16us) write_op.cc:276] Timestamp: P: 1781639522003058 usec, L: 0
0616 19:52:12.330297 (+ 111us) write_op.cc:270] Start()
0616 19:52:12.330312 (+ 15us) write_op.cc:276] Timestamp: P: 1781639522003625 usec, L: 0
0616 19:52:12.330413 (+ 101us) write_op.cc:270] Start()
0616 19:52:12.330428 (+ 15us) write_op.cc:276] Timestamp: P: 1781639522004172 usec, L: 0
0616 19:52:12.330520 (+ 92us) write_op.cc:270] Start()
0616 19:52:12.330535 (+ 15us) write_op.cc:276] Timestamp: P: 1781639522005294 usec, L: 0
0616 19:52:12.330633 (+ 98us) write_op.cc:270] Start()
0616 19:52:12.330648 (+ 15us) write_op.cc:276] Timestamp: P: 1781639522044267 usec, L: 0
0616 19:52:12.330766 (+ 118us) write_op.cc:270] Start()
0616 19:52:12.330782 (+ 16us) write_op.cc:276] Timestamp: P: 1781639522046610 usec, L: 0
0616 19:52:12.330890 (+ 108us) write_op.cc:270] Start()
0616 19:52:12.330905 (+ 15us) write_op.cc:276] Timestamp: P: 1781639522076969 usec, L: 0
0616 19:52:12.331026 (+ 121us) write_op.cc:270] Start()
0616 19:52:12.339346 (+ 8320us) write_op.cc:276] Timestamp: P: 1781639522097600 usec, L: 0
0616 19:52:12.339544 (+ 198us) write_op.cc:270] Start()
0616 19:52:12.339567 (+ 23us) write_op.cc:276] Timestamp: P: 1781639522158549 usec, L: 0
0616 19:52:12.339890 (+ 323us) write_op.cc:270] Start()
0616 19:52:12.339916 (+ 26us) write_op.cc:276] Timestamp: P: 1781639522173087 usec, L: 0
0616 19:52:12.340137 (+ 221us) write_op.cc:270] Start()
0616 19:52:12.340159 (+ 22us) write_op.cc:276] Timestamp: P: 1781639522173718 usec, L: 0
0616 19:52:12.340446 (+ 287us) write_op.cc:270] Start()
0616 19:52:12.340508 (+ 62us) write_op.cc:276] Timestamp: P: 1781639522174277 usec, L: 0
0616 19:52:12.340668 (+ 160us) write_op.cc:270] Start()
0616 19:52:12.340687 (+ 19us) write_op.cc:276] Timestamp: P: 1781639522174811 usec, L: 0
0616 19:52:12.340853 (+ 166us) write_op.cc:270] Start()
0616 19:52:12.340878 (+ 25us) write_op.cc:276] Timestamp: P: 1781639522265010 usec, L: 0
0616 19:52:12.341044 (+ 166us) write_op.cc:270] Start()
0616 19:52:12.341068 (+ 24us) write_op.cc:276] Timestamp: P: 1781639522364976 usec, L: 0
0616 19:52:12.341218 (+ 150us) write_op.cc:270] Start()
0616 19:52:12.341239 (+ 21u
I20260616 19:52:12.601859 1861 leader_election.cc:304] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b8fb7a8523741a2b7a5e75d8b415be0; no voters: 85d6b13547f2413c86ee07194ca74704, c404c91cd2194cf6838fddd212f2f4ae
I20260616 19:52:12.603293 2409 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260616 19:52:12.604490 1026 tablet_service.cc:1511] Processing CreateTablet for tablet afe118a94c3749078d8e5b919f71b04c (DEFAULT_TABLE table=default.Table_92ba13ce312d41f29620ddcca694a28d [id=cee303e08ea349a887210b0161ff35f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.604822 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe118a94c3749078d8e5b919f71b04c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.604781 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5029a79e046a489aa9976eff948a3c5b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:12.604933 922 raft_consensus.cc:3060] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.607438 922 raft_consensus.cc:2468] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:12.608474 718 leader_election.cc:304] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:52:12.608642 719 leader_election.cc:343] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 5029a79e046a489aa9976eff948a3c5b
I20260616 19:52:12.600672 2233 leader_election.cc:290] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.609107 2233 raft_consensus.cc:2804] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:12.609443 2233 raft_consensus.cc:697] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:12.610270 2233 consensus_queue.cc:237] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.609326 2428 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260616 19:52:12.612536 1196 tablet_bootstrap.cc:492] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.614158 1196 ts_tablet_manager.cc:1403] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.072s user 0.002s sys 0.001s
I20260616 19:52:12.623018 2294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "85d6b13547f2413c86ee07194ca74704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:52:12.623885 2294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: This master's current role is: LEADER
I20260616 19:52:12.615224 1193 ts_tablet_manager.cc:1929] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:12.639261 1193 log.cc:1199] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/6cc988a195ec4bbf8691801421fed8bb
I20260616 19:52:12.639803 1193 ts_tablet_manager.cc:1950] T 6cc988a195ec4bbf8691801421fed8bb P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:12.640491 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1000) took 1072 ms. Trace:
I20260616 19:52:12.640710 1193 rpcz_store.cc:276] 0616 19:52:11.567734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.567790 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:12.510464 (+942674us) ts_tablet_manager.cc:1151] Deleting tablet 6cc988a195ec4bbf8691801421fed8bb
0616 19:52:12.510473 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.537308 (+ 26835us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.615152 (+ 77844us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.640395 (+ 25243us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":942532}
I20260616 19:52:12.642901 1196 raft_consensus.cc:359] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.644527 1196 raft_consensus.cc:385] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.645025 1196 raft_consensus.cc:740] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.645380 1198 tablet_bootstrap.cc:492] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:12.646819 1198 ts_tablet_manager.cc:1403] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.074s user 0.005s sys 0.000s
I20260616 19:52:12.648785 1198 raft_consensus.cc:359] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.647693 1196 consensus_queue.cc:260] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.650650 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 997) took 1087 ms. Trace:
I20260616 19:52:12.652604 1198 raft_consensus.cc:385] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.652696 1198 raft_consensus.cc:740] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.652820 2287 raft_consensus.cc:493] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.652874 1193 rpcz_store.cc:276] 0616 19:52:11.563029 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.568538 (+ 5509us) service_pool.cc:224] Handling call
0616 19:52:12.648836 (+1080298us) ts_tablet_manager.cc:1151] Deleting tablet df1ee0d1e1514c86802cdce5ae0756eb
0616 19:52:12.648850 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.650317 (+ 1467us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1079850}
I20260616 19:52:12.653239 1198 consensus_queue.cc:260] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.653266 2287 raft_consensus.cc:515] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.656301 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1696a3c9f24001a4aaf99725f73f62" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.654626 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1696a3c9f24001a4aaf99725f73f62" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:12.656921 993 leader_election.cc:343] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:12.657500 996 leader_election.cc:343] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.657600 996 leader_election.cc:304] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:12.657819 2401 raft_consensus.cc:2749] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.657737 1196 ts_tablet_manager.cc:1434] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.039s user 0.002s sys 0.001s
I20260616 19:52:12.658463 2287 leader_election.cc:290] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:12.658231 1193 tablet_replica.cc:333] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:12.659598 1198 ts_tablet_manager.cc:1434] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260616 19:52:12.660815 1196 tablet_bootstrap.cc:492] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:12.662518 1198 tablet_bootstrap.cc:492] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:12.664628 1198 tablet_bootstrap.cc:654] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.666112 902 tablet_service.cc:1511] Processing CreateTablet for tablet 065eaf6f86244a3b9338aa31c0a3031b (DEFAULT_TABLE table=default.Table_77fdcd738d884951bfea81e0e2265982 [id=7630b96d4e3642d5ab382d93eaba017a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.671510 1193 raft_consensus.cc:2243] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:12.672117 1193 pending_rounds.cc:70] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:12.672266 1193 pending_rounds.cc:77] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595525579419648 op_type: NO_OP noop_request { }
I20260616 19:52:12.667243 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 065eaf6f86244a3b9338aa31c0a3031b (DEFAULT_TABLE table=default.Table_77fdcd738d884951bfea81e0e2265982 [id=7630b96d4e3642d5ab382d93eaba017a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.673722 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065eaf6f86244a3b9338aa31c0a3031b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.674192 1193 raft_consensus.cc:2889] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:12.674373 1193 raft_consensus.cc:2272] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.675343 1193 ts_tablet_manager.cc:1916] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.680928 1196 tablet_bootstrap.cc:654] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.683949 1198 tablet_bootstrap.cc:492] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:12.684089 1198 ts_tablet_manager.cc:1403] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260616 19:52:12.684937 1198 raft_consensus.cc:359] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.685094 1198 raft_consensus.cc:385] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.685156 1198 raft_consensus.cc:740] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.689358 2233 raft_consensus.cc:493] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.689666 2233 raft_consensus.cc:515] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.690112 1198 consensus_queue.cc:260] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.691681 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 6cc988a195ec4bbf8691801421fed8bb (table default.Table_097cc1cefc2845c9811c04a380239f0d [id=94c69bbe02ab4591b12325de17d718be]) successfully deleted
I20260616 19:52:12.693063 1198 ts_tablet_manager.cc:1434] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260616 19:52:12.693743 1198 tablet_bootstrap.cc:492] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:12.695780 1198 tablet_bootstrap.cc:654] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.699275 1193 ts_tablet_manager.cc:1929] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:12.708348 1193 log.cc:1199] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/5029a79e046a489aa9976eff948a3c5b
I20260616 19:52:12.709244 1193 ts_tablet_manager.cc:1950] T 5029a79e046a489aa9976eff948a3c5b P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:52:12.709192 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet df1ee0d1e1514c86802cdce5ae0756eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df1ee0d1e1514c86802cdce5ae0756eb already in progress: creating tablet
I20260616 19:52:12.710273 747 tablet_service.cc:1511] Processing CreateTablet for tablet afe118a94c3749078d8e5b919f71b04c (DEFAULT_TABLE table=default.Table_92ba13ce312d41f29620ddcca694a28d [id=cee303e08ea349a887210b0161ff35f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.710969 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ee10d6f8fd5040aebd9c9592d84534fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.711301 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe118a94c3749078d8e5b919f71b04c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.711907 1193 tablet_replica.cc:333] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:12.712570 1193 raft_consensus.cc:2243] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.713406 1193 raft_consensus.cc:2272] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.714540 1193 ts_tablet_manager.cc:1916] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.705382 1196 tablet_bootstrap.cc:492] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
W20260616 19:52:12.718830 719 leader_election.cc:343] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 1c35e4c8e9304e798c9031469877b70e
I20260616 19:52:12.717972 2233 leader_election.cc:290] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.722705 1196 ts_tablet_manager.cc:1403] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.063s user 0.006s sys 0.003s
I20260616 19:52:12.723234 2285 raft_consensus.cc:493] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.723424 2285 raft_consensus.cc:515] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.724320 2285 leader_election.cc:290] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.724246 1196 raft_consensus.cc:359] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.724578 1196 raft_consensus.cc:385] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.724757 1196 raft_consensus.cc:740] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.725322 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe118a94c3749078d8e5b919f71b04c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.727260 1192 tablet_bootstrap.cc:654] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.730005 2287 raft_consensus.cc:493] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.730139 2287 raft_consensus.cc:515] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.730228 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c82b71969e4cbcb890d16e1cdd5348" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:12.730378 1055 raft_consensus.cc:2468] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:12.730708 2287 leader_election.cc:290] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:12.727483 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065eaf6f86244a3b9338aa31c0a3031b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.730998 858 leader_election.cc:304] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:12.731164 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a718fefe07141119b7ef7edcbf61123" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.734406 2297 raft_consensus.cc:2804] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:12.734483 2297 raft_consensus.cc:493] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:12.734539 2297 raft_consensus.cc:3060] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:12.734822 993 leader_election.cc:343] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.735064 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12cd3744782442f94dc6e76727cca1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.728091 2462 tablet.cc:1724] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:12.725198 1196 consensus_queue.cc:260] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.736588 1196 ts_tablet_manager.cc:1434] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260616 19:52:12.737309 2297 raft_consensus.cc:515] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:12.738380 2297 leader_election.cc:290] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.739369 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c82b71969e4cbcb890d16e1cdd5348" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:12.739537 1055 raft_consensus.cc:3060] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.742808 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d5740c8bc14441a4f5d7c509791679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.748333 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc9e90f53094eb48cfb003d45aa5290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.751657 2233 raft_consensus.cc:493] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.751864 2233 raft_consensus.cc:515] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.752521 2233 leader_election.cc:290] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.752592 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6912ee85a31f45bebe43e81281d8f3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.739703 2462 tablet.cc:1724] T df036f9d31ca4770bb00bc9cece46953 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260616 19:52:12.752964 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b548b6b7f746fe9fd67c2e6563e961" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:12.753146 1057 raft_consensus.cc:2468] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:12.753582 719 leader_election.cc:304] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:12.753825 2233 raft_consensus.cc:2804] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260616 19:52:12.753980 2233 raft_consensus.cc:493] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:12.754125 2233 raft_consensus.cc:3060] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Advancing to term 2
I20260616 19:52:12.755998 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet c239a24dbdc047f9beb2ed7e1492acfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.758064 1191 ts_tablet_manager.cc:1929] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:12.758170 1191 log.cc:1199] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/64aa32856ca34743933931fb51f2bd7b
I20260616 19:52:12.758508 1191 ts_tablet_manager.cc:1950] T 64aa32856ca34743933931fb51f2bd7b P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:12.757560 2233 raft_consensus.cc:515] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.759133 2461 tablet.cc:1724] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:12.759617 2233 leader_election.cc:290] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 2 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.763696 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b548b6b7f746fe9fd67c2e6563e961" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:12.763861 1057 raft_consensus.cc:3060] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Advancing to term 2
I20260616 19:52:12.769459 747 tablet_service.cc:1511] Processing CreateTablet for tablet a12cd3744782442f94dc6e76727cca1c (DEFAULT_TABLE table=default.Table_1932c06b086a4a5999bd9df382ca4e09 [id=794152a3398c4fe99fb71026bb4c02cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.766459 1057 raft_consensus.cc:2468] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 2.
I20260616 19:52:12.731191 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a718fefe07141119b7ef7edcbf61123" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:12.729279 718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 120842us
W20260616 19:52:12.770747 996 leader_election.cc:343] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.770854 996 leader_election.cc:304] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:12.771299 719 leader_election.cc:304] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:12.771759 775 raft_consensus.cc:1240] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 2 FOLLOWER]: Rejecting Update request from peer ae28da1c4102450ab76eb2946a5cbf2e for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260616 19:52:12.772056 2287 raft_consensus.cc:2749] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.772601 2452 raft_consensus.cc:2804] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 2 FOLLOWER]: Leader election won for term 2
I20260616 19:52:12.772810 2452 raft_consensus.cc:697] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 2 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:12.773283 2452 consensus_queue.cc:237] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.776108 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 881) took 5019 ms. Trace:
I20260616 19:52:12.779557 1191 rpcz_store.cc:276] 0616 19:52:07.756585 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.756650 (+ 65us) service_pool.cc:224] Handling call
0616 19:52:12.447503 (+4690853us) ts_tablet_manager.cc:1151] Deleting tablet 64aa32856ca34743933931fb51f2bd7b
0616 19:52:12.447515 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.451838 (+ 4323us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.758008 (+306170us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.776088 (+ 18080us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4637592}
I20260616 19:52:12.780093 1191 tablet_replica.cc:333] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:12.780385 1191 raft_consensus.cc:2243] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.781011 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 01d862f2ce2e4051bcbc71ba8f24846e with delete_type TABLET_DATA_DELETED (replaced by tablet f12cafb741da4019aa39f0579db97d34) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.782393 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c82b71969e4cbcb890d16e1cdd5348" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:12.782612 1191 raft_consensus.cc:2272] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.783316 1191 ts_tablet_manager.cc:1916] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.735888 1193 ts_tablet_manager.cc:1929] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:12.783689 1193 log.cc:1199] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/9d800b4e2c2d42279c102e4e061f5530
I20260616 19:52:12.784746 459 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_1516f5dc3b2b4de48c2c4076d1cb1205 [id=af4aada43ecf46b8bacf0d9d1388e92e] alter complete (version 1)
I20260616 19:52:12.784931 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b548b6b7f746fe9fd67c2e6563e961" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:12.785080 860 consensus_peers.cc:597] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44493f0ffd064249a28628cf24895395. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:12.785247 860 leader_election.cc:343] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.785445 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b548b6b7f746fe9fd67c2e6563e961" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:12.785712 2195 consensus_queue.cc:1059] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:12.785916 2195 raft_consensus.cc:3055] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Stepping down as leader of term 1
I20260616 19:52:12.785974 2195 raft_consensus.cc:740] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:12.786161 2195 consensus_queue.cc:260] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.786432 2195 raft_consensus.cc:3060] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Advancing to term 2
I20260616 19:52:12.783933 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c82b71969e4cbcb890d16e1cdd5348" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:12.789950 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c35e4c8e9304e798c9031469877b70e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.790136 1193 ts_tablet_manager.cc:1950] T 9d800b4e2c2d42279c102e4e061f5530 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:12.790349 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 47b548b6b7f746fe9fd67c2e6563e961 with delete_type TABLET_DATA_DELETED (replaced by tablet bcc5116ef5df4140a96f03c003337c68) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.792044 1198 tablet_bootstrap.cc:492] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:12.792225 1198 ts_tablet_manager.cc:1403] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.099s user 0.009s sys 0.001s
I20260616 19:52:12.793335 1198 raft_consensus.cc:359] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.793560 1198 raft_consensus.cc:385] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.793685 1198 raft_consensus.cc:740] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.794062 1198 consensus_queue.cc:260] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.780180 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 64aa32856ca34743933931fb51f2bd7b (table default.Table_9d7e4f47840e4f26bc2ee3c1ae553a0c [id=fb8670837a3f4c7086c4f112b7319a38]) successfully deleted
I20260616 19:52:12.794515 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c35e4c8e9304e798c9031469877b70e with delete_type TABLET_DATA_DELETED (replaced by tablet b2e5e84b95c7429bb53dd616f118500a) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.794692 1198 ts_tablet_manager.cc:1434] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:52:12.794906 758 tablet_service.cc:1511] Processing CreateTablet for tablet 065eaf6f86244a3b9338aa31c0a3031b (DEFAULT_TABLE table=default.Table_77fdcd738d884951bfea81e0e2265982 [id=7630b96d4e3642d5ab382d93eaba017a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:12.795305 765 tablet_service.cc:1558] Processing DeleteTablet for tablet f52b2c5ff6264ffe8d579cb3816fc253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.795745 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 64aa32856ca34743933931fb51f2bd7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.784916 718 leader_election.cc:304] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:12.785282 2448 raft_consensus.cc:493] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.797701 2233 raft_consensus.cc:2749] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:12.798015 860 leader_election.cc:343] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.785934 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12cd3744782442f94dc6e76727cca1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.787727 759 tablet_service.cc:1558] Processing DeleteTablet for tablet fbb308b05bb04bc18ccaa9550a73d3e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.797611 2448 raft_consensus.cc:515] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.798787 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065eaf6f86244a3b9338aa31c0a3031b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:12.799115 2448 leader_election.cc:290] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.785610 1196 tablet_bootstrap.cc:492] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:12.803985 719 leader_election.cc:343] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 4bd6fa49eff4400ca40c722e18cea951
I20260616 19:52:12.816587 2465 tablet.cc:1724] T df036f9d31ca4770bb00bc9cece46953 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260616 19:52:12.817665 2463 tablet.cc:1724] T 76d73be228664063822c41cbefafcab8 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:12.818121 2464 tablet.cc:1724] T 76d73be228664063822c41cbefafcab8 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:12.819973 1193 tablet_replica.cc:333] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:12.820225 1193 raft_consensus.cc:2243] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.820439 1193 raft_consensus.cc:2272] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.821257 1193 ts_tablet_manager.cc:1916] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.821460 1192 tablet_bootstrap.cc:492] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:12.821640 1192 ts_tablet_manager.cc:1403] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.342s user 0.005s sys 0.003s
I20260616 19:52:12.822420 1192 raft_consensus.cc:359] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.822635 1192 raft_consensus.cc:385] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.822717 1192 raft_consensus.cc:740] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.823086 1192 consensus_queue.cc:260] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.825515 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_20d4a8dca77f48baab105824d595b6e1" } new_table_name: "default.Table_765af6beca7a4087bf44c1886cd89977" modify_external_catalogs: true
I20260616 19:52:12.827181 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e81c4d57236048a894b29fda3bb1f845" } modify_external_catalogs: true
I20260616 19:52:12.827368 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e81c4d57236048a894b29fda3bb1f845" } modify_external_catalogs: true
I20260616 19:52:12.827466 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6b3560adb98443f2a64f79a3aa726779" } modify_external_catalogs: true
I20260616 19:52:12.827625 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6b3560adb98443f2a64f79a3aa726779" } modify_external_catalogs: true
I20260616 19:52:12.829753 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b3559538aad547e3a85120356396f742" } new_table_name: "default.Table_9493cfa0a29c4762adedec26550d98d5" modify_external_catalogs: true
I20260616 19:52:12.830122 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 5029a79e046a489aa9976eff948a3c5b (table default.Table_010bd6ff844d4227b21111bb4499d70b [id=7f01acd67fa942bfb14744f0851047e7]) successfully deleted
I20260616 19:52:12.830065 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1335dee9b9ef4807bc77bb4ccdba2f37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:12.830515 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 9d800b4e2c2d42279c102e4e061f5530 (table default.Table_fab39b1a6f2940f4955f9d3b9dd78a79 [id=444a660aa02c4f17a70407bd7d57b590]) successfully deleted
W20260616 19:52:12.830596 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1335dee9b9ef4807bc77bb4ccdba2f37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:12.830930 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet fd020407d4f8470e99045206ca16c6d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd020407d4f8470e99045206ca16c6d2 already in progress: creating tablet
W20260616 19:52:12.831172 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a20701ab3a5d43df92c471bd6013ac6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a20701ab3a5d43df92c471bd6013ac6c already in progress: creating tablet
I20260616 19:52:12.831262 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f13d175adfe540b39fd55004a11c9aad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:12.831557 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet e896d5aa87f14e5593d01085bb6d434f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e896d5aa87f14e5593d01085bb6d434f already in progress: creating tablet
W20260616 19:52:12.831794 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet df14405fff32417da8e9069680100dbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df14405fff32417da8e9069680100dbd already in progress: creating tablet
I20260616 19:52:12.833168 2285 raft_consensus.cc:493] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.833336 2285 raft_consensus.cc:515] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.833926 2285 leader_election.cc:290] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:12.836634 1193 ts_tablet_manager.cc:1929] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:12.837028 2471 tablet.cc:1724] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:12.833817 1191 ts_tablet_manager.cc:1929] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:12.838569 1191 log.cc:1199] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/17029c1ba36644e9847200b54bf9094c
I20260616 19:52:12.839057 1191 ts_tablet_manager.cc:1950] T 17029c1ba36644e9847200b54bf9094c P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:12.839473 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 882) took 5080 ms. Trace:
I20260616 19:52:12.839603 1191 rpcz_store.cc:276] 0616 19:52:07.758981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.759135 (+ 154us) service_pool.cc:224] Handling call
0616 19:52:12.780038 (+5020903us) ts_tablet_manager.cc:1151] Deleting tablet 17029c1ba36644e9847200b54bf9094c
0616 19:52:12.780052 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.814923 (+ 34871us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.833764 (+ 18841us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.839456 (+ 5692us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4970067}
I20260616 19:52:12.840054 1191 tablet_replica.cc:333] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:12.840315 1191 raft_consensus.cc:2243] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.840550 1191 raft_consensus.cc:2272] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.841136 1191 ts_tablet_manager.cc:1916] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.845993 1193 log.cc:1199] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/ca5dc1e6cde347fc9a34e555385dc646
I20260616 19:52:12.850183 1193 ts_tablet_manager.cc:1950] T ca5dc1e6cde347fc9a34e555385dc646 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:12.865281 1193 tablet_replica.cc:333] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:12.866137 1193 raft_consensus.cc:2243] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.866925 1193 raft_consensus.cc:2272] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.868969 1190 ts_tablet_manager.cc:1929] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260616 19:52:12.869050 858 leader_election.cc:343] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: aa72e00b0a3a423f96bdd7abb6013810
I20260616 19:52:12.869138 1190 log.cc:1199] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/d270afd0c0f3457aa6dd14721dca261d
I20260616 19:52:12.869496 1190 ts_tablet_manager.cc:1950] T d270afd0c0f3457aa6dd14721dca261d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:12.870494 1198 tablet_bootstrap.cc:492] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:12.872705 1198 tablet_bootstrap.cc:654] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.875720 1192 ts_tablet_manager.cc:1434] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.054s user 0.001s sys 0.001s
I20260616 19:52:12.836731 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0d790574e48845f386fb32c35473162b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.879120 448 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 47351.8us
I20260616 19:52:12.879361 1193 ts_tablet_manager.cc:1916] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:12.879601 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d790574e48845f386fb32c35473162b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:12.879571 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c37aeb69afa040eeb9db1f8bdc60bb99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c37aeb69afa040eeb9db1f8bdc60bb99 already in progress: creating tablet
W20260616 19:52:12.879825 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 5e8c37e4293a4f2fa4f54397686c5dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e8c37e4293a4f2fa4f54397686c5dfc already in progress: creating tablet
W20260616 19:52:12.880038 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 87ca1b3a712845f9a93653faa0e95291 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87ca1b3a712845f9a93653faa0e95291 already in progress: creating tablet
I20260616 19:52:12.837298 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_368e4b7684c64cdcb5a8ac4665e649d2" } modify_external_catalogs: true
I20260616 19:52:12.881304 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 895) took 3936 ms. Trace:
I20260616 19:52:12.881382 1190 rpcz_store.cc:276] 0616 19:52:08.944826 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.944878 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:12.468298 (+3523420us) ts_tablet_manager.cc:1151] Deleting tablet d270afd0c0f3457aa6dd14721dca261d
0616 19:52:12.468310 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.786867 (+318557us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.868913 (+ 82046us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.881286 (+ 12373us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3523178}
I20260616 19:52:12.881778 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet d270afd0c0f3457aa6dd14721dca261d (table default.Table_ea860bf78ecb48ebb09d584767ab3f41 [id=014e024d22a94b42b4e61fac211f07e9]) successfully deleted
I20260616 19:52:12.882200 1192 tablet_bootstrap.cc:492] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:12.883512 1192 tablet_bootstrap.cc:654] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.837052 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_26225edcf68948129e11a93186e1cf9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:12.884263 1198 tablet_bootstrap.cc:492] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:12.884374 1198 ts_tablet_manager.cc:1403] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.007s
W20260616 19:52:12.884536 718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 86140.1us
W20260616 19:52:12.884671 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26225edcf68948129e11a93186e1cf9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:12.884748 718 leader_election.cc:343] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.884851 718 leader_election.cc:304] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:12.885111 2448 raft_consensus.cc:2749] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.885195 1198 raft_consensus.cc:359] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.885347 1198 raft_consensus.cc:385] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.885388 1198 raft_consensus.cc:740] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
W20260616 19:52:12.841460 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01dea6525ab34ee68fc8d8ff5d7d8da9 consensus state has no leader
I20260616 19:52:12.885568 1198 consensus_queue.cc:260] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.886024 1193 ts_tablet_manager.cc:1929] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:12.886109 1193 log.cc:1199] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/4bd6fa49eff4400ca40c722e18cea951
I20260616 19:52:12.886144 1198 ts_tablet_manager.cc:1434] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:12.886395 1193 ts_tablet_manager.cc:1950] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:12.886405 1198 tablet_bootstrap.cc:492] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:12.886932 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd6fa49eff4400ca40c722e18cea951" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.887133 921 raft_consensus.cc:2393] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
I20260616 19:52:12.887818 718 leader_election.cc:304] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:12.887861 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa72e00b0a3a423f96bdd7abb6013810" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:12.887984 718 raft_consensus.cc:2686] T 4bd6fa49eff4400ca40c722e18cea951 P 7245e7dab0ec474a876537be514c8767: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:52:12.888052 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2db86dd551a14e588331c28f7ad6e0d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:12.888754 1193 tablet_replica.cc:333] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:12.888923 1193 raft_consensus.cc:2243] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:12.889001 860 leader_election.cc:343] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:12.889046 1193 raft_consensus.cc:2272] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.889096 860 leader_election.cc:304] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
W20260616 19:52:12.852717 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a935e1df16dd4ceabb270cfeb75c9fb2 consensus state has no leader
I20260616 19:52:12.889549 1193 ts_tablet_manager.cc:1916] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.889580 2297 raft_consensus.cc:2749] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:12.854132 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 3624b437ae284916b343c82c07c61e62
I20260616 19:52:12.890787 2462 tablet.cc:1724] T 76d73be228664063822c41cbefafcab8 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:12.854351 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f176111bc2a7494da5e17986963a2c5c
I20260616 19:52:12.891131 1198 tablet_bootstrap.cc:654] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.854837 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_77c7656d4f3a49f1ac1ef9398f720934" } modify_external_catalogs: true
I20260616 19:52:12.837514 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7c51501edf0e42cd9653b3bc4414d838"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:12.891702 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_77c7656d4f3a49f1ac1ef9398f720934" } modify_external_catalogs: true
W20260616 19:52:12.892139 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c51501edf0e42cd9653b3bc4414d838 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.893690 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 3624b437ae284916b343c82c07c61e62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.893990 1190 tablet_replica.cc:333] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:12.894219 1190 raft_consensus.cc:2243] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:12.894812 1190 raft_consensus.cc:2272] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.895380 1190 ts_tablet_manager.cc:1916] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.840225 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 17029c1ba36644e9847200b54bf9094c (table default.Table_bfda4071639c49399f2f5bf499be37e9 [id=1449ff28bd8546908359606f7272846f]) successfully deleted
W20260616 19:52:12.897953 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 57753.8us
I20260616 19:52:12.898551 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 3624b437ae284916b343c82c07c61e62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.899187 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet f176111bc2a7494da5e17986963a2c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.899565 2464 tablet.cc:1724] T df036f9d31ca4770bb00bc9cece46953 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260616 19:52:12.900686 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet ca5dc1e6cde347fc9a34e555385dc646 (table default.Table_ee076c723b314968b2d9f7de0e0947c3 [id=d37e43e64c414245a12d2a86ebcbc24b]) successfully deleted
I20260616 19:52:12.900746 1198 tablet_bootstrap.cc:492] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:12.900856 1198 ts_tablet_manager.cc:1403] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.002s
I20260616 19:52:12.872792 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1c9c9f90122442a298e318fcfa29121e" } new_table_name: "default.Table_b4b107ff33584b268f159abfa80497ee" modify_external_catalogs: true
I20260616 19:52:12.902262 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 3624b437ae284916b343c82c07c61e62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.903393 1196 tablet_bootstrap.cc:654] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.904202 1198 raft_consensus.cc:359] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.904699 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet bbf73c4c1133405bb46df19c0559ab92
I20260616 19:52:12.904734 1198 raft_consensus.cc:385] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.904985 1198 raft_consensus.cc:740] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.905146 1192 tablet_bootstrap.cc:492] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:12.905409 1192 ts_tablet_manager.cc:1403] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.002s
I20260616 19:52:12.905334 1198 consensus_queue.cc:260] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.906091 885 tablet_service.cc:1558] Processing DeleteTablet for tablet bbf73c4c1133405bb46df19c0559ab92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.906313 1198 ts_tablet_manager.cc:1434] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260616 19:52:12.906401 2448 raft_consensus.cc:493] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.906553 2448 raft_consensus.cc:515] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.907137 2448 leader_election.cc:290] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.907420 751 tablet_service.cc:1558] Processing DeleteTablet for tablet f176111bc2a7494da5e17986963a2c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.907591 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 4bd6fa49eff4400ca40c722e18cea951 (table default.Table_ae1d446a11f34a77bd9bcdafbef99127 [id=b401e2a905f842579b3b60e5d20815aa]) successfully deleted
W20260616 19:52:12.907897 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet adf5010b9025406bb1da70e6875213c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adf5010b9025406bb1da70e6875213c6 already in progress: creating tablet
I20260616 19:52:12.906420 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet bbf73c4c1133405bb46df19c0559ab92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:12.908255 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet cf1ab0a125cf46e9a1afc625297db7af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf1ab0a125cf46e9a1afc625297db7af already in progress: creating tablet
W20260616 19:52:12.908757 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 6c9066a57e784356aa27cfcac75c3bd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c9066a57e784356aa27cfcac75c3bd2 already in progress: creating tablet
W20260616 19:52:12.908812 719 leader_election.cc:343] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: fbb308b05bb04bc18ccaa9550a73d3e7
W20260616 19:52:12.909281 858 consensus_peers.cc:597] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e91c377ae66441268351cd3592aa9dbc. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:12.909278 751 tablet_service.cc:1558] Processing DeleteTablet for tablet bbf73c4c1133405bb46df19c0559ab92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.910006 2297 consensus_queue.cc:1048] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:12.910619 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb308b05bb04bc18ccaa9550a73d3e7" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:12.910775 923 raft_consensus.cc:2468] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:12.912875 1192 raft_consensus.cc:359] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.913105 1192 raft_consensus.cc:385] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.913198 1192 raft_consensus.cc:740] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.913470 1192 consensus_queue.cc:260] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.914125 1192 ts_tablet_manager.cc:1434] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260616 19:52:12.914481 1192 tablet_bootstrap.cc:492] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:12.914708 718 leader_election.cc:304] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:12.915007 2448 raft_consensus.cc:2804] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:12.915119 2448 raft_consensus.cc:493] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:12.915215 2448 raft_consensus.cc:3060] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:12.915437 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 88246ba54ff543cb8effb3b96019a2b8 (table default.Table_3cf14af743a244c382cff85d7e6f7b97 [id=003b87fcdc824c5c9dffad8092480ee9], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 88246ba54ff543cb8effb3b96019a2b8 consensus state has no leader
I20260616 19:52:12.915838 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1d5b4585972f43468ed8b94000e5773f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.916296 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d5b4585972f43468ed8b94000e5773f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.916983 1191 ts_tablet_manager.cc:1929] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260616 19:52:12.917093 1191 log.cc:1199] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/eb04ccc26e64484a9a29c515d4b954fe
I20260616 19:52:12.917722 1191 ts_tablet_manager.cc:1950] T eb04ccc26e64484a9a29c515d4b954fe P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:12.918051 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 883) took 5147 ms. Trace:
I20260616 19:52:12.918123 1191 rpcz_store.cc:276] 0616 19:52:07.770244 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.770299 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:12.840003 (+5069704us) ts_tablet_manager.cc:1151] Deleting tablet eb04ccc26e64484a9a29c515d4b954fe
0616 19:52:12.840012 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.898703 (+ 58691us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.916927 (+ 18224us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.918032 (+ 1105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5029989}
I20260616 19:52:12.918388 2448 raft_consensus.cc:515] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.918503 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet eb04ccc26e64484a9a29c515d4b954fe (table default.Table_093bd1c50f834db49bf52da0c66fae6d [id=87e3217093844e81ac448e2e9d8fa3ec]) successfully deleted
I20260616 19:52:12.918604 1191 tablet_replica.cc:333] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:12.918776 1191 raft_consensus.cc:2243] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:12.919914 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2db86dd551a14e588331c28f7ad6e0d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:12.920428 719 leader_election.cc:343] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: fbb308b05bb04bc18ccaa9550a73d3e7
I20260616 19:52:12.920678 2448 leader_election.cc:290] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:12.919952 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb308b05bb04bc18ccaa9550a73d3e7" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:12.924407 923 raft_consensus.cc:3060] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.925944 1192 tablet_bootstrap.cc:654] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.926174 1198 tablet_bootstrap.cc:492] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:12.927256 923 raft_consensus.cc:2468] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:12.927467 1196 tablet_bootstrap.cc:492] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.927588 1196 ts_tablet_manager.cc:1403] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.142s user 0.010s sys 0.009s
W20260616 19:52:12.923319 860 consensus_peers.cc:597] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e91c377ae66441268351cd3592aa9dbc. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:12.928236 1196 raft_consensus.cc:359] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.928704 1196 raft_consensus.cc:385] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.928799 1196 raft_consensus.cc:740] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.928591 718 leader_election.cc:304] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:12.929090 2448 raft_consensus.cc:2804] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:12.929229 2448 raft_consensus.cc:697] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:12.929456 2448 consensus_queue.cc:237] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.929913 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_368e4b7684c64cdcb5a8ac4665e649d2" } modify_external_catalogs: true
W20260616 19:52:12.933109 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2aef4e720784161927386e48b79286e consensus state has no leader
I20260616 19:52:12.936367 1193 ts_tablet_manager.cc:1929] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:12.939618 452 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_16508a5420d3488088367681d9b55f03 [id=946fd4fcf5f244acafa1e82743e70af2] alter complete (version 2)
I20260616 19:52:12.941556 1193 log.cc:1199] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/da74f89b7ff44f49b8e2f2c2cbcbdb0b
I20260616 19:52:12.942122 1193 ts_tablet_manager.cc:1950] T da74f89b7ff44f49b8e2f2c2cbcbdb0b P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:12.927603 1198 tablet_bootstrap.cc:654] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.942934 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7b1eed4af94f4d9497213d6a3bc40ddc" } modify_external_catalogs: true
I20260616 19:52:12.943086 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7b1eed4af94f4d9497213d6a3bc40ddc" } modify_external_catalogs: true
I20260616 19:52:12.943540 903 tablet_service.cc:1558] Processing DeleteTablet for tablet f176111bc2a7494da5e17986963a2c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.945937 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c35e4c8e9304e798c9031469877b70e with delete_type TABLET_DATA_DELETED (replaced by tablet b2e5e84b95c7429bb53dd616f118500a) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.948055 1196 consensus_queue.cc:260] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.948690 1196 ts_tablet_manager.cc:1434] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260616 19:52:12.948997 1196 tablet_bootstrap.cc:492] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:12.950608 1196 tablet_bootstrap.cc:654] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.918932 1191 raft_consensus.cc:2272] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.952303 1191 ts_tablet_manager.cc:1916] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.952661 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet da74f89b7ff44f49b8e2f2c2cbcbdb0b (table default.Table_2349f63e2a7e4af4ae0a80e8ed86c6a9 [id=f37d0e612ff74a31842cf47ec47beb3f]) successfully deleted
I20260616 19:52:12.953125 1192 tablet_bootstrap.cc:492] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:12.953311 1192 ts_tablet_manager.cc:1403] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.000s
W20260616 19:52:12.957165 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d55200fc438d407e9930400424b88024 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d55200fc438d407e9930400424b88024 already in progress: creating tablet
I20260616 19:52:12.957872 1193 tablet_replica.cc:333] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:12.958351 1190 ts_tablet_manager.cc:1929] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:12.958467 1193 raft_consensus.cc:2243] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.958956 1193 raft_consensus.cc:2272] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.960275 1193 ts_tablet_manager.cc:1916] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.960520 1190 log.cc:1199] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/65b0dc43b40649f29037f40d2ea9247e
I20260616 19:52:12.960994 1190 ts_tablet_manager.cc:1950] T 65b0dc43b40649f29037f40d2ea9247e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:12.961982 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 896) took 4013 ms. Trace:
I20260616 19:52:12.962531 1198 tablet_bootstrap.cc:492] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:12.962766 459 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_753c560ec30d4346bf6b8590dc7ee3f8 [id=548cacd5de984fa89aa96b1c659f9e38] alter complete (version 5)
I20260616 19:52:12.965559 1198 ts_tablet_manager.cc:1403] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.002s
I20260616 19:52:12.965863 1190 rpcz_store.cc:276] 0616 19:52:08.948077 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.948516 (+ 439us) service_pool.cc:224] Handling call
0616 19:52:12.893948 (+3945432us) ts_tablet_manager.cc:1151] Deleting tablet 65b0dc43b40649f29037f40d2ea9247e
0616 19:52:12.893956 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.930177 (+ 36221us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.958187 (+ 28010us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:12.961960 (+ 3773us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3945233}
I20260616 19:52:12.965767 2297 raft_consensus.cc:493] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:12.966203 2297 raft_consensus.cc:515] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.966429 1198 raft_consensus.cc:359] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:12.966576 1198 raft_consensus.cc:385] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.966620 1198 raft_consensus.cc:740] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
W20260616 19:52:12.967523 858 leader_election.cc:343] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 1c35e4c8e9304e798c9031469877b70e
I20260616 19:52:12.967702 2297 leader_election.cc:290] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:12.959241 1192 raft_consensus.cc:359] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.967788 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c35e4c8e9304e798c9031469877b70e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:12.967924 1192 raft_consensus.cc:385] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.967986 1192 raft_consensus.cc:740] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.967969 781 raft_consensus.cc:2468] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:12.968294 860 leader_election.cc:304] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:12.968801 2297 raft_consensus.cc:2804] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:12.968919 2297 raft_consensus.cc:493] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:12.969041 2297 raft_consensus.cc:3060] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.969929 898 tablet_service.cc:1558] Processing DeleteTablet for tablet b718514e4fbd4601afeb021ed35643e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.970274 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c5047956478f488dbb4734bbaa138c00
I20260616 19:52:12.970923 751 tablet_service.cc:1558] Processing DeleteTablet for tablet c5047956478f488dbb4734bbaa138c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:12.974211 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4977207a3a3e4366a30e0cffb72a5682"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.974749 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4977207a3a3e4366a30e0cffb72a5682 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.975139 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 647b1abeb3c14b11b9a5c62b67e83cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.976634 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8523fd6785af4abea4891fea2612453d" } new_table_name: "default.Table_96e14812934147b4a2e6ea4b045ecf8a" modify_external_catalogs: true
I20260616 19:52:12.977013 2297 raft_consensus.cc:515] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.978299 2297 leader_election.cc:290] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:12.978854 858 leader_election.cc:343] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 1c35e4c8e9304e798c9031469877b70e
I20260616 19:52:12.978845 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c35e4c8e9304e798c9031469877b70e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:12.979013 781 raft_consensus.cc:3060] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:12.979180 1192 consensus_queue.cc:260] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.979678 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet c5047956478f488dbb4734bbaa138c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.979875 1192 ts_tablet_manager.cc:1434] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260616 19:52:12.980125 1192 tablet_bootstrap.cc:492] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:12.980686 1190 tablet_replica.cc:333] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:12.980835 1190 raft_consensus.cc:2243] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:12.980816 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 65b0dc43b40649f29037f40d2ea9247e (table default.Table_8fff86d5c2344e2fb59db9872ee90b74 [id=06f5d602dcec42a884b5eb53f9d0a27c]) successfully deleted
I20260616 19:52:12.980975 1190 raft_consensus.cc:2272] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:12.981429 1190 ts_tablet_manager.cc:1916] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:12.981698 781 raft_consensus.cc:2468] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:12.982064 860 leader_election.cc:304] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:12.982508 2297 raft_consensus.cc:2804] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:12.982746 2297 raft_consensus.cc:697] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:12.981434 898 tablet_service.cc:1558] Processing DeleteTablet for tablet c5047956478f488dbb4734bbaa138c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:12.982993 2297 consensus_queue.cc:237] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.986912 1192 tablet_bootstrap.cc:654] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:12.987005 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:12.988037 1196 tablet_bootstrap.cc:492] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:12.988332 1196 ts_tablet_manager.cc:1403] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.000s
I20260616 19:52:12.989040 1196 raft_consensus.cc:359] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.989261 1196 raft_consensus.cc:385] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:12.989351 1196 raft_consensus.cc:740] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:12.989616 1196 consensus_queue.cc:260] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:12.990231 1196 ts_tablet_manager.cc:1434] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:12.990540 1196 tablet_bootstrap.cc:492] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:12.993950 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ea877235c11b47e9b05186321e824f1a" } new_table_name: "default.Table_a7baef0a47494ac68b20783d5f7c16fb" modify_external_catalogs: true
I20260616 19:52:12.994630 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6a864fa5eeba49da95a681f3d1de9030"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:12.995079 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a864fa5eeba49da95a681f3d1de9030 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:12.995749 1196 tablet_bootstrap.cc:654] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:12.998210 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 141969us
I20260616 19:52:12.998699 2464 tablet.cc:1724] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260616 19:52:13.001158 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d69db202af9e4d4f86a9d8d40e9fe3af consensus state has no leader
I20260616 19:52:13.001569 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_fe7bc05510b54924b11d62344defe4a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:12.991541 1193 ts_tablet_manager.cc:1929] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.002040 1193 log.cc:1199] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/9060de590fa84ea08dc7d39765bc9308
I20260616 19:52:13.001711 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8345aacaa215426e86af44475fc967ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.002946 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8345aacaa215426e86af44475fc967ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:13.002571 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8fbe5a6b44a3444ebdd185962058a861 consensus state has no leader
I20260616 19:52:13.007606 1196 tablet_bootstrap.cc:492] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:13.008821 1191 ts_tablet_manager.cc:1929] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
W20260616 19:52:13.009608 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe7bc05510b54924b11d62344defe4a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.009358 1193 ts_tablet_manager.cc:1950] T 9060de590fa84ea08dc7d39765bc9308 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:13.011554 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 9060de590fa84ea08dc7d39765bc9308 (table default.Table_7713a34d9f7e4031a42f66ee98382545 [id=6f77a88fd07a47cfbef0a061968dda5c]) successfully deleted
I20260616 19:52:13.014035 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 3f96ef25396a4092bc475f4aab269bc7 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:13.010876 2463 tablet.cc:1724] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:13.020614 1193 tablet_replica.cc:333] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:13.020805 1193 raft_consensus.cc:2243] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.020946 1193 raft_consensus.cc:2272] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.021389 1193 ts_tablet_manager.cc:1916] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.010509 1196 ts_tablet_manager.cc:1403] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260616 19:52:13.026201 1196 raft_consensus.cc:359] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.028419 1196 raft_consensus.cc:385] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.028574 1196 raft_consensus.cc:740] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.028853 1196 consensus_queue.cc:260] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.029505 1196 ts_tablet_manager.cc:1434] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260616 19:52:13.029842 1196 tablet_bootstrap.cc:492] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:13.029816 1191 log.cc:1199] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/3de0e62cfd33410490a0b460fd5f69e9
I20260616 19:52:13.030259 1191 ts_tablet_manager.cc:1950] T 3de0e62cfd33410490a0b460fd5f69e9 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:13.030995 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 890) took 5142 ms. Trace:
I20260616 19:52:13.031093 1191 rpcz_store.cc:276] 0616 19:52:07.888414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:07.888514 (+ 100us) service_pool.cc:224] Handling call
0616 19:52:12.918559 (+5030045us) ts_tablet_manager.cc:1151] Deleting tablet 3de0e62cfd33410490a0b460fd5f69e9
0616 19:52:12.918568 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:12.995975 (+ 77407us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.008769 (+ 12794us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.030977 (+ 22208us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4987682}
I20260616 19:52:13.031538 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 893) took 4991 ms. Trace:
I20260616 19:52:13.031665 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 3de0e62cfd33410490a0b460fd5f69e9 (table default.Table_f5c1eb12b45345aabb7ab3c7a1854ead [id=c7d1624942fb42aa95ad085062052262]) successfully deleted
I20260616 19:52:13.032595 1196 tablet_bootstrap.cc:654] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.035785 1198 consensus_queue.cc:260] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.036187 459 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc] alter complete (version 2)
I20260616 19:52:13.036402 1198 ts_tablet_manager.cc:1434] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.071s user 0.001s sys 0.001s
I20260616 19:52:13.034396 1193 ts_tablet_manager.cc:1929] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:13.037067 1193 log.cc:1199] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/17029c1ba36644e9847200b54bf9094c
I20260616 19:52:13.037613 1193 ts_tablet_manager.cc:1950] T 17029c1ba36644e9847200b54bf9094c P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:13.031617 1191 rpcz_store.cc:276] 0616 19:52:08.039637 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.039691 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:13.031390 (+4991699us) ts_tablet_manager.cc:1151] Deleting tablet 10b02ac0fa4744e48529b35a4ca78567
0616 19:52:13.031401 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.031521 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4991505}
W20260616 19:52:13.039042 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 10b02ac0fa4744e48529b35a4ca78567 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10b02ac0fa4744e48529b35a4ca78567 already in progress: creating tablet
I20260616 19:52:13.043666 1190 ts_tablet_manager.cc:1929] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:13.044412 1190 log.cc:1199] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/1d80d9028184443da49623228259263d
I20260616 19:52:13.036798 1198 tablet_bootstrap.cc:492] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:13.042918 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 269c1dea941c481fb6fd2e4d59c877c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b0f5388a73143569012ed714e53a8be) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.039451 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 894) took 4991 ms. Trace:
I20260616 19:52:13.044795 1191 rpcz_store.cc:276] 0616 19:52:08.047991 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.048304 (+ 313us) service_pool.cc:224] Handling call
0616 19:52:13.039337 (+4991033us) ts_tablet_manager.cc:1151] Deleting tablet fdb74517ce5443a8bfea100ca364db1d
0616 19:52:13.039348 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.039435 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4990326}
W20260616 19:52:13.045259 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet fdb74517ce5443a8bfea100ca364db1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdb74517ce5443a8bfea100ca364db1d already in progress: creating tablet
I20260616 19:52:13.045326 1191 tablet_replica.cc:333] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:13.045598 1191 raft_consensus.cc:2243] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.045801 1191 raft_consensus.cc:2272] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.046380 1190 ts_tablet_manager.cc:1950] T 1d80d9028184443da49623228259263d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:13.047055 1191 ts_tablet_manager.cc:1916] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.048030 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 897) took 4099 ms. Trace:
I20260616 19:52:13.048975 1198 tablet_bootstrap.cc:654] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.051257 1190 rpcz_store.cc:276] 0616 19:52:08.948644 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.948691 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:12.980642 (+4031951us) ts_tablet_manager.cc:1151] Deleting tablet 1d80d9028184443da49623228259263d
0616 19:52:12.980652 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.014722 (+ 34070us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.043603 (+ 28881us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.048012 (+ 4409us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4031830}
I20260616 19:52:13.052310 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 1d80d9028184443da49623228259263d (table default.Table_97db7730461e4d00ab3bc527573cde94 [id=cd27259f954043f8b50d2bb5788f1ecb]) successfully deleted
I20260616 19:52:13.052786 2287 raft_consensus.cc:493] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.052896 1190 tablet_replica.cc:333] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:13.052917 2287 raft_consensus.cc:515] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.053072 1190 raft_consensus.cc:2243] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.053236 1190 raft_consensus.cc:2272] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.053627 2287 leader_election.cc:290] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:13.053791 1190 ts_tablet_manager.cc:1916] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.055879 751 tablet_service.cc:1558] Processing DeleteTablet for tablet b718514e4fbd4601afeb021ed35643e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.056085 758 tablet_service.cc:1558] Processing DeleteTablet for tablet aa72e00b0a3a423f96bdd7abb6013810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.056274 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1c2030b3a14c6aafaa961869606f31" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:13.056916 996 leader_election.cc:343] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.057220 747 tablet_service.cc:1558] Processing DeleteTablet for tablet aabf57dd6d704645b6bf97b730dbe964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.054574 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1c2030b3a14c6aafaa961869606f31" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:13.058280 993 leader_election.cc:343] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.058385 993 leader_election.cc:304] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.058797 2287 raft_consensus.cc:2749] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.062505 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 17029c1ba36644e9847200b54bf9094c (table default.Table_bfda4071639c49399f2f5bf499be37e9 [id=1449ff28bd8546908359606f7272846f]) successfully deleted
W20260616 19:52:13.063246 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1b3c170ea2a34e72824dc90f15534745 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b3c170ea2a34e72824dc90f15534745 already in progress: creating tablet
W20260616 19:52:13.064092 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 4faa62f03c2a4588a776883dc54d0426 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4faa62f03c2a4588a776883dc54d0426 already in progress: creating tablet
W20260616 19:52:13.064663 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a0313e65e6a3441abcd663110cfcd70d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0313e65e6a3441abcd663110cfcd70d already in progress: creating tablet
I20260616 19:52:13.064950 1193 tablet_replica.cc:333] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:13.065151 1193 raft_consensus.cc:2243] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.065328 1193 raft_consensus.cc:2272] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.065882 1193 ts_tablet_manager.cc:1916] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.071241 1198 tablet_bootstrap.cc:492] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:13.071470 1198 ts_tablet_manager.cc:1403] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.002s
I20260616 19:52:13.071465 781 raft_consensus.cc:3060] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.072304 1198 raft_consensus.cc:359] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.072575 1198 raft_consensus.cc:385] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.072669 1198 raft_consensus.cc:740] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.072948 1198 consensus_queue.cc:260] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.073998 1191 ts_tablet_manager.cc:1929] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:13.079839 1192 tablet_bootstrap.cc:492] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:13.079895 1191 log.cc:1199] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/47b548b6b7f746fe9fd67c2e6563e961
I20260616 19:52:13.080034 1192 ts_tablet_manager.cc:1403] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.100s user 0.008s sys 0.001s
I20260616 19:52:13.080320 1191 ts_tablet_manager.cc:1950] T 47b548b6b7f746fe9fd67c2e6563e961 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:13.082530 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 731556662b62419dae76149b22469ebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.078207 1198 ts_tablet_manager.cc:1434] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260616 19:52:13.084760 1198 tablet_bootstrap.cc:492] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:13.086114 1198 tablet_bootstrap.cc:654] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.087293 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 895) took 5000 ms. Trace:
I20260616 19:52:13.087746 1191 rpcz_store.cc:276] 0616 19:52:08.086942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.086996 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:13.045273 (+4958277us) ts_tablet_manager.cc:1151] Deleting tablet 47b548b6b7f746fe9fd67c2e6563e961
0616 19:52:13.045289 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.066595 (+ 21306us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.073950 (+ 7355us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.087275 (+ 13325us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4958094}
I20260616 19:52:13.088492 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 47b548b6b7f746fe9fd67c2e6563e961 (table default.Table_60ba0f6f88634456a3d4afc9f759c4a7 [id=9c7b653f62ef4b74946cc87069f8df6e]) successfully deleted
I20260616 19:52:13.088740 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 896) took 4979 ms. Trace:
I20260616 19:52:13.088858 1191 rpcz_store.cc:276] 0616 19:52:08.108991 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.109044 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:13.088502 (+4979458us) ts_tablet_manager.cc:1151] Deleting tablet 7e2fb4a0198342edaf87eb1b1f6406fb
0616 19:52:13.088513 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.088722 (+ 209us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4954371}
W20260616 19:52:13.089319 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 7e2fb4a0198342edaf87eb1b1f6406fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e2fb4a0198342edaf87eb1b1f6406fb already in progress: creating tablet
I20260616 19:52:13.090245 1190 ts_tablet_manager.cc:1929] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:13.090379 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 897) took 4981 ms. Trace:
I20260616 19:52:13.090498 1191 rpcz_store.cc:276] 0616 19:52:08.109380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.109429 (+ 49us) service_pool.cc:224] Handling call
0616 19:52:13.089312 (+4979883us) ts_tablet_manager.cc:1151] Deleting tablet 1eacae5ee28947a9a4fb2315165c4df2
0616 19:52:13.089322 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.090361 (+ 1039us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4955083}
W20260616 19:52:13.090903 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 1eacae5ee28947a9a4fb2315165c4df2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1eacae5ee28947a9a4fb2315165c4df2 already in progress: creating tablet
I20260616 19:52:13.090978 1190 log.cc:1199] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/6cc988a195ec4bbf8691801421fed8bb
I20260616 19:52:13.091435 1190 ts_tablet_manager.cc:1950] T 6cc988a195ec4bbf8691801421fed8bb P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:13.091998 1192 raft_consensus.cc:359] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.095412 2462 tablet.cc:1724] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:13.096521 1192 raft_consensus.cc:385] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.096884 1192 raft_consensus.cc:740] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.097601 1055 raft_consensus.cc:2468] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:13.099110 1192 consensus_queue.cc:260] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.099747 1192 ts_tablet_manager.cc:1434] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260616 19:52:13.102140 858 leader_election.cc:304] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:13.102157 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 898) took 4978 ms. Trace:
I20260616 19:52:13.102281 2452 raft_consensus.cc:493] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.102246 1191 rpcz_store.cc:276] 0616 19:52:08.123676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.128415 (+ 4739us) service_pool.cc:224] Handling call
0616 19:52:13.090910 (+4962495us) ts_tablet_manager.cc:1151] Deleting tablet 9fd39dba6d6f4ff892bfd0ff462b74bd
0616 19:52:13.097767 (+ 6857us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.102140 (+ 4373us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4948935}
I20260616 19:52:13.102401 2452 raft_consensus.cc:515] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.102623 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 904) took 4609 ms. Trace:
I20260616 19:52:13.102734 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_343a164ba15342d8ba89e6d0ea6ed50f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.102947 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e004f84474eb4deba328c85df07a597d" } new_table_name: "default.Table_85129a18f0b64ea7969bc43f66442669" modify_external_catalogs: true
W20260616 19:52:13.103057 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 9fd39dba6d6f4ff892bfd0ff462b74bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fd39dba6d6f4ff892bfd0ff462b74bd already in progress: creating tablet
W20260616 19:52:13.103281 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_343a164ba15342d8ba89e6d0ea6ed50f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.104434 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ce3905f6aa13493295bd76511ff3eb6b" } new_table_name: "default.Table_414b6a8fd4c04b0a812d3c5f28df39ac" modify_external_catalogs: true
I20260616 19:52:13.104976 2297 raft_consensus.cc:2804] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:13.105103 2297 raft_consensus.cc:697] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:13.105320 2297 consensus_queue.cc:237] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:13.109120 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4407a66f73c1400a9a55839383f5e385" } modify_external_catalogs: true
I20260616 19:52:13.109273 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4407a66f73c1400a9a55839383f5e385" } modify_external_catalogs: true
I20260616 19:52:13.110996 1191 rpcz_store.cc:276] 0616 19:52:08.493472 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.493543 (+ 71us) service_pool.cc:224] Handling call
0616 19:52:13.102517 (+4608974us) ts_tablet_manager.cc:1151] Deleting tablet 966fabee5ae34c5da6a35d74caef244f
0616 19:52:13.102528 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.102607 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4608753}
I20260616 19:52:13.111706 2452 leader_election.cc:290] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.112313 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 905) took 4618 ms. Trace:
I20260616 19:52:13.112435 1191 rpcz_store.cc:276] 0616 19:52:08.493609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.493662 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:13.112172 (+4618510us) ts_tablet_manager.cc:1151] Deleting tablet 9614f1b2704749c1a4590303c7efc1d8
0616 19:52:13.112183 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.112281 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4618303}
I20260616 19:52:13.113224 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_131945fffea34b6bb6a08d2a11f7c486" } modify_external_catalogs: true
I20260616 19:52:13.113384 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_131945fffea34b6bb6a08d2a11f7c486" } modify_external_catalogs: true
I20260616 19:52:13.113806 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 906) took 4572 ms. Trace:
I20260616 19:52:13.113925 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d97ff7c321c94095b345b04eda72d78e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.113969 1191 rpcz_store.cc:276] 0616 19:52:08.541051 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.541104 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:13.113685 (+4572581us) ts_tablet_manager.cc:1151] Deleting tablet 2f1e12555be64192860eab59b3aeb562
0616 19:52:13.113695 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.113786 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4566840}
I20260616 19:52:13.114393 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 907) took 4562 ms. Trace:
W20260616 19:52:13.114470 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d97ff7c321c94095b345b04eda72d78e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.114455 1191 rpcz_store.cc:276] 0616 19:52:08.552293 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.552351 (+ 58us) service_pool.cc:224] Handling call
0616 19:52:13.114302 (+4561951us) ts_tablet_manager.cc:1151] Deleting tablet 733f4f262ed64a01a5f5f4c68ba37872
0616 19:52:13.114311 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.114380 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4561736}
I20260616 19:52:13.114909 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e079f7ad5717469eb58807eb230fb2e9" } modify_external_catalogs: true
I20260616 19:52:13.115062 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e079f7ad5717469eb58807eb230fb2e9" } modify_external_catalogs: true
I20260616 19:52:13.115285 1191 tablet_replica.cc:333] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:13.115453 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 966fabee5ae34c5da6a35d74caef244f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 966fabee5ae34c5da6a35d74caef244f already in progress: creating tablet
I20260616 19:52:13.115490 1191 raft_consensus.cc:2243] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.115657 1191 raft_consensus.cc:2272] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:13.115707 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 9614f1b2704749c1a4590303c7efc1d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9614f1b2704749c1a4590303c7efc1d8 already in progress: creating tablet
W20260616 19:52:13.115890 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 2f1e12555be64192860eab59b3aeb562 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f1e12555be64192860eab59b3aeb562 already in progress: creating tablet
W20260616 19:52:13.116076 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 733f4f262ed64a01a5f5f4c68ba37872 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 733f4f262ed64a01a5f5f4c68ba37872 already in progress: creating tablet
I20260616 19:52:13.117463 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]). Expected version 2 got 0
I20260616 19:52:13.119566 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b718514e4fbd4601afeb021ed35643e6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:13.119656 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd7a70654d8e46fba2bd837a64af9064 consensus state has no leader
I20260616 19:52:13.119771 923 raft_consensus.cc:2468] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:13.119897 1192 tablet_bootstrap.cc:492] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:52:13.120108 719 leader_election.cc:343] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: b718514e4fbd4601afeb021ed35643e6
I20260616 19:52:13.120368 718 leader_election.cc:304] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:13.123564 1191 ts_tablet_manager.cc:1916] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.125003 2452 raft_consensus.cc:2804] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:13.125149 2452 raft_consensus.cc:493] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:13.125255 2452 raft_consensus.cc:3060] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.125722 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3eb946a084f04151b6389333e33cc455"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.126475 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3eb946a084f04151b6389333e33cc455 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.127652 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ceb8a1d6b2fc40218e784665adbc56d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.128171 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ceb8a1d6b2fc40218e784665adbc56d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:13.128424 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 957302ca5638411b9a636442323ba8ed consensus state has no leader
I20260616 19:52:13.100921 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 898) took 4127 ms. Trace:
I20260616 19:52:13.129102 1190 rpcz_store.cc:276] 0616 19:52:08.973670 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.973759 (+ 89us) service_pool.cc:224] Handling call
0616 19:52:13.052843 (+4079084us) ts_tablet_manager.cc:1151] Deleting tablet 6cc988a195ec4bbf8691801421fed8bb
0616 19:52:13.052854 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.068907 (+ 16053us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.090177 (+ 21270us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.100905 (+ 10728us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4078889}
I20260616 19:52:13.129823 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 890) took 4199 ms. Trace:
I20260616 19:52:13.129917 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 6cc988a195ec4bbf8691801421fed8bb (table default.Table_097cc1cefc2845c9811c04a380239f0d [id=94c69bbe02ab4591b12325de17d718be]) successfully deleted
I20260616 19:52:13.135377 2452 raft_consensus.cc:515] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.135205 1190 rpcz_store.cc:276] 0616 19:52:08.929975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.930044 (+ 69us) service_pool.cc:224] Handling call
0616 19:52:13.129698 (+4199654us) ts_tablet_manager.cc:1151] Deleting tablet 4ce69dcb31fe41879e9feb3b01547dd9
0616 19:52:13.129709 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.129805 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4140170}
W20260616 19:52:13.140741 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 4ce69dcb31fe41879e9feb3b01547dd9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ce69dcb31fe41879e9feb3b01547dd9 already in progress: creating tablet
I20260616 19:52:13.143741 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 102f322eb98f4224acb8637f8c29ac19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.144058 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_aced0d28db084d7c9ea82e3d772c5c80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.144726 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aced0d28db084d7c9ea82e3d772c5c80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.145498 1192 tablet_bootstrap.cc:654] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.146266 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4f6998bf4b4e4215a968b6a952754ff2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.146833 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f6998bf4b4e4215a968b6a952754ff2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.148388 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f836a17118c9405d96e7581590b7ec0a" } new_table_name: "default.Table_e719267b26ff4112ba4d40a3a25a5d05" modify_external_catalogs: true
I20260616 19:52:13.155855 1190 tablet_replica.cc:333] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:13.156054 1190 raft_consensus.cc:2243] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:13.156335 1190 raft_consensus.cc:2272] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.157685 1190 ts_tablet_manager.cc:1916] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.140534 2448 raft_consensus.cc:493] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.164036 2448 raft_consensus.cc:515] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:13.164682 2448 leader_election.cc:290] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.165062 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64aa32856ca34743933931fb51f2bd7b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.160607 1196 tablet_bootstrap.cc:492] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:13.165310 923 raft_consensus.cc:2393] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
W20260616 19:52:13.165784 719 leader_election.cc:343] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 64aa32856ca34743933931fb51f2bd7b
I20260616 19:52:13.165894 719 leader_election.cc:304] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.166314 2448 raft_consensus.cc:3060] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.168697 2448 raft_consensus.cc:2749] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.168706 2287 raft_consensus.cc:493] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.168823 2287 raft_consensus.cc:515] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.169405 2287 leader_election.cc:290] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:13.170421 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239a24dbdc047f9beb2ed7e1492acfe" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:13.170888 993 leader_election.cc:343] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.171871 1191 ts_tablet_manager.cc:1929] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.171962 1191 log.cc:1199] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/aabf57dd6d704645b6bf97b730dbe964
I20260616 19:52:13.172281 1191 ts_tablet_manager.cc:1950] T aabf57dd6d704645b6bf97b730dbe964 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:13.172291 1192 tablet_bootstrap.cc:492] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:13.172423 1192 ts_tablet_manager.cc:1403] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.000s
I20260616 19:52:13.173180 1192 raft_consensus.cc:359] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.173431 1192 raft_consensus.cc:385] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.173539 1192 raft_consensus.cc:740] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.173877 1192 consensus_queue.cc:260] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.176649 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239a24dbdc047f9beb2ed7e1492acfe" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:13.177248 996 leader_election.cc:343] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.177366 996 leader_election.cc:304] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.177631 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 908) took 4584 ms. Trace:
I20260616 19:52:13.177721 2287 raft_consensus.cc:2749] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.177706 1191 rpcz_store.cc:276] 0616 19:52:08.593689 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.593884 (+ 195us) service_pool.cc:224] Handling call
0616 19:52:13.115242 (+4521358us) ts_tablet_manager.cc:1151] Deleting tablet aabf57dd6d704645b6bf97b730dbe964
0616 19:52:13.115251 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.165768 (+ 50517us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.171821 (+ 6053us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.177614 (+ 5793us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4521098}
I20260616 19:52:13.178022 1191 tablet_replica.cc:333] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:13.178211 1191 raft_consensus.cc:2243] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.178408 1191 raft_consensus.cc:2272] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.178383 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet aabf57dd6d704645b6bf97b730dbe964 (table default.Table_914e42d3110442b99b33a9a77c30dd49 [id=8253e0421d10438cbb925f20579d9471]) successfully deleted
I20260616 19:52:13.178982 1191 ts_tablet_manager.cc:1916] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.179140 1190 ts_tablet_manager.cc:1929] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.179735 1190 log.cc:1199] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/44493f0ffd064249a28628cf24895395
I20260616 19:52:13.180342 1192 ts_tablet_manager.cc:1434] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260616 19:52:13.180827 1192 tablet_bootstrap.cc:492] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:13.183375 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8286cbce941848058f9f1d96424d16d5" } modify_external_catalogs: true
I20260616 19:52:13.183549 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8286cbce941848058f9f1d96424d16d5" } modify_external_catalogs: true
I20260616 19:52:13.165516 1196 ts_tablet_manager.cc:1403] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.136s user 0.001s sys 0.005s
I20260616 19:52:13.187163 1196 raft_consensus.cc:359] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.187361 1196 raft_consensus.cc:385] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.187433 1196 raft_consensus.cc:740] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.187633 1196 consensus_queue.cc:260] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.180415 1190 ts_tablet_manager.cc:1950] T 44493f0ffd064249a28628cf24895395 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:13.186400 898 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a09d62e68148349b337c5075763672 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.193523 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 903) took 4176 ms. Trace:
I20260616 19:52:13.193708 1190 rpcz_store.cc:276] 0616 19:52:09.017220 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.017762 (+ 542us) service_pool.cc:224] Handling call
0616 19:52:13.155794 (+4138032us) ts_tablet_manager.cc:1151] Deleting tablet 44493f0ffd064249a28628cf24895395
0616 19:52:13.155806 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.166291 (+ 10485us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.179059 (+ 12768us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.193484 (+ 14425us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4137858}
I20260616 19:52:13.194344 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 44493f0ffd064249a28628cf24895395 (table default.Table_718b661372f441feb171907daff44e2d [id=a5404ca6c40f44b8b881ef582d703fd5]) successfully deleted
I20260616 19:52:13.194823 1190 tablet_replica.cc:333] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:13.194913 1192 tablet_bootstrap.cc:654] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.195236 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b57bceabff64533ae3a49b8afda614d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.195587 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8d6b895b77014dab9e9cbd601d9d9ac2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.195094 1190 raft_consensus.cc:2243] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:13.199196 1190 raft_consensus.cc:2272] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.200282 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b718514e4fbd4601afeb021ed35643e6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:13.200511 923 raft_consensus.cc:3060] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:13.202386 719 leader_election.cc:343] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: b718514e4fbd4601afeb021ed35643e6
I20260616 19:52:13.203478 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bf7b4202c79a461d935e4aa929bcb500" } new_table_name: "default.Table_2cf157e2fe134e2c80976c8deaf8deba" modify_external_catalogs: true
I20260616 19:52:13.204780 1196 ts_tablet_manager.cc:1434] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260616 19:52:13.204710 2452 leader_election.cc:290] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:13.206187 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d6b895b77014dab9e9cbd601d9d9ac2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.210966 923 raft_consensus.cc:2468] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:13.211467 718 leader_election.cc:304] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:13.212199 1191 ts_tablet_manager.cc:1929] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.212317 1191 log.cc:1199] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/ca5dc1e6cde347fc9a34e555385dc646
I20260616 19:52:13.213310 1190 ts_tablet_manager.cc:1916] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:13.215714 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1a95eafa064b4b95b5281915ea5bd9f7 consensus state has no leader
I20260616 19:52:13.216053 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e20dacac303a4fdfbb7580b7a07a0f91" } new_table_name: "default.Table_16b6dddb0e0844758b17a720a494e216" modify_external_catalogs: true
I20260616 19:52:13.217882 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3dea2593211d4e4c990c543a009c1ad3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.218370 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dea2593211d4e4c990c543a009c1ad3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.219175 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c72cfa1b4cd747f78d9abb8b2595745b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.219643 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c72cfa1b4cd747f78d9abb8b2595745b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.221388 1198 tablet_bootstrap.cc:492] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:13.221521 1198 ts_tablet_manager.cc:1403] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.137s user 0.002s sys 0.014s
W20260616 19:52:13.222661 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 15d5db407c264ed1b718a7cece511b2f consensus state has no leader
I20260616 19:52:13.223083 2452 raft_consensus.cc:2804] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:13.223582 1198 raft_consensus.cc:359] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.223816 1198 raft_consensus.cc:385] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.223909 1198 raft_consensus.cc:740] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.224606 1198 consensus_queue.cc:260] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.225157 1198 ts_tablet_manager.cc:1434] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260616 19:52:13.227402 1198 tablet_bootstrap.cc:492] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:13.229102 1198 tablet_bootstrap.cc:654] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:13.229996 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4970ac68130e40fa8288c8c74f705378 consensus state has no leader
I20260616 19:52:13.233464 1192 tablet_bootstrap.cc:492] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:13.233659 1192 ts_tablet_manager.cc:1403] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.000s
I20260616 19:52:13.234305 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9ebc1905db49466db1697dab76e8e7b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.234470 1192 raft_consensus.cc:359] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.234784 1192 raft_consensus.cc:385] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260616 19:52:13.234826 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ebc1905db49466db1697dab76e8e7b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.234880 1192 raft_consensus.cc:740] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.235185 1192 consensus_queue.cc:260] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.238113 2452 raft_consensus.cc:697] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:13.238384 2452 consensus_queue.cc:237] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.238725 1190 ts_tablet_manager.cc:1929] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.238837 1190 log.cc:1199] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/9060de590fa84ea08dc7d39765bc9308
I20260616 19:52:13.240410 1190 ts_tablet_manager.cc:1950] T 9060de590fa84ea08dc7d39765bc9308 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:13.241276 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 917) took 4172 ms. Trace:
I20260616 19:52:13.241751 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet e6f309caaa9042f99432a61fd2ebb089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.244952 781 raft_consensus.cc:3060] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.237238 1196 tablet_bootstrap.cc:492] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:13.248421 2287 consensus_queue.cc:1048] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:13.248660 1196 tablet_bootstrap.cc:654] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.251844 1193 ts_tablet_manager.cc:1929] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:13.252022 1193 log.cc:1199] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/1e8160ad4cf74f16a586ae59291ce7d1
I20260616 19:52:13.252307 1193 ts_tablet_manager.cc:1950] T 1e8160ad4cf74f16a586ae59291ce7d1 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:13.260592 461 master_service.cc:960] ReplaceTablet: received request to replace tablet c3d71d78c92f45f1a6c0af3589026b10 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:13.264894 1191 ts_tablet_manager.cc:1950] T ca5dc1e6cde347fc9a34e555385dc646 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:13.266438 2401 consensus_queue.cc:1048] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:13.273654 1190 rpcz_store.cc:276] 0616 19:52:09.068671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.219029 (+150358us) service_pool.cc:224] Handling call
0616 19:52:13.194749 (+3975720us) ts_tablet_manager.cc:1151] Deleting tablet 9060de590fa84ea08dc7d39765bc9308
0616 19:52:13.194761 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.216242 (+ 21481us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.238647 (+ 22405us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.241233 (+ 2586us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3975551}
I20260616 19:52:13.274142 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 9060de590fa84ea08dc7d39765bc9308 (table default.Table_7713a34d9f7e4031a42f66ee98382545 [id=6f77a88fd07a47cfbef0a061968dda5c]) successfully deleted
I20260616 19:52:13.274530 1190 tablet_replica.cc:333] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:13.241505 1192 ts_tablet_manager.cc:1434] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260616 19:52:13.276553 1192 tablet_bootstrap.cc:492] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:13.277596 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 09b2bf2ff1004853a39522a0b0608290
I20260616 19:52:13.278236 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 09b2bf2ff1004853a39522a0b0608290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.278740 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 09b2bf2ff1004853a39522a0b0608290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.279553 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 09b2bf2ff1004853a39522a0b0608290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.280932 1198 tablet_bootstrap.cc:492] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:13.281430 1198 ts_tablet_manager.cc:1403] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.003s
I20260616 19:52:13.281580 1192 tablet_bootstrap.cc:654] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.282950 1198 raft_consensus.cc:359] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.283197 1198 raft_consensus.cc:385] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.283304 1198 raft_consensus.cc:740] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.283623 1198 consensus_queue.cc:260] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.284945 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0dc52e26f5554d789addb5923a612070
I20260616 19:52:13.285928 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dc52e26f5554d789addb5923a612070 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.286127 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dc52e26f5554d789addb5923a612070 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.287125 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dc52e26f5554d789addb5923a612070 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.292816 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet a817b1d4c7b640db8894bc801878caae with delete_type TABLET_DATA_DELETED (replaced by tablet cf23aef677064e43bbba3ffba26f2719) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.293148 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 20b9e3626794464aa823724bee0a1682
I20260616 19:52:13.293787 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 20b9e3626794464aa823724bee0a1682 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.294065 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 20b9e3626794464aa823724bee0a1682 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.294600 1198 ts_tablet_manager.cc:1434] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260616 19:52:13.294713 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 909) took 4700 ms. Trace:
I20260616 19:52:13.294816 1191 rpcz_store.cc:276] 0616 19:52:08.593827 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.594185 (+ 358us) service_pool.cc:224] Handling call
0616 19:52:13.177970 (+4583785us) ts_tablet_manager.cc:1151] Deleting tablet ca5dc1e6cde347fc9a34e555385dc646
0616 19:52:13.177983 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.209319 (+ 31336us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.212139 (+ 2820us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.294693 (+ 82554us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4583604}
I20260616 19:52:13.295011 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 20b9e3626794464aa823724bee0a1682 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.295353 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet ca5dc1e6cde347fc9a34e555385dc646 (table default.Table_ee076c723b314968b2d9f7de0e0947c3 [id=d37e43e64c414245a12d2a86ebcbc24b]) successfully deleted
I20260616 19:52:13.295433 1198 tablet_bootstrap.cc:492] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:13.296897 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1026) took 1003 ms. Trace:
I20260616 19:52:13.297096 1198 tablet_bootstrap.cc:654] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.297026 1193 rpcz_store.cc:276] 0616 19:52:12.293315 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.414719 (+121404us) service_pool.cc:224] Handling call
0616 19:52:13.064908 (+650189us) ts_tablet_manager.cc:1151] Deleting tablet 1e8160ad4cf74f16a586ae59291ce7d1
0616 19:52:13.064916 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.209109 (+144193us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.251781 (+ 42672us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.296863 (+ 45082us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":639123}
I20260616 19:52:13.297617 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 1e8160ad4cf74f16a586ae59291ce7d1 (table default.Table_2984957106b44cdc9ecd5a06e8edb7d3 [id=23f3d793560846b7a0701ec470588cbc]) successfully deleted
I20260616 19:52:13.302181 1191 tablet_replica.cc:333] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:13.302454 1191 raft_consensus.cc:2243] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.304229 1191 raft_consensus.cc:2272] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.305299 1191 ts_tablet_manager.cc:1916] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:13.306155 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet b65c52ad5b0d48caa5da88c75c60971c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b65c52ad5b0d48caa5da88c75c60971c already in progress: creating tablet
W20260616 19:52:13.306730 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet ee10d6f8fd5040aebd9c9592d84534fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee10d6f8fd5040aebd9c9592d84534fc already in progress: creating tablet
W20260616 19:52:13.308166 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 01d862f2ce2e4051bcbc71ba8f24846e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01d862f2ce2e4051bcbc71ba8f24846e already in progress: creating tablet
I20260616 19:52:13.308481 1193 tablet_replica.cc:333] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:13.308513 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 3f96ef25396a4092bc475f4aab269bc7
I20260616 19:52:13.308962 454 catalog_manager.cc:6784] ReplaceTablet: tablet 3f96ef25396a4092bc475f4aab269bc7 deleted and replaced by tablet 78cef79e6b324df7943e6f499516c5d9
I20260616 19:52:13.309592 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f96ef25396a4092bc475f4aab269bc7 with delete_type TABLET_DATA_DELETED (replaced by tablet 78cef79e6b324df7943e6f499516c5d9) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.309146 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f96ef25396a4092bc475f4aab269bc7 with delete_type TABLET_DATA_DELETED (replaced by tablet 78cef79e6b324df7943e6f499516c5d9) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.310247 1196 tablet_bootstrap.cc:492] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:13.311414 1196 ts_tablet_manager.cc:1403] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.000s
I20260616 19:52:13.312179 1196 raft_consensus.cc:359] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.312404 1196 raft_consensus.cc:385] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.312526 1196 raft_consensus.cc:740] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.312772 1196 consensus_queue.cc:260] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.313107 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f96ef25396a4092bc475f4aab269bc7 with delete_type TABLET_DATA_DELETED (replaced by tablet 78cef79e6b324df7943e6f499516c5d9) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.313336 1196 ts_tablet_manager.cc:1434] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:13.314707 1196 tablet_bootstrap.cc:492] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:13.316105 2297 raft_consensus.cc:493] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.316260 2297 raft_consensus.cc:515] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.316913 2297 leader_election.cc:290] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:13.317433 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731556662b62419dae76149b22469ebd" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:13.317545 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1a78091a693742a28eef4e5ea7e4cb0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.317873 860 leader_election.cc:343] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:13.318059 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a78091a693742a28eef4e5ea7e4cb0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.319149 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731556662b62419dae76149b22469ebd" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:13.319334 1055 raft_consensus.cc:2468] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:13.319748 858 leader_election.cc:304] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:13.320132 2297 raft_consensus.cc:2804] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:13.320789 2297 raft_consensus.cc:493] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:13.320907 2297 raft_consensus.cc:3060] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.323467 2297 raft_consensus.cc:515] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.323374 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 102f322eb98f4224acb8637f8c29ac19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.324698 2297 leader_election.cc:290] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:13.324753 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731556662b62419dae76149b22469ebd" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:13.324941 1055 raft_consensus.cc:3060] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.325202 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731556662b62419dae76149b22469ebd" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:13.325624 860 leader_election.cc:343] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.327373 1055 raft_consensus.cc:2468] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:13.327859 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8b4d4c8b67aa44f68a974f7ca7090dd4
I20260616 19:52:13.328109 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b1c4351701974ad8945770a0482b8df5" } new_table_name: "default.Table_2ed9e23776d3482cb73c577f2d6ad2cd" modify_external_catalogs: true
I20260616 19:52:13.328684 858 leader_election.cc:304] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:13.328859 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b4d4c8b67aa44f68a974f7ca7090dd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.329875 2297 raft_consensus.cc:2804] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:13.329838 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b38a7f54b0584662954227bde2b75aeb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.330031 2297 raft_consensus.cc:697] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:13.330017 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b4d4c8b67aa44f68a974f7ca7090dd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:13.330346 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b38a7f54b0584662954227bde2b75aeb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.330288 2297 consensus_queue.cc:237] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.330878 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_83154e1a68504df5b9e99369cdb4c876" } new_table_name: "default.Table_7ebc041f2fae4a4cae849d98053f6c1f" modify_external_catalogs: true
I20260616 19:52:13.331331 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b4d4c8b67aa44f68a974f7ca7090dd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:13.333410 860 consensus_peers.cc:597] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca5dc1e6cde347fc9a34e555385dc646. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:13.335908 1193 raft_consensus.cc:2243] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 2 LEADER]: Raft consensus shutting down.
I20260616 19:52:13.336138 1193 pending_rounds.cc:70] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:13.336174 1193 pending_rounds.cc:77] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7297595526242320384 op_type: NO_OP noop_request { }
I20260616 19:52:13.336247 1193 raft_consensus.cc:2889] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:13.336314 1193 raft_consensus.cc:2272] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.337116 2452 raft_consensus.cc:493] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.337230 2401 raft_consensus.cc:493] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.337283 2452 raft_consensus.cc:515] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.337363 2401 raft_consensus.cc:515] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.337944 2401 leader_election.cc:290] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:13.337980 2452 leader_election.cc:290] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.338402 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a817b1d4c7b640db8894bc801878caae" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.338749 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_de1900d5d6c048b49ac5e89381ff03ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.338959 993 leader_election.cc:343] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.339274 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a817b1d4c7b640db8894bc801878caae" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:13.339560 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf57dd6d704645b6bf97b730dbe964" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:13.339800 996 leader_election.cc:343] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.339901 996 leader_election.cc:304] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.340386 2401 raft_consensus.cc:2749] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.340384 1940 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" instance_seqno: 1781639509283738) as {username='slave'} at 127.0.105.130:59087; Asking this server to re-register.
W20260616 19:52:13.341782 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de1900d5d6c048b49ac5e89381ff03ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.341818 971 heartbeater.cc:461] Registering TS with master...
I20260616 19:52:13.342409 1934 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "7245e7dab0ec474a876537be514c8767" instance_seqno: 1781639508785759) as {username='slave'} at 127.0.105.129:36525; Asking this server to re-register.
I20260616 19:52:13.340374 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e6777fb7d1cf4e95a774d36f85affd8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.343164 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6777fb7d1cf4e95a774d36f85affd8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.344549 832 heartbeater.cc:461] Registering TS with master...
I20260616 19:52:13.348263 2401 raft_consensus.cc:493] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.348405 2401 raft_consensus.cc:515] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:13.348623 719 leader_election.cc:343] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: aabf57dd6d704645b6bf97b730dbe964
I20260616 19:52:13.348731 719 leader_election.cc:304] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.348941 2401 leader_election.cc:290] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:13.349236 2452 raft_consensus.cc:2749] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.349743 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ac2e31a1ba40b39145c26a1e4e0884" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.349931 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ac2e31a1ba40b39145c26a1e4e0884" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:13.350242 993 leader_election.cc:343] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:13.350427 996 leader_election.cc:343] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.350525 996 leader_election.cc:304] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.350895 2401 raft_consensus.cc:2749] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.353852 1191 ts_tablet_manager.cc:1929] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.356957 1938 ts_manager.cc:194] Registered new tserver with Master: ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:13.358626 2452 raft_consensus.cc:493] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.358891 2452 raft_consensus.cc:515] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.359046 1932 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" instance_seqno: 1781639509785789) as {username='slave'} at 127.0.105.131:36065; Asking this server to re-register.
I20260616 19:52:13.359295 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bbe41b97de514a868fc05e0bb96895bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.359827 1934 ts_manager.cc:194] Registered new tserver with Master: 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:13.359869 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbe41b97de514a868fc05e0bb96895bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.360015 2452 leader_election.cc:290] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.360229 2495 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85d6b13547f2413c86ee07194ca74704)
I20260616 19:52:13.360452 2495 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } }
I20260616 19:52:13.361593 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102f322eb98f4224acb8637f8c29ac19" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.361807 923 raft_consensus.cc:2468] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:13.362262 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
I20260616 19:52:13.362661 2495 leader_election.cc:290] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85d6b13547f2413c86ee07194ca74704 (127.0.105.190:35857), c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219)
I20260616 19:52:13.275363 1190 raft_consensus.cc:2243] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.362897 1190 raft_consensus.cc:2272] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.363044 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_65b8b2d0dc4e4a1b84fbeebb0af17087"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.363401 1378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1351 } } ignore_live_leader: false dest_uuid: "c404c91cd2194cf6838fddd212f2f4ae" is_pre_election: true
W20260616 19:52:13.363538 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65b8b2d0dc4e4a1b84fbeebb0af17087 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.363843 1196 tablet_bootstrap.cc:654] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.364503 747 tablet_service.cc:1511] Processing CreateTablet for tablet c1103ff2aae0453bbdfab26ed80139ac (DEFAULT_TABLE table=default.Table_a5adefde605d4bfb86e0d089b619c69b [id=daba1692faa94990984346e2e378cf8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.364790 718 leader_election.cc:304] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:13.364912 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1103ff2aae0453bbdfab26ed80139ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.365365 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1351 } } ignore_live_leader: false dest_uuid: "85d6b13547f2413c86ee07194ca74704" is_pre_election: true
I20260616 19:52:13.366086 1861 leader_election.cc:304] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b8fb7a8523741a2b7a5e75d8b415be0; no voters: 85d6b13547f2413c86ee07194ca74704, c404c91cd2194cf6838fddd212f2f4ae
I20260616 19:52:13.368571 2452 raft_consensus.cc:2804] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:13.368695 2452 raft_consensus.cc:493] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:13.368822 2452 raft_consensus.cc:3060] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.369020 1190 ts_tablet_manager.cc:1916] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.368893 2495 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260616 19:52:13.371225 2452 raft_consensus.cc:515] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.371791 2448 raft_consensus.cc:493] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.371906 1192 tablet_bootstrap.cc:492] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:13.371910 2448 raft_consensus.cc:515] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.372080 1192 ts_tablet_manager.cc:1403] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.096s user 0.004s sys 0.000s
I20260616 19:52:13.372313 2452 leader_election.cc:290] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.372512 2448 leader_election.cc:290] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.373142 1192 raft_consensus.cc:359] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.373358 1192 raft_consensus.cc:385] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.373453 1192 raft_consensus.cc:740] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
W20260616 19:52:13.373570 719 leader_election.cc:343] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 3b57bceabff64533ae3a49b8afda614d
I20260616 19:52:13.373776 1192 consensus_queue.cc:260] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.373894 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b57bceabff64533ae3a49b8afda614d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.374095 921 raft_consensus.cc:2468] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:13.374431 1192 ts_tablet_manager.cc:1434] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:13.374742 1192 tablet_bootstrap.cc:492] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:52:13.375330 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a70f6acb318049229bc8a6b4b340601c consensus state has no leader
I20260616 19:52:13.373777 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102f322eb98f4224acb8637f8c29ac19" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:13.376580 923 raft_consensus.cc:3060] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.376991 1192 tablet_bootstrap.cc:654] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.377557 452 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
I20260616 19:52:13.379285 923 raft_consensus.cc:2468] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:13.379667 718 leader_election.cc:304] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:13.380070 718 leader_election.cc:304] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:13.380389 2448 raft_consensus.cc:2804] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:13.380456 2448 raft_consensus.cc:493] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:13.380533 2448 raft_consensus.cc:3060] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.362493 1107 heartbeater.cc:461] Registering TS with master...
I20260616 19:52:13.365943 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102f322eb98f4224acb8637f8c29ac19" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:13.382402 1055 raft_consensus.cc:2468] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:13.368352 2401 raft_consensus.cc:493] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.372390 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102f322eb98f4224acb8637f8c29ac19" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:13.383208 1058 raft_consensus.cc:3060] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.383206 2401 raft_consensus.cc:515] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.383813 2401 leader_election.cc:290] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:13.384330 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc58b2bda2a43f18f157469b591854b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.385756 1058 raft_consensus.cc:2468] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:13.387043 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ea06e51835f457b8bcb4de9b9d5f992 consensus state has no leader
W20260616 19:52:13.387450 993 leader_election.cc:343] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.388093 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc58b2bda2a43f18f157469b591854b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:13.388862 996 leader_election.cc:343] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.388957 996 leader_election.cc:304] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.389400 2401 raft_consensus.cc:2749] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.389671 1191 log.cc:1199] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/1e8160ad4cf74f16a586ae59291ce7d1
I20260616 19:52:13.390196 1191 ts_tablet_manager.cc:1950] T 1e8160ad4cf74f16a586ae59291ce7d1 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:13.391425 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 910) took 4792 ms. Trace:
I20260616 19:52:13.391942 452 master_service.cc:960] ReplaceTablet: received request to replace tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:13.392834 1934 ts_manager.cc:194] Registered new tserver with Master: 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.395095 1191 rpcz_store.cc:276] 0616 19:52:08.598903 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.598960 (+ 57us) service_pool.cc:224] Handling call
0616 19:52:13.295057 (+4696097us) ts_tablet_manager.cc:1151] Deleting tablet 1e8160ad4cf74f16a586ae59291ce7d1
0616 19:52:13.297993 (+ 2936us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.328055 (+ 30062us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.353796 (+ 25741us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.391407 (+ 37611us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4695881}
I20260616 19:52:13.395684 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 1e8160ad4cf74f16a586ae59291ce7d1 (table default.Table_2984957106b44cdc9ecd5a06e8edb7d3 [id=23f3d793560846b7a0701ec470588cbc]) successfully deleted
I20260616 19:52:13.396000 1198 tablet_bootstrap.cc:492] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:13.396171 1198 ts_tablet_manager.cc:1403] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.101s user 0.006s sys 0.000s
I20260616 19:52:13.396037 1191 tablet_replica.cc:333] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:13.396561 1191 raft_consensus.cc:2243] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:13.396899 1191 raft_consensus.cc:2272] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.396996 1198 raft_consensus.cc:359] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.397190 1198 raft_consensus.cc:385] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.397300 1198 raft_consensus.cc:740] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.397571 1198 consensus_queue.cc:260] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.397814 1191 ts_tablet_manager.cc:1916] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.401778 454 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 31db3862f78943519bcd9531c5530048 (table default.Table_8cda9a799036458f9543a8a8aac3ee5a [id=c72157c1e0f943e4af149e7f692209ee]). Expected version 1 got 0
I20260616 19:52:13.398180 1198 ts_tablet_manager.cc:1434] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:13.402630 1025 tablet_service.cc:1511] Processing CreateTablet for tablet c1103ff2aae0453bbdfab26ed80139ac (DEFAULT_TABLE table=default.Table_a5adefde605d4bfb86e0d089b619c69b [id=daba1692faa94990984346e2e378cf8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.403043 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1103ff2aae0453bbdfab26ed80139ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.404232 1193 ts_tablet_manager.cc:1916] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.408608 898 tablet_service.cc:1511] Processing CreateTablet for tablet c1103ff2aae0453bbdfab26ed80139ac (DEFAULT_TABLE table=default.Table_a5adefde605d4bfb86e0d089b619c69b [id=daba1692faa94990984346e2e378cf8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.409070 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1103ff2aae0453bbdfab26ed80139ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.402652 1198 tablet_bootstrap.cc:492] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:13.412092 1198 tablet_bootstrap.cc:654] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.412606 903 tablet_service.cc:1558] Processing DeleteTablet for tablet fb1c2030b3a14c6aafaa961869606f31 with delete_type TABLET_DATA_DELETED (replaced by tablet c7f724dc23024a7297cfb8689f199600) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.416927 898 tablet_service.cc:1511] Processing CreateTablet for tablet d775748ab84144a0b9395d04ea3bd562 (DEFAULT_TABLE table=default.Table_678e58d369004dd58c9fc0e0ced4ad20 [id=56a0e1968c344c34aaa47f6ffc726155]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.417428 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d775748ab84144a0b9395d04ea3bd562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.417544 2448 raft_consensus.cc:515] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.418172 2448 leader_election.cc:290] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.418355 2448 raft_consensus.cc:2804] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:13.418447 2448 raft_consensus.cc:697] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:13.418565 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b57bceabff64533ae3a49b8afda614d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:13.418643 2448 consensus_queue.cc:237] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.418740 921 raft_consensus.cc:3060] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.421105 921 raft_consensus.cc:2468] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:13.421286 747 tablet_service.cc:1511] Processing CreateTablet for tablet d775748ab84144a0b9395d04ea3bd562 (DEFAULT_TABLE table=default.Table_678e58d369004dd58c9fc0e0ced4ad20 [id=56a0e1968c344c34aaa47f6ffc726155]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.421612 718 leader_election.cc:304] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:13.421864 2470 raft_consensus.cc:2804] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:13.421970 2470 raft_consensus.cc:697] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
W20260616 19:52:13.422031 719 leader_election.cc:343] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 3b57bceabff64533ae3a49b8afda614d
I20260616 19:52:13.422174 2470 consensus_queue.cc:237] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.421623 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d775748ab84144a0b9395d04ea3bd562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.423883 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8ab332529d7746c3b8cf64f5957b0c3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.424567 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ab332529d7746c3b8cf64f5957b0c3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.425357 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f369debb579f481e8b6b311ac65097a7" } new_table_name: "default.Table_cd3fa037a4fa4959bfea35fbc223bcc9" modify_external_catalogs: true
I20260616 19:52:13.428928 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c3d71d78c92f45f1a6c0af3589026b10
I20260616 19:52:13.429488 461 catalog_manager.cc:6784] ReplaceTablet: tablet c3d71d78c92f45f1a6c0af3589026b10 deleted and replaced by tablet 68d63a5978ca45b99929405ce1a35ac2
I20260616 19:52:13.429566 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fae2f430cf904db09b2f18a37d3d9f7f
I20260616 19:52:13.430212 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet c3d71d78c92f45f1a6c0af3589026b10 with delete_type TABLET_DATA_DELETED (replaced by tablet 68d63a5978ca45b99929405ce1a35ac2) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.430429 758 tablet_service.cc:1558] Processing DeleteTablet for tablet c3d71d78c92f45f1a6c0af3589026b10 with delete_type TABLET_DATA_DELETED (replaced by tablet 68d63a5978ca45b99929405ce1a35ac2) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.430682 2401 raft_consensus.cc:493] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.430820 2401 raft_consensus.cc:515] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.431221 885 tablet_service.cc:1558] Processing DeleteTablet for tablet fae2f430cf904db09b2f18a37d3d9f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.431272 758 tablet_service.cc:1558] Processing DeleteTablet for tablet fae2f430cf904db09b2f18a37d3d9f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.431407 2401 leader_election.cc:290] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:13.431604 903 tablet_service.cc:1558] Processing DeleteTablet for tablet c3d71d78c92f45f1a6c0af3589026b10 with delete_type TABLET_DATA_DELETED (replaced by tablet 68d63a5978ca45b99929405ce1a35ac2) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.432140 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0d3e7da3c74f5ea5dc4aac80a01c82" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:13.432626 996 leader_election.cc:343] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.432724 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0d3e7da3c74f5ea5dc4aac80a01c82" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.435075 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c2b44a48b8754af487aa042a8b651b52" } new_table_name: "default.Table_897efa9fcf78475cb7a10b3c661196df" modify_external_catalogs: true
W20260616 19:52:13.435137 993 leader_election.cc:343] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.435256 993 leader_election.cc:304] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.435228 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e1ef4766e04c4030a2f1a81c5c761f0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.435554 2401 raft_consensus.cc:2749] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:13.435811 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1ef4766e04c4030a2f1a81c5c761f0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.435878 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_09064f2784da477896e7e01c6581b826"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.436352 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09064f2784da477896e7e01c6581b826 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.437644 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a585dc2cbde74ec68c6abe440508eb07" } new_table_name: "default.Table_878aea485f5f4108aa82651f4e9167c3" modify_external_catalogs: true
I20260616 19:52:13.439117 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet fae2f430cf904db09b2f18a37d3d9f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.439749 2297 raft_consensus.cc:493] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.439893 2297 raft_consensus.cc:515] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.440553 2297 leader_election.cc:290] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:13.441949 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a09d62e68148349b337c5075763672" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:13.442111 1058 raft_consensus.cc:2468] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:13.442548 858 leader_election.cc:304] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:13.442924 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a09d62e68148349b337c5075763672" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:13.443365 860 leader_election.cc:343] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.443385 2297 raft_consensus.cc:2804] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:13.443509 2297 raft_consensus.cc:493] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:13.443589 2297 raft_consensus.cc:3060] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.441447 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 31db3862f78943519bcd9531c5530048 (table default.Table_8cda9a799036458f9543a8a8aac3ee5a [id=c72157c1e0f943e4af149e7f692209ee]). Expected version 1 got 0
I20260616 19:52:13.446014 2297 raft_consensus.cc:515] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.447726 2297 leader_election.cc:290] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:13.447654 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a09d62e68148349b337c5075763672" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:13.447829 1058 raft_consensus.cc:3060] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.448352 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_aba0e849bdd049bf83f24ded8d4919c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.450479 1058 raft_consensus.cc:2468] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
W20260616 19:52:13.450714 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aba0e849bdd049bf83f24ded8d4919c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.451016 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a09d62e68148349b337c5075763672" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:13.451192 858 leader_election.cc:304] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:52:13.451532 860 leader_election.cc:343] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.452677 2297 raft_consensus.cc:2804] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:13.453534 2297 raft_consensus.cc:697] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:13.453941 2297 consensus_queue.cc:237] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.457317 2452 raft_consensus.cc:493] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.458724 2452 raft_consensus.cc:515] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.461045 1025 tablet_service.cc:1511] Processing CreateTablet for tablet d775748ab84144a0b9395d04ea3bd562 (DEFAULT_TABLE table=default.Table_678e58d369004dd58c9fc0e0ced4ad20 [id=56a0e1968c344c34aaa47f6ffc726155]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.461503 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d775748ab84144a0b9395d04ea3bd562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.468550 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13d175adfe540b39fd55004a11c9aad" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.468817 921 raft_consensus.cc:2468] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:13.469278 718 leader_election.cc:304] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:13.469955 1192 tablet_bootstrap.cc:492] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:13.469946 2452 leader_election.cc:290] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.470079 2452 raft_consensus.cc:2804] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:13.470157 2452 raft_consensus.cc:493] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:13.470229 2452 raft_consensus.cc:3060] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:13.471758 858 consensus_peers.cc:597] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17029c1ba36644e9847200b54bf9094c. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:13.474527 1192 ts_tablet_manager.cc:1403] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.100s user 0.003s sys 0.000s
I20260616 19:52:13.475394 1192 raft_consensus.cc:359] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.475675 1192 raft_consensus.cc:385] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.475795 1192 raft_consensus.cc:740] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.476082 1192 consensus_queue.cc:260] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.476708 1192 ts_tablet_manager.cc:1434] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:13.477110 2401 raft_consensus.cc:493] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.477236 2401 raft_consensus.cc:515] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.477788 2401 leader_election.cc:290] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:13.480523 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6955250583bf4c3cbff20316dfa5d1a7" } modify_external_catalogs: true
I20260616 19:52:13.480844 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6955250583bf4c3cbff20316dfa5d1a7" } modify_external_catalogs: true
I20260616 19:52:13.481885 903 tablet_service.cc:1511] Processing CreateTablet for tablet 9f1940f3d73d472c9c68a10539848e9d (DEFAULT_TABLE table=default.Table_80f6064bd3104b6699561f5e6cda71ea [id=24945804be7e40dfb20aa6d3cbad6a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.482489 1191 ts_tablet_manager.cc:1929] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.482836 1191 log.cc:1199] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/f52b2c5ff6264ffe8d579cb3816fc253
I20260616 19:52:13.483206 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 9f1940f3d73d472c9c68a10539848e9d (DEFAULT_TABLE table=default.Table_80f6064bd3104b6699561f5e6cda71ea [id=24945804be7e40dfb20aa6d3cbad6a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.483502 1191 ts_tablet_manager.cc:1950] T f52b2c5ff6264ffe8d579cb3816fc253 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:13.483572 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f1940f3d73d472c9c68a10539848e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.484061 885 tablet_service.cc:1511] Processing CreateTablet for tablet 1c11608333084f0abc3d94279ac9f04c (DEFAULT_TABLE table=default.Table_62b1eb40939947c7bd2d7f18665caf57 [id=f41459c1fdfe471e89a3097a9511c55b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.485113 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 1c11608333084f0abc3d94279ac9f04c (DEFAULT_TABLE table=default.Table_62b1eb40939947c7bd2d7f18665caf57 [id=f41459c1fdfe471e89a3097a9511c55b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.485512 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c11608333084f0abc3d94279ac9f04c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.490305 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_992b7795e9584cdc84514004082b6975" } modify_external_catalogs: true
I20260616 19:52:13.490489 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_992b7795e9584cdc84514004082b6975" } modify_external_catalogs: true
W20260616 19:52:13.471939 719 leader_election.cc:343] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: f13d175adfe540b39fd55004a11c9aad
I20260616 19:52:13.493443 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269c1dea941c481fb6fd2e4d59c877c0" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.493655 747 tablet_service.cc:1511] Processing CreateTablet for tablet 9f1940f3d73d472c9c68a10539848e9d (DEFAULT_TABLE table=default.Table_80f6064bd3104b6699561f5e6cda71ea [id=24945804be7e40dfb20aa6d3cbad6a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.494060 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f1940f3d73d472c9c68a10539848e9d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:13.495226 993 leader_election.cc:343] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.495795 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c11608333084f0abc3d94279ac9f04c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.496428 1192 tablet_bootstrap.cc:492] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:13.498055 1192 tablet_bootstrap.cc:654] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.502244 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269c1dea941c481fb6fd2e4d59c877c0" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:13.502553 747 tablet_service.cc:1511] Processing CreateTablet for tablet 1c11608333084f0abc3d94279ac9f04c (DEFAULT_TABLE table=default.Table_62b1eb40939947c7bd2d7f18665caf57 [id=f41459c1fdfe471e89a3097a9511c55b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.502993 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c11608333084f0abc3d94279ac9f04c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.503068 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 911) took 4875 ms. Trace:
I20260616 19:52:13.506608 1191 rpcz_store.cc:276] 0616 19:52:08.627594 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.627660 (+ 66us) service_pool.cc:224] Handling call
0616 19:52:13.395990 (+4768330us) ts_tablet_manager.cc:1151] Deleting tablet f52b2c5ff6264ffe8d579cb3816fc253
0616 19:52:13.395999 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.452300 (+ 56301us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.482432 (+ 30132us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.503045 (+ 20613us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4768032}
I20260616 19:52:13.508303 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet f52b2c5ff6264ffe8d579cb3816fc253 (table default.Table_25651fb93ba2434cb75171647df9d2ec [id=3a6c9b0d46764e87832e82eabcdadc7f]) successfully deleted
W20260616 19:52:13.508317 996 leader_election.cc:343] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.508399 455 master_service.cc:960] ReplaceTablet: received request to replace tablet d1e3778611a24397a1a776be2cc76284 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:13.508445 996 leader_election.cc:304] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.499537 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f1940f3d73d472c9c68a10539848e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.508931 2401 raft_consensus.cc:2749] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.509161 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 912) took 4599 ms. Trace:
I20260616 19:52:13.509404 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_91fa1a22ad84466890a2c7ed02a873c0" } modify_external_catalogs: true
I20260616 19:52:13.513485 1191 rpcz_store.cc:276] 0616 19:52:08.909227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.909305 (+ 78us) service_pool.cc:224] Handling call
0616 19:52:13.509032 (+4599727us) ts_tablet_manager.cc:1151] Deleting tablet 34264036a635419fbc8f9e2c388a817b
0616 19:52:13.509046 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.509144 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4599486}
W20260616 19:52:13.514483 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 34264036a635419fbc8f9e2c388a817b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34264036a635419fbc8f9e2c388a817b already in progress: creating tablet
I20260616 19:52:13.514927 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 918) took 4580 ms. Trace:
I20260616 19:52:13.515245 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_91fa1a22ad84466890a2c7ed02a873c0" } modify_external_catalogs: true
I20260616 19:52:13.507139 885 tablet_service.cc:1558] Processing DeleteTablet for tablet c6939d108a7948bb9e56311a34d95486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.516357 1196 tablet_bootstrap.cc:492] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:13.516584 1196 ts_tablet_manager.cc:1403] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.202s user 0.007s sys 0.002s
I20260616 19:52:13.517266 1196 raft_consensus.cc:359] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.517416 1196 raft_consensus.cc:385] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.517458 1196 raft_consensus.cc:740] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.517635 1196 consensus_queue.cc:260] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.518069 1196 ts_tablet_manager.cc:1434] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260616 19:52:13.518337 1196 tablet_bootstrap.cc:492] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:13.519892 1196 tablet_bootstrap.cc:654] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.521642 1191 rpcz_store.cc:276] 0616 19:52:08.934084 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.934141 (+ 57us) service_pool.cc:224] Handling call
0616 19:52:13.514796 (+4580655us) ts_tablet_manager.cc:1151] Deleting tablet 40124cee94a445ed9175132d4e0c86d8
0616 19:52:13.514809 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.514909 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4580441}
I20260616 19:52:13.522854 1192 tablet_bootstrap.cc:492] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
W20260616 19:52:13.523972 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 40124cee94a445ed9175132d4e0c86d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40124cee94a445ed9175132d4e0c86d8 already in progress: creating tablet
W20260616 19:52:13.524075 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2dfa92a1ce0448c1ba877319cdd4e9b5 consensus state has no leader
I20260616 19:52:13.523617 1198 tablet_bootstrap.cc:492] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:13.524379 1198 ts_tablet_manager.cc:1403] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.122s user 0.005s sys 0.003s
I20260616 19:52:13.525213 1198 raft_consensus.cc:359] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.525434 1198 raft_consensus.cc:385] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.525524 1198 raft_consensus.cc:740] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.525777 1198 consensus_queue.cc:260] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.525851 452 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
W20260616 19:52:13.528307 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd7b91e00d6c4f70b0eda75fe83d617e consensus state has no leader
I20260616 19:52:13.530912 2452 raft_consensus.cc:515] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.531029 1198 ts_tablet_manager.cc:1434] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260616 19:52:13.531306 1198 tablet_bootstrap.cc:492] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:13.532253 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dae68b113ed343b4879c83b8554c55f2" } modify_external_catalogs: true
I20260616 19:52:13.532555 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dae68b113ed343b4879c83b8554c55f2" } modify_external_catalogs: true
W20260616 19:52:13.533157 719 leader_election.cc:343] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: f13d175adfe540b39fd55004a11c9aad
I20260616 19:52:13.533420 2452 leader_election.cc:290] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.534938 1198 tablet_bootstrap.cc:654] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.532104 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13d175adfe540b39fd55004a11c9aad" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:13.536624 921 raft_consensus.cc:3060] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.537182 885 tablet_service.cc:1511] Processing CreateTablet for tablet b2cd95a123854d18beabedb341db0563 (DEFAULT_TABLE table=default.Table_5030578ef2be4c15836c8043b7346740 [id=d84ad2b4bd274b6fb7104cd4461998c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.537458 751 tablet_service.cc:1511] Processing CreateTablet for tablet 7de044cb57e941ab9471ffe3bd7eeccb (DEFAULT_TABLE table=default.Table_a1db6293d2e041c9900a691731c2ca4b [id=37b0117b1ac241c08e3553a3cc959418]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.537549 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2cd95a123854d18beabedb341db0563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.537794 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de044cb57e941ab9471ffe3bd7eeccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.539077 921 raft_consensus.cc:2468] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:13.540005 758 tablet_service.cc:1511] Processing CreateTablet for tablet b2cd95a123854d18beabedb341db0563 (DEFAULT_TABLE table=default.Table_5030578ef2be4c15836c8043b7346740 [id=d84ad2b4bd274b6fb7104cd4461998c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.540303 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2cd95a123854d18beabedb341db0563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.545933 718 leader_election.cc:304] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:13.546054 1190 ts_tablet_manager.cc:1929] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:13.546141 1190 log.cc:1199] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/4bd6fa49eff4400ca40c722e18cea951
I20260616 19:52:13.546428 1190 ts_tablet_manager.cc:1950] T 4bd6fa49eff4400ca40c722e18cea951 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:13.546501 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_efa0c3da20a04fe7aa79633b5e4537c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.547606 2511 raft_consensus.cc:2804] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
W20260616 19:52:13.547672 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efa0c3da20a04fe7aa79633b5e4537c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.547786 452 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
I20260616 19:52:13.547849 2511 raft_consensus.cc:697] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:13.463471 1193 ts_tablet_manager.cc:1929] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260616 19:52:13.548348 1193 log.cc:1199] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/47b548b6b7f746fe9fd67c2e6563e961
I20260616 19:52:13.536211 2401 raft_consensus.cc:493] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.548543 2401 raft_consensus.cc:515] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.548782 1193 ts_tablet_manager.cc:1950] T 47b548b6b7f746fe9fd67c2e6563e961 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:13.549155 2401 leader_election.cc:290] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:13.549522 2401 raft_consensus.cc:493] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.549630 2401 raft_consensus.cc:515] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.548089 2511 consensus_queue.cc:237] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.550101 2401 leader_election.cc:290] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:13.550125 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe373c3bb094972b0e17fcb1587987a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:13.539579 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 919) took 4605 ms. Trace:
I20260616 19:52:13.550421 1191 rpcz_store.cc:276] 0616 19:52:08.934175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.935003 (+ 828us) service_pool.cc:224] Handling call
0616 19:52:13.533895 (+4598892us) ts_tablet_manager.cc:1151] Deleting tablet aee589880bac4eff98fa6edd32c0b92d
0616 19:52:13.539427 (+ 5532us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.539561 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4598681}
W20260616 19:52:13.551362 996 leader_election.cc:343] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.551636 2448 raft_consensus.cc:493] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.544420 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d825bcf365f424fb99a10afe3e96501 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.551786 2448 raft_consensus.cc:515] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.551905 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896d5aa87f14e5593d01085bb6d434f" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:13.545572 1026 tablet_service.cc:1511] Processing CreateTablet for tablet b2cd95a123854d18beabedb341db0563 (DEFAULT_TABLE table=default.Table_5030578ef2be4c15836c8043b7346740 [id=d84ad2b4bd274b6fb7104cd4461998c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.552251 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2cd95a123854d18beabedb341db0563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.552295 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 920) took 4616 ms. Trace:
I20260616 19:52:13.552567 2448 leader_election.cc:290] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:13.553200 719 leader_election.cc:343] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: aa72e00b0a3a423f96bdd7abb6013810
I20260616 19:52:13.556507 1191 rpcz_store.cc:276] 0616 19:52:08.935417 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.935520 (+ 103us) service_pool.cc:224] Handling call
0616 19:52:13.552179 (+4616659us) ts_tablet_manager.cc:1151] Deleting tablet 6677452bd2ce4ba5a07fdf67e9529830
0616 19:52:13.552197 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.552280 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4614957}
W20260616 19:52:13.556665 996 leader_election.cc:343] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.557152 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 917) took 4623 ms. Trace:
I20260616 19:52:13.557540 1191 rpcz_store.cc:276] 0616 19:52:08.933970 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:08.934161 (+ 191us) service_pool.cc:224] Handling call
0616 19:52:13.557050 (+4622889us) ts_tablet_manager.cc:1151] Deleting tablet 4ce69dcb31fe41879e9feb3b01547dd9
0616 19:52:13.557059 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.557137 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4620548}
I20260616 19:52:13.560113 1191 tablet_replica.cc:333] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:13.560336 1191 raft_consensus.cc:2243] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.560608 1191 raft_consensus.cc:2272] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.561121 1191 ts_tablet_manager.cc:1916] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.548369 1192 ts_tablet_manager.cc:1403] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.000s
I20260616 19:52:13.549932 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe373c3bb094972b0e17fcb1587987a" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.550643 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896d5aa87f14e5593d01085bb6d434f" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.552819 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa72e00b0a3a423f96bdd7abb6013810" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.562922 922 raft_consensus.cc:2468] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:13.563040 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 918) took 4493 ms. Trace:
I20260616 19:52:13.563107 1190 rpcz_store.cc:276] 0616 19:52:09.069490 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.219216 (+149726us) service_pool.cc:224] Handling call
0616 19:52:13.274462 (+4055246us) ts_tablet_manager.cc:1151] Deleting tablet 4bd6fa49eff4400ca40c722e18cea951
0616 19:52:13.274473 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.445267 (+170794us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.546005 (+100738us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.563029 (+ 17024us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4055091}
W20260616 19:52:13.563196 993 leader_election.cc:343] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.563284 993 leader_election.cc:304] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.563377 1190 tablet_replica.cc:333] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:13.563532 1190 raft_consensus.cc:2243] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
W20260616 19:52:13.563638 993 leader_election.cc:343] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.563714 993 leader_election.cc:304] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.563817 1190 raft_consensus.cc:2272] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.564208 2401 raft_consensus.cc:2749] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.564317 1190 ts_tablet_manager.cc:1916] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.564358 2401 raft_consensus.cc:2749] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.564713 718 leader_election.cc:304] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:13.566071 1192 raft_consensus.cc:359] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.566298 1192 raft_consensus.cc:385] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.566394 1192 raft_consensus.cc:740] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.566653 1192 consensus_queue.cc:260] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.567835 2448 raft_consensus.cc:2804] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:13.568003 2448 raft_consensus.cc:493] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:13.568136 2448 raft_consensus.cc:3060] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.570159 1192 ts_tablet_manager.cc:1434] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260616 19:52:13.570497 1192 tablet_bootstrap.cc:492] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:13.570819 2448 raft_consensus.cc:515] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.549732 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 47b548b6b7f746fe9fd67c2e6563e961 (table default.Table_60ba0f6f88634456a3d4afc9f759c4a7 [id=9c7b653f62ef4b74946cc87069f8df6e]) successfully deleted
W20260616 19:52:13.550817 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet aee589880bac4eff98fa6edd32c0b92d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aee589880bac4eff98fa6edd32c0b92d already in progress: creating tablet
W20260616 19:52:13.574105 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 6677452bd2ce4ba5a07fdf67e9529830 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6677452bd2ce4ba5a07fdf67e9529830 already in progress: creating tablet
W20260616 19:52:13.574337 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 4ce69dcb31fe41879e9feb3b01547dd9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ce69dcb31fe41879e9feb3b01547dd9 already in progress: creating tablet
I20260616 19:52:13.575098 1029 tablet_service.cc:1511] Processing CreateTablet for tablet a1234f02aafa4d9bb0d4350048af90eb (DEFAULT_TABLE table=default.Table_f56d9704ddc841ecb86a4e8303e471e7 [id=77c80bce19444f6ab38a9172c31bc345]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.575467 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1234f02aafa4d9bb0d4350048af90eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:13.556823 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 277085ae6c9e4af4a072d669c18ae4da consensus state has no leader
I20260616 19:52:13.565436 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 4bd6fa49eff4400ca40c722e18cea951 (table default.Table_ae1d446a11f34a77bd9bcdafbef99127 [id=b401e2a905f842579b3b60e5d20815aa]) successfully deleted
I20260616 19:52:13.576838 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e316e44693d473dad901eeb95299988 with delete_type TABLET_DATA_DELETED (replaced by tablet 93c940bd14a040ddba5ea058e732bf0c) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.576994 902 tablet_service.cc:1511] Processing CreateTablet for tablet beff072c989f4b54b3f57f5c19526de5 (DEFAULT_TABLE table=default.Table_8d28df6ecf2f4da3806d394095e83a0d [id=d0e03d8f692841a9a3cc6821379b96aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.577319 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beff072c989f4b54b3f57f5c19526de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.577677 885 tablet_service.cc:1511] Processing CreateTablet for tablet 7de044cb57e941ab9471ffe3bd7eeccb (DEFAULT_TABLE table=default.Table_a1db6293d2e041c9900a691731c2ca4b [id=37b0117b1ac241c08e3553a3cc959418]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.577992 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de044cb57e941ab9471ffe3bd7eeccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.579393 1035 tablet_service.cc:1511] Processing CreateTablet for tablet e0780840800b4c4a8a259703dad28fd3 (DEFAULT_TABLE table=default.Table_e2673166695846d9b5207926e41723a7 [id=dfb0afd4360b4807b3eb5a1db650684b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.579700 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0780840800b4c4a8a259703dad28fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.580678 889 tablet_service.cc:1511] Processing CreateTablet for tablet a1234f02aafa4d9bb0d4350048af90eb (DEFAULT_TABLE table=default.Table_f56d9704ddc841ecb86a4e8303e471e7 [id=77c80bce19444f6ab38a9172c31bc345]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.580978 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1234f02aafa4d9bb0d4350048af90eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.580684 890 tablet_service.cc:1511] Processing CreateTablet for tablet e0780840800b4c4a8a259703dad28fd3 (DEFAULT_TABLE table=default.Table_e2673166695846d9b5207926e41723a7 [id=dfb0afd4360b4807b3eb5a1db650684b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.581524 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0780840800b4c4a8a259703dad28fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.585009 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa72e00b0a3a423f96bdd7abb6013810" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:13.585175 922 raft_consensus.cc:3060] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.585319 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 3d44aed473e44e2eaa0d166f164c9309
I20260616 19:52:13.587538 922 raft_consensus.cc:2468] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:13.588071 718 leader_election.cc:304] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:13.588146 1036 tablet_service.cc:1511] Processing CreateTablet for tablet beff072c989f4b54b3f57f5c19526de5 (DEFAULT_TABLE table=default.Table_8d28df6ecf2f4da3806d394095e83a0d [id=d0e03d8f692841a9a3cc6821379b96aa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:13.588218 719 leader_election.cc:343] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: aa72e00b0a3a423f96bdd7abb6013810
I20260616 19:52:13.588349 2470 raft_consensus.cc:2804] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:13.588449 2470 raft_consensus.cc:697] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:13.588500 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beff072c989f4b54b3f57f5c19526de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.588683 2470 consensus_queue.cc:237] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.589562 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b3d1ae6133974de8942b6f6a2ae9f310" } new_table_name: "default.Table_c986682087fc4381b1bff202b6574f26" modify_external_catalogs: true
I20260616 19:52:13.566921 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7dc92bc15da14504a1ff5feda5aff7cf
I20260616 19:52:13.591171 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc92bc15da14504a1ff5feda5aff7cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.591471 2448 leader_election.cc:290] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.593647 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4d61e1aedb0e4aa1ac42880ed2ed5ab8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.594225 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d61e1aedb0e4aa1ac42880ed2ed5ab8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.594285 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f0b3b9a1d74449d1a00b3c989eac3ee5" } new_table_name: "default.Table_43ca82dacb8e4deaa0ad4eb9b088ab2d" modify_external_catalogs: true
I20260616 19:52:13.595630 903 tablet_service.cc:1511] Processing CreateTablet for tablet d1a4f4342c1e470ca8c415e02863616b (DEFAULT_TABLE table=default.Table_d47c0fc456964736901f20477b062604 [id=45035cbbc6ae4fc0898a917a4ddc4d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.595984 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a4f4342c1e470ca8c415e02863616b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.596045 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1c02cec36bb14929ab52e7240773c239"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.596568 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c02cec36bb14929ab52e7240773c239 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.597465 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d1e3778611a24397a1a776be2cc76284
I20260616 19:52:13.592692 1196 tablet_bootstrap.cc:492] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:13.597668 1196 ts_tablet_manager.cc:1403] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.079s user 0.008s sys 0.015s
I20260616 19:52:13.597810 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc92bc15da14504a1ff5feda5aff7cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.597975 455 catalog_manager.cc:6784] ReplaceTablet: tablet d1e3778611a24397a1a776be2cc76284 deleted and replaced by tablet 1f9beca7b7d749bea74949dde5a1a6cb
I20260616 19:52:13.598325 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c7f4c8e2282640fb98ec05f8b719772a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.598436 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d44aed473e44e2eaa0d166f164c9309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.598429 1196 raft_consensus.cc:359] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.598567 1196 raft_consensus.cc:385] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.598618 1196 raft_consensus.cc:740] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.598675 890 tablet_service.cc:1558] Processing DeleteTablet for tablet d1e3778611a24397a1a776be2cc76284 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f9beca7b7d749bea74949dde5a1a6cb) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:13.598809 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7f4c8e2282640fb98ec05f8b719772a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.598786 1196 consensus_queue.cc:260] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.599267 1196 ts_tablet_manager.cc:1434] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:52:13.599548 1196 tablet_bootstrap.cc:492] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:13.603456 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet d1e3778611a24397a1a776be2cc76284 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f9beca7b7d749bea74949dde5a1a6cb) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.604990 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d44aed473e44e2eaa0d166f164c9309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.605242 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c
I20260616 19:52:13.606072 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.606403 747 tablet_service.cc:1511] Processing CreateTablet for tablet d1a4f4342c1e470ca8c415e02863616b (DEFAULT_TABLE table=default.Table_d47c0fc456964736901f20477b062604 [id=45035cbbc6ae4fc0898a917a4ddc4d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.606446 758 tablet_service.cc:1511] Processing CreateTablet for tablet beff072c989f4b54b3f57f5c19526de5 (DEFAULT_TABLE table=default.Table_8d28df6ecf2f4da3806d394095e83a0d [id=d0e03d8f692841a9a3cc6821379b96aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.606793 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a4f4342c1e470ca8c415e02863616b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.607059 759 tablet_service.cc:1511] Processing CreateTablet for tablet e0780840800b4c4a8a259703dad28fd3 (DEFAULT_TABLE table=default.Table_e2673166695846d9b5207926e41723a7 [id=dfb0afd4360b4807b3eb5a1db650684b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.607568 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0780840800b4c4a8a259703dad28fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.609257 1192 tablet_bootstrap.cc:654] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.609754 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1d9d5b9b81694258accdb0d18ae094de
I20260616 19:52:13.610946 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d9d5b9b81694258accdb0d18ae094de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.611006 2297 raft_consensus.cc:493] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.611128 2297 raft_consensus.cc:515] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.611814 1196 tablet_bootstrap.cc:654] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:13.612723 858 leader_election.cc:343] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 9d800b4e2c2d42279c102e4e061f5530
I20260616 19:52:13.613216 2297 leader_election.cc:290] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:13.613709 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beff072c989f4b54b3f57f5c19526de5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:13.616829 860 leader_election.cc:343] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 9d800b4e2c2d42279c102e4e061f5530
I20260616 19:52:13.616797 751 tablet_service.cc:1511] Processing CreateTablet for tablet a1234f02aafa4d9bb0d4350048af90eb (DEFAULT_TABLE table=default.Table_f56d9704ddc841ecb86a4e8303e471e7 [id=77c80bce19444f6ab38a9172c31bc345]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.616937 860 leader_election.cc:304] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:13.617129 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1234f02aafa4d9bb0d4350048af90eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.617708 2297 raft_consensus.cc:2749] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.622531 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d9d5b9b81694258accdb0d18ae094de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.622826 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.624709 1196 tablet_bootstrap.cc:492] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:13.624848 1196 ts_tablet_manager.cc:1403] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.002s
I20260616 19:52:13.626201 1196 raft_consensus.cc:359] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.626446 1196 raft_consensus.cc:385] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.626554 1196 raft_consensus.cc:740] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.626791 1196 consensus_queue.cc:260] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.627426 1196 ts_tablet_manager.cc:1434] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:13.627741 1196 tablet_bootstrap.cc:492] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:13.627725 1191 ts_tablet_manager.cc:1929] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:13.627714 2297 raft_consensus.cc:493] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.627847 1191 log.cc:1199] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/fb1c2030b3a14c6aafaa961869606f31
I20260616 19:52:13.627869 2297 raft_consensus.cc:515] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.628260 1191 ts_tablet_manager.cc:1950] T fb1c2030b3a14c6aafaa961869606f31 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:13.629050 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed22bbef8ef479dad179b96ba850d26" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:13.629220 1058 raft_consensus.cc:2468] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:13.629383 1196 tablet_bootstrap.cc:654] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.629458 1192 tablet_bootstrap.cc:492] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:13.629632 1192 ts_tablet_manager.cc:1403] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.000s
I20260616 19:52:13.629690 858 leader_election.cc:304] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:13.629968 2195 raft_consensus.cc:2804] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:13.630033 2195 raft_consensus.cc:493] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:13.630095 2195 raft_consensus.cc:3060] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.631261 1198 tablet_bootstrap.cc:492] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:13.631402 1198 ts_tablet_manager.cc:1403] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.100s user 0.004s sys 0.001s
W20260616 19:52:13.633937 858 consensus_peers.cc:597] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e8160ad4cf74f16a586ae59291ce7d1. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:13.634078 1025 tablet_service.cc:1511] Processing CreateTablet for tablet d1a4f4342c1e470ca8c415e02863616b (DEFAULT_TABLE table=default.Table_d47c0fc456964736901f20477b062604 [id=45035cbbc6ae4fc0898a917a4ddc4d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.634446 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a4f4342c1e470ca8c415e02863616b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.634580 2195 raft_consensus.cc:515] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.635425 2195 leader_election.cc:290] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:13.635562 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed22bbef8ef479dad179b96ba850d26" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:13.635733 775 raft_consensus.cc:3060] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.636178 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed22bbef8ef479dad179b96ba850d26" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:13.636329 1058 raft_consensus.cc:3060] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.637216 759 tablet_service.cc:1511] Processing CreateTablet for tablet 66d1f74bd23d48af8028bc3499d2c79d (DEFAULT_TABLE table=default.Table_0e8a5c6334524a4e97813b34c6ead7e3 [id=9505f53a17e74c3a9d8c502b086aa8fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.637555 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d1f74bd23d48af8028bc3499d2c79d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.638166 775 raft_consensus.cc:2468] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:13.638556 860 leader_election.cc:304] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:13.639091 2195 raft_consensus.cc:2804] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:13.639218 2195 raft_consensus.cc:697] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:13.639462 2195 consensus_queue.cc:237] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.640424 1196 tablet_bootstrap.cc:492] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:13.640563 1196 ts_tablet_manager.cc:1403] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.001s
I20260616 19:52:13.640858 2297 leader_election.cc:290] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:13.641074 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed22bbef8ef479dad179b96ba850d26" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:13.641253 775 raft_consensus.cc:2376] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1. Re-sending same reply.
I20260616 19:52:13.641275 1196 raft_consensus.cc:359] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.641455 1196 raft_consensus.cc:385] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.641515 1196 raft_consensus.cc:740] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.641757 1193 tablet_replica.cc:333] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:13.641793 1196 consensus_queue.cc:260] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.642521 1196 ts_tablet_manager.cc:1434] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:13.642822 1058 raft_consensus.cc:2468] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:13.642992 1196 tablet_bootstrap.cc:492] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:13.644586 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc92bc15da14504a1ff5feda5aff7cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.644694 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d44aed473e44e2eaa0d166f164c9309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.645371 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.645391 759 tablet_service.cc:1558] Processing DeleteTablet for tablet d1e3778611a24397a1a776be2cc76284 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f9beca7b7d749bea74949dde5a1a6cb) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.645879 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_96078f528b924e8db7c87740bd036da6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.646482 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96078f528b924e8db7c87740bd036da6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.647713 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_58fcb5c4647344929d53cd74264f0cde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.647965 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d9d5b9b81694258accdb0d18ae094de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:13.648218 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58fcb5c4647344929d53cd74264f0cde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.649381 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_943726059a874d73a2fb021f8c95b8b4" } modify_external_catalogs: true
I20260616 19:52:13.649536 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_943726059a874d73a2fb021f8c95b8b4" } modify_external_catalogs: true
I20260616 19:52:13.641970 1193 raft_consensus.cc:2243] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.651769 1193 raft_consensus.cc:2272] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.652542 1193 ts_tablet_manager.cc:1916] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.655685 1196 tablet_bootstrap.cc:654] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.662631 1192 raft_consensus.cc:359] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.662923 1192 raft_consensus.cc:385] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.663040 1192 raft_consensus.cc:740] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
W20260616 19:52:13.663390 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 296dd76b85b244769d9e4c51163a4e4a consensus state has no leader
I20260616 19:52:13.663327 1192 consensus_queue.cc:260] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.663848 1192 ts_tablet_manager.cc:1434] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260616 19:52:13.664341 1198 raft_consensus.cc:359] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.664532 1198 raft_consensus.cc:385] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.664582 1198 raft_consensus.cc:740] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.664775 1198 consensus_queue.cc:260] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.665290 1198 ts_tablet_manager.cc:1434] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260616 19:52:13.665601 1198 tablet_bootstrap.cc:492] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:13.668347 1198 tablet_bootstrap.cc:654] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.671681 1193 ts_tablet_manager.cc:1929] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:13.673776 1196 tablet_bootstrap.cc:492] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:13.676434 1196 ts_tablet_manager.cc:1403] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.002s
I20260616 19:52:13.677260 1196 raft_consensus.cc:359] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:13.677522 1196 raft_consensus.cc:385] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.677632 1196 raft_consensus.cc:740] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.677942 1196 consensus_queue.cc:260] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:13.678709 1196 ts_tablet_manager.cc:1434] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:13.680193 1196 tablet_bootstrap.cc:492] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:13.682229 1193 log.cc:1199] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/1c35e4c8e9304e798c9031469877b70e
I20260616 19:52:13.682662 1193 ts_tablet_manager.cc:1950] T 1c35e4c8e9304e798c9031469877b70e P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:13.682752 1196 tablet_bootstrap.cc:654] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.684684 1193 tablet_replica.cc:333] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:13.686446 1193 raft_consensus.cc:2243] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.686811 1193 raft_consensus.cc:2272] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.687774 1193 ts_tablet_manager.cc:1916] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.690591 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 940) took 4603 ms. Trace:
I20260616 19:52:13.690740 1191 rpcz_store.cc:276] 0616 19:52:09.087617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.469611 (+381994us) service_pool.cc:224] Handling call
0616 19:52:13.560071 (+4090460us) ts_tablet_manager.cc:1151] Deleting tablet fb1c2030b3a14c6aafaa961869606f31
0616 19:52:13.560080 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.624762 (+ 64682us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.627679 (+ 2917us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.690569 (+ 62890us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4090194}
W20260616 19:52:13.695521 860 consensus_peers.cc:597] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17029c1ba36644e9847200b54bf9094c. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:13.697829 1196 tablet_bootstrap.cc:492] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:13.698033 1196 ts_tablet_manager.cc:1403] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.001s
I20260616 19:52:13.698854 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 1c35e4c8e9304e798c9031469877b70e (table default.Table_940a8144c5014fc9b2fcb74257f85d89 [id=7278ea7c992e450d840d9174df3f1ca0]) successfully deleted
I20260616 19:52:13.698872 1196 raft_consensus.cc:359] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.699193 1196 raft_consensus.cc:385] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.699324 1196 raft_consensus.cc:740] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.699638 1196 consensus_queue.cc:260] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.699936 2195 raft_consensus.cc:493] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.700057 2195 raft_consensus.cc:515] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.700428 1196 ts_tablet_manager.cc:1434] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:13.700664 2195 leader_election.cc:290] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:13.700778 1196 tablet_bootstrap.cc:492] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:13.701637 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e316e44693d473dad901eeb95299988" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:13.701839 775 raft_consensus.cc:2468] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:13.702560 860 leader_election.cc:304] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:13.702818 2195 raft_consensus.cc:2804] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:13.702890 2195 raft_consensus.cc:493] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:13.702973 2195 raft_consensus.cc:3060] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.705298 2195 raft_consensus.cc:515] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.706745 2195 leader_election.cc:290] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:13.706995 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e316e44693d473dad901eeb95299988" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:13.707168 775 raft_consensus.cc:3060] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.708132 1196 tablet_bootstrap.cc:654] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.709950 775 raft_consensus.cc:2468] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:13.710065 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0363a58ed2604e7b9292a1dd3d8a78ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.710361 781 raft_consensus.cc:3060] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.710378 860 leader_election.cc:304] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:52:13.710733 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0363a58ed2604e7b9292a1dd3d8a78ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.710819 2195 raft_consensus.cc:2804] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:13.711072 2195 raft_consensus.cc:697] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:13.711316 2195 consensus_queue.cc:237] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.693701 2287 raft_consensus.cc:493] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.717470 2287 raft_consensus.cc:515] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.718075 2287 leader_election.cc:290] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:13.701637 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e316e44693d473dad901eeb95299988" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:13.706183 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e316e44693d473dad901eeb95299988" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:13.719015 1055 raft_consensus.cc:3060] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.719861 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet fb1c2030b3a14c6aafaa961869606f31 (table default.Table_7cdef69863694f0ba023c214e42394e8 [id=a7f1b3885b764715a88750ea3752dbdb]) successfully deleted
I20260616 19:52:13.719915 1191 tablet_replica.cc:333] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:13.721838 1055 raft_consensus.cc:2468] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:13.721979 1191 raft_consensus.cc:2243] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.722121 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet fbe784716b3c4293bd4eddf57f6c9048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.722380 1191 raft_consensus.cc:2272] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.722894 1191 ts_tablet_manager.cc:1916] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.721372 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647b1abeb3c14b11b9a5c62b67e83cf8" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:13.722604 2470 raft_consensus.cc:493] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.723912 2470 raft_consensus.cc:515] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.716929 1193 ts_tablet_manager.cc:1929] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.725457 1193 log.cc:1199] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/f52b2c5ff6264ffe8d579cb3816fc253
I20260616 19:52:13.725572 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647b1abeb3c14b11b9a5c62b67e83cf8" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.725903 1193 ts_tablet_manager.cc:1950] T f52b2c5ff6264ffe8d579cb3816fc253 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:52:13.726378 993 leader_election.cc:343] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.726838 1193 tablet_replica.cc:333] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:52:13.728355 996 leader_election.cc:343] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.728507 996 leader_election.cc:304] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.729218 2287 raft_consensus.cc:2749] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.729420 1198 tablet_bootstrap.cc:492] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:13.729581 1198 ts_tablet_manager.cc:1403] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.000s
I20260616 19:52:13.730487 1198 raft_consensus.cc:359] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:13.730671 1198 raft_consensus.cc:385] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.730747 1198 raft_consensus.cc:740] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.730791 1193 raft_consensus.cc:2243] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.730962 1193 raft_consensus.cc:2272] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.731050 1198 consensus_queue.cc:260] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:13.731505 1193 ts_tablet_manager.cc:1916] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.732858 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a718fefe07141119b7ef7edcbf61123" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:13.734104 718 leader_election.cc:343] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.727420 2470 leader_election.cc:290] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.738322 1198 ts_tablet_manager.cc:1434] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260616 19:52:13.738785 1198 tablet_bootstrap.cc:492] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:13.739252 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a718fefe07141119b7ef7edcbf61123" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:13.739449 1055 raft_consensus.cc:2468] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:13.740001 719 leader_election.cc:304] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.747918 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet bcc5116ef5df4140a96f03c003337c68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.748245 2511 raft_consensus.cc:2804] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:13.748397 2511 raft_consensus.cc:493] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:13.748574 2511 raft_consensus.cc:3060] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.748816 1192 tablet_bootstrap.cc:492] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:13.750660 1192 tablet_bootstrap.cc:654] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.751446 2511 raft_consensus.cc:515] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.756968 1198 tablet_bootstrap.cc:654] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.761013 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet f52b2c5ff6264ffe8d579cb3816fc253 (table default.Table_25651fb93ba2434cb75171647df9d2ec [id=3a6c9b0d46764e87832e82eabcdadc7f]) successfully deleted
I20260616 19:52:13.763150 1198 tablet_bootstrap.cc:492] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:13.764261 2534 tablet.cc:1724] T d51a6fb4c49e461583a5aba1813b2a3e P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:13.764349 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_98df6f73169842f793087e98d434137e" } new_table_name: "default.Table_15212331af52405da63b6269aefa51d2" modify_external_catalogs: true
I20260616 19:52:13.765025 1198 ts_tablet_manager.cc:1403] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260616 19:52:13.766003 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8137db8cd2914dd79478b66ddbff1c19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.766738 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8137db8cd2914dd79478b66ddbff1c19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.766956 452 catalog_manager.cc:5696] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:13.710886 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 7de044cb57e941ab9471ffe3bd7eeccb (DEFAULT_TABLE table=default.Table_a1db6293d2e041c9900a691731c2ca4b [id=37b0117b1ac241c08e3553a3cc959418]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.771962 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de044cb57e941ab9471ffe3bd7eeccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.777107 1192 tablet_bootstrap.cc:492] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:13.777351 1192 ts_tablet_manager.cc:1403] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260616 19:52:13.778525 1192 raft_consensus.cc:359] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.778820 1192 raft_consensus.cc:385] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.778926 1192 raft_consensus.cc:740] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.779246 1192 consensus_queue.cc:260] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.780246 1192 ts_tablet_manager.cc:1434] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:13.780588 1192 tablet_bootstrap.cc:492] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:13.782702 1192 tablet_bootstrap.cc:654] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.785202 2535 tablet.cc:1724] T d51a6fb4c49e461583a5aba1813b2a3e P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:13.786500 1191 ts_tablet_manager.cc:1929] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:13.788936 1191 log.cc:1199] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/2e316e44693d473dad901eeb95299988
I20260616 19:52:13.790105 1191 ts_tablet_manager.cc:1950] T 2e316e44693d473dad901eeb95299988 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:13.791133 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 943) took 4657 ms. Trace:
I20260616 19:52:13.796540 1191 rpcz_store.cc:276] 0616 19:52:09.133455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.491416 (+357961us) service_pool.cc:224] Handling call
0616 19:52:13.719867 (+4228451us) ts_tablet_manager.cc:1151] Deleting tablet 2e316e44693d473dad901eeb95299988
0616 19:52:13.719877 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.722289 (+ 2412us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x616000200e54. stack: 00007f92671a0086 00007f926719fe40 00007f92661593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f92731d47e0 00007f9274520933 00007f92770e3ae7 00007f9277116bb4 00007f92770f75d0 00007f92770f735d 0000000000aa681c 00007f92671e5f6f 00007f92671e928b 00007f92671e9108
0616 19:52:13.743789 (+ 21500us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.786436 (+ 42647us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.791110 (+ 4674us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4316928,"tablet-delete.queue_time_us":4222710}
I20260616 19:52:13.769624 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_52ed654c2a7e47f588674617cd3a57a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.801124 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52ed654c2a7e47f588674617cd3a57a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.770812 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1e4e899fd0774fcea48561588b790c30" } new_table_name: "default.Table_01232f43cf644a519f3a37450e610110" modify_external_catalogs: true
I20260616 19:52:13.789920 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6b52ddbd352c45ff92fe44ae26a29462"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.802520 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b52ddbd352c45ff92fe44ae26a29462 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.799401 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_090f3e0ccafb44a487aa44fd31777366" } modify_external_catalogs: true
I20260616 19:52:13.803447 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_090f3e0ccafb44a487aa44fd31777366" } modify_external_catalogs: true
I20260616 19:52:13.807459 452 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
I20260616 19:52:13.814402 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_43ca82dacb8e4deaa0ad4eb9b088ab2d" } modify_external_catalogs: true
I20260616 19:52:13.814596 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_43ca82dacb8e4deaa0ad4eb9b088ab2d" } modify_external_catalogs: true
I20260616 19:52:13.759305 1193 ts_tablet_manager.cc:1929] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:13.817152 1193 log.cc:1199] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/64aa32856ca34743933931fb51f2bd7b
I20260616 19:52:13.817508 1193 ts_tablet_manager.cc:1950] T 64aa32856ca34743933931fb51f2bd7b P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:13.818306 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1042) took 1024 ms. Trace:
I20260616 19:52:13.818403 1193 rpcz_store.cc:276] 0616 19:52:12.794069 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.795667 (+ 1598us) service_pool.cc:224] Handling call
0616 19:52:13.726778 (+931111us) ts_tablet_manager.cc:1151] Deleting tablet 64aa32856ca34743933931fb51f2bd7b
0616 19:52:13.726787 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.750058 (+ 23271us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.759207 (+ 9149us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.818267 (+ 59060us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":930058}
I20260616 19:52:13.818740 1193 tablet_replica.cc:333] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:13.818928 1193 raft_consensus.cc:2243] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:13.819154 1193 pending_rounds.cc:70] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:13.819222 1193 pending_rounds.cc:77] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595526882131968 op_type: NO_OP noop_request { }
I20260616 19:52:13.819320 1193 raft_consensus.cc:2889] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:13.819413 1193 raft_consensus.cc:2272] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.762648 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 90205213ba5f49a2931e68839cefb2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.820065 1190 ts_tablet_manager.cc:1929] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.820187 1190 log.cc:1199] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/ca5dc1e6cde347fc9a34e555385dc646
I20260616 19:52:13.820397 1193 ts_tablet_manager.cc:1916] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.820968 2195 raft_consensus.cc:493] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.821084 2195 raft_consensus.cc:515] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.821600 2195 leader_election.cc:290] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:13.822590 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1c2030b3a14c6aafaa961869606f31" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:13.822865 858 leader_election.cc:343] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: fb1c2030b3a14c6aafaa961869606f31
W20260616 19:52:13.823232 860 leader_election.cc:343] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.823356 860 leader_election.cc:304] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:13.823657 2195 raft_consensus.cc:2749] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.828377 1193 ts_tablet_manager.cc:1929] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.828578 1193 log.cc:1199] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/fbb308b05bb04bc18ccaa9550a73d3e7
I20260616 19:52:13.828975 1193 ts_tablet_manager.cc:1950] T fbb308b05bb04bc18ccaa9550a73d3e7 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:13.792661 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e316e44693d473dad901eeb95299988 with delete_type TABLET_DATA_DELETED (replaced by tablet 93c940bd14a040ddba5ea058e732bf0c) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.792909 751 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a09d62e68148349b337c5075763672 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.829546 898 tablet_service.cc:1511] Processing CreateTablet for tablet 66d1f74bd23d48af8028bc3499d2c79d (DEFAULT_TABLE table=default.Table_0e8a5c6334524a4e97813b34c6ead7e3 [id=9505f53a17e74c3a9d8c502b086aa8fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.829802 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1040) took 1042 ms. Trace:
I20260616 19:52:13.829959 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d1f74bd23d48af8028bc3499d2c79d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.830147 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 64aa32856ca34743933931fb51f2bd7b (table default.Table_9d7e4f47840e4f26bc2ee3c1ae553a0c [id=fb8670837a3f4c7086c4f112b7319a38]) successfully deleted
I20260616 19:52:13.830406 1193 rpcz_store.cc:276] 0616 19:52:12.787615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.787666 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:13.818676 (+1031010us) ts_tablet_manager.cc:1151] Deleting tablet fbb308b05bb04bc18ccaa9550a73d3e7
0616 19:52:13.818686 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.825658 (+ 6972us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.828309 (+ 2651us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.829768 (+ 1459us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1020111}
I20260616 19:52:13.830777 1193 tablet_replica.cc:333] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:13.831068 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet fbb308b05bb04bc18ccaa9550a73d3e7 (table default.Table_fae6d52794914f15a61ce5057c2d51b5 [id=4ac9b907f9cf42478b9591bce31ccbcb]) successfully deleted
I20260616 19:52:13.831418 1193 raft_consensus.cc:2243] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:13.831681 1193 pending_rounds.cc:70] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:13.831768 1193 pending_rounds.cc:77] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595529424101376 op_type: NO_OP noop_request { }
I20260616 19:52:13.831894 1193 raft_consensus.cc:2889] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:13.832005 1193 raft_consensus.cc:2272] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.832890 1193 ts_tablet_manager.cc:1916] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.839877 2511 leader_election.cc:290] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.840252 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a718fefe07141119b7ef7edcbf61123" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:13.840274 751 tablet_service.cc:1511] Processing CreateTablet for tablet fcf8905dbff64913ae28f1845dc7626b (DEFAULT_TABLE table=default.Table_ed4536204745427fb6b47d9f6ec3b4de [id=25b05e86595044448a26fad7f5ce7dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.840737 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf8905dbff64913ae28f1845dc7626b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:13.840811 718 leader_election.cc:343] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.841624 1196 tablet_bootstrap.cc:492] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:13.841807 1196 ts_tablet_manager.cc:1403] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.141s user 0.013s sys 0.017s
I20260616 19:52:13.842579 1196 raft_consensus.cc:359] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.842787 1196 raft_consensus.cc:385] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.842885 1196 raft_consensus.cc:740] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.822219 2287 raft_consensus.cc:493] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.845109 2287 raft_consensus.cc:515] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.845719 2287 leader_election.cc:290] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:13.829285 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 66d1f74bd23d48af8028bc3499d2c79d (DEFAULT_TABLE table=default.Table_0e8a5c6334524a4e97813b34c6ead7e3 [id=9505f53a17e74c3a9d8c502b086aa8fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.846668 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d1f74bd23d48af8028bc3499d2c79d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.846673 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d825bcf365f424fb99a10afe3e96501" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:13.847131 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a6565379687e4ddfb471b513939775be
W20260616 19:52:13.847185 996 leader_election.cc:343] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.839687 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a718fefe07141119b7ef7edcbf61123" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:13.848037 1058 raft_consensus.cc:3060] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.848158 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet a6565379687e4ddfb471b513939775be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.850558 1058 raft_consensus.cc:2468] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:13.851009 719 leader_election.cc:304] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.852180 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d825bcf365f424fb99a10afe3e96501" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:13.852733 993 leader_election.cc:343] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.852689 2540 tablet.cc:1724] T d51a6fb4c49e461583a5aba1813b2a3e P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:13.852841 993 leader_election.cc:304] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.853178 2287 raft_consensus.cc:2749] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.853484 898 tablet_service.cc:1558] Processing DeleteTablet for tablet a6565379687e4ddfb471b513939775be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.853920 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 2e316e44693d473dad901eeb95299988 (table default.Table_032fed7521604405ba49b2f399e0f628 [id=5aaccdcce80844bbb73b04f81bde9373]) successfully deleted
I20260616 19:52:13.853961 1193 ts_tablet_manager.cc:1929] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.854045 1193 log.cc:1199] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/f13d175adfe540b39fd55004a11c9aad
I20260616 19:52:13.854382 1193 ts_tablet_manager.cc:1950] T f13d175adfe540b39fd55004a11c9aad P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:13.856099 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d089eb0b17fc4358968ddd4d6675fc6b" } new_table_name: "default.Table_69373349730344568e1a38f8dd6812e1" modify_external_catalogs: true
I20260616 19:52:13.856855 898 tablet_service.cc:1511] Processing CreateTablet for tablet fcf8905dbff64913ae28f1845dc7626b (DEFAULT_TABLE table=default.Table_ed4536204745427fb6b47d9f6ec3b4de [id=25b05e86595044448a26fad7f5ce7dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.857390 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf8905dbff64913ae28f1845dc7626b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.860633 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 945) took 4304 ms. Trace:
I20260616 19:52:13.861243 2470 raft_consensus.cc:493] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.861378 2470 raft_consensus.cc:515] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:13.861984 2470 leader_election.cc:290] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.862437 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c82b71969e4cbcb890d16e1cdd5348" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:13.862629 1058 raft_consensus.cc:2393] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
I20260616 19:52:13.862639 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c82b71969e4cbcb890d16e1cdd5348" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.862706 2470 raft_consensus.cc:493] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.862807 2470 raft_consensus.cc:515] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.863303 2470 leader_election.cc:290] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.861414 1191 rpcz_store.cc:276] 0616 19:52:09.556674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.560503 (+ 3829us) service_pool.cc:224] Handling call
0616 19:52:13.860504 (+4300001us) ts_tablet_manager.cc:1151] Deleting tablet 9a77f8c5c40e4892831cb8af6c305c62
0616 19:52:13.860515 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.860612 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4299771}
I20260616 19:52:13.863607 718 leader_election.cc:304] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.863801 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90205213ba5f49a2931e68839cefb2d2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.863946 2470 raft_consensus.cc:3060] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.863986 922 raft_consensus.cc:2468] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:13.866231 2470 raft_consensus.cc:2749] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:13.866324 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 9a77f8c5c40e4892831cb8af6c305c62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a77f8c5c40e4892831cb8af6c305c62 already in progress: creating tablet
I20260616 19:52:13.866608 718 leader_election.cc:304] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:13.866837 2470 raft_consensus.cc:2804] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:13.866906 2470 raft_consensus.cc:493] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:13.866986 2470 raft_consensus.cc:3060] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.869118 1025 tablet_service.cc:1511] Processing CreateTablet for tablet fcf8905dbff64913ae28f1845dc7626b (DEFAULT_TABLE table=default.Table_ed4536204745427fb6b47d9f6ec3b4de [id=25b05e86595044448a26fad7f5ce7dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.869451 749 tablet_service.cc:1511] Processing CreateTablet for tablet 519875cfa5f14aaca274d33b5915071e (DEFAULT_TABLE table=default.Table_0510b4247a0d451484e1c7b5b8a4d42d [id=2eddb85f54c74180a2927dc6b53fe0e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.869793 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519875cfa5f14aaca274d33b5915071e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.870209 2470 raft_consensus.cc:515] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.855438 758 tablet_service.cc:1558] Processing DeleteTablet for tablet a6565379687e4ddfb471b513939775be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.870929 2470 leader_election.cc:290] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.857887 2511 raft_consensus.cc:2804] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:13.871083 2511 raft_consensus.cc:697] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:13.871313 2511 consensus_queue.cc:237] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.871378 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90205213ba5f49a2931e68839cefb2d2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:13.871531 922 raft_consensus.cc:3060] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.872020 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90205213ba5f49a2931e68839cefb2d2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:13.872177 1055 raft_consensus.cc:3060] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.872434 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1046) took 1041 ms. Trace:
I20260616 19:52:13.872532 1193 rpcz_store.cc:276] 0616 19:52:12.830621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.831184 (+ 563us) service_pool.cc:224] Handling call
0616 19:52:13.830722 (+999538us) ts_tablet_manager.cc:1151] Deleting tablet f13d175adfe540b39fd55004a11c9aad
0616 19:52:13.830731 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.837061 (+ 6330us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.853910 (+ 16849us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.872417 (+ 18507us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":999330}
I20260616 19:52:13.872895 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet f13d175adfe540b39fd55004a11c9aad (table default.Table_630c32eab3fb4372a3a7de16f0f7916c [id=f7089c8c9b504f13949fd8db2c11c45c]) successfully deleted
W20260616 19:52:13.873260 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 3624b437ae284916b343c82c07c61e62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3624b437ae284916b343c82c07c61e62 already in progress: creating tablet
I20260616 19:52:13.873499 1193 tablet_replica.cc:333] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:52:13.873487 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f176111bc2a7494da5e17986963a2c5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f176111bc2a7494da5e17986963a2c5c already in progress: creating tablet
I20260616 19:52:13.873670 1193 raft_consensus.cc:2243] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.873812 1193 raft_consensus.cc:2272] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.863685 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90205213ba5f49a2931e68839cefb2d2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:13.874315 1193 ts_tablet_manager.cc:1916] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.874405 922 raft_consensus.cc:2468] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:13.874573 1055 raft_consensus.cc:2468] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:13.874740 718 leader_election.cc:304] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:13.874945 2470 raft_consensus.cc:2804] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:13.875036 2470 raft_consensus.cc:697] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:13.875223 2470 consensus_queue.cc:237] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.878999 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9319f6312d3a460090760936118e8ec9" } modify_external_catalogs: true
I20260616 19:52:13.879184 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9319f6312d3a460090760936118e8ec9" } modify_external_catalogs: true
W20260616 19:52:13.886197 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0877856fc6d14cd99cf49ce418518f95 consensus state has no leader
I20260616 19:52:13.888259 1192 tablet_bootstrap.cc:492] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:13.888396 1192 ts_tablet_manager.cc:1403] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.108s user 0.003s sys 0.000s
I20260616 19:52:13.889103 1192 raft_consensus.cc:359] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.889281 1192 raft_consensus.cc:385] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.889323 1192 raft_consensus.cc:740] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:13.889657 1192 consensus_queue.cc:260] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.890859 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_89ec43c7fc3847e1ae3dde1c2cc4682c" } modify_external_catalogs: true
I20260616 19:52:13.891053 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_89ec43c7fc3847e1ae3dde1c2cc4682c" } modify_external_catalogs: true
I20260616 19:52:13.891999 1192 ts_tablet_manager.cc:1434] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260616 19:52:13.892235 1192 tablet_bootstrap.cc:492] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:13.894181 1192 tablet_bootstrap.cc:654] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.894963 1193 ts_tablet_manager.cc:1929] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.895076 1193 log.cc:1199] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/bbf73c4c1133405bb46df19c0559ab92
I20260616 19:52:13.895428 1193 ts_tablet_manager.cc:1950] T bbf73c4c1133405bb46df19c0559ab92 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:13.896418 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet bbf73c4c1133405bb46df19c0559ab92 (table default.Table_77c7656d4f3a49f1ac1ef9398f720934 [id=3875e9f7e8ef471cb793134e7bc06a32]) successfully deleted
W20260616 19:52:13.897464 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c5047956478f488dbb4734bbaa138c00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5047956478f488dbb4734bbaa138c00 already in progress: creating tablet
I20260616 19:52:13.897754 1193 tablet_replica.cc:333] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:13.897955 1193 raft_consensus.cc:2243] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:13.898178 1193 pending_rounds.cc:70] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:13.898253 1193 pending_rounds.cc:77] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595528147009536 op_type: NO_OP noop_request { }
I20260616 19:52:13.898355 1193 raft_consensus.cc:2889] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:13.898447 1193 raft_consensus.cc:2272] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.899188 1193 ts_tablet_manager.cc:1916] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.904700 898 tablet_service.cc:1511] Processing CreateTablet for tablet 519875cfa5f14aaca274d33b5915071e (DEFAULT_TABLE table=default.Table_0510b4247a0d451484e1c7b5b8a4d42d [id=2eddb85f54c74180a2927dc6b53fe0e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.905404 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 519875cfa5f14aaca274d33b5915071e (DEFAULT_TABLE table=default.Table_0510b4247a0d451484e1c7b5b8a4d42d [id=2eddb85f54c74180a2927dc6b53fe0e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.905838 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519875cfa5f14aaca274d33b5915071e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.905912 749 tablet_service.cc:1511] Processing CreateTablet for tablet 019260ff2963425fb03fdb2f0c7d630a (DEFAULT_TABLE table=default.Table_1ca42bb7fe334d8194ffafa0c3cfcfbf [id=16458d4cd43a4131bac5ab4dd5afa734]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.906150 903 tablet_service.cc:1511] Processing CreateTablet for tablet 019260ff2963425fb03fdb2f0c7d630a (DEFAULT_TABLE table=default.Table_1ca42bb7fe334d8194ffafa0c3cfcfbf [id=16458d4cd43a4131bac5ab4dd5afa734]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.906397 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019260ff2963425fb03fdb2f0c7d630a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.906453 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019260ff2963425fb03fdb2f0c7d630a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.910116 2287 raft_consensus.cc:493] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.910246 2287 raft_consensus.cc:515] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.910830 2287 leader_election.cc:290] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:13.911341 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe784716b3c4293bd4eddf57f6c9048" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.911969 1193 ts_tablet_manager.cc:1929] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260616 19:52:13.912621 993 leader_election.cc:343] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.912344 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe784716b3c4293bd4eddf57f6c9048" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:13.913395 996 leader_election.cc:343] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:13.913496 996 leader_election.cc:304] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.913868 2287 raft_consensus.cc:2749] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.914251 1193 log.cc:1199] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/b718514e4fbd4601afeb021ed35643e6
I20260616 19:52:13.917407 1193 ts_tablet_manager.cc:1950] T b718514e4fbd4601afeb021ed35643e6 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:13.918646 2195 raft_consensus.cc:493] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.918761 2195 raft_consensus.cc:515] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.919277 2195 leader_election.cc:290] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:13.919430 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet b718514e4fbd4601afeb021ed35643e6 (table default.Table_9eedef731fd84c70a73a66128d239708 [id=b4da8c337e114065ad1498aa33588d55]) successfully deleted
I20260616 19:52:13.919965 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ab6193c479400da00e1fa80a5274a2" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:13.923403 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ab6193c479400da00e1fa80a5274a2" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:13.923578 1055 raft_consensus.cc:2468] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:13.923979 858 leader_election.cc:304] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:13.924221 2195 raft_consensus.cc:2804] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:13.924288 2195 raft_consensus.cc:493] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:13.924345 2195 raft_consensus.cc:3060] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.926345 1193 tablet_replica.cc:333] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:13.926542 1193 raft_consensus.cc:2243] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:13.926705 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 946) took 4369 ms. Trace:
I20260616 19:52:13.926752 1193 pending_rounds.cc:70] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:13.926793 1193 pending_rounds.cc:77] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595529581477888 op_type: NO_OP noop_request { }
I20260616 19:52:13.926872 1193 raft_consensus.cc:2889] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:13.926798 1191 rpcz_store.cc:276] 0616 19:52:09.556780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.560774 (+ 3994us) service_pool.cc:224] Handling call
0616 19:52:13.864653 (+4303879us) ts_tablet_manager.cc:1151] Deleting tablet faf4a0e2d3a1415aafe22501d8ae88b4
0616 19:52:13.926542 (+ 61889us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.926685 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4303365}
I20260616 19:52:13.926847 2195 raft_consensus.cc:515] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.926936 1193 raft_consensus.cc:2272] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:13.927294 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet faf4a0e2d3a1415aafe22501d8ae88b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet faf4a0e2d3a1415aafe22501d8ae88b4 already in progress: creating tablet
I20260616 19:52:13.927866 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 944) took 4417 ms. Trace:
I20260616 19:52:13.927906 1193 ts_tablet_manager.cc:1916] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.927944 1191 rpcz_store.cc:276] 0616 19:52:09.510276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.567809 (+ 57533us) service_pool.cc:224] Handling call
0616 19:52:13.927060 (+4359251us) ts_tablet_manager.cc:1151] Deleting tablet 4481d9d481ee45449ac332ff19c06a54
0616 19:52:13.927755 (+ 695us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.927849 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4358992}
I20260616 19:52:13.928117 2195 leader_election.cc:290] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:13.928792 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 4481d9d481ee45449ac332ff19c06a54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4481d9d481ee45449ac332ff19c06a54 already in progress: creating tablet
I20260616 19:52:13.929234 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9d39b60e1f084549aae7eafe209b9a8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.929828 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d39b60e1f084549aae7eafe209b9a8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.930609 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 948) took 4256 ms. Trace:
I20260616 19:52:13.930678 1191 rpcz_store.cc:276] 0616 19:52:09.674186 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.674417 (+ 231us) service_pool.cc:224] Handling call
0616 19:52:13.928177 (+4253760us) ts_tablet_manager.cc:1151] Deleting tablet b0b4d05e770845e0aa8e6a30a86babe8
0616 19:52:13.930509 (+ 2332us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.930594 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4253564}
I20260616 19:52:13.930995 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 982) took 3537 ms. Trace:
I20260616 19:52:13.931063 1191 rpcz_store.cc:276] 0616 19:52:10.393428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.602733 (+209305us) service_pool.cc:224] Handling call
0616 19:52:13.930885 (+3328152us) ts_tablet_manager.cc:1151] Deleting tablet de16c3feb7374077bc9817c703e5127c
0616 19:52:13.930903 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.930981 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2989078}
I20260616 19:52:13.931319 1191 tablet_replica.cc:333] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:13.931494 1191 raft_consensus.cc:2243] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.931624 1191 raft_consensus.cc:2272] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.932116 1191 ts_tablet_manager.cc:1916] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.932679 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ab6193c479400da00e1fa80a5274a2" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:13.932828 1055 raft_consensus.cc:3060] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.935221 1055 raft_consensus.cc:2468] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
W20260616 19:52:13.935541 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet b0b4d05e770845e0aa8e6a30a86babe8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0b4d05e770845e0aa8e6a30a86babe8 already in progress: creating tablet
I20260616 19:52:13.935647 858 leader_election.cc:304] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:52:13.935900 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet de16c3feb7374077bc9817c703e5127c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de16c3feb7374077bc9817c703e5127c already in progress: creating tablet
I20260616 19:52:13.935910 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a7f1e25312e1460dae26b68c9dc6e727" } new_table_name: "default.Table_271beee9b8bf4b7983773430ad7b346d" modify_external_catalogs: true
I20260616 19:52:13.936643 2195 raft_consensus.cc:2804] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:13.936770 2195 raft_consensus.cc:697] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:13.936991 2195 consensus_queue.cc:237] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.936422 758 tablet_service.cc:1558] Processing DeleteTablet for tablet d5c82b71969e4cbcb890d16e1cdd5348 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:05 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.939095 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ab6193c479400da00e1fa80a5274a2" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:13.939685 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519875cfa5f14aaca274d33b5915071e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.939909 2470 raft_consensus.cc:493] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:13.940026 2470 raft_consensus.cc:515] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.940663 2470 leader_election.cc:290] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:13.941021 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a09d62e68148349b337c5075763672" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:13.941207 1055 raft_consensus.cc:2393] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
I20260616 19:52:13.942056 1191 ts_tablet_manager.cc:1929] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:13.942135 1191 log.cc:1199] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/90205213ba5f49a2931e68839cefb2d2
I20260616 19:52:13.942438 1191 ts_tablet_manager.cc:1950] T 90205213ba5f49a2931e68839cefb2d2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:13.942685 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a718fefe07141119b7ef7edcbf61123 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.943101 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 984) took 3477 ms. Trace:
I20260616 19:52:13.943169 1191 rpcz_store.cc:276] 0616 19:52:10.465713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.606994 (+141281us) service_pool.cc:224] Handling call
0616 19:52:13.931270 (+3324276us) ts_tablet_manager.cc:1151] Deleting tablet 90205213ba5f49a2931e68839cefb2d2
0616 19:52:13.931279 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.938323 (+ 7044us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.942015 (+ 3692us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.943085 (+ 1070us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2989395}
I20260616 19:52:13.945844 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a09d62e68148349b337c5075763672" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:13.946322 718 leader_election.cc:304] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:13.946354 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 90205213ba5f49a2931e68839cefb2d2 (table default.Table_3fde6faf0f8549f69328d3129ad9f367 [id=e43abc84d7e146e591d10768c8f146e1]) successfully deleted
W20260616 19:52:13.947181 858 consensus_peers.cc:597] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c35e4c8e9304e798c9031469877b70e. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:13.947480 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 0877856fc6d14cd99cf49ce418518f95 (table default.Table_15212331af52405da63b6269aefa51d2 [id=32ab8b0a4aa7442dbb8fa84994df3078], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0877856fc6d14cd99cf49ce418518f95 consensus state has no leader
I20260616 19:52:13.947724 1191 tablet_replica.cc:333] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:13.948199 1191 raft_consensus.cc:2243] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.948282 2470 raft_consensus.cc:3060] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:13.950362 1191 raft_consensus.cc:2272] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.950630 2470 raft_consensus.cc:2749] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:13.951180 1191 ts_tablet_manager.cc:1916] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.951423 1193 ts_tablet_manager.cc:1929] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:13.951553 1193 log.cc:1199] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/aa72e00b0a3a423f96bdd7abb6013810
I20260616 19:52:13.952219 1193 ts_tablet_manager.cc:1950] T aa72e00b0a3a423f96bdd7abb6013810 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:13.948350 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf8905dbff64913ae28f1845dc7626b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.952677 1198 raft_consensus.cc:359] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.953174 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet aa72e00b0a3a423f96bdd7abb6013810 (table default.Table_4635b5a6e60140b9acd169b569531ffd [id=13855ad4407546ea81ea615a1cdc0438]) successfully deleted
I20260616 19:52:13.954180 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1d5efc4005fa447091cbc9aa28ac3922
I20260616 19:52:13.955448 1198 raft_consensus.cc:385] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:13.955513 1198 raft_consensus.cc:740] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
W20260616 19:52:13.955803 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04f54a486d4b46248ef9eb7d9c67606a consensus state has no leader
I20260616 19:52:13.955945 1198 consensus_queue.cc:260] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:13.956317 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2a181d074c994f10a48ed0651ec560f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.956921 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a181d074c994f10a48ed0651ec560f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.958807 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d5efc4005fa447091cbc9aa28ac3922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.958868 452 master_service.cc:960] ReplaceTablet: received request to replace tablet ce0963f38738468eb1518deadb3f119d from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:13.959020 1193 tablet_replica.cc:333] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:13.959990 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d5efc4005fa447091cbc9aa28ac3922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.960551 1198 ts_tablet_manager.cc:1434] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.194s user 0.019s sys 0.000s
I20260616 19:52:13.962087 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 296dd76b85b244769d9e4c51163a4e4a
I20260616 19:52:13.962779 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 296dd76b85b244769d9e4c51163a4e4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.962842 1193 raft_consensus.cc:2243] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.962915 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_96e14812934147b4a2e6ea4b045ecf8a" } new_table_name: "default.Table_be897d5410d941d6b1866917c3340089" modify_external_catalogs: true
I20260616 19:52:13.963017 1193 raft_consensus.cc:2272] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.963969 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d5efc4005fa447091cbc9aa28ac3922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.964190 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 296dd76b85b244769d9e4c51163a4e4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.964573 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 296dd76b85b244769d9e4c51163a4e4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.965770 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 019260ff2963425fb03fdb2f0c7d630a (DEFAULT_TABLE table=default.Table_1ca42bb7fe334d8194ffafa0c3cfcfbf [id=16458d4cd43a4131bac5ab4dd5afa734]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:13.969238 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d2b9af0d4e847df8901a5bd4b5002bc consensus state has no leader
I20260616 19:52:13.969580 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9a0a6711ab2a4c2abb2f08bfc900e22c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:13.969393 1190 ts_tablet_manager.cc:1950] T ca5dc1e6cde347fc9a34e555385dc646 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
W20260616 19:52:13.970075 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a0a6711ab2a4c2abb2f08bfc900e22c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.970269 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 922) took 4861 ms. Trace:
I20260616 19:52:13.970340 1190 rpcz_store.cc:276] 0616 19:52:09.108649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.229453 (+120804us) service_pool.cc:224] Handling call
0616 19:52:13.563338 (+4333885us) ts_tablet_manager.cc:1151] Deleting tablet ca5dc1e6cde347fc9a34e555385dc646
0616 19:52:13.563347 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.817332 (+253985us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.820015 (+ 2683us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.970254 (+150239us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4311826}
I20260616 19:52:13.970769 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 925) took 4465 ms. Trace:
I20260616 19:52:13.970834 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet ca5dc1e6cde347fc9a34e555385dc646 (table default.Table_ee076c723b314968b2d9f7de0e0947c3 [id=d37e43e64c414245a12d2a86ebcbc24b]) successfully deleted
I20260616 19:52:13.970846 1190 rpcz_store.cc:276] 0616 19:52:09.504862 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.504924 (+ 62us) service_pool.cc:224] Handling call
0616 19:52:13.970619 (+4465695us) ts_tablet_manager.cc:1151] Deleting tablet 4481d9d481ee45449ac332ff19c06a54
0616 19:52:13.970627 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.970716 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4465517}
W20260616 19:52:13.971306 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 4481d9d481ee45449ac332ff19c06a54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4481d9d481ee45449ac332ff19c06a54 already in progress: creating tablet
I20260616 19:52:13.971165 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 927) took 4433 ms. Trace:
I20260616 19:52:13.971405 1190 rpcz_store.cc:276] 0616 19:52:09.537602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.537650 (+ 48us) service_pool.cc:224] Handling call
0616 19:52:13.971076 (+4433426us) ts_tablet_manager.cc:1151] Deleting tablet faf4a0e2d3a1415aafe22501d8ae88b4
0616 19:52:13.971084 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.971151 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4433228}
I20260616 19:52:13.971980 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 926) took 4434 ms. Trace:
W20260616 19:52:13.972067 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet faf4a0e2d3a1415aafe22501d8ae88b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet faf4a0e2d3a1415aafe22501d8ae88b4 already in progress: creating tablet
I20260616 19:52:13.972069 1190 rpcz_store.cc:276] 0616 19:52:09.537442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.537655 (+ 213us) service_pool.cc:224] Handling call
0616 19:52:13.971875 (+4434220us) ts_tablet_manager.cc:1151] Deleting tablet 9a77f8c5c40e4892831cb8af6c305c62
0616 19:52:13.971884 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.971960 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4433948}
I20260616 19:52:13.972374 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 928) took 4339 ms. Trace:
W20260616 19:52:13.972517 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 9a77f8c5c40e4892831cb8af6c305c62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a77f8c5c40e4892831cb8af6c305c62 already in progress: creating tablet
I20260616 19:52:13.972450 1190 rpcz_store.cc:276] 0616 19:52:09.632941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.633009 (+ 68us) service_pool.cc:224] Handling call
0616 19:52:13.972301 (+4339292us) ts_tablet_manager.cc:1151] Deleting tablet b0b4d05e770845e0aa8e6a30a86babe8
0616 19:52:13.972309 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.972363 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4339108}
I20260616 19:52:13.972831 1190 tablet_replica.cc:333] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
W20260616 19:52:13.972968 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet b0b4d05e770845e0aa8e6a30a86babe8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0b4d05e770845e0aa8e6a30a86babe8 already in progress: creating tablet
I20260616 19:52:13.973067 1190 raft_consensus.cc:2243] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:13.973201 1190 raft_consensus.cc:2272] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:13.974120 1191 ts_tablet_manager.cc:1929] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:13.974539 1193 ts_tablet_manager.cc:1916] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.977646 1191 log.cc:1199] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/f1a09d62e68148349b337c5075763672
I20260616 19:52:13.978144 1191 ts_tablet_manager.cc:1950] T f1a09d62e68148349b337c5075763672 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:13.978174 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 265a37409d8e4b1bb8ea20e3970b5f69
I20260616 19:52:13.978941 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 265a37409d8e4b1bb8ea20e3970b5f69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.979163 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 265a37409d8e4b1bb8ea20e3970b5f69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.843166 1196 consensus_queue.cc:260] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:13.980537 781 raft_consensus.cc:2468] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:13.981472 1196 ts_tablet_manager.cc:1434] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.140s user 0.017s sys 0.001s
I20260616 19:52:13.982228 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019260ff2963425fb03fdb2f0c7d630a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:13.987643 1196 tablet_bootstrap.cc:492] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:13.989041 1196 tablet_bootstrap.cc:654] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:13.990489 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c06730f5b5aa455f9186556667799363"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:13.991012 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c06730f5b5aa455f9186556667799363 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:13.992619 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 96bf58d365a54c24b5131416d95d2b6a
I20260616 19:52:13.993876 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 96bf58d365a54c24b5131416d95d2b6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:13.993909 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 96bf58d365a54c24b5131416d95d2b6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:13.996652 898 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3cdea598304978be676ef1f152e6ac (DEFAULT_TABLE table=default.Table_29352ec1bc7d4d1bb8cfed469b161c97 [id=c368ee89c4be435f9c56aab82f7b7407]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.997025 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3cdea598304978be676ef1f152e6ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.000321 1029 tablet_service.cc:1511] Processing CreateTablet for tablet db68525259e1467d9b100f25b1b9bce4 (DEFAULT_TABLE table=default.Table_a3cb602d8c514961b4d948e21c3fd48a [id=dd1fde2b6cf24e62b7623dce6ed0012f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.000763 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db68525259e1467d9b100f25b1b9bce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.001657 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1305053f736840b0934912ca14c3eea9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.002182 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1305053f736840b0934912ca14c3eea9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.004614 2287 raft_consensus.cc:493] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.004730 2287 raft_consensus.cc:515] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.005486 2287 leader_election.cc:290] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:14.005784 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f309caaa9042f99432a61fd2ebb089" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:14.006165 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f309caaa9042f99432a61fd2ebb089" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:14.006306 996 leader_election.cc:343] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:14.006798 993 leader_election.cc:343] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.006920 993 leader_election.cc:304] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:14.007416 2287 raft_consensus.cc:2749] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:14.010807 903 tablet_service.cc:1511] Processing CreateTablet for tablet db68525259e1467d9b100f25b1b9bce4 (DEFAULT_TABLE table=default.Table_a3cb602d8c514961b4d948e21c3fd48a [id=dd1fde2b6cf24e62b7623dce6ed0012f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.011211 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db68525259e1467d9b100f25b1b9bce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.014428 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b013e93d172843e4bf4f985e35a4343b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.015413 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b013e93d172843e4bf4f985e35a4343b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.015901 455 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_c986682087fc4381b1bff202b6574f26 [id=2d4376cceca648ef87dcf561d1e9e701] alter complete (version 2)
I20260616 19:52:13.993026 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 265a37409d8e4b1bb8ea20e3970b5f69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:13.993719 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 96bf58d365a54c24b5131416d95d2b6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.016528 1198 tablet_bootstrap.cc:492] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:52:14.017195 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32bf8c116d6d4c8780dc6aecb2570f9a consensus state has no leader
I20260616 19:52:14.017863 1198 tablet_bootstrap.cc:654] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.018952 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 983) took 3553 ms. Trace:
I20260616 19:52:14.019027 1191 rpcz_store.cc:276] 0616 19:52:10.465593 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.605348 (+139755us) service_pool.cc:224] Handling call
0616 19:52:13.947684 (+3342336us) ts_tablet_manager.cc:1151] Deleting tablet f1a09d62e68148349b337c5075763672
0616 19:52:13.947693 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:13.965306 (+ 17613us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:13.974066 (+ 8760us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.018935 (+ 44869us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3005762}
I20260616 19:52:14.019418 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 979) took 3626 ms. Trace:
I20260616 19:52:14.019479 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet f1a09d62e68148349b337c5075763672 (table default.Table_9a89b6471d8c42e594c15f43327d9572 [id=e2e41de8962e4ce081aa7c1ac71f8064]) successfully deleted
I20260616 19:52:14.019496 1191 rpcz_store.cc:276] 0616 19:52:10.393181 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.584677 (+191496us) service_pool.cc:224] Handling call
0616 19:52:14.019303 (+3434626us) ts_tablet_manager.cc:1151] Deleting tablet 30f47e639195478f9cda4ab8f8b33798
0616 19:52:14.019313 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.019404 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3069357}
I20260616 19:52:14.019752 1191 tablet_replica.cc:333] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:14.019941 1191 raft_consensus.cc:2243] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:14.019927 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 30f47e639195478f9cda4ab8f8b33798 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30f47e639195478f9cda4ab8f8b33798 already in progress: creating tablet
I20260616 19:52:14.020071 1191 raft_consensus.cc:2272] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.020545 1191 ts_tablet_manager.cc:1916] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:13.995512 758 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3cdea598304978be676ef1f152e6ac (DEFAULT_TABLE table=default.Table_29352ec1bc7d4d1bb8cfed469b161c97 [id=c368ee89c4be435f9c56aab82f7b7407]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:13.997804 759 tablet_service.cc:1511] Processing CreateTablet for tablet db68525259e1467d9b100f25b1b9bce4 (DEFAULT_TABLE table=default.Table_a3cb602d8c514961b4d948e21c3fd48a [id=dd1fde2b6cf24e62b7623dce6ed0012f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.021917 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3cdea598304978be676ef1f152e6ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.022085 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db68525259e1467d9b100f25b1b9bce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.030637 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 49ab6193c479400da00e1fa80a5274a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.034228 1191 ts_tablet_manager.cc:1929] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:14.034363 1191 log.cc:1199] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/afc58b2bda2a43f18f157469b591854b
I20260616 19:52:14.034641 1191 ts_tablet_manager.cc:1950] T afc58b2bda2a43f18f157469b591854b P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:14.035342 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 981) took 3642 ms. Trace:
I20260616 19:52:14.035365 1193 ts_tablet_manager.cc:1929] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:14.035459 1193 log.cc:1199] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/aabf57dd6d704645b6bf97b730dbe964
I20260616 19:52:14.035427 1191 rpcz_store.cc:276] 0616 19:52:10.393353 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.602132 (+208779us) service_pool.cc:224] Handling call
0616 19:52:14.019712 (+3417580us) ts_tablet_manager.cc:1151] Deleting tablet afc58b2bda2a43f18f157469b591854b
0616 19:52:14.019721 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.029572 (+ 9851us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.034173 (+ 4601us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.035323 (+ 1150us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3064149}
I20260616 19:52:14.035831 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 978) took 3642 ms. Trace:
I20260616 19:52:14.035913 1191 rpcz_store.cc:276] 0616 19:52:10.393092 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.582087 (+188995us) service_pool.cc:224] Handling call
0616 19:52:14.035709 (+3453622us) ts_tablet_manager.cc:1151] Deleting tablet 608c26854fdf4dcd8cec2604d23a0dec
0616 19:52:14.035718 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.035815 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3075140}
I20260616 19:52:14.035982 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet afc58b2bda2a43f18f157469b591854b (table default.Table_24447e65692d452a82a5ef91bdc6ab4f [id=9c655609a0ef47a2b4fb050ad8dab9d7]) successfully deleted
W20260616 19:52:14.036283 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 608c26854fdf4dcd8cec2604d23a0dec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 608c26854fdf4dcd8cec2604d23a0dec already in progress: creating tablet
I20260616 19:52:14.038223 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ce0963f38738468eb1518deadb3f119d
I20260616 19:52:14.038729 452 catalog_manager.cc:6784] ReplaceTablet: tablet ce0963f38738468eb1518deadb3f119d deleted and replaced by tablet 14a703acc7804dedbf29b15893e63402
I20260616 19:52:14.039453 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet ce0963f38738468eb1518deadb3f119d with delete_type TABLET_DATA_DELETED (replaced by tablet 14a703acc7804dedbf29b15893e63402) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.039505 898 tablet_service.cc:1558] Processing DeleteTablet for tablet ce0963f38738468eb1518deadb3f119d with delete_type TABLET_DATA_DELETED (replaced by tablet 14a703acc7804dedbf29b15893e63402) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:14.039757 758 tablet_service.cc:1558] Processing DeleteTablet for tablet ce0963f38738468eb1518deadb3f119d with delete_type TABLET_DATA_DELETED (replaced by tablet 14a703acc7804dedbf29b15893e63402) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.041213 898 tablet_service.cc:1511] Processing CreateTablet for tablet f23cce0db24b4e2e8cfad9b1143bdac0 (DEFAULT_TABLE table=default.Table_19d0a2bac9d24c37be1eb4c961016b03 [id=9f20d41291564d59a0400cc835cd877d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.041587 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f23cce0db24b4e2e8cfad9b1143bdac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.045253 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 980) took 3652 ms. Trace:
I20260616 19:52:14.045579 1191 rpcz_store.cc:276] 0616 19:52:10.393265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.586338 (+193073us) service_pool.cc:224] Handling call
0616 19:52:14.036104 (+3449766us) ts_tablet_manager.cc:1151] Deleting tablet 7ffc15f90dc24de49455205d5de6b58e
0616 19:52:14.036113 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.045232 (+ 9119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3075448}
W20260616 19:52:14.046290 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 7ffc15f90dc24de49455205d5de6b58e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ffc15f90dc24de49455205d5de6b58e already in progress: creating tablet
I20260616 19:52:14.047969 1191 tablet_replica.cc:333] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:14.048020 758 tablet_service.cc:1511] Processing CreateTablet for tablet f23cce0db24b4e2e8cfad9b1143bdac0 (DEFAULT_TABLE table=default.Table_19d0a2bac9d24c37be1eb4c961016b03 [id=9f20d41291564d59a0400cc835cd877d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.048164 1191 raft_consensus.cc:2243] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:14.048312 1191 raft_consensus.cc:2272] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.048385 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f23cce0db24b4e2e8cfad9b1143bdac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.048848 1191 ts_tablet_manager.cc:1916] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:14.052320 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d69db202af9e4d4f86a9d8d40e9fe3af consensus state has no leader
I20260616 19:52:14.056725 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_343a164ba15342d8ba89e6d0ea6ed50f" } modify_external_catalogs: true
I20260616 19:52:14.056921 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_343a164ba15342d8ba89e6d0ea6ed50f" } modify_external_catalogs: true
I20260616 19:52:14.060978 759 tablet_service.cc:1511] Processing CreateTablet for tablet 1984a5e7b2b444b49df76abae237d101 (DEFAULT_TABLE table=default.Table_5155a017375748c783f9145caefc0fd3 [id=14a30d5e4de84e04a8db27a856b5dbd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.061389 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1984a5e7b2b444b49df76abae237d101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.064713 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 90205213ba5f49a2931e68839cefb2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:55 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:14.064944 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a718fefe07141119b7ef7edcbf61123 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:14.067276 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4b58578dcfc347a2950facb364ee0924"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:14.067582 1026 tablet_service.cc:1511] Processing CreateTablet for tablet f23cce0db24b4e2e8cfad9b1143bdac0 (DEFAULT_TABLE table=default.Table_19d0a2bac9d24c37be1eb4c961016b03 [id=9f20d41291564d59a0400cc835cd877d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:14.067788 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b58578dcfc347a2950facb364ee0924 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.067940 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f23cce0db24b4e2e8cfad9b1143bdac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.072775 2195 consensus_queue.cc:1048] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:14.075016 1193 ts_tablet_manager.cc:1950] T aabf57dd6d704645b6bf97b730dbe964 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:14.075834 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1053) took 1020 ms. Trace:
I20260616 19:52:14.083891 1193 rpcz_store.cc:276] 0616 19:52:13.055652 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.057143 (+ 1491us) service_pool.cc:224] Handling call
0616 19:52:13.953447 (+896304us) ts_tablet_manager.cc:1151] Deleting tablet aabf57dd6d704645b6bf97b730dbe964
0616 19:52:13.953456 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.013004 (+ 59548us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.035314 (+ 22310us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.075817 (+ 40503us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3610,"tablet-delete.queue_time_us":896118}
I20260616 19:52:14.084383 1193 tablet_replica.cc:333] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:14.085590 1190 ts_tablet_manager.cc:1916] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.086609 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet aabf57dd6d704645b6bf97b730dbe964 (table default.Table_914e42d3110442b99b33a9a77c30dd49 [id=8253e0421d10438cbb925f20579d9471]) successfully deleted
I20260616 19:52:14.089347 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 1984a5e7b2b444b49df76abae237d101 (DEFAULT_TABLE table=default.Table_5155a017375748c783f9145caefc0fd3 [id=14a30d5e4de84e04a8db27a856b5dbd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.089746 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1984a5e7b2b444b49df76abae237d101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.091821 1193 raft_consensus.cc:2243] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:14.092139 1193 pending_rounds.cc:70] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:14.092242 1193 pending_rounds.cc:77] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595528899411968 op_type: NO_OP noop_request { }
I20260616 19:52:14.093385 2195 consensus_queue.cc:1048] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:14.093535 454 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet d4525fa8a0954c6180fe0ced057b8ede
I20260616 19:52:14.094107 1193 raft_consensus.cc:2889] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:14.094660 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_856c35c00b504ecfaeb47c24739826b1" } new_table_name: "default.Table_fb121c44335544e99513d82eafb2df23" modify_external_catalogs: true
I20260616 19:52:14.096621 1193 raft_consensus.cc:2272] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.097607 889 tablet_service.cc:1511] Processing CreateTablet for tablet ad0b7615a5934617be3d8e18a220fa31 (DEFAULT_TABLE table=default.Table_c2c67f979a81481abf747ff078acd0b4 [id=a1ed128b240940cc83688f2a491daee6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.098001 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0b7615a5934617be3d8e18a220fa31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.081264 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3cdea598304978be676ef1f152e6ac (DEFAULT_TABLE table=default.Table_29352ec1bc7d4d1bb8cfed469b161c97 [id=c368ee89c4be435f9c56aab82f7b7407]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.099706 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3cdea598304978be676ef1f152e6ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.100214 749 tablet_service.cc:1511] Processing CreateTablet for tablet 04f54a486d4b46248ef9eb7d9c67606a (DEFAULT_TABLE table=default.Table_01232f43cf644a519f3a37450e610110 [id=f0a646ee88c64c3b9df7553453b35b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.100577 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 43b4c3bd370749b18fb86f7a0aae2c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.100620 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f54a486d4b46248ef9eb7d9c67606a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.100725 902 tablet_service.cc:1511] Processing CreateTablet for tablet 04f54a486d4b46248ef9eb7d9c67606a (DEFAULT_TABLE table=default.Table_01232f43cf644a519f3a37450e610110 [id=f0a646ee88c64c3b9df7553453b35b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.101056 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f54a486d4b46248ef9eb7d9c67606a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.105763 1025 tablet_service.cc:1511] Processing CreateTablet for tablet ad0b7615a5934617be3d8e18a220fa31 (DEFAULT_TABLE table=default.Table_c2c67f979a81481abf747ff078acd0b4 [id=a1ed128b240940cc83688f2a491daee6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.106163 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0b7615a5934617be3d8e18a220fa31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.110008 1193 ts_tablet_manager.cc:1916] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.110082 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 04f54a486d4b46248ef9eb7d9c67606a (DEFAULT_TABLE table=default.Table_01232f43cf644a519f3a37450e610110 [id=f0a646ee88c64c3b9df7553453b35b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.110435 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f54a486d4b46248ef9eb7d9c67606a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:14.114630 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cbbbfa65120b4b9b98ef0fc30a13f2d3 consensus state has no leader
I20260616 19:52:14.121857 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3dbb4ec5745241608403a4e108e679c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.122637 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dbb4ec5745241608403a4e108e679c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.126570 1196 tablet_bootstrap.cc:492] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:14.126729 1196 ts_tablet_manager.cc:1403] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.139s user 0.010s sys 0.007s
I20260616 19:52:14.127398 1196 raft_consensus.cc:359] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.127553 1196 raft_consensus.cc:385] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.127600 1196 raft_consensus.cc:740] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.127802 1196 consensus_queue.cc:260] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.128262 1196 ts_tablet_manager.cc:1434] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260616 19:52:14.128592 1196 tablet_bootstrap.cc:492] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:14.131085 1196 tablet_bootstrap.cc:654] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.133445 2287 raft_consensus.cc:493] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.133576 2287 raft_consensus.cc:515] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.134174 2287 leader_election.cc:290] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:14.134816 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b4c3bd370749b18fb86f7a0aae2c50" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:14.134650 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3b235f0a3ad24b69b3c56069ff59e4dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.135396 993 leader_election.cc:343] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:14.135449 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b235f0a3ad24b69b3c56069ff59e4dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.137625 759 tablet_service.cc:1511] Processing CreateTablet for tablet ad0b7615a5934617be3d8e18a220fa31 (DEFAULT_TABLE table=default.Table_c2c67f979a81481abf747ff078acd0b4 [id=a1ed128b240940cc83688f2a491daee6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.138479 2428 catalog_manager.cc:1294] Loaded cluster ID: d3d9ed8a8f984d7f816cb660c217abc3
I20260616 19:52:14.138631 2428 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: loading cluster ID for follower catalog manager: success
I20260616 19:52:14.142122 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0b7615a5934617be3d8e18a220fa31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.143702 2287 raft_consensus.cc:493] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.143755 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b4c3bd370749b18fb86f7a0aae2c50" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:14.143819 2287 raft_consensus.cc:515] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.144353 2287 leader_election.cc:290] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:14.146564 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31db3862f78943519bcd9531c5530048" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:14.144361 996 leader_election.cc:343] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.146944 996 leader_election.cc:304] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:14.147076 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b85d7fd26e434183950acc63c19296b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.147646 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b85d7fd26e434183950acc63c19296b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:14.148044 993 leader_election.cc:343] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.148315 2287 raft_consensus.cc:2749] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:14.150043 1192 tablet_bootstrap.cc:492] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:14.150236 1192 ts_tablet_manager.cc:1403] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.258s user 0.004s sys 0.000s
I20260616 19:52:14.151031 1192 raft_consensus.cc:359] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.151252 1192 raft_consensus.cc:385] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.151350 1192 raft_consensus.cc:740] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.151618 1192 consensus_queue.cc:260] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.152508 1192 ts_tablet_manager.cc:1434] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:14.153425 1198 tablet_bootstrap.cc:492] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:14.155347 1198 ts_tablet_manager.cc:1403] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.139s user 0.003s sys 0.011s
I20260616 19:52:14.156032 1198 raft_consensus.cc:359] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.156235 1198 raft_consensus.cc:385] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.156319 1198 raft_consensus.cc:740] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.156618 1198 consensus_queue.cc:260] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.160885 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_56c4bdfb8f804d10beeb4340c95e0cd8" } new_table_name: "default.Table_116b73b8589844c2b09c7f8dee648cf1" modify_external_catalogs: true
I20260616 19:52:14.161391 1192 tablet_bootstrap.cc:492] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:14.162715 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_191f8acd55ae4da9982a9fb3ec2d51cd" } modify_external_catalogs: true
I20260616 19:52:14.162981 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_191f8acd55ae4da9982a9fb3ec2d51cd" } modify_external_catalogs: true
I20260616 19:52:14.165154 898 tablet_service.cc:1511] Processing CreateTablet for tablet 1984a5e7b2b444b49df76abae237d101 (DEFAULT_TABLE table=default.Table_5155a017375748c783f9145caefc0fd3 [id=14a30d5e4de84e04a8db27a856b5dbd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.165513 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1984a5e7b2b444b49df76abae237d101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.165766 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_96078f528b924e8db7c87740bd036da6" } modify_external_catalogs: true
I20260616 19:52:14.165917 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_96078f528b924e8db7c87740bd036da6" } modify_external_catalogs: true
I20260616 19:52:14.166817 2195 raft_consensus.cc:493] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.166931 2195 raft_consensus.cc:515] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.167819 2195 leader_election.cc:290] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:14.168210 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6530753b4184cfe972ae3a43f23d589" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:14.168754 860 leader_election.cc:343] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.169013 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet c7f724dc23024a7297cfb8689f199600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.169363 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6530753b4184cfe972ae3a43f23d589" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:14.169543 1058 raft_consensus.cc:2468] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:14.170248 858 leader_election.cc:304] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:14.170806 2297 raft_consensus.cc:2804] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:14.170885 2297 raft_consensus.cc:493] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:14.170955 2297 raft_consensus.cc:3060] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.171813 1191 ts_tablet_manager.cc:1929] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:14.171904 1191 log.cc:1199] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/731556662b62419dae76149b22469ebd
I20260616 19:52:14.172118 1198 ts_tablet_manager.cc:1434] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260616 19:52:14.172174 1191 ts_tablet_manager.cc:1950] T 731556662b62419dae76149b22469ebd P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:14.173065 1198 tablet_bootstrap.cc:492] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:14.173355 2297 raft_consensus.cc:515] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.173924 2297 leader_election.cc:290] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:14.174403 1198 tablet_bootstrap.cc:654] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.176344 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6530753b4184cfe972ae3a43f23d589" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:14.177467 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cce34f3008e44c63bd5961fdfe303d9a" } new_table_name: "default.Table_08464d650ddd4fd1ac12cd0949f35d4e" modify_external_catalogs: true
I20260616 19:52:14.179211 775 raft_consensus.cc:3060] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.179554 1035 tablet_service.cc:1511] Processing CreateTablet for tablet f12cafb741da4019aa39f0579db97d34 (DEFAULT_TABLE table=default.Table_e620d37af90643a49c022902197a8b38 [id=85447ee8daef47269202c72ff15fc29f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:14.179668 860 leader_election.cc:343] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.183091 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 3553e8da720b43678b4c7ae7ea4d224b (DEFAULT_TABLE table=default.Table_b95df4211cf34d5e90161549b0e21196 [id=df50bfd0a1ec4ad686c09452b300fabd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.184181 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_897efa9fcf78475cb7a10b3c661196df" } modify_external_catalogs: true
I20260616 19:52:14.184340 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_897efa9fcf78475cb7a10b3c661196df" } modify_external_catalogs: true
W20260616 19:52:14.185802 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 97f78879bc38457bbd06593c03aac6ce consensus state has no leader
I20260616 19:52:14.192919 1190 ts_tablet_manager.cc:1929] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:14.193032 1190 log.cc:1199] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/5029a79e046a489aa9976eff948a3c5b
I20260616 19:52:14.193323 1190 ts_tablet_manager.cc:1950] T 5029a79e046a489aa9976eff948a3c5b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:14.193598 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 929) took 4539 ms. Trace:
I20260616 19:52:14.193667 1190 rpcz_store.cc:276] 0616 19:52:09.654145 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.654242 (+ 97us) service_pool.cc:224] Handling call
0616 19:52:13.972733 (+4318491us) ts_tablet_manager.cc:1151] Deleting tablet 5029a79e046a489aa9976eff948a3c5b
0616 19:52:13.972744 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.159088 (+186344us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.192869 (+ 33781us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.193583 (+ 714us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4318269}
I20260616 19:52:14.194097 1190 tablet_replica.cc:333] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:14.194485 1190 raft_consensus.cc:2243] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:14.194730 1190 raft_consensus.cc:2272] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.195302 1190 ts_tablet_manager.cc:1916] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.196033 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fb615e00d33b41198a66d343a4fc73d0" } modify_external_catalogs: true
I20260616 19:52:14.196223 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fb615e00d33b41198a66d343a4fc73d0" } modify_external_catalogs: true
I20260616 19:52:14.198614 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6530753b4184cfe972ae3a43f23d589" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:14.198779 1058 raft_consensus.cc:3060] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.198987 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3553e8da720b43678b4c7ae7ea4d224b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.142107 1193 ts_tablet_manager.cc:1929] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:14.200033 1193 log.cc:1199] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/3b57bceabff64533ae3a49b8afda614d
I20260616 19:52:14.200536 1193 ts_tablet_manager.cc:1950] T 3b57bceabff64533ae3a49b8afda614d P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:14.201169 1058 raft_consensus.cc:2468] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:14.203235 902 tablet_service.cc:1511] Processing CreateTablet for tablet f12cafb741da4019aa39f0579db97d34 (DEFAULT_TABLE table=default.Table_e620d37af90643a49c022902197a8b38 [id=85447ee8daef47269202c72ff15fc29f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.203488 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 5029a79e046a489aa9976eff948a3c5b (table default.Table_010bd6ff844d4227b21111bb4499d70b [id=7f01acd67fa942bfb14744f0851047e7]) successfully deleted
I20260616 19:52:14.203604 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12cafb741da4019aa39f0579db97d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.204401 903 tablet_service.cc:1558] Processing DeleteTablet for tablet e6530753b4184cfe972ae3a43f23d589 with delete_type TABLET_DATA_DELETED (replaced by tablet f89a0c065a4a4fb7afa8cab29d78c2e5) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:14.204520 858 consensus_peers.cc:597] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aabf57dd6d704645b6bf97b730dbe964. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:14.204721 889 tablet_service.cc:1511] Processing CreateTablet for tablet 3553e8da720b43678b4c7ae7ea4d224b (DEFAULT_TABLE table=default.Table_b95df4211cf34d5e90161549b0e21196 [id=df50bfd0a1ec4ad686c09452b300fabd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:14.204955 860 consensus_peers.cc:597] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c35e4c8e9304e798c9031469877b70e. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:14.205050 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3553e8da720b43678b4c7ae7ea4d224b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.204720 858 leader_election.cc:304] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:14.207739 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c95433a6363d436ab8db4357fc5dc6ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.208305 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c95433a6363d436ab8db4357fc5dc6ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.213014 460 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 148e019688e943858e6dcc021d308d09
I20260616 19:52:14.222886 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 150af2d5b0614adc8ae7a2bdac076a87
I20260616 19:52:14.224251 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 150af2d5b0614adc8ae7a2bdac076a87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.227854 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 81440ccb0e3a4001911a4af5a974f47a (DEFAULT_TABLE table=default.Table_475293cd66a246eb8371da761e3a1200 [id=cb77ddec00f64d0d92f3517f5b67c011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.228417 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81440ccb0e3a4001911a4af5a974f47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.229674 889 tablet_service.cc:1511] Processing CreateTablet for tablet 81440ccb0e3a4001911a4af5a974f47a (DEFAULT_TABLE table=default.Table_475293cd66a246eb8371da761e3a1200 [id=cb77ddec00f64d0d92f3517f5b67c011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.230062 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81440ccb0e3a4001911a4af5a974f47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.230831 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 150af2d5b0614adc8ae7a2bdac076a87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:14.235765 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12cafb741da4019aa39f0579db97d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.236718 902 tablet_service.cc:1511] Processing CreateTablet for tablet d2c87488f7b84af595c4e509f6ecd9d7 (DEFAULT_TABLE table=default.Table_5f6a8f2248c34edb80817679ba78faf5 [id=348c15ea8eda410f9269d0e7713a4386]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.237028 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c87488f7b84af595c4e509f6ecd9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.237689 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ceb8a1d6b2fc40218e784665adbc56d5" } new_table_name: "default.Table_c82ec79589b348c98b547e71862d6280" modify_external_catalogs: true
I20260616 19:52:14.237850 2555 raft_consensus.cc:2804] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:14.239049 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_fa35967391724eb79fe0160539f718b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.239670 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa35967391724eb79fe0160539f718b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.241829 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 998) took 3116 ms. Trace:
I20260616 19:52:14.241969 1191 rpcz_store.cc:276] 0616 19:52:11.124959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.125000 (+ 41us) service_pool.cc:224] Handling call
0616 19:52:14.047920 (+2922920us) ts_tablet_manager.cc:1151] Deleting tablet 731556662b62419dae76149b22469ebd
0616 19:52:14.047930 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.152305 (+104375us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.171762 (+ 19457us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.241811 (+ 70049us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2922770}
I20260616 19:52:14.242478 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 731556662b62419dae76149b22469ebd (table default.Table_465ef4c1c4044473a6e721ae45cbd7a1 [id=c49098557d4b4b0d9a720713127e4b53]) successfully deleted
I20260616 19:52:14.243005 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 997) took 3118 ms. Trace:
I20260616 19:52:14.243158 1191 rpcz_store.cc:276] 0616 19:52:11.124869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.130106 (+ 5237us) service_pool.cc:224] Handling call
0616 19:52:14.242851 (+3112745us) ts_tablet_manager.cc:1151] Deleting tablet 0b249e29f69943f287411783b84c6817
0616 19:52:14.242865 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.242982 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3112589}
W20260616 19:52:14.243649 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0b249e29f69943f287411783b84c6817 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b249e29f69943f287411783b84c6817 already in progress: creating tablet
I20260616 19:52:14.244028 1191 tablet_replica.cc:333] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:14.244277 1191 raft_consensus.cc:2243] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:14.244493 1191 raft_consensus.cc:2272] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.244602 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 150af2d5b0614adc8ae7a2bdac076a87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.244863 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31db3862f78943519bcd9531c5530048" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:14.245007 1191 ts_tablet_manager.cc:1916] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.238485 2557 raft_consensus.cc:493] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.246212 2557 raft_consensus.cc:515] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.195393 1192 tablet_bootstrap.cc:654] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.247253 2470 consensus_queue.cc:1048] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:14.247314 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6939d108a7948bb9e56311a34d95486" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:14.247460 1058 raft_consensus.cc:2468] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:14.247884 858 leader_election.cc:304] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:14.248121 751 tablet_service.cc:1511] Processing CreateTablet for tablet 81440ccb0e3a4001911a4af5a974f47a (DEFAULT_TABLE table=default.Table_475293cd66a246eb8371da761e3a1200 [id=cb77ddec00f64d0d92f3517f5b67c011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.248615 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81440ccb0e3a4001911a4af5a974f47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.250993 1198 tablet_bootstrap.cc:492] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:14.251107 1198 ts_tablet_manager.cc:1403] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.078s user 0.001s sys 0.001s
I20260616 19:52:14.251746 1198 raft_consensus.cc:359] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.251880 1198 raft_consensus.cc:385] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.251920 1198 raft_consensus.cc:740] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.252079 1198 consensus_queue.cc:260] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.252831 749 tablet_service.cc:1511] Processing CreateTablet for tablet 3553e8da720b43678b4c7ae7ea4d224b (DEFAULT_TABLE table=default.Table_b95df4211cf34d5e90161549b0e21196 [id=df50bfd0a1ec4ad686c09452b300fabd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.253227 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3553e8da720b43678b4c7ae7ea4d224b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.254921 1025 tablet_service.cc:1511] Processing CreateTablet for tablet d2c87488f7b84af595c4e509f6ecd9d7 (DEFAULT_TABLE table=default.Table_5f6a8f2248c34edb80817679ba78faf5 [id=348c15ea8eda410f9269d0e7713a4386]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.255270 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c87488f7b84af595c4e509f6ecd9d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:14.257819 719 consensus_peers.cc:597] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:14.259377 903 tablet_service.cc:1511] Processing CreateTablet for tablet 4a354c0f48dc44599b300616e35489fb (DEFAULT_TABLE table=default.Table_bc97998e16fb4032acc3f1a702877fb0 [id=f60fe5b5d2864501bee0cadfcddbe5d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.259789 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a354c0f48dc44599b300616e35489fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.259832 747 tablet_service.cc:1511] Processing CreateTablet for tablet d2c87488f7b84af595c4e509f6ecd9d7 (DEFAULT_TABLE table=default.Table_5f6a8f2248c34edb80817679ba78faf5 [id=348c15ea8eda410f9269d0e7713a4386]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.260651 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c87488f7b84af595c4e509f6ecd9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.261060 765 tablet_service.cc:1511] Processing CreateTablet for tablet 4a354c0f48dc44599b300616e35489fb (DEFAULT_TABLE table=default.Table_bc97998e16fb4032acc3f1a702877fb0 [id=f60fe5b5d2864501bee0cadfcddbe5d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.261541 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a354c0f48dc44599b300616e35489fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.264994 2557 leader_election.cc:290] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:14.265190 996 leader_election.cc:343] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.265314 996 leader_election.cc:304] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:14.266189 2557 raft_consensus.cc:2804] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:14.266343 2557 raft_consensus.cc:493] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:14.266463 2557 raft_consensus.cc:3060] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.271492 2557 raft_consensus.cc:515] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.276785 2287 raft_consensus.cc:2749] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:14.277115 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1054) took 1082 ms. Trace:
I20260616 19:52:14.277211 1193 rpcz_store.cc:276] 0616 19:52:13.194944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.195175 (+ 231us) service_pool.cc:224] Handling call
0616 19:52:14.084335 (+889160us) ts_tablet_manager.cc:1151] Deleting tablet 3b57bceabff64533ae3a49b8afda614d
0616 19:52:14.084345 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.139239 (+ 54894us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.142059 (+ 2820us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.277096 (+135037us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75686,"tablet-delete.queue_time_us":888966}
I20260616 19:52:14.277922 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 3b57bceabff64533ae3a49b8afda614d (table default.Table_9b86a6539e534ff4a58c2c7ad01e99a0 [id=e29060d6148a4e819d0e9c80cb32956b]) successfully deleted
I20260616 19:52:14.278872 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 731556662b62419dae76149b22469ebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.283118 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 4a354c0f48dc44599b300616e35489fb (DEFAULT_TABLE table=default.Table_bc97998e16fb4032acc3f1a702877fb0 [id=f60fe5b5d2864501bee0cadfcddbe5d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.283603 758 tablet_service.cc:1511] Processing CreateTablet for tablet f12cafb741da4019aa39f0579db97d34 (DEFAULT_TABLE table=default.Table_e620d37af90643a49c022902197a8b38 [id=85447ee8daef47269202c72ff15fc29f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.283716 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a354c0f48dc44599b300616e35489fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.284184 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12cafb741da4019aa39f0579db97d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.287633 1196 tablet_bootstrap.cc:492] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:14.287812 1196 ts_tablet_manager.cc:1403] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.159s user 0.005s sys 0.001s
I20260616 19:52:14.287106 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6939d108a7948bb9e56311a34d95486" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:14.288662 1198 ts_tablet_manager.cc:1434] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.037s user 0.001s sys 0.001s
I20260616 19:52:14.288796 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_87cb94f05bdc4cfabca5fbe1b1102f51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:14.288857 1196 raft_consensus.cc:359] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.289002 1196 raft_consensus.cc:385] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.289062 1196 raft_consensus.cc:740] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.289261 1196 consensus_queue.cc:260] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
W20260616 19:52:14.289430 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87cb94f05bdc4cfabca5fbe1b1102f51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.289860 1196 ts_tablet_manager.cc:1434] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:14.294567 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8839050ed0db4c7da35e13c3b40639b0" } new_table_name: "default.Table_cbac83e56fd146bb83304422535ec42a" modify_external_catalogs: true
I20260616 19:52:14.296015 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2ed166bd3a824fa69fffae629bd3570f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.296829 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c6add7925294880a5a20eb3d189d1ee consensus state has no leader
I20260616 19:52:14.297145 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet bd7b91e00d6c4f70b0eda75fe83d617e
I20260616 19:52:14.297187 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6667e28dee3645d7aa4766beddcfa4b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.297652 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6667e28dee3645d7aa4766beddcfa4b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.297785 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3e1dcfe4518549b894954f78c6d060d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.298237 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e1dcfe4518549b894954f78c6d060d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:14.298921 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ed166bd3a824fa69fffae629bd3570f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.299871 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e6777fb7d1cf4e95a774d36f85affd8c" } modify_external_catalogs: true
I20260616 19:52:14.300050 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e6777fb7d1cf4e95a774d36f85affd8c" } modify_external_catalogs: true
I20260616 19:52:14.301172 759 tablet_service.cc:1558] Processing DeleteTablet for tablet bd7b91e00d6c4f70b0eda75fe83d617e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.301483 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 40bdb01a15254c329d82f0d40919b880 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.302151 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet bd7b91e00d6c4f70b0eda75fe83d617e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.302508 1198 tablet_bootstrap.cc:492] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:14.303845 1198 tablet_bootstrap.cc:654] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.275815 1192 tablet_bootstrap.cc:492] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:14.306262 1192 ts_tablet_manager.cc:1403] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.145s user 0.004s sys 0.000s
I20260616 19:52:14.306977 1192 raft_consensus.cc:359] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.307140 1192 raft_consensus.cc:385] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.307195 1192 raft_consensus.cc:740] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.307421 1192 consensus_queue.cc:260] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.307996 1192 ts_tablet_manager.cc:1434] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:14.308239 1192 tablet_bootstrap.cc:492] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:14.308843 1196 tablet_bootstrap.cc:492] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:14.310002 1192 tablet_bootstrap.cc:654] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.277168 2555 raft_consensus.cc:697] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:14.312574 2555 consensus_queue.cc:237] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.312896 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1055) took 1034 ms. Trace:
I20260616 19:52:14.313023 1193 rpcz_store.cc:276] 0616 19:52:13.278137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.278187 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:14.312666 (+1034479us) ts_tablet_manager.cc:1151] Deleting tablet 09b2bf2ff1004853a39522a0b0608290
0616 19:52:14.312676 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.312877 (+ 201us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1034277}
W20260616 19:52:14.313621 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 09b2bf2ff1004853a39522a0b0608290 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09b2bf2ff1004853a39522a0b0608290 already in progress: creating tablet
I20260616 19:52:14.286402 2560 consensus_queue.cc:1048] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:14.290910 860 leader_election.cc:343] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.299856 889 tablet_service.cc:1558] Processing DeleteTablet for tablet bd7b91e00d6c4f70b0eda75fe83d617e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:14.300640 1190 ts_tablet_manager.cc:1929] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:14.316776 1190 log.cc:1199] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/19b9248b88434a6e9ef7a3d602eee70c
I20260616 19:52:14.319638 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8eb987854b2d4a2aa71dc4e1315916f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.320493 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8eb987854b2d4a2aa71dc4e1315916f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.321576 1190 ts_tablet_manager.cc:1950] T 19b9248b88434a6e9ef7a3d602eee70c P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:14.322539 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 931) took 4525 ms. Trace:
I20260616 19:52:14.322496 759 tablet_service.cc:1511] Processing CreateTablet for tablet 3ebd245b36b94e5b94c48fd368a1e4ef (DEFAULT_TABLE table=default.Table_9155a2bee4b44dcc89a4732cfbd04ab0 [id=a0fd46be77d240ac89e0462e66310301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.323041 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ebd245b36b94e5b94c48fd368a1e4ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.323501 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6939d108a7948bb9e56311a34d95486" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:14.323648 781 raft_consensus.cc:3060] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.326218 781 raft_consensus.cc:2468] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:14.318905 889 tablet_service.cc:1511] Processing CreateTablet for tablet 3ebd245b36b94e5b94c48fd368a1e4ef (DEFAULT_TABLE table=default.Table_9155a2bee4b44dcc89a4732cfbd04ab0 [id=a0fd46be77d240ac89e0462e66310301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.326610 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ebd245b36b94e5b94c48fd368a1e4ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.327134 860 leader_election.cc:304] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:14.330633 751 tablet_service.cc:1558] Processing DeleteTablet for tablet c6939d108a7948bb9e56311a34d95486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.332414 2554 raft_consensus.cc:2804] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:14.332567 2554 raft_consensus.cc:697] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:14.332783 2554 consensus_queue.cc:237] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.333184 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1056) took 1046 ms. Trace:
I20260616 19:52:14.333268 1193 rpcz_store.cc:276] 0616 19:52:13.286986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.287079 (+ 93us) service_pool.cc:224] Handling call
0616 19:52:14.333042 (+1045963us) ts_tablet_manager.cc:1151] Deleting tablet 0dc52e26f5554d789addb5923a612070
0616 19:52:14.333054 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.333163 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1045756}
W20260616 19:52:14.333729 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0dc52e26f5554d789addb5923a612070 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dc52e26f5554d789addb5923a612070 already in progress: creating tablet
I20260616 19:52:14.342118 1190 rpcz_store.cc:276] 0616 19:52:09.797152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.797226 (+ 74us) service_pool.cc:224] Handling call
0616 19:52:14.194055 (+4396829us) ts_tablet_manager.cc:1151] Deleting tablet 19b9248b88434a6e9ef7a3d602eee70c
0616 19:52:14.194064 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.260232 (+ 66168us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.300573 (+ 40341us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.322524 (+ 21951us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4396525}
I20260616 19:52:14.342662 1190 tablet_replica.cc:333] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:14.342892 1190 raft_consensus.cc:2243] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:14.343114 1190 raft_consensus.cc:2272] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.343717 1190 ts_tablet_manager.cc:1916] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.343864 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 3ebd245b36b94e5b94c48fd368a1e4ef (DEFAULT_TABLE table=default.Table_9155a2bee4b44dcc89a4732cfbd04ab0 [id=a0fd46be77d240ac89e0462e66310301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.344130 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 19b9248b88434a6e9ef7a3d602eee70c (table default.Table_57a6b5bc33da4eb7ac681cdaebcff9c4 [id=7c1cbcd4d250459cba3590b94f9c8519]) successfully deleted
I20260616 19:52:14.344250 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ebd245b36b94e5b94c48fd368a1e4ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.347656 1196 tablet_bootstrap.cc:654] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.350013 2559 raft_consensus.cc:493] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:52:14.318743 858 consensus_peers.cc:597] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 731556662b62419dae76149b22469ebd. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:14.350149 2559 raft_consensus.cc:515] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.350922 2559 leader_election.cc:290] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:14.351529 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a718fefe07141119b7ef7edcbf61123" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:14.323040 2557 leader_election.cc:290] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:14.352756 751 tablet_service.cc:1511] Processing CreateTablet for tablet 4819496da1bc4421b1641b8441546879 (DEFAULT_TABLE table=default.Table_03f32450daa54bdeb536825ee2bec211 [id=c68197b559ce451b9bed2db67f00b507]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.353176 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4819496da1bc4421b1641b8441546879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.356213 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1057) took 1062 ms. Trace:
I20260616 19:52:14.356354 1193 rpcz_store.cc:276] 0616 19:52:13.293682 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.293738 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:14.356086 (+1062348us) ts_tablet_manager.cc:1151] Deleting tablet 20b9e3626794464aa823724bee0a1682
0616 19:52:14.356096 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.356194 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1062174}
W20260616 19:52:14.356945 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 20b9e3626794464aa823724bee0a1682 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20b9e3626794464aa823724bee0a1682 already in progress: creating tablet
I20260616 19:52:14.357156 1191 ts_tablet_manager.cc:1929] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:14.357343 1191 log.cc:1199] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/102f322eb98f4224acb8637f8c29ac19
I20260616 19:52:14.357717 1191 ts_tablet_manager.cc:1950] T 102f322eb98f4224acb8637f8c29ac19 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:14.358445 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1008) took 2966 ms. Trace:
I20260616 19:52:14.358575 1191 rpcz_store.cc:276] 0616 19:52:11.391633 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.393715 (+ 2082us) service_pool.cc:224] Handling call
0616 19:52:14.243988 (+2850273us) ts_tablet_manager.cc:1151] Deleting tablet 102f322eb98f4224acb8637f8c29ac19
0616 19:52:14.243996 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.247858 (+ 3862us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.357094 (+109236us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.358426 (+ 1332us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2634618}
I20260616 19:52:14.359196 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 102f322eb98f4224acb8637f8c29ac19 (table default.Table_9e4be7ef0c8d47f18765df6682984b16 [id=451f7d9acb9e4ec889906998eebae58f]) successfully deleted
I20260616 19:52:14.359529 1191 tablet_replica.cc:333] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:14.359758 1191 raft_consensus.cc:2243] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:14.359952 1191 raft_consensus.cc:2272] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.363318 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1058) took 1054 ms. Trace:
I20260616 19:52:14.363431 1193 rpcz_store.cc:276] 0616 19:52:13.309055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.309103 (+ 48us) service_pool.cc:224] Handling call
0616 19:52:14.363178 (+1054075us) ts_tablet_manager.cc:1151] Deleting tablet 3f96ef25396a4092bc475f4aab269bc7
0616 19:52:14.363188 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.363293 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1051955}
W20260616 19:52:14.363968 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 3f96ef25396a4092bc475f4aab269bc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f96ef25396a4092bc475f4aab269bc7 already in progress: creating tablet
I20260616 19:52:14.364306 1193 tablet_replica.cc:333] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:52:14.365231 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 57768.5us
I20260616 19:52:14.368364 2287 raft_consensus.cc:493] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.368538 2287 raft_consensus.cc:515] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.368717 1193 raft_consensus.cc:2243] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:14.368996 1193 pending_rounds.cc:70] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:14.369042 1193 pending_rounds.cc:77] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595528885202944 op_type: NO_OP noop_request { }
I20260616 19:52:14.369122 1193 raft_consensus.cc:2889] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:14.369125 2287 leader_election.cc:290] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:14.369194 1193 raft_consensus.cc:2272] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.369729 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc5116ef5df4140a96f03c003337c68" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:14.370251 996 leader_election.cc:343] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.370894 1193 ts_tablet_manager.cc:1916] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.370908 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc5116ef5df4140a96f03c003337c68" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:14.372377 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 4819496da1bc4421b1641b8441546879 (DEFAULT_TABLE table=default.Table_03f32450daa54bdeb536825ee2bec211 [id=c68197b559ce451b9bed2db67f00b507]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.373310 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4819496da1bc4421b1641b8441546879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.373394 889 tablet_service.cc:1511] Processing CreateTablet for tablet daef25a2d2c945058bd2897030ce773b (DEFAULT_TABLE table=default.Table_88300869cc934881b02e8e152209d02f [id=0ab58988903344ada84b912a04c6bed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.373775 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daef25a2d2c945058bd2897030ce773b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.373718 1035 tablet_service.cc:1511] Processing CreateTablet for tablet daef25a2d2c945058bd2897030ce773b (DEFAULT_TABLE table=default.Table_88300869cc934881b02e8e152209d02f [id=0ab58988903344ada84b912a04c6bed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.374022 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daef25a2d2c945058bd2897030ce773b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:14.376449 993 leader_election.cc:343] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.376602 993 leader_election.cc:304] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:14.377727 1192 tablet_bootstrap.cc:492] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:14.377841 1192 ts_tablet_manager.cc:1403] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.070s user 0.006s sys 0.002s
I20260616 19:52:14.378647 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 70e1f138c3154dfbb93aca7bed67719d
I20260616 19:52:14.378584 1192 raft_consensus.cc:359] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.378737 1192 raft_consensus.cc:385] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.378788 1192 raft_consensus.cc:740] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.379568 2287 raft_consensus.cc:2749] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:14.380131 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 70e1f138c3154dfbb93aca7bed67719d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.380700 1192 consensus_queue.cc:260] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.381197 1192 ts_tablet_manager.cc:1434] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:14.381429 903 tablet_service.cc:1511] Processing CreateTablet for tablet 4819496da1bc4421b1641b8441546879 (DEFAULT_TABLE table=default.Table_03f32450daa54bdeb536825ee2bec211 [id=c68197b559ce451b9bed2db67f00b507]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.382007 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4819496da1bc4421b1641b8441546879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.383133 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c06730f5b5aa455f9186556667799363" } new_table_name: "default.Table_3f91f4dd18b54a2e88100598a7741ae3" modify_external_catalogs: true
W20260616 19:52:14.384523 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 869c51a0cda04e9dbe3b5597f844f4a6 has no consensus state
I20260616 19:52:14.385150 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 70e1f138c3154dfbb93aca7bed67719d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.386900 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_af9d4f3f9d8a44578de13634217e4d31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.387420 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af9d4f3f9d8a44578de13634217e4d31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.393771 1190 ts_tablet_manager.cc:1929] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:14.398155 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0d460c8772ab439ebbdb0ac62f94dd34" } new_table_name: "default.Table_b79d38d1900a4424ae4f0bea3f7d4953" modify_external_catalogs: true
I20260616 19:52:14.399411 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bd73b82d71a7493299d20a966c252fc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.400076 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd73b82d71a7493299d20a966c252fc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.400230 1190 log.cc:1199] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/d9c664f0386549d6867c407526ee45a0
I20260616 19:52:14.400946 1190 ts_tablet_manager.cc:1950] T d9c664f0386549d6867c407526ee45a0 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
W20260616 19:52:14.404186 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c937acc521eb438ea1b89f134caea19d consensus state has no leader
I20260616 19:52:14.404884 747 tablet_service.cc:1511] Processing CreateTablet for tablet dd67b62322a545838edf287885e60998 (DEFAULT_TABLE table=default.Table_1b8bba2a2d5b418e90b1f08ed8249a10 [id=5128d0e6e04844dc988e9ce64c97e091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.405252 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd67b62322a545838edf287885e60998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.406553 765 tablet_service.cc:1511] Processing CreateTablet for tablet daef25a2d2c945058bd2897030ce773b (DEFAULT_TABLE table=default.Table_88300869cc934881b02e8e152209d02f [id=0ab58988903344ada84b912a04c6bed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.406885 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daef25a2d2c945058bd2897030ce773b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.406917 1036 tablet_service.cc:1511] Processing CreateTablet for tablet dd67b62322a545838edf287885e60998 (DEFAULT_TABLE table=default.Table_1b8bba2a2d5b418e90b1f08ed8249a10 [id=5128d0e6e04844dc988e9ce64c97e091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.407255 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd67b62322a545838edf287885e60998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.408958 1191 ts_tablet_manager.cc:1916] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.409319 1198 tablet_bootstrap.cc:492] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:14.409483 1198 ts_tablet_manager.cc:1403] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.107s user 0.003s sys 0.000s
I20260616 19:52:14.410490 1198 raft_consensus.cc:359] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.410718 1198 raft_consensus.cc:385] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.410813 1198 raft_consensus.cc:740] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.411080 1198 consensus_queue.cc:260] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.418859 1198 ts_tablet_manager.cc:1434] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260616 19:52:14.421344 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 930) took 4628 ms. Trace:
I20260616 19:52:14.421452 1190 rpcz_store.cc:276] 0616 19:52:09.792863 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:09.805430 (+ 12567us) service_pool.cc:224] Handling call
0616 19:52:14.342612 (+4537182us) ts_tablet_manager.cc:1151] Deleting tablet d9c664f0386549d6867c407526ee45a0
0616 19:52:14.342621 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.347453 (+ 4832us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.393716 (+ 46263us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.421321 (+ 27605us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4536943}
I20260616 19:52:14.421798 1190 tablet_replica.cc:333] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:14.421975 1190 raft_consensus.cc:2243] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:14.422294 1190 raft_consensus.cc:2272] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.422731 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet d9c664f0386549d6867c407526ee45a0 (table default.Table_8f93c0209c4d41ea9c714fe9ebed8588 [id=0cc25e520828404183490059b522eefb]) successfully deleted
I20260616 19:52:14.422806 1190 ts_tablet_manager.cc:1916] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.400444 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 70e1f138c3154dfbb93aca7bed67719d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:14.404382 1192 tablet_bootstrap.cc:492] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:14.405558 898 tablet_service.cc:1511] Processing CreateTablet for tablet dd67b62322a545838edf287885e60998 (DEFAULT_TABLE table=default.Table_1b8bba2a2d5b418e90b1f08ed8249a10 [id=5128d0e6e04844dc988e9ce64c97e091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:14.425000 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd67b62322a545838edf287885e60998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:14.427026 1198 tablet_bootstrap.cc:492] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:14.433779 2428 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: acquiring CA information for follower catalog manager: success
I20260616 19:52:14.436501 1191 ts_tablet_manager.cc:1929] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:14.436705 1191 log.cc:1199] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/d5c82b71969e4cbcb890d16e1cdd5348
I20260616 19:52:14.437172 1191 ts_tablet_manager.cc:1950] T d5c82b71969e4cbcb890d16e1cdd5348 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:14.438414 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5df56c7ad1094b8798967a22c2d0cf0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.438992 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5df56c7ad1094b8798967a22c2d0cf0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.441100 1192 tablet_bootstrap.cc:654] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.443418 1198 tablet_bootstrap.cc:654] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.448081 1196 tablet_bootstrap.cc:492] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:14.448290 1196 ts_tablet_manager.cc:1403] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.140s user 0.003s sys 0.000s
I20260616 19:52:14.449126 1196 raft_consensus.cc:359] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.449368 1196 raft_consensus.cc:385] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.449470 1196 raft_consensus.cc:740] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.449748 1196 consensus_queue.cc:260] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.453759 1196 ts_tablet_manager.cc:1434] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260616 19:52:14.457106 1196 tablet_bootstrap.cc:492] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:14.457823 1192 tablet_bootstrap.cc:492] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:14.458029 1192 ts_tablet_manager.cc:1403] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.000s
I20260616 19:52:14.458753 1196 tablet_bootstrap.cc:654] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.461166 1192 raft_consensus.cc:359] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.462918 1192 raft_consensus.cc:385] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.463042 1192 raft_consensus.cc:740] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.463336 1192 consensus_queue.cc:260] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.468101 1198 tablet_bootstrap.cc:492] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:14.468295 1198 ts_tablet_manager.cc:1403] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.002s
I20260616 19:52:14.469084 1198 raft_consensus.cc:359] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.469300 1198 raft_consensus.cc:385] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.469388 1198 raft_consensus.cc:740] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.469666 1198 consensus_queue.cc:260] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.476648 1198 ts_tablet_manager.cc:1434] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260616 19:52:14.482599 1192 ts_tablet_manager.cc:1434] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.022s user 0.001s sys 0.000s
I20260616 19:52:14.484493 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1011) took 2819 ms. Trace:
I20260616 19:52:14.484649 1191 rpcz_store.cc:276] 0616 19:52:11.618087 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.618355 (+ 268us) service_pool.cc:224] Handling call
0616 19:52:14.359482 (+2741127us) ts_tablet_manager.cc:1151] Deleting tablet d5c82b71969e4cbcb890d16e1cdd5348
0616 19:52:14.359492 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.411863 (+ 52371us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.436428 (+ 24565us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.437952 (+ 1524us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3968,"tablet-delete.queue_time_us":2740958}
I20260616 19:52:14.485178 1192 tablet_bootstrap.cc:492] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:14.485194 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet d5c82b71969e4cbcb890d16e1cdd5348 (table default.Table_ece3f5e58baa45dfb295c03ab6a85f01 [id=d5fe1c6faa0d446ca84e71bbdfb4018d]) successfully deleted
I20260616 19:52:14.485313 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1016) took 2866 ms. Trace:
I20260616 19:52:14.485378 1191 rpcz_store.cc:276] 0616 19:52:11.618534 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.618721 (+ 187us) service_pool.cc:224] Handling call
0616 19:52:14.485175 (+2866454us) ts_tablet_manager.cc:1151] Deleting tablet c204a0af6eac4bc2897b48be50070860
0616 19:52:14.485186 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.485297 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2866307}
W20260616 19:52:14.485821 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c204a0af6eac4bc2897b48be50070860 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c204a0af6eac4bc2897b48be50070860 already in progress: creating tablet
I20260616 19:52:14.485889 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1013) took 2867 ms. Trace:
I20260616 19:52:14.485948 1191 rpcz_store.cc:276] 0616 19:52:11.618293 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.619966 (+ 1673us) service_pool.cc:224] Handling call
0616 19:52:14.485792 (+2865826us) ts_tablet_manager.cc:1151] Deleting tablet 89432adb0a4b442bbc5e46ee43a3e1b2
0616 19:52:14.485801 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.485876 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2864865}
I20260616 19:52:14.486379 1191 tablet_replica.cc:333] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:14.486362 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 89432adb0a4b442bbc5e46ee43a3e1b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89432adb0a4b442bbc5e46ee43a3e1b2 already in progress: creating tablet
I20260616 19:52:14.486634 1191 raft_consensus.cc:2243] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:14.486826 1191 raft_consensus.cc:2272] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.486927 1198 tablet_bootstrap.cc:492] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:14.487422 1191 ts_tablet_manager.cc:1916] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.494570 1190 ts_tablet_manager.cc:1929] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:14.494788 1190 log.cc:1199] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/1e8160ad4cf74f16a586ae59291ce7d1
I20260616 19:52:14.495821 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet af5e277102b8480db44e5ffe88267808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.497503 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 19b9248b88434a6e9ef7a3d602eee70c from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:14.498519 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_320b1c835f2741be8cf8c2cbca4d5611" } modify_external_catalogs: true
I20260616 19:52:14.498832 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_320b1c835f2741be8cf8c2cbca4d5611" } modify_external_catalogs: true
W20260616 19:52:14.504549 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 48702.1us
I20260616 19:52:14.509182 1198 tablet_bootstrap.cc:654] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:14.511047 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 192316us
I20260616 19:52:14.513144 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f1e12555be64192860eab59b3aeb562 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.514310 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a718fefe07141119b7ef7edcbf61123" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:14.514526 1058 raft_consensus.cc:2393] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:14.515408 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6939d108a7948bb9e56311a34d95486" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:14.512377 1192 tablet_bootstrap.cc:654] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.515574 1055 raft_consensus.cc:3060] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.513010 1190 ts_tablet_manager.cc:1950] T 1e8160ad4cf74f16a586ae59291ce7d1 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:14.517153 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 961) took 4099 ms. Trace:
I20260616 19:52:14.517248 1190 rpcz_store.cc:276] 0616 19:52:10.417846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.580002 (+162156us) service_pool.cc:224] Handling call
0616 19:52:14.421753 (+3841751us) ts_tablet_manager.cc:1151] Deleting tablet 1e8160ad4cf74f16a586ae59291ce7d1
0616 19:52:14.421762 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.451662 (+ 29900us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.494512 (+ 42850us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.517129 (+ 22617us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3841509}
I20260616 19:52:14.517592 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1a24c6f631b84d5a90cc8cc8d52361ab" } modify_external_catalogs: true
I20260616 19:52:14.517716 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 1e8160ad4cf74f16a586ae59291ce7d1 (table default.Table_2984957106b44cdc9ecd5a06e8edb7d3 [id=23f3d793560846b7a0701ec470588cbc]) successfully deleted
I20260616 19:52:14.517797 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1a24c6f631b84d5a90cc8cc8d52361ab" } modify_external_catalogs: true
I20260616 19:52:14.518011 1190 tablet_replica.cc:333] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:14.518164 1055 raft_consensus.cc:2468] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:14.518193 1190 raft_consensus.cc:2243] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:14.518323 1190 raft_consensus.cc:2272] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.518836 1190 ts_tablet_manager.cc:1916] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.519308 758 tablet_service.cc:1558] Processing DeleteTablet for tablet fb1c2030b3a14c6aafaa961869606f31 with delete_type TABLET_DATA_DELETED (replaced by tablet c7f724dc23024a7297cfb8689f199600) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.521881 2287 raft_consensus.cc:493] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.522008 2287 raft_consensus.cc:515] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.522279 1198 tablet_bootstrap.cc:492] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:14.522404 1198 ts_tablet_manager.cc:1403] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.002s
I20260616 19:52:14.522588 2287 leader_election.cc:290] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:14.523538 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40bdb01a15254c329d82f0d40919b880" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:14.523970 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40bdb01a15254c329d82f0d40919b880" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:14.525046 993 leader_election.cc:343] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:14.525434 996 leader_election.cc:343] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.525523 996 leader_election.cc:304] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:14.526751 2557 consensus_queue.cc:1048] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:14.528036 2287 raft_consensus.cc:2749] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:14.530246 458 master_service.cc:960] ReplaceTablet: received request to replace tablet e88de49e07a4467d9698d71c321c16f5 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:14.535641 858 leader_election.cc:304] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:14.537999 453 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet effc56eb742948de919c49187f05e4c7
I20260616 19:52:14.539739 1192 tablet_bootstrap.cc:492] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:14.539947 1192 ts_tablet_manager.cc:1403] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.003s
I20260616 19:52:14.540659 1191 ts_tablet_manager.cc:1929] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:14.540781 1191 log.cc:1199] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/49ab6193c479400da00e1fa80a5274a2
I20260616 19:52:14.541100 1191 ts_tablet_manager.cc:1950] T 49ab6193c479400da00e1fa80a5274a2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:14.541857 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1015) took 2923 ms. Trace:
I20260616 19:52:14.541946 1191 rpcz_store.cc:276] 0616 19:52:11.618465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.620239 (+ 1774us) service_pool.cc:224] Handling call
0616 19:52:14.486336 (+2866097us) ts_tablet_manager.cc:1151] Deleting tablet 49ab6193c479400da00e1fa80a5274a2
0616 19:52:14.486347 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.512457 (+ 26110us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.540600 (+ 28143us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.541837 (+ 1237us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2865301}
I20260616 19:52:14.542367 2557 raft_consensus.cc:3060] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.542356 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 49ab6193c479400da00e1fa80a5274a2 (table default.Table_8b66b38f443d4eaebf8391a80ef74818 [id=1f077f42ac19492597ea7cd3027cae10]) successfully deleted
I20260616 19:52:14.544016 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f3cb6d6a4b17493eaecd974beddf55a1" } new_table_name: "default.Table_31d718b4876e45f4b7366b0b32d66680" modify_external_catalogs: true
I20260616 19:52:14.544720 2557 raft_consensus.cc:2749] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:14.544840 1192 raft_consensus.cc:359] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.545019 1192 raft_consensus.cc:385] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.545128 1192 raft_consensus.cc:740] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
W20260616 19:52:14.545486 858 consensus_peers.cc:597] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1a09d62e68148349b337c5075763672. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:14.545430 1192 consensus_queue.cc:260] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.548382 1192 ts_tablet_manager.cc:1434] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260616 19:52:14.550379 2428 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 2b8fb7a8523741a2b7a5e75d8b415be0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260616 19:52:14.552556 1192 tablet_bootstrap.cc:492] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:14.553150 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_61c8c6e63044481d8029246da0b0537c" } modify_external_catalogs: true
I20260616 19:52:14.553328 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_61c8c6e63044481d8029246da0b0537c" } modify_external_catalogs: true
I20260616 19:52:14.556003 1192 tablet_bootstrap.cc:654] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.545646 1190 ts_tablet_manager.cc:1929] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:14.556602 1190 log.cc:1199] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/9d800b4e2c2d42279c102e4e061f5530
I20260616 19:52:14.556787 1193 ts_tablet_manager.cc:1929] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:14.557367 1190 ts_tablet_manager.cc:1950] T 9d800b4e2c2d42279c102e4e061f5530 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:14.557904 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1014) took 2939 ms. Trace:
I20260616 19:52:14.558064 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 962) took 4140 ms. Trace:
I20260616 19:52:14.558197 1190 rpcz_store.cc:276] 0616 19:52:10.417918 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.580263 (+162345us) service_pool.cc:224] Handling call
0616 19:52:14.517956 (+3937693us) ts_tablet_manager.cc:1151] Deleting tablet 9d800b4e2c2d42279c102e4e061f5530
0616 19:52:14.517969 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.521841 (+ 3872us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.545573 (+ 23732us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.558048 (+ 12475us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3937527}
I20260616 19:52:14.558733 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 9d800b4e2c2d42279c102e4e061f5530 (table default.Table_fab39b1a6f2940f4955f9d3b9dd78a79 [id=444a660aa02c4f17a70407bd7d57b590]) successfully deleted
I20260616 19:52:14.559139 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 963) took 4141 ms. Trace:
I20260616 19:52:14.559257 1190 rpcz_store.cc:276] 0616 19:52:10.417974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.580437 (+162463us) service_pool.cc:224] Handling call
0616 19:52:14.559031 (+3978594us) ts_tablet_manager.cc:1151] Deleting tablet 608c26854fdf4dcd8cec2604d23a0dec
0616 19:52:14.559040 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.559124 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3978435}
W20260616 19:52:14.559738 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 608c26854fdf4dcd8cec2604d23a0dec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 608c26854fdf4dcd8cec2604d23a0dec already in progress: creating tablet
I20260616 19:52:14.560540 1191 rpcz_store.cc:276] 0616 19:52:11.618391 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.619999 (+ 1608us) service_pool.cc:224] Handling call
0616 19:52:14.557745 (+2937746us) ts_tablet_manager.cc:1151] Deleting tablet df1ee0d1e1514c86802cdce5ae0756eb
0616 19:52:14.557758 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.557879 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2936617}
W20260616 19:52:14.560948 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 290d1bf172f949089e013d24ec64435d has no consensus state
I20260616 19:52:14.565022 1193 log.cc:1199] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/102f322eb98f4224acb8637f8c29ac19
I20260616 19:52:14.566027 1193 ts_tablet_manager.cc:1950] T 102f322eb98f4224acb8637f8c29ac19 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:14.566200 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
I20260616 19:52:14.566895 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 84ce7bf3e0004ffaa2c5e314fa69322c (table default.Table_4f1675b0cae24ecea8b9f4efebb44772 [id=4f2b128cff5248f98e3506bb72a39391]). Expected version 3 got 0
W20260616 19:52:14.568854 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet df1ee0d1e1514c86802cdce5ae0756eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df1ee0d1e1514c86802cdce5ae0756eb already in progress: creating tablet
I20260616 19:52:14.568885 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1012) took 2950 ms. Trace:
I20260616 19:52:14.568965 1191 rpcz_store.cc:276] 0616 19:52:11.618169 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.619902 (+ 1733us) service_pool.cc:224] Handling call
0616 19:52:14.568753 (+2948851us) ts_tablet_manager.cc:1151] Deleting tablet aa989f24b81b4c148069d1d8176dad8b
0616 19:52:14.568765 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.568866 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2946659}
I20260616 19:52:14.567742 1198 raft_consensus.cc:359] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:14.569386 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet aa989f24b81b4c148069d1d8176dad8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa989f24b81b4c148069d1d8176dad8b already in progress: creating tablet
I20260616 19:52:14.570343 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 8f67e5add64244629cbe8694223bd00e from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:14.570513 1198 raft_consensus.cc:385] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.570545 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 67ac2e31a1ba40b39145c26a1e4e0884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:14.570590 1198 raft_consensus.cc:740] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.570791 1198 consensus_queue.cc:260] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.571055 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 964) took 4153 ms. Trace:
I20260616 19:52:14.571177 1190 rpcz_store.cc:276] 0616 19:52:10.418029 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.580619 (+162590us) service_pool.cc:224] Handling call
0616 19:52:14.562210 (+3981591us) ts_tablet_manager.cc:1151] Deleting tablet 30f47e639195478f9cda4ab8f8b33798
0616 19:52:14.570878 (+ 8668us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.571037 (+ 159us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3627403}
W20260616 19:52:14.571677 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 30f47e639195478f9cda4ab8f8b33798 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30f47e639195478f9cda4ab8f8b33798 already in progress: creating tablet
I20260616 19:52:14.569463 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1017) took 2710 ms. Trace:
I20260616 19:52:14.574559 1191 rpcz_store.cc:276] 0616 19:52:11.858807 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.858871 (+ 64us) service_pool.cc:224] Handling call
0616 19:52:14.569347 (+2710476us) ts_tablet_manager.cc:1151] Deleting tablet fd020407d4f8470e99045206ca16c6d2
0616 19:52:14.569358 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.569444 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2687953}
I20260616 19:52:14.574792 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0f1f9211c91e4a50918fa11912d3b839"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.574990 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet fd020407d4f8470e99045206ca16c6d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd020407d4f8470e99045206ca16c6d2 already in progress: creating tablet
W20260616 19:52:14.575347 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f1f9211c91e4a50918fa11912d3b839 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.564837 1196 tablet_bootstrap.cc:492] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:14.577001 1196 ts_tablet_manager.cc:1403] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.120s user 0.003s sys 0.000s
I20260616 19:52:14.577855 1196 raft_consensus.cc:359] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.578076 1196 raft_consensus.cc:385] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.578770 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 965) took 4160 ms. Trace:
I20260616 19:52:14.578903 1190 rpcz_store.cc:276] 0616 19:52:10.418095 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.608056 (+189961us) service_pool.cc:224] Handling call
0616 19:52:14.571958 (+3963902us) ts_tablet_manager.cc:1151] Deleting tablet 7ffc15f90dc24de49455205d5de6b58e
0616 19:52:14.577933 (+ 5975us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.578751 (+ 818us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3624383}
I20260616 19:52:14.579265 1198 ts_tablet_manager.cc:1434] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.057s user 0.000s sys 0.002s
W20260616 19:52:14.579403 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 7ffc15f90dc24de49455205d5de6b58e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ffc15f90dc24de49455205d5de6b58e already in progress: creating tablet
I20260616 19:52:14.579732 1190 tablet_replica.cc:333] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:14.578197 1196 raft_consensus.cc:740] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.581103 2557 consensus_queue.cc:1048] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:14.581727 1196 consensus_queue.cc:260] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.582368 1196 ts_tablet_manager.cc:1434] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260616 19:52:14.582620 1196 tablet_bootstrap.cc:492] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:14.584697 1196 tablet_bootstrap.cc:654] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.588742 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1059) took 1265 ms. Trace:
I20260616 19:52:14.594786 1190 raft_consensus.cc:2243] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:14.594961 1190 raft_consensus.cc:2272] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.597575 1198 tablet_bootstrap.cc:492] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:52:14.600878 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f61d0824e6144f00956b4ee552b33029 consensus state has no leader
I20260616 19:52:14.601522 1198 tablet_bootstrap.cc:654] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.601812 1193 rpcz_store.cc:276] 0616 19:52:13.323145 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.323298 (+ 153us) service_pool.cc:224] Handling call
0616 19:52:14.364262 (+1040964us) ts_tablet_manager.cc:1151] Deleting tablet 102f322eb98f4224acb8637f8c29ac19
0616 19:52:14.364271 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.470077 (+105806us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.556597 (+ 86520us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.588721 (+ 32124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1040351}
I20260616 19:52:14.589654 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1018) took 2726 ms. Trace:
I20260616 19:52:14.602339 1191 rpcz_store.cc:276] 0616 19:52:11.862961 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.863011 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:14.574965 (+2711954us) ts_tablet_manager.cc:1151] Deleting tablet c37aeb69afa040eeb9db1f8bdc60bb99
0616 19:52:14.580500 (+ 5535us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.589635 (+ 9135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17,"tablet-delete.queue_time_us":2693564}
I20260616 19:52:14.602846 1191 tablet_replica.cc:333] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:14.602926 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c37aeb69afa040eeb9db1f8bdc60bb99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c37aeb69afa040eeb9db1f8bdc60bb99 already in progress: creating tablet
I20260616 19:52:14.603106 1191 raft_consensus.cc:2243] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:14.603911 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1060) took 1274 ms. Trace:
I20260616 19:52:14.603966 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 102f322eb98f4224acb8637f8c29ac19 (table default.Table_9e4be7ef0c8d47f18765df6682984b16 [id=451f7d9acb9e4ec889906998eebae58f]) successfully deleted
I20260616 19:52:14.604010 1193 rpcz_store.cc:276] 0616 19:52:13.329919 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.329971 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:14.603781 (+1273810us) ts_tablet_manager.cc:1151] Deleting tablet 8b4d4c8b67aa44f68a974f7ca7090dd4
0616 19:52:14.603793 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.603893 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1273646}
I20260616 19:52:14.604341 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1063) took 1174 ms. Trace:
W20260616 19:52:14.604502 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8b4d4c8b67aa44f68a974f7ca7090dd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b4d4c8b67aa44f68a974f7ca7090dd4 already in progress: creating tablet
I20260616 19:52:14.605343 1191 raft_consensus.cc:2272] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.608176 2287 raft_consensus.cc:493] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.608301 2287 raft_consensus.cc:515] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.608929 2287 leader_election.cc:290] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:14.610803 858 consensus_peers.cc:597] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e316e44693d473dad901eeb95299988. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:14.612392 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f724dc23024a7297cfb8689f199600" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:14.613116 993 leader_election.cc:343] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.613083 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f724dc23024a7297cfb8689f199600" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:14.613723 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d9c89216995430188b1eed4c6b26d1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:14.614128 996 leader_election.cc:343] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.614233 996 leader_election.cc:304] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:14.614645 2287 raft_consensus.cc:2749] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:14.618682 1191 ts_tablet_manager.cc:1916] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.621632 1190 ts_tablet_manager.cc:1916] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.624264 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.641613 2557 consensus_queue.cc:1048] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:14.643117 454 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
I20260616 19:52:14.643338 454 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 84ce7bf3e0004ffaa2c5e314fa69322c (table default.Table_4f1675b0cae24ecea8b9f4efebb44772 [id=4f2b128cff5248f98e3506bb72a39391]). Expected version 3 got 0
W20260616 19:52:14.645124 860 consensus_peers.cc:597] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aabf57dd6d704645b6bf97b730dbe964. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:14.645889 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_fdf8cb959fb04d818c77e3bced7e61b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:14.646358 2470 consensus_queue.cc:1048] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:14.646617 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdf8cb959fb04d818c77e3bced7e61b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.655377 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 76a89e7686aa44df9bb017816d1accb1
I20260616 19:52:14.657276 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 76a89e7686aa44df9bb017816d1accb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.657521 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 76a89e7686aa44df9bb017816d1accb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:14.657744 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 76a89e7686aa44df9bb017816d1accb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.604405 1193 rpcz_store.cc:276] 0616 19:52:13.430329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.430383 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:14.604247 (+1173864us) ts_tablet_manager.cc:1151] Deleting tablet c3d71d78c92f45f1a6c0af3589026b10
0616 19:52:14.604256 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.604326 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1173707}
W20260616 19:52:14.658531 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c3d71d78c92f45f1a6c0af3589026b10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3d71d78c92f45f1a6c0af3589026b10 already in progress: creating tablet
I20260616 19:52:14.658980 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1064) took 1227 ms. Trace:
I20260616 19:52:14.659094 1193 rpcz_store.cc:276] 0616 19:52:13.431170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.431231 (+ 61us) service_pool.cc:224] Handling call
0616 19:52:14.658859 (+1227628us) ts_tablet_manager.cc:1151] Deleting tablet fae2f430cf904db09b2f18a37d3d9f7f
0616 19:52:14.658879 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.658964 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5504,"tablet-delete.queue_time_us":1227481}
W20260616 19:52:14.659588 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet fae2f430cf904db09b2f18a37d3d9f7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fae2f430cf904db09b2f18a37d3d9f7f already in progress: creating tablet
I20260616 19:52:14.660133 1193 tablet_replica.cc:333] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:14.660379 1193 raft_consensus.cc:2243] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:14.660641 1193 raft_consensus.cc:2272] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.661213 1193 ts_tablet_manager.cc:1916] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.664386 1198 tablet_bootstrap.cc:492] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:14.664590 1198 ts_tablet_manager.cc:1403] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.067s user 0.000s sys 0.003s
I20260616 19:52:14.665313 1198 raft_consensus.cc:359] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.665518 1198 raft_consensus.cc:385] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.665602 1198 raft_consensus.cc:740] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.665887 1198 consensus_queue.cc:260] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.666451 1198 ts_tablet_manager.cc:1434] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:52:14.666734 1198 tablet_bootstrap.cc:492] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:14.672082 2470 raft_consensus.cc:493] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.672225 2470 raft_consensus.cc:515] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.672844 2470 leader_election.cc:290] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:14.673467 1198 tablet_bootstrap.cc:654] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:14.673730 719 leader_election.cc:343] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: fb1c2030b3a14c6aafaa961869606f31
I20260616 19:52:14.624356 1191 ts_tablet_manager.cc:1929] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:14.674306 1191 log.cc:1199] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/e896d5aa87f14e5593d01085bb6d434f
I20260616 19:52:14.674368 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1c2030b3a14c6aafaa961869606f31" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:14.674540 922 raft_consensus.cc:2468] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:14.674609 1191 ts_tablet_manager.cc:1950] T e896d5aa87f14e5593d01085bb6d434f P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:14.675079 718 leader_election.cc:304] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:14.675307 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1019) took 2811 ms. Trace:
I20260616 19:52:14.675406 1191 rpcz_store.cc:276] 0616 19:52:11.863536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.864301 (+ 765us) service_pool.cc:224] Handling call
0616 19:52:14.602800 (+2738499us) ts_tablet_manager.cc:1151] Deleting tablet e896d5aa87f14e5593d01085bb6d434f
0616 19:52:14.602810 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.621652 (+ 18842us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.624309 (+ 2657us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.675289 (+ 50980us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2718038}
I20260616 19:52:14.675524 2470 raft_consensus.cc:2804] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:14.675734 1191 tablet_replica.cc:333] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:14.675769 2470 raft_consensus.cc:493] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:14.675905 1191 raft_consensus.cc:2243] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:14.675921 2470 raft_consensus.cc:3060] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.676034 1191 raft_consensus.cc:2272] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.676784 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet e896d5aa87f14e5593d01085bb6d434f (table default.Table_8f195aaf0b9c47169f6c04a5e380bd22 [id=a2abe0bca3fa4d35b86a23f91f6973b4]) successfully deleted
I20260616 19:52:14.679404 2470 raft_consensus.cc:515] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.680343 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_93b5e652dc2a4061abf781fea9c4aae1" } new_table_name: "default.Table_19dc528305e04eca93daea4a433b1d50" modify_external_catalogs: true
I20260616 19:52:14.680426 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1c2030b3a14c6aafaa961869606f31" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:14.680603 922 raft_consensus.cc:3060] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.683159 922 raft_consensus.cc:2468] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:14.683846 718 leader_election.cc:304] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:14.684388 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d4d414b3d75449c5a328e01cd03ad768" } modify_external_catalogs: true
I20260616 19:52:14.685091 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d4d414b3d75449c5a328e01cd03ad768" } modify_external_catalogs: true
I20260616 19:52:14.685848 1191 ts_tablet_manager.cc:1916] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:14.687021 719 leader_election.cc:343] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: fb1c2030b3a14c6aafaa961869606f31
I20260616 19:52:14.687362 2470 leader_election.cc:290] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:14.687637 2470 raft_consensus.cc:2804] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:14.688138 2470 raft_consensus.cc:697] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:14.688479 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet e88de49e07a4467d9698d71c321c16f5
I20260616 19:52:14.689004 458 catalog_manager.cc:6784] ReplaceTablet: tablet e88de49e07a4467d9698d71c321c16f5 deleted and replaced by tablet 40dac55e5a2646f8b7b92126861926ff
I20260616 19:52:14.690507 2470 consensus_queue.cc:237] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.691473 898 tablet_service.cc:1558] Processing DeleteTablet for tablet e88de49e07a4467d9698d71c321c16f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 40dac55e5a2646f8b7b92126861926ff) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:14.689229 758 tablet_service.cc:1558] Processing DeleteTablet for tablet e88de49e07a4467d9698d71c321c16f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 40dac55e5a2646f8b7b92126861926ff) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.692701 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet e88de49e07a4467d9698d71c321c16f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 40dac55e5a2646f8b7b92126861926ff) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.695024 458 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
I20260616 19:52:14.695801 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3242a9af55a549e895eea5daa4ff2f9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.696301 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3242a9af55a549e895eea5daa4ff2f9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:14.701059 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 51983531f0f5423aa5f4bb3435cd5a7e consensus state has no leader
I20260616 19:52:14.701383 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 5c6add7925294880a5a20eb3d189d1ee from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:14.706322 1198 tablet_bootstrap.cc:492] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:14.706542 1198 ts_tablet_manager.cc:1403] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.002s
I20260616 19:52:14.707068 1196 tablet_bootstrap.cc:492] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:14.707297 1196 ts_tablet_manager.cc:1403] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.125s user 0.002s sys 0.002s
I20260616 19:52:14.707358 1198 raft_consensus.cc:359] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.707525 1198 raft_consensus.cc:385] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.707583 1198 raft_consensus.cc:740] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.707777 1198 consensus_queue.cc:260] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.708201 1198 ts_tablet_manager.cc:1434] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:14.708506 1198 tablet_bootstrap.cc:492] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:14.708881 1196 raft_consensus.cc:359] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.709170 1196 raft_consensus.cc:385] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.709280 1196 raft_consensus.cc:740] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.711066 2557 raft_consensus.cc:493] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.711272 2557 raft_consensus.cc:515] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.712397 2557 leader_election.cc:290] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:14.712502 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ce7bf3e0004ffaa2c5e314fa69322c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:14.712688 1056 raft_consensus.cc:2468] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:14.713111 858 leader_election.cc:304] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:14.713490 2557 raft_consensus.cc:2804] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:14.713614 2557 raft_consensus.cc:493] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:14.713753 2557 raft_consensus.cc:3060] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.715212 2297 raft_consensus.cc:493] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:14.715328 2297 raft_consensus.cc:515] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:14.715863 2297 leader_election.cc:290] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:14.716842 2557 raft_consensus.cc:515] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.712826 1196 consensus_queue.cc:260] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:52:14.716991 858 leader_election.cc:343] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: cbd1070277a14fd98af5fa45925e4f0f
I20260616 19:52:14.718716 1196 ts_tablet_manager.cc:1434] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260616 19:52:14.719128 2557 leader_election.cc:290] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:14.719354 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ce7bf3e0004ffaa2c5e314fa69322c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:14.719556 1196 tablet_bootstrap.cc:492] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:14.719559 1058 raft_consensus.cc:3060] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.721125 1196 tablet_bootstrap.cc:654] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.722012 1198 tablet_bootstrap.cc:654] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.721962 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3b70c7a16c9f4b17837aadaeffea6140" } new_table_name: "default.Table_585a5c1e09694471afe08831622a8ff4" modify_external_catalogs: true
I20260616 19:52:14.729457 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet cd19e83413ad420e97af92ca609757e5
I20260616 19:52:14.732967 898 tablet_service.cc:1558] Processing DeleteTablet for tablet cd19e83413ad420e97af92ca609757e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:14.733204 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet cd19e83413ad420e97af92ca609757e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.738241 461 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
I20260616 19:52:14.739219 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2a5f3eb8fe14467f80b2d3222e2f2963"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.740145 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a5f3eb8fe14467f80b2d3222e2f2963 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.742017 2557 raft_consensus.cc:493] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.742719 2557 raft_consensus.cc:515] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:14.743217 858 consensus_peers.cc:597] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49ab6193c479400da00e1fa80a5274a2. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:14.749930 2557 leader_election.cc:290] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:14.753950 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ac2e31a1ba40b39145c26a1e4e0884" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:14.754146 1059 raft_consensus.cc:2468] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:14.754599 858 leader_election.cc:304] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:14.755052 2297 raft_consensus.cc:2804] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:14.755120 2297 raft_consensus.cc:493] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:14.755170 2297 raft_consensus.cc:3060] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.756094 1191 ts_tablet_manager.cc:1929] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:14.756184 1191 log.cc:1199] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/c6939d108a7948bb9e56311a34d95486
I20260616 19:52:14.757982 2297 raft_consensus.cc:515] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.758531 2297 leader_election.cc:290] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:14.763208 1058 raft_consensus.cc:2468] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:14.763605 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ac2e31a1ba40b39145c26a1e4e0884" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:14.763785 1059 raft_consensus.cc:3060] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.765009 858 leader_election.cc:304] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:14.765262 2557 raft_consensus.cc:2804] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:14.766294 1059 raft_consensus.cc:2468] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:14.770483 858 leader_election.cc:304] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:14.772553 2297 raft_consensus.cc:2804] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:14.772645 1191 ts_tablet_manager.cc:1950] T c6939d108a7948bb9e56311a34d95486 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:14.772732 2297 raft_consensus.cc:697] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:14.772981 2297 consensus_queue.cc:237] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.775260 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ac7715ebf36342b1adc93cb3bceaed4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.776057 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac7715ebf36342b1adc93cb3bceaed4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.776089 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1020) took 2911 ms. Trace:
I20260616 19:52:14.776186 1191 rpcz_store.cc:276] 0616 19:52:11.864624 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.864706 (+ 82us) service_pool.cc:224] Handling call
0616 19:52:14.675692 (+2810986us) ts_tablet_manager.cc:1151] Deleting tablet c6939d108a7948bb9e56311a34d95486
0616 19:52:14.675701 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.691232 (+ 15531us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.756036 (+ 64804us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.776069 (+ 20033us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2790857}
I20260616 19:52:14.776675 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet c6939d108a7948bb9e56311a34d95486 (table default.Table_8dbc007d3ffb483d8f4ca4fefdde8a2b [id=794886751c914a4b9a139e477021e487]) successfully deleted
I20260616 19:52:14.777493 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1021) took 2912 ms. Trace:
I20260616 19:52:14.778575 1191 rpcz_store.cc:276] 0616 19:52:11.864737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.864852 (+ 115us) service_pool.cc:224] Handling call
0616 19:52:14.776721 (+2911869us) ts_tablet_manager.cc:1151] Deleting tablet a20701ab3a5d43df92c471bd6013ac6c
0616 19:52:14.776731 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.777474 (+ 743us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2891824}
W20260616 19:52:14.779604 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a20701ab3a5d43df92c471bd6013ac6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a20701ab3a5d43df92c471bd6013ac6c already in progress: creating tablet
I20260616 19:52:14.779922 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1022) took 2906 ms. Trace:
I20260616 19:52:14.779930 2557 raft_consensus.cc:697] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:14.780784 1191 rpcz_store.cc:276] 0616 19:52:11.873119 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.873437 (+ 318us) service_pool.cc:224] Handling call
0616 19:52:14.779792 (+2906355us) ts_tablet_manager.cc:1151] Deleting tablet df14405fff32417da8e9069680100dbd
0616 19:52:14.779805 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.779905 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2894785}
W20260616 19:52:14.781525 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet df14405fff32417da8e9069680100dbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df14405fff32417da8e9069680100dbd already in progress: creating tablet
I20260616 19:52:14.781845 2557 consensus_queue.cc:237] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:14.781989 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1025) took 2825 ms. Trace:
I20260616 19:52:14.782744 1191 rpcz_store.cc:276] 0616 19:52:11.956135 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.956259 (+ 124us) service_pool.cc:224] Handling call
0616 19:52:14.781890 (+2825631us) ts_tablet_manager.cc:1151] Deleting tablet 87ca1b3a712845f9a93653faa0e95291
0616 19:52:14.781899 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.781974 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2825474}
W20260616 19:52:14.783530 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 87ca1b3a712845f9a93653faa0e95291 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87ca1b3a712845f9a93653faa0e95291 already in progress: creating tablet
I20260616 19:52:14.732277 758 tablet_service.cc:1558] Processing DeleteTablet for tablet cd19e83413ad420e97af92ca609757e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:14.741055 718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 57224.1us
I20260616 19:52:14.787561 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ce7bf3e0004ffaa2c5e314fa69322c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:14.787861 781 raft_consensus.cc:2468] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:14.792390 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8f67e5add64244629cbe8694223bd00e
I20260616 19:52:14.793123 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f67e5add64244629cbe8694223bd00e with delete_type TABLET_DATA_DELETED (replaced by tablet 56b26290785843698daf2398931ed416) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.793269 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f67e5add64244629cbe8694223bd00e with delete_type TABLET_DATA_DELETED (replaced by tablet 56b26290785843698daf2398931ed416) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:14.793932 460 catalog_manager.cc:6784] ReplaceTablet: tablet 8f67e5add64244629cbe8694223bd00e deleted and replaced by tablet 56b26290785843698daf2398931ed416
I20260616 19:52:14.793960 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f67e5add64244629cbe8694223bd00e with delete_type TABLET_DATA_DELETED (replaced by tablet 56b26290785843698daf2398931ed416) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:14.795293 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1024) took 2839 ms. Trace:
I20260616 19:52:14.795395 1191 rpcz_store.cc:276] 0616 19:52:11.956003 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.957289 (+ 1286us) service_pool.cc:224] Handling call
0616 19:52:14.795146 (+2837857us) ts_tablet_manager.cc:1151] Deleting tablet 5e8c37e4293a4f2fa4f54397686c5dfc
0616 19:52:14.795161 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.795271 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2826157}
W20260616 19:52:14.795887 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 5e8c37e4293a4f2fa4f54397686c5dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e8c37e4293a4f2fa4f54397686c5dfc already in progress: creating tablet
I20260616 19:52:14.796221 1191 tablet_replica.cc:333] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:14.801512 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ce7bf3e0004ffaa2c5e314fa69322c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:14.801791 781 raft_consensus.cc:3060] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.804663 781 raft_consensus.cc:2468] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:14.808130 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ac2e31a1ba40b39145c26a1e4e0884" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:14.809062 860 leader_election.cc:343] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: cbd1070277a14fd98af5fa45925e4f0f
I20260616 19:52:14.809170 860 leader_election.cc:304] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:14.809666 2555 consensus_queue.cc:1048] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:14.810050 2555 raft_consensus.cc:2749] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260616 19:52:14.810575 860 leader_election.cc:343] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.810786 2470 consensus_queue.cc:1048] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:14.811825 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ac2e31a1ba40b39145c26a1e4e0884" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:14.815796 1192 tablet_bootstrap.cc:492] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:14.816025 1192 ts_tablet_manager.cc:1403] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.264s user 0.007s sys 0.001s
I20260616 19:52:14.817226 1192 raft_consensus.cc:359] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.817513 1192 raft_consensus.cc:385] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.817619 1192 raft_consensus.cc:740] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.817906 1192 consensus_queue.cc:260] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.818567 1192 ts_tablet_manager.cc:1434] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:52:14.818962 2287 raft_consensus.cc:493] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.819099 2287 raft_consensus.cc:515] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.819729 2287 leader_election.cc:290] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:14.820555 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e277102b8480db44e5ffe88267808" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:14.821101 996 leader_election.cc:343] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.822572 758 tablet_service.cc:1558] Processing DeleteTablet for tablet e6530753b4184cfe972ae3a43f23d589 with delete_type TABLET_DATA_DELETED (replaced by tablet f89a0c065a4a4fb7afa8cab29d78c2e5) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.831379 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0d0dc8e6e8b94b42a633512f5d869265"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.831900 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d0dc8e6e8b94b42a633512f5d869265 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.833813 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cef65e1f2a234a8498e16b9138776e71" } modify_external_catalogs: true
I20260616 19:52:14.834002 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cef65e1f2a234a8498e16b9138776e71" } modify_external_catalogs: true
W20260616 19:52:14.846379 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a14416733ff7463082843ef2597ebc88 consensus state has no leader
I20260616 19:52:14.850330 1191 raft_consensus.cc:2243] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:14.850749 1191 raft_consensus.cc:2272] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.853456 1191 ts_tablet_manager.cc:1916] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.858134 1196 tablet_bootstrap.cc:492] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:14.820271 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e277102b8480db44e5ffe88267808" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:14.822000 2559 raft_consensus.cc:493] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:14.868878 2559 raft_consensus.cc:515] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.869465 2559 leader_election.cc:290] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:14.867056 719 consensus_peers.cc:597] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90205213ba5f49a2931e68839cefb2d2. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:14.870555 1196 ts_tablet_manager.cc:1403] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.151s user 0.004s sys 0.000s
W20260616 19:52:14.847345 860 leader_election.cc:343] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.885915 1196 raft_consensus.cc:359] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:14.887475 993 leader_election.cc:343] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:14.887632 993 leader_election.cc:304] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:14.888171 2287 raft_consensus.cc:2749] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:14.890774 458 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
I20260616 19:52:14.892803 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1711b70016334d1e9cd9e043a4cd1625"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:14.893801 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1711b70016334d1e9cd9e043a4cd1625 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.894970 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239a24dbdc047f9beb2ed7e1492acfe" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:14.896884 1196 raft_consensus.cc:385] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.896996 1196 raft_consensus.cc:740] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.897277 1196 consensus_queue.cc:260] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.897994 1196 ts_tablet_manager.cc:1434] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260616 19:52:14.901280 1198 tablet_bootstrap.cc:492] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:14.901453 1198 ts_tablet_manager.cc:1403] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.193s user 0.011s sys 0.000s
I20260616 19:52:14.902264 1198 raft_consensus.cc:359] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.902449 1198 raft_consensus.cc:385] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.902520 1198 raft_consensus.cc:740] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.902802 1198 consensus_queue.cc:260] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.912595 1055 raft_consensus.cc:2468] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:14.913043 858 leader_election.cc:304] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:14.913287 2557 raft_consensus.cc:2804] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:14.913363 2557 raft_consensus.cc:493] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:14.913421 2557 raft_consensus.cc:3060] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.913980 1192 tablet_bootstrap.cc:492] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:14.916534 1192 tablet_bootstrap.cc:654] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:14.918334 996 consensus_peers.cc:597] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbf73c4c1133405bb46df19c0559ab92. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:14.896781 1193 ts_tablet_manager.cc:1929] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:14.915282 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239a24dbdc047f9beb2ed7e1492acfe" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:14.920131 780 raft_consensus.cc:2468] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:14.920535 1193 log.cc:1199] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/7dc92bc15da14504a1ff5feda5aff7cf
I20260616 19:52:14.921032 1193 ts_tablet_manager.cc:1950] T 7dc92bc15da14504a1ff5feda5aff7cf P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:14.923857 1198 ts_tablet_manager.cc:1434] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.022s user 0.001s sys 0.000s
I20260616 19:52:14.924310 1196 tablet_bootstrap.cc:492] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:14.933749 858 consensus_peers.cc:597] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5c82b71969e4cbcb890d16e1cdd5348. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:14.934963 1198 tablet_bootstrap.cc:492] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:14.937094 1198 tablet_bootstrap.cc:654] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.939607 780 raft_consensus.cc:3060] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.947549 1190 ts_tablet_manager.cc:1929] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:14.948037 1190 log.cc:1199] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/afc58b2bda2a43f18f157469b591854b
I20260616 19:52:14.948432 1190 ts_tablet_manager.cc:1950] T afc58b2bda2a43f18f157469b591854b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:14.954098 758 tablet_service.cc:1558] Processing DeleteTablet for tablet c239a24dbdc047f9beb2ed7e1492acfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:14.957054 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_08464d650ddd4fd1ac12cd0949f35d4e" } new_table_name: "default.Table_1936994c9dc74e62b39778da2355b418" modify_external_catalogs: true
I20260616 19:52:14.959132 1192 tablet_bootstrap.cc:492] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:14.959311 1192 ts_tablet_manager.cc:1403] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.045s user 0.000s sys 0.004s
I20260616 19:52:14.960136 1192 raft_consensus.cc:359] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.960335 1192 raft_consensus.cc:385] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:14.960417 1192 raft_consensus.cc:740] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:14.960739 1192 consensus_queue.cc:260] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.961258 1192 ts_tablet_manager.cc:1434] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:14.961567 1192 tablet_bootstrap.cc:492] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:14.963488 1192 tablet_bootstrap.cc:654] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.969058 1196 tablet_bootstrap.cc:654] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:14.970330 1191 ts_tablet_manager.cc:1929] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:14.970499 1191 log.cc:1199] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/8a718fefe07141119b7ef7edcbf61123
I20260616 19:52:14.970906 1191 ts_tablet_manager.cc:1950] T 8a718fefe07141119b7ef7edcbf61123 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:14.965664 2557 raft_consensus.cc:515] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:14.971647 2557 leader_election.cc:290] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:14.974222 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cb3a5b66dc3a4963b7828b4a3f004534"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:14.974423 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239a24dbdc047f9beb2ed7e1492acfe" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:14.974581 1055 raft_consensus.cc:3060] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:14.974784 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb3a5b66dc3a4963b7828b4a3f004534 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:14.966012 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 966) took 4547 ms. Trace:
I20260616 19:52:14.966296 2297 consensus_queue.cc:1048] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:14.975035 1190 rpcz_store.cc:276] 0616 19:52:10.418186 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.639827 (+221641us) service_pool.cc:224] Handling call
0616 19:52:14.579687 (+3939860us) ts_tablet_manager.cc:1151] Deleting tablet afc58b2bda2a43f18f157469b591854b
0616 19:52:14.579696 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.750564 (+170868us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.947485 (+196921us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.965998 (+ 18513us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3626827}
I20260616 19:52:14.975432 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 967) took 4557 ms. Trace:
I20260616 19:52:14.975497 1190 rpcz_store.cc:276] 0616 19:52:10.418253 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:10.640275 (+222022us) service_pool.cc:224] Handling call
0616 19:52:14.975315 (+4335040us) ts_tablet_manager.cc:1151] Deleting tablet de16c3feb7374077bc9817c703e5127c
0616 19:52:14.975324 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.975416 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4022392}
I20260616 19:52:14.975778 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 980) took 3948 ms. Trace:
I20260616 19:52:14.975832 1190 rpcz_store.cc:276] 0616 19:52:11.027156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.027229 (+ 73us) service_pool.cc:224] Handling call
0616 19:52:14.975695 (+3948466us) ts_tablet_manager.cc:1151] Deleting tablet 0b249e29f69943f287411783b84c6817
0616 19:52:14.975703 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.975766 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3945297}
I20260616 19:52:14.976019 1190 tablet_replica.cc:333] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:14.976217 1190 raft_consensus.cc:2243] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:14.978930 1190 pending_rounds.cc:70] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:52:14.979276 1190 pending_rounds.cc:77] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595521981517824 op_type: NO_OP noop_request { }
I20260616 19:52:14.979511 1190 raft_consensus.cc:2889] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:14.979616 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet afc58b2bda2a43f18f157469b591854b (table default.Table_24447e65692d452a82a5ef91bdc6ab4f [id=9c655609a0ef47a2b4fb050ad8dab9d7]) successfully deleted
W20260616 19:52:14.979848 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet de16c3feb7374077bc9817c703e5127c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de16c3feb7374077bc9817c703e5127c already in progress: creating tablet
W20260616 19:52:14.979985 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 0b249e29f69943f287411783b84c6817 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b249e29f69943f287411783b84c6817 already in progress: creating tablet
I20260616 19:52:14.980269 1190 raft_consensus.cc:2272] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.980971 1190 ts_tablet_manager.cc:1916] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:14.973109 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239a24dbdc047f9beb2ed7e1492acfe" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:14.982457 780 raft_consensus.cc:3060] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:14.981576 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1075) took 1337 ms. Trace:
I20260616 19:52:14.984301 1193 rpcz_store.cc:276] 0616 19:52:13.644441 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.644535 (+ 94us) service_pool.cc:224] Handling call
0616 19:52:14.660093 (+1015558us) ts_tablet_manager.cc:1151] Deleting tablet 7dc92bc15da14504a1ff5feda5aff7cf
0616 19:52:14.660101 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.745933 (+ 85832us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.896710 (+150777us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.981550 (+ 84840us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1015380}
I20260616 19:52:14.984781 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 7dc92bc15da14504a1ff5feda5aff7cf (table default.Table_6955250583bf4c3cbff20316dfa5d1a7 [id=8c7791625cfd4d39ad0dff83be1c7089]) successfully deleted
I20260616 19:52:14.984944 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1074) took 1340 ms. Trace:
I20260616 19:52:14.985028 1193 rpcz_store.cc:276] 0616 19:52:13.644359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.644646 (+ 287us) service_pool.cc:224] Handling call
0616 19:52:14.984820 (+1340174us) ts_tablet_manager.cc:1151] Deleting tablet 3d44aed473e44e2eaa0d166f164c9309
0616 19:52:14.984830 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.984927 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1340019}
W20260616 19:52:14.985424 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 3d44aed473e44e2eaa0d166f164c9309 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d44aed473e44e2eaa0d166f164c9309 already in progress: creating tablet
I20260616 19:52:14.986909 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1077) took 1341 ms. Trace:
I20260616 19:52:14.987015 1193 rpcz_store.cc:276] 0616 19:52:13.645257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.645327 (+ 70us) service_pool.cc:224] Handling call
0616 19:52:14.986803 (+1341476us) ts_tablet_manager.cc:1151] Deleting tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c
0616 19:52:14.986813 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.986893 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1341301}
W20260616 19:52:14.987421 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c already in progress: creating tablet
I20260616 19:52:14.987803 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1076) took 1342 ms. Trace:
I20260616 19:52:14.987912 1193 rpcz_store.cc:276] 0616 19:52:13.645182 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.645363 (+ 181us) service_pool.cc:224] Handling call
0616 19:52:14.987705 (+1342342us) ts_tablet_manager.cc:1151] Deleting tablet d1e3778611a24397a1a776be2cc76284
0616 19:52:14.987715 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.987787 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1342197}
W20260616 19:52:14.988334 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d1e3778611a24397a1a776be2cc76284 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1e3778611a24397a1a776be2cc76284 already in progress: creating tablet
I20260616 19:52:14.988690 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1078) took 1343 ms. Trace:
I20260616 19:52:14.988793 1193 rpcz_store.cc:276] 0616 19:52:13.645328 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.647904 (+ 2576us) service_pool.cc:224] Handling call
0616 19:52:14.988601 (+1340697us) ts_tablet_manager.cc:1151] Deleting tablet 1d9d5b9b81694258accdb0d18ae094de
0616 19:52:14.988609 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.988675 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1340533}
W20260616 19:52:14.989200 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1d9d5b9b81694258accdb0d18ae094de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d9d5b9b81694258accdb0d18ae094de already in progress: creating tablet
I20260616 19:52:14.989604 1193 tablet_replica.cc:333] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:14.989817 1193 raft_consensus.cc:2243] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:14.990100 1193 pending_rounds.cc:70] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:14.990196 1193 pending_rounds.cc:77] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595530755072000 op_type: NO_OP noop_request { }
I20260616 19:52:14.990324 1193 raft_consensus.cc:2889] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:14.990435 1193 raft_consensus.cc:2272] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:14.991207 1193 ts_tablet_manager.cc:1916] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:14.999297 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 869c51a0cda04e9dbe3b5597f844f4a6 (table default.Table_c82ec79589b348c98b547e71862d6280 [id=a0f03f89bec647268f90cb43c150bd4a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 869c51a0cda04e9dbe3b5597f844f4a6 has no consensus state
I20260616 19:52:15.003822 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f5c46a428ff44d26a5c49322087cdf7a
I20260616 19:52:15.004637 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f5c46a428ff44d26a5c49322087cdf7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:15.005686 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet f5c46a428ff44d26a5c49322087cdf7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:15.005637 898 tablet_service.cc:1558] Processing DeleteTablet for tablet f5c46a428ff44d26a5c49322087cdf7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:15.019002 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d97ff7c321c94095b345b04eda72d78e" } new_table_name: "default.Table_58006924fee94c2793516ba75c6297d6" modify_external_catalogs: true
I20260616 19:52:15.029364 1198 tablet_bootstrap.cc:492] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:15.030105 1198 ts_tablet_manager.cc:1403] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.095s user 0.020s sys 0.000s
I20260616 19:52:15.031055 1198 raft_consensus.cc:359] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.032114 1198 raft_consensus.cc:385] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.032364 1198 raft_consensus.cc:740] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.032850 1198 consensus_queue.cc:260] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.036374 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3ea40ffcc904453a9d49c71e251e88ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:15.037047 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ea40ffcc904453a9d49c71e251e88ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:15.043342 1198 ts_tablet_manager.cc:1434] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
W20260616 19:52:15.051349 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 733f956d45d84506bfb666832a9aaedf consensus state has no leader
I20260616 19:52:15.058463 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_95277d9a3185463f83d0690136dfa391"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:15.059041 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95277d9a3185463f83d0690136dfa391 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:15.065579 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1026) took 3075 ms. Trace:
I20260616 19:52:15.066084 780 raft_consensus.cc:2468] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:15.068727 1190 ts_tablet_manager.cc:1929] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:15.068806 1190 log.cc:1199] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/e91c377ae66441268351cd3592aa9dbc
I20260616 19:52:15.069113 1190 ts_tablet_manager.cc:1950] T e91c377ae66441268351cd3592aa9dbc P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:15.070359 1055 raft_consensus.cc:2468] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:15.070940 858 leader_election.cc:304] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:15.065706 1191 rpcz_store.cc:276] 0616 19:52:11.990038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.990088 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:14.796168 (+2806080us) ts_tablet_manager.cc:1151] Deleting tablet 8a718fefe07141119b7ef7edcbf61123
0616 19:52:14.796180 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:14.850626 (+ 54446us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x616000184c54. stack: 00007f92671a0086 00007f926719fe40 00007f92661593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f92731d47e0 00007f9274520933 00007f92770e3ae7 00007f9277116bb4 00007f92770f75d0 00007f92770f735d 0000000000aa681c 00007f92671e5f6f 00007f92671e928b 00007f92671e9108
0616 19:52:14.944649 (+ 94023us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:14.970259 (+ 25610us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.065556 (+ 95297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123885824,"tablet-delete.queue_time_us":2805906}
I20260616 19:52:15.071365 1191 tablet_replica.cc:333] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:15.071446 1192 tablet_bootstrap.cc:492] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:15.071543 1192 ts_tablet_manager.cc:1403] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.110s user 0.002s sys 0.013s
I20260616 19:52:15.071606 1191 raft_consensus.cc:2243] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:15.071779 1191 raft_consensus.cc:2272] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:15.072129 1192 raft_consensus.cc:359] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.072284 1192 raft_consensus.cc:385] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.072325 1192 raft_consensus.cc:740] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.072383 1191 ts_tablet_manager.cc:1916] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:15.072525 1192 consensus_queue.cc:260] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.072950 1192 ts_tablet_manager.cc:1434] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
W20260616 19:52:15.074450 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c6add7925294880a5a20eb3d189d1ee consensus state has no leader
I20260616 19:52:15.075978 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 8a718fefe07141119b7ef7edcbf61123 (table default.Table_db902752da5f4f3ab65c0b21c57d34a9 [id=347e25a5fa42418fa9952ed1e6bf9c03]) successfully deleted
I20260616 19:52:15.076046 2559 raft_consensus.cc:2804] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:15.076154 2559 raft_consensus.cc:697] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:15.076399 2559 consensus_queue.cc:237] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.076934 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bcab4a4c76834c019a078e7bb73a6af5" } modify_external_catalogs: true
I20260616 19:52:15.077077 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bcab4a4c76834c019a078e7bb73a6af5" } modify_external_catalogs: true
I20260616 19:52:15.079344 1192 tablet_bootstrap.cc:492] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:15.086515 1192 tablet_bootstrap.cc:654] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.088064 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_88539f40d59d4e51ac2000dd59eee749" } new_table_name: "default.Table_4caa0f5a7db1472db6b0c1f053454557" modify_external_catalogs: true
I20260616 19:52:15.089505 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1932c06b086a4a5999bd9df382ca4e09" } modify_external_catalogs: true
I20260616 19:52:15.089726 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1932c06b086a4a5999bd9df382ca4e09" } modify_external_catalogs: true
W20260616 19:52:15.089623 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be76abf48f9844b8945cf0d2f642fddd has no consensus state
I20260616 19:52:15.090756 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_323f0e585ad6419a8a9221edf79f8716"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:15.091482 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_323f0e585ad6419a8a9221edf79f8716 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:15.095713 780 raft_consensus.cc:3060] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.101352 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 982) took 4008 ms. Trace:
I20260616 19:52:15.101473 1190 rpcz_store.cc:276] 0616 19:52:11.093099 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.093153 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:14.975985 (+3882832us) ts_tablet_manager.cc:1151] Deleting tablet e91c377ae66441268351cd3592aa9dbc
0616 19:52:14.975991 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.066080 (+ 90089us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.068684 (+ 2604us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.101322 (+ 32638us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3882561}
I20260616 19:52:15.101859 1190 tablet_replica.cc:333] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:15.102012 1192 tablet_bootstrap.cc:492] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:15.102099 1190 raft_consensus.cc:2243] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:15.102279 1190 raft_consensus.cc:2272] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:15.102502 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet e91c377ae66441268351cd3592aa9dbc (table default.Table_44015174890646ee876b8d08923fc342 [id=0bc90fd55c8e4d5b8ac18717e00cea54]) successfully deleted
I20260616 19:52:15.102807 1190 ts_tablet_manager.cc:1916] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:15.105983 1196 tablet_bootstrap.cc:492] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:15.102279 1192 ts_tablet_manager.cc:1403] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.005s
I20260616 19:52:15.107563 1192 raft_consensus.cc:359] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.107776 1192 raft_consensus.cc:385] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.108830 1192 raft_consensus.cc:740] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.109090 1192 consensus_queue.cc:260] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.109760 1192 ts_tablet_manager.cc:1434] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260616 19:52:15.110091 1192 tablet_bootstrap.cc:492] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:15.111771 1192 tablet_bootstrap.cc:654] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.106101 1196 ts_tablet_manager.cc:1403] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.182s user 0.003s sys 0.002s
I20260616 19:52:15.117342 1196 raft_consensus.cc:359] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.117623 1196 raft_consensus.cc:385] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.117745 1196 raft_consensus.cc:740] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.118029 1196 consensus_queue.cc:260] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.123586 1192 tablet_bootstrap.cc:492] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:15.123785 1192 ts_tablet_manager.cc:1403] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.001s
I20260616 19:52:15.124574 1192 raft_consensus.cc:359] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.124806 1192 raft_consensus.cc:385] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.124897 1192 raft_consensus.cc:740] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.125164 1192 consensus_queue.cc:260] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.125679 1192 ts_tablet_manager.cc:1434] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:15.126245 1192 tablet_bootstrap.cc:492] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:15.128114 1192 tablet_bootstrap.cc:654] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.139112 1196 ts_tablet_manager.cc:1434] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260616 19:52:15.140800 2559 raft_consensus.cc:493] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.141023 2559 raft_consensus.cc:515] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.142285 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c89216995430188b1eed4c6b26d1e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:15.142498 775 raft_consensus.cc:2468] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:15.142555 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c89216995430188b1eed4c6b26d1e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:15.142755 1055 raft_consensus.cc:2468] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:15.143144 858 leader_election.cc:304] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:15.143381 2297 raft_consensus.cc:2804] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:15.143453 2297 raft_consensus.cc:493] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:15.143507 2297 raft_consensus.cc:3060] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.143858 1196 tablet_bootstrap.cc:492] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:15.145977 2559 leader_election.cc:290] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:15.146540 1198 tablet_bootstrap.cc:492] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:15.147960 1198 tablet_bootstrap.cc:654] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.151865 455 master_service.cc:960] ReplaceTablet: received request to replace tablet b1771a4ed9d649558fed580992af1f96 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:15.152395 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e81c554664ed46b5b0abee87fa9b8e32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:15.153165 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d9c89216995430188b1eed4c6b26d1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:15.158159 1198 tablet_bootstrap.cc:492] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:15.158382 1198 ts_tablet_manager.cc:1403] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20260616 19:52:15.159322 1198 raft_consensus.cc:359] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.159578 1198 raft_consensus.cc:385] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.159683 1198 raft_consensus.cc:740] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.160005 1198 consensus_queue.cc:260] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.172658 2297 raft_consensus.cc:515] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.173338 2297 leader_election.cc:290] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:15.174968 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59dbf72f58d74c269eed40e480d869ec consensus state has no leader
W20260616 19:52:15.175762 858 consensus_peers.cc:597] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6939d108a7948bb9e56311a34d95486. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:15.176200 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c89216995430188b1eed4c6b26d1e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:15.176416 775 raft_consensus.cc:3060] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.176563 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c89216995430188b1eed4c6b26d1e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:15.176842 1055 raft_consensus.cc:3060] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.177824 1198 ts_tablet_manager.cc:1434] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
W20260616 19:52:15.180112 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e81c554664ed46b5b0abee87fa9b8e32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:15.180445 1192 tablet_bootstrap.cc:492] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:15.180598 1192 ts_tablet_manager.cc:1403] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.054s user 0.009s sys 0.015s
I20260616 19:52:15.181397 1192 raft_consensus.cc:359] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.181565 1192 raft_consensus.cc:385] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.181628 1192 raft_consensus.cc:740] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.181849 1192 consensus_queue.cc:260] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.182330 1192 ts_tablet_manager.cc:1434] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:52:15.182605 1192 tablet_bootstrap.cc:492] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:15.184073 1198 tablet_bootstrap.cc:492] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:15.185349 1198 tablet_bootstrap.cc:654] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.187522 1196 tablet_bootstrap.cc:654] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.190817 1198 tablet_bootstrap.cc:492] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:15.191000 1198 ts_tablet_manager.cc:1403] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260616 19:52:15.191669 1198 raft_consensus.cc:359] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.191881 1198 raft_consensus.cc:385] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.191987 1198 raft_consensus.cc:740] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.192245 1198 consensus_queue.cc:260] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.204618 1198 ts_tablet_manager.cc:1434] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.014s user 0.000s sys 0.001s
I20260616 19:52:15.209748 1192 tablet_bootstrap.cc:654] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.210263 2287 raft_consensus.cc:493] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.210393 2287 raft_consensus.cc:515] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.210922 2287 leader_election.cc:290] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:15.212109 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1e12555be64192860eab59b3aeb562" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:15.212668 996 leader_election.cc:343] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.213042 2297 raft_consensus.cc:493] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.213130 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1e12555be64192860eab59b3aeb562" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:15.213166 2297 raft_consensus.cc:515] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:15.213706 2297 leader_election.cc:290] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:15.213989 993 leader_election.cc:343] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.214087 993 leader_election.cc:304] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:15.214735 2287 raft_consensus.cc:2749] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:15.215441 860 leader_election.cc:343] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 64aa32856ca34743933931fb51f2bd7b
I20260616 19:52:15.215688 2297 consensus_queue.cc:1048] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:15.216922 858 leader_election.cc:343] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 64aa32856ca34743933931fb51f2bd7b
I20260616 19:52:15.216910 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4d61e1aedb0e4aa1ac42880ed2ed5ab8" } new_table_name: "default.Table_6dbb237ba04f42998b1557760ce6f8c3" modify_external_catalogs: true
I20260616 19:52:15.217011 858 leader_election.cc:304] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:15.220642 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:15.221011 2297 raft_consensus.cc:2749] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260616 19:52:15.229189 858 consensus_peers.cc:597] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:15.236120 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c90d49c02db04fe19f8797c4dfa190a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:15.238121 1198 tablet_bootstrap.cc:492] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:52:15.242931 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a889853940f2445aa808904c14a883e8 has no consensus state
I20260616 19:52:15.241962 1198 tablet_bootstrap.cc:654] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.244094 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f2dbfc9d56f34516a9c5c940d1affa8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:15.250413 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2dbfc9d56f34516a9c5c940d1affa8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:15.256886 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 9f1940f3d73d472c9c68a10539848e9d from {username='slave'} at 127.0.0.1:41696
W20260616 19:52:15.257051 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c90d49c02db04fe19f8797c4dfa190a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:15.257339 1192 tablet_bootstrap.cc:492] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:15.257504 1192 ts_tablet_manager.cc:1403] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.075s user 0.004s sys 0.005s
I20260616 19:52:15.259181 1192 raft_consensus.cc:359] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.259418 1192 raft_consensus.cc:385] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.259493 1192 raft_consensus.cc:740] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.260696 1192 consensus_queue.cc:260] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.264235 1192 ts_tablet_manager.cc:1434] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260616 19:52:15.272385 1191 ts_tablet_manager.cc:1929] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:15.272538 1191 log.cc:1199] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/e6530753b4184cfe972ae3a43f23d589
I20260616 19:52:15.272858 1191 ts_tablet_manager.cc:1950] T e6530753b4184cfe972ae3a43f23d589 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:15.273141 1190 ts_tablet_manager.cc:1929] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:15.273244 1190 log.cc:1199] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/fbb308b05bb04bc18ccaa9550a73d3e7
I20260616 19:52:15.273541 1190 ts_tablet_manager.cc:1950] T fbb308b05bb04bc18ccaa9550a73d3e7 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:15.273873 1055 raft_consensus.cc:2468] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:15.274310 775 raft_consensus.cc:2468] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:15.274772 1193 ts_tablet_manager.cc:1929] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:15.274905 1193 log.cc:1199] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/90205213ba5f49a2931e68839cefb2d2
I20260616 19:52:15.274858 860 leader_election.cc:304] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:15.275143 2559 raft_consensus.cc:2804] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:15.275247 1193 ts_tablet_manager.cc:1950] T 90205213ba5f49a2931e68839cefb2d2 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:15.275254 2559 raft_consensus.cc:697] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:15.275467 2559 consensus_queue.cc:237] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.276129 1192 tablet_bootstrap.cc:492] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:15.277980 1192 tablet_bootstrap.cc:654] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.279548 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c127220d3313482bafdf2f278d3d815f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:15.290307 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_00b803667bdf48af929af230c36f05b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:15.291594 1192 tablet_bootstrap.cc:492] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:15.291742 1192 ts_tablet_manager.cc:1403] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.004s
I20260616 19:52:15.292610 1192 raft_consensus.cc:359] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.292790 1192 raft_consensus.cc:385] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.292858 1192 raft_consensus.cc:740] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.293517 1192 consensus_queue.cc:260] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.294521 1192 ts_tablet_manager.cc:1434] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:15.294811 1192 tablet_bootstrap.cc:492] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:15.296973 1192 tablet_bootstrap.cc:654] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:15.298866 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00b803667bdf48af929af230c36f05b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:15.298897 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c127220d3313482bafdf2f278d3d815f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:15.308791 2555 consensus_queue.cc:1048] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:15.309341 1196 tablet_bootstrap.cc:492] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:15.310592 1192 tablet_bootstrap.cc:492] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:15.310717 1192 ts_tablet_manager.cc:1403] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20260616 19:52:15.311401 1192 raft_consensus.cc:359] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.311565 1192 raft_consensus.cc:385] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.311627 1192 raft_consensus.cc:740] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.317589 1192 consensus_queue.cc:260] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.317996 1196 ts_tablet_manager.cc:1403] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.174s user 0.002s sys 0.001s
I20260616 19:52:15.318379 2560 raft_consensus.cc:493] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.318495 2560 raft_consensus.cc:515] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.319101 2560 leader_election.cc:290] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:15.319283 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4cabb1304dc14288988fe837d088cc27" } modify_external_catalogs: true
I20260616 19:52:15.319447 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4cabb1304dc14288988fe837d088cc27" } modify_external_catalogs: true
I20260616 19:52:15.321177 1192 ts_tablet_manager.cc:1434] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260616 19:52:15.321357 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1696a3c9f24001a4aaf99725f73f62" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:15.321466 1192 tablet_bootstrap.cc:492] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:15.321556 1055 raft_consensus.cc:2468] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:15.321959 858 leader_election.cc:304] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:15.322623 2297 raft_consensus.cc:2804] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:15.322722 2297 raft_consensus.cc:493] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:15.322803 2297 raft_consensus.cc:3060] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.325383 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1696a3c9f24001a4aaf99725f73f62" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:15.325910 860 leader_election.cc:343] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.328079 1192 tablet_bootstrap.cc:654] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.335810 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9b188e63a36744d999a6225688f78a2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:15.335996 1198 tablet_bootstrap.cc:492] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:15.336155 1198 ts_tablet_manager.cc:1403] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.098s user 0.009s sys 0.024s
I20260616 19:52:15.336956 1198 raft_consensus.cc:359] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.337121 1198 raft_consensus.cc:385] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.337193 1198 raft_consensus.cc:740] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.337433 1198 consensus_queue.cc:260] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:15.340305 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b188e63a36744d999a6225688f78a2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:15.344781 1196 raft_consensus.cc:359] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.348546 1196 raft_consensus.cc:385] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.348742 1196 raft_consensus.cc:740] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.349244 1198 ts_tablet_manager.cc:1434] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260616 19:52:15.349985 1196 consensus_queue.cc:260] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.351454 2559 raft_consensus.cc:493] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.351589 2559 raft_consensus.cc:515] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.352166 2559 leader_election.cc:290] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:15.352762 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe373c3bb094972b0e17fcb1587987a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:15.352869 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe373c3bb094972b0e17fcb1587987a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:15.353036 1055 raft_consensus.cc:2468] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:15.353441 858 leader_election.cc:304] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:15.353695 2559 raft_consensus.cc:2804] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:15.353762 2559 raft_consensus.cc:493] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:15.353822 2559 raft_consensus.cc:3060] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.357226 1196 ts_tablet_manager.cc:1434] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.039s user 0.002s sys 0.000s
I20260616 19:52:15.361421 1196 tablet_bootstrap.cc:492] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:15.366524 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 981) took 4273 ms. Trace:
I20260616 19:52:15.366626 1190 rpcz_store.cc:276] 0616 19:52:11.092985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.093471 (+ 486us) service_pool.cc:224] Handling call
0616 19:52:15.101798 (+4008327us) ts_tablet_manager.cc:1151] Deleting tablet fbb308b05bb04bc18ccaa9550a73d3e7
0616 19:52:15.101810 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.170566 (+ 68756us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.273084 (+102518us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.366503 (+ 93419us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4008123}
I20260616 19:52:15.367954 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 997) took 3807 ms. Trace:
I20260616 19:52:15.368031 1190 rpcz_store.cc:276] 0616 19:52:11.560516 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.560924 (+ 408us) service_pool.cc:224] Handling call
0616 19:52:15.367825 (+3806901us) ts_tablet_manager.cc:1151] Deleting tablet aa989f24b81b4c148069d1d8176dad8b
0616 19:52:15.367835 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.367934 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3806734}
I20260616 19:52:15.368372 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 999) took 3807 ms. Trace:
I20260616 19:52:15.369199 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1080) took 1606 ms. Trace:
I20260616 19:52:15.369313 1198 tablet_bootstrap.cc:492] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:15.369278 1193 rpcz_store.cc:276] 0616 19:52:13.762459 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.762511 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:14.989438 (+1226927us) ts_tablet_manager.cc:1151] Deleting tablet 90205213ba5f49a2931e68839cefb2d2
0616 19:52:14.989446 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.223310 (+233864us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.274711 (+ 51401us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.369175 (+ 94464us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1169738}
I20260616 19:52:15.369616 1193 tablet_replica.cc:333] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:15.369822 1193 raft_consensus.cc:2243] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:15.369980 1193 raft_consensus.cc:2272] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:15.370339 2297 raft_consensus.cc:515] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.370940 2297 leader_election.cc:290] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:15.372092 1192 tablet_bootstrap.cc:492] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:15.372227 2287 raft_consensus.cc:493] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.372350 2287 raft_consensus.cc:515] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.372762 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet fbb308b05bb04bc18ccaa9550a73d3e7 (table default.Table_fae6d52794914f15a61ce5057c2d51b5 [id=4ac9b907f9cf42478b9591bce31ccbcb]) successfully deleted
I20260616 19:52:15.372841 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1027) took 3370 ms. Trace:
W20260616 19:52:15.372997 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet aa989f24b81b4c148069d1d8176dad8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa989f24b81b4c148069d1d8176dad8b already in progress: creating tablet
I20260616 19:52:15.372910 1191 rpcz_store.cc:276] 0616 19:52:12.002186 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.002258 (+ 72us) service_pool.cc:224] Handling call
0616 19:52:15.071304 (+3069046us) ts_tablet_manager.cc:1151] Deleting tablet e6530753b4184cfe972ae3a43f23d589
0616 19:52:15.071317 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.169500 (+ 98183us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.272305 (+102805us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.372821 (+100516us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3068859}
I20260616 19:52:15.373152 2287 leader_election.cc:290] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:15.373276 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1028) took 3263 ms. Trace:
I20260616 19:52:15.373345 1191 rpcz_store.cc:276] 0616 19:52:12.110048 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.110252 (+ 204us) service_pool.cc:224] Handling call
0616 19:52:15.373143 (+3262891us) ts_tablet_manager.cc:1151] Deleting tablet cf1ab0a125cf46e9a1afc625297db7af
0616 19:52:15.373153 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.373259 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3262704}
I20260616 19:52:15.373483 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1696a3c9f24001a4aaf99725f73f62" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:15.373621 1055 raft_consensus.cc:3060] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.373652 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1029) took 3263 ms. Trace:
I20260616 19:52:15.373627 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1696a3c9f24001a4aaf99725f73f62" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:15.373723 1191 rpcz_store.cc:276] 0616 19:52:12.110188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.112481 (+ 2293us) service_pool.cc:224] Handling call
0616 19:52:15.373560 (+3261079us) ts_tablet_manager.cc:1151] Deleting tablet adf5010b9025406bb1da70e6875213c6
0616 19:52:15.373568 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.373636 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3260901}
I20260616 19:52:15.373997 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1030) took 3259 ms. Trace:
I20260616 19:52:15.374048 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet e6530753b4184cfe972ae3a43f23d589 (table default.Table_f05f097bf69a4898afcc750f4aa55d7f [id=99e870e6f821406bb65af1f96f5ad30f]) successfully deleted
I20260616 19:52:15.374068 1191 rpcz_store.cc:276] 0616 19:52:12.114310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.114673 (+ 363us) service_pool.cc:224] Handling call
0616 19:52:15.373911 (+3259238us) ts_tablet_manager.cc:1151] Deleting tablet 6c9066a57e784356aa27cfcac75c3bd2
0616 19:52:15.373919 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.373983 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3259098}
W20260616 19:52:15.374289 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet cf1ab0a125cf46e9a1afc625297db7af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf1ab0a125cf46e9a1afc625297db7af already in progress: creating tablet
I20260616 19:52:15.374325 1191 tablet_replica.cc:333] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:15.374363 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ac7715ebf36342b1adc93cb3bceaed4c" } new_table_name: "default.Table_75c27ca6a3694b52bc0fcca1ab38b143" modify_external_catalogs: true
W20260616 19:52:15.374475 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet adf5010b9025406bb1da70e6875213c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adf5010b9025406bb1da70e6875213c6 already in progress: creating tablet
I20260616 19:52:15.374492 1191 raft_consensus.cc:2243] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:15.374621 1191 raft_consensus.cc:2272] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:15.374783 860 leader_election.cc:343] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.374837 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8b9d6b95a74dbe97461b4bc9984fe3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:15.375126 1191 ts_tablet_manager.cc:1916] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:15.376258 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 90205213ba5f49a2931e68839cefb2d2 (table default.Table_3fde6faf0f8549f69328d3129ad9f367 [id=e43abc84d7e146e591d10768c8f146e1]) successfully deleted
I20260616 19:52:15.376533 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8b9d6b95a74dbe97461b4bc9984fe3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:15.376932 996 leader_election.cc:343] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.377298 1193 ts_tablet_manager.cc:1916] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:15.377943 1192 ts_tablet_manager.cc:1403] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.003s
W20260616 19:52:15.378811 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 6c9066a57e784356aa27cfcac75c3bd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c9066a57e784356aa27cfcac75c3bd2 already in progress: creating tablet
I20260616 19:52:15.378741 1192 raft_consensus.cc:359] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:15.378898 1192 raft_consensus.cc:385] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.378952 1192 raft_consensus.cc:740] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.368443 1190 rpcz_store.cc:276] 0616 19:52:11.560744 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.561125 (+ 381us) service_pool.cc:224] Handling call
0616 19:52:15.368270 (+3807145us) ts_tablet_manager.cc:1151] Deleting tablet df1ee0d1e1514c86802cdce5ae0756eb
0616 19:52:15.368280 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.368357 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3806987}
I20260616 19:52:15.380555 1190 tablet_replica.cc:333] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:15.380756 1190 raft_consensus.cc:2243] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:15.381021 1190 raft_consensus.cc:2272] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:15.378597 993 leader_election.cc:343] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.381860 993 leader_election.cc:304] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:15.382578 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet df1ee0d1e1514c86802cdce5ae0756eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df1ee0d1e1514c86802cdce5ae0756eb already in progress: creating tablet
W20260616 19:52:15.382772 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4cbbc95ca5f24d1381f3d1b18c89a6bf has no consensus state
I20260616 19:52:15.382964 1198 tablet_bootstrap.cc:654] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.383188 1196 tablet_bootstrap.cc:654] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.386035 2287 raft_consensus.cc:2749] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:15.386879 1192 consensus_queue.cc:260] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:15.387427 1190 ts_tablet_manager.cc:1916] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:15.387497 1192 ts_tablet_manager.cc:1434] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260616 19:52:15.393083 1192 tablet_bootstrap.cc:492] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:52:15.393504 860 leader_election.cc:343] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.396543 1192 tablet_bootstrap.cc:654] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.401707 1196 tablet_bootstrap.cc:492] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:15.403419 1196 ts_tablet_manager.cc:1403] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.001s
I20260616 19:52:15.406077 1196 raft_consensus.cc:359] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.406561 1196 raft_consensus.cc:385] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.406677 1196 raft_consensus.cc:740] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.408540 2287 raft_consensus.cc:493] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.408674 2287 raft_consensus.cc:515] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:15.409322 2287 leader_election.cc:290] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:15.410066 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c74b39e66d344b99f8fc75b855c0520" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:15.410607 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c74b39e66d344b99f8fc75b855c0520" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:15.411131 996 leader_election.cc:343] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:15.411566 993 leader_election.cc:343] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.411653 993 leader_election.cc:304] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:15.412089 2287 raft_consensus.cc:2749] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:15.414868 456 catalog_manager.cc:5696] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:15.415241 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 84ce7bf3e0004ffaa2c5e314fa69322c (table default.Table_4f1675b0cae24ecea8b9f4efebb44772 [id=4f2b128cff5248f98e3506bb72a39391]). Expected version 3 got 0
I20260616 19:52:15.417229 461 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
I20260616 19:52:15.418620 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_be7daca5af8f4b14b93e1f45984f985f" } new_table_name: "default.Table_f589c17bc07e4ae8857722996d572ad8" modify_external_catalogs: true
I20260616 19:52:15.420689 889 tablet_service.cc:1511] Processing CreateTablet for tablet b85c6c37a1014000b617d072bba1bdc2 (DEFAULT_TABLE table=default.Table_3b235f0a3ad24b69b3c56069ff59e4dc [id=b2edb4d8b1354a86b3cdcf4f8be79dfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.420935 898 tablet_service.cc:1511] Processing CreateTablet for tablet 6f55bafac7924ba28feb92839909aac9 (DEFAULT_TABLE table=default.Table_b85d7fd26e434183950acc63c19296b9 [id=822d91830b6542ea9c3b83bd518acb24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.421169 1192 tablet_bootstrap.cc:492] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:15.421308 1192 ts_tablet_manager.cc:1403] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.003s
I20260616 19:52:15.422014 1192 raft_consensus.cc:359] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.422176 1192 raft_consensus.cc:385] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.422237 1192 raft_consensus.cc:740] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.422467 1192 consensus_queue.cc:260] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.423362 758 tablet_service.cc:1511] Processing CreateTablet for tablet 6f55bafac7924ba28feb92839909aac9 (DEFAULT_TABLE table=default.Table_b85d7fd26e434183950acc63c19296b9 [id=822d91830b6542ea9c3b83bd518acb24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.423832 751 tablet_service.cc:1511] Processing CreateTablet for tablet b85c6c37a1014000b617d072bba1bdc2 (DEFAULT_TABLE table=default.Table_3b235f0a3ad24b69b3c56069ff59e4dc [id=b2edb4d8b1354a86b3cdcf4f8be79dfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.424233 759 tablet_service.cc:1511] Processing CreateTablet for tablet 290d1bf172f949089e013d24ec64435d (DEFAULT_TABLE table=default.Table_3f91f4dd18b54a2e88100598a7741ae3 [id=9da43e2eb29a42b998beaf7dc1e78f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.424638 747 tablet_service.cc:1511] Processing CreateTablet for tablet d84f659c29914d318686f26f4b9fdf94 (DEFAULT_TABLE table=default.Table_9a0a6711ab2a4c2abb2f08bfc900e22c [id=6dfd5530f3524aa88bf515c8604ffdff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.425009 765 tablet_service.cc:1511] Processing CreateTablet for tablet 503e6289258046f79532ef7b97d4a1c3 (DEFAULT_TABLE table=default.Table_2a181d074c994f10a48ed0651ec560f6 [id=34d0a3551909467db12c6f8960401dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.425583 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0c281b936f2147b9989f03a3e1b6884e
I20260616 19:52:15.426272 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a718fefe07141119b7ef7edcbf61123 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:15.426491 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c74b39e66d344b99f8fc75b855c0520 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:15.426431 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 503e6289258046f79532ef7b97d4a1c3 (DEFAULT_TABLE table=default.Table_2a181d074c994f10a48ed0651ec560f6 [id=34d0a3551909467db12c6f8960401dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.426776 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 6f55bafac7924ba28feb92839909aac9 (DEFAULT_TABLE table=default.Table_b85d7fd26e434183950acc63c19296b9 [id=822d91830b6542ea9c3b83bd518acb24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.427207 1029 tablet_service.cc:1511] Processing CreateTablet for tablet b85c6c37a1014000b617d072bba1bdc2 (DEFAULT_TABLE table=default.Table_3b235f0a3ad24b69b3c56069ff59e4dc [id=b2edb4d8b1354a86b3cdcf4f8be79dfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.427618 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 290d1bf172f949089e013d24ec64435d (DEFAULT_TABLE table=default.Table_3f91f4dd18b54a2e88100598a7741ae3 [id=9da43e2eb29a42b998beaf7dc1e78f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.423488 1192 ts_tablet_manager.cc:1434] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:52:15.427996 1035 tablet_service.cc:1511] Processing CreateTablet for tablet d84f659c29914d318686f26f4b9fdf94 (DEFAULT_TABLE table=default.Table_9a0a6711ab2a4c2abb2f08bfc900e22c [id=6dfd5530f3524aa88bf515c8604ffdff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.429546 885 tablet_service.cc:1511] Processing CreateTablet for tablet 375c577934d04e41b31ed6ef90ff4fd4 (DEFAULT_TABLE table=default.Table_9d39b60e1f084549aae7eafe209b9a8c [id=d4ffd8643cce48fc847b7c65f57692d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.429929 887 tablet_service.cc:1511] Processing CreateTablet for tablet 8c00212468b4461589d5f341d7d6b0fe (DEFAULT_TABLE table=default.Table_aba0e849bdd049bf83f24ded8d4919c9 [id=f345a8f283294519b38a1b55e8d66d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.430011 903 tablet_service.cc:1511] Processing CreateTablet for tablet 290d1bf172f949089e013d24ec64435d (DEFAULT_TABLE table=default.Table_3f91f4dd18b54a2e88100598a7741ae3 [id=9da43e2eb29a42b998beaf7dc1e78f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.430226 891 tablet_service.cc:1511] Processing CreateTablet for tablet c2ca142f6cc84cc78e13cbf495ad6400 (DEFAULT_TABLE table=default.Table_58fcb5c4647344929d53cd74264f0cde [id=a91c39bd30114c629e9cdf38aa2a7ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.430428 902 tablet_service.cc:1511] Processing CreateTablet for tablet d84f659c29914d318686f26f4b9fdf94 (DEFAULT_TABLE table=default.Table_9a0a6711ab2a4c2abb2f08bfc900e22c [id=6dfd5530f3524aa88bf515c8604ffdff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.430486 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c281b936f2147b9989f03a3e1b6884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:15.430807 897 tablet_service.cc:1511] Processing CreateTablet for tablet cc7f6431067543b69688a574a55c433c (DEFAULT_TABLE table=default.Table_c7f4c8e2282640fb98ec05f8b719772a [id=4b546d4b5263485fb956dd007a87b5a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.431212 904 tablet_service.cc:1511] Processing CreateTablet for tablet f9e3e058b5c042039dfc7322f15e2979 (DEFAULT_TABLE table=default.Table_efa0c3da20a04fe7aa79633b5e4537c2 [id=52cea254aed249dea8f24caaed636f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.431531 2297 raft_consensus.cc:493] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.431640 2297 raft_consensus.cc:515] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.430819 890 tablet_service.cc:1511] Processing CreateTablet for tablet 503e6289258046f79532ef7b97d4a1c3 (DEFAULT_TABLE table=default.Table_2a181d074c994f10a48ed0651ec560f6 [id=34d0a3551909467db12c6f8960401dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.432225 2297 leader_election.cc:290] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:15.433151 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269c1dea941c481fb6fd2e4d59c877c0" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:15.433948 860 leader_election.cc:343] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.434727 1192 tablet_bootstrap.cc:492] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:15.434763 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269c1dea941c481fb6fd2e4d59c877c0" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:15.434971 1057 raft_consensus.cc:2468] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:15.437323 746 tablet_service.cc:1511] Processing CreateTablet for tablet f9e3e058b5c042039dfc7322f15e2979 (DEFAULT_TABLE table=default.Table_efa0c3da20a04fe7aa79633b5e4537c2 [id=52cea254aed249dea8f24caaed636f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.437496 754 tablet_service.cc:1511] Processing CreateTablet for tablet 267134453b214104967e80ec03480933 (DEFAULT_TABLE table=default.Table_09064f2784da477896e7e01c6581b826 [id=bedd8717e01e4c12922804581681b0e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.438215 749 tablet_service.cc:1511] Processing CreateTablet for tablet 375c577934d04e41b31ed6ef90ff4fd4 (DEFAULT_TABLE table=default.Table_9d39b60e1f084549aae7eafe209b9a8c [id=d4ffd8643cce48fc847b7c65f57692d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.438763 757 tablet_service.cc:1511] Processing CreateTablet for tablet c2ca142f6cc84cc78e13cbf495ad6400 (DEFAULT_TABLE table=default.Table_58fcb5c4647344929d53cd74264f0cde [id=a91c39bd30114c629e9cdf38aa2a7ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.439235 764 tablet_service.cc:1511] Processing CreateTablet for tablet 8c00212468b4461589d5f341d7d6b0fe (DEFAULT_TABLE table=default.Table_aba0e849bdd049bf83f24ded8d4919c9 [id=f345a8f283294519b38a1b55e8d66d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.439674 762 tablet_service.cc:1511] Processing CreateTablet for tablet bf8cd47ad89246fe8a7726aed35cf657 (DEFAULT_TABLE table=default.Table_e1ef4766e04c4030a2f1a81c5c761f0a [id=e531bb5a1a7642df9c2eb93e4e4901c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.440165 752 tablet_service.cc:1511] Processing CreateTablet for tablet 1276071ff0224382b2ffb4ade81d96f2 (DEFAULT_TABLE table=default.Table_65b8b2d0dc4e4a1b84fbeebb0af17087 [id=d7e17976adc94089a95e8d15fbdb5d0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.440625 761 tablet_service.cc:1511] Processing CreateTablet for tablet 82e6b4af46d0479c860c8a88f14d9bdc (DEFAULT_TABLE table=default.Table_bbe41b97de514a868fc05e0bb96895bc [id=6405118fa6f643ce94bdab69713b815d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.440850 755 tablet_service.cc:1511] Processing CreateTablet for tablet cc7f6431067543b69688a574a55c433c (DEFAULT_TABLE table=default.Table_c7f4c8e2282640fb98ec05f8b719772a [id=4b546d4b5263485fb956dd007a87b5a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.441016 763 tablet_service.cc:1511] Processing CreateTablet for tablet 54b1595a9cf343cc8c60ae5ef8615029 (DEFAULT_TABLE table=default.Table_1a78091a693742a28eef4e5ea7e4cb0d [id=d5ccdb66feea46f58ea8ec86c0796fd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.441263 748 tablet_service.cc:1511] Processing CreateTablet for tablet 04e36dc0843b438fa14a5c64e4f0d430 (DEFAULT_TABLE table=default.Table_9ebc1905db49466db1697dab76e8e7b2 [id=3e8d91b1df70488c88a1bb4c42f7e642]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.438213 753 tablet_service.cc:1511] Processing CreateTablet for tablet 50797706bd3a40099d64c292c32bf1f0 (DEFAULT_TABLE table=default.Table_b38a7f54b0584662954227bde2b75aeb [id=089bc577e3f14d10abaff39c002261f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.441634 760 tablet_service.cc:1511] Processing CreateTablet for tablet 0851460d14b64c4d91ab7318f982dba9 (DEFAULT_TABLE table=default.Table_8d6b895b77014dab9e9cbd601d9d9ac2 [id=6287d457716b4b84bc9efbb9d9fde03c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.442039 750 tablet_service.cc:1511] Processing CreateTablet for tablet 574de1bb197845f386d2cb070454f845 (DEFAULT_TABLE table=default.Table_4f6998bf4b4e4215a968b6a952754ff2 [id=9d8c7d2f1cce4792a91ad2c27dca4567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.440603 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c281b936f2147b9989f03a3e1b6884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:15.443181 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 0a9e8877705840329d6a063bb5194965
I20260616 19:52:15.443832 457 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:41696 (request call id 1416) took 1016 ms. Trace:
I20260616 19:52:15.443935 457 rpcz_store.cc:276] 0616 19:52:14.426995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.498393 (+ 71398us) service_pool.cc:224] Handling call
0616 19:52:14.499025 (+ 632us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0616 19:52:14.499148 (+ 123us) catalog_manager.cc:2840] Modifying in-memory table state
0616 19:52:14.499211 (+ 63us) catalog_manager.cc:2849] Locking tablets
0616 19:52:15.413126 (+913915us) catalog_manager.cc:2863] Removing table and tablets from system table
0616 19:52:15.442942 (+ 29816us) catalog_manager.cc:2881] Removing table from by-name map
0616 19:52:15.443048 (+ 106us) catalog_manager.cc:2897] Committing in-memory state
0616 19:52:15.443101 (+ 53us) catalog_manager.cc:2901] Aborting table tasks
0616 19:52:15.443809 (+ 708us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:15.414904 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:15.415018 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:15.415023 (+ 5us) write_op.cc:435] Acquired schema lock
0616 19:52:15.415025 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:15.415128 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:15.415140 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:15.415145 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:15.415267 (+ 122us) tablet.cc:701] Row locks acquired
0616 19:52:15.415270 (+ 3us) write_op.cc:260] PREPARE: finished
0616 19:52:15.415302 (+ 32us) write_op.cc:270] Start()
0616 19:52:15.415328 (+ 26us) write_op.cc:276] Timestamp: P: 1781639535415261 usec, L: 0
0616 19:52:15.415331 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:15.415466 (+ 135us) log.cc:844] Serialized 762 byte log entry
0616 19:52:15.424352 (+ 8886us) op_driver.cc:464] REPLICATION: finished
0616 19:52:15.424604 (+ 252us) write_op.cc:301] APPLY: starting
0616 19:52:15.424618 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:15.424659 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:15.424680 (+ 21us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:15.424761 (+ 81us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:15.424792 (+ 31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0616 19:52:15.424799 (+ 7us) write_op.cc:312] APPLY: finished
0616 19:52:15.424861 (+ 62us) log.cc:844] Serialized 29 byte log entry
0616 19:52:15.424919 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:15.424934 (+ 15us) write_op.cc:454] Released schema lock
0616 19:52:15.424940 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:15.425014 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:15.425017 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":3328,"child_traces":[["op",{"apply.queue_time_us":202,"apply.run_cpu_time_us":404,"apply.run_wall_time_us":404,"num_ops":2,"prepare.queue_time_us":1141,"prepare.run_cpu_time_us":650,"prepare.run_wall_time_us":650,"raft.queue_time_us":1856,"raft.run_cpu_time_us":602,"raft.run_wall_time_us":603,"replication_time_us":8993}]]}
I20260616 19:52:15.445392 858 leader_election.cc:304] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:15.445778 2297 raft_consensus.cc:2804] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:15.445883 2297 raft_consensus.cc:493] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:15.445974 2297 raft_consensus.cc:3060] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.448028 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c281b936f2147b9989f03a3e1b6884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:15.448405 1032 tablet_service.cc:1511] Processing CreateTablet for tablet f9e3e058b5c042039dfc7322f15e2979 (DEFAULT_TABLE table=default.Table_efa0c3da20a04fe7aa79633b5e4537c2 [id=52cea254aed249dea8f24caaed636f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.448854 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 54b1595a9cf343cc8c60ae5ef8615029 (DEFAULT_TABLE table=default.Table_1a78091a693742a28eef4e5ea7e4cb0d [id=d5ccdb66feea46f58ea8ec86c0796fd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.448951 1033 tablet_service.cc:1511] Processing CreateTablet for tablet cc7f6431067543b69688a574a55c433c (DEFAULT_TABLE table=default.Table_c7f4c8e2282640fb98ec05f8b719772a [id=4b546d4b5263485fb956dd007a87b5a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.449023 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 574de1bb197845f386d2cb070454f845 (DEFAULT_TABLE table=default.Table_4f6998bf4b4e4215a968b6a952754ff2 [id=9d8c7d2f1cce4792a91ad2c27dca4567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.448874 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 0851460d14b64c4d91ab7318f982dba9 (DEFAULT_TABLE table=default.Table_8d6b895b77014dab9e9cbd601d9d9ac2 [id=6287d457716b4b84bc9efbb9d9fde03c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.449371 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 8c00212468b4461589d5f341d7d6b0fe (DEFAULT_TABLE table=default.Table_aba0e849bdd049bf83f24ded8d4919c9 [id=f345a8f283294519b38a1b55e8d66d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.449577 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 267134453b214104967e80ec03480933 (DEFAULT_TABLE table=default.Table_09064f2784da477896e7e01c6581b826 [id=bedd8717e01e4c12922804581681b0e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.449707 1030 tablet_service.cc:1511] Processing CreateTablet for tablet bf8cd47ad89246fe8a7726aed35cf657 (DEFAULT_TABLE table=default.Table_e1ef4766e04c4030a2f1a81c5c761f0a [id=e531bb5a1a7642df9c2eb93e4e4901c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.449991 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 1276071ff0224382b2ffb4ade81d96f2 (DEFAULT_TABLE table=default.Table_65b8b2d0dc4e4a1b84fbeebb0af17087 [id=d7e17976adc94089a95e8d15fbdb5d0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.450315 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 82e6b4af46d0479c860c8a88f14d9bdc (DEFAULT_TABLE table=default.Table_bbe41b97de514a868fc05e0bb96895bc [id=6405118fa6f643ce94bdab69713b815d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.450615 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 04e36dc0843b438fa14a5c64e4f0d430 (DEFAULT_TABLE table=default.Table_9ebc1905db49466db1697dab76e8e7b2 [id=3e8d91b1df70488c88a1bb4c42f7e642]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.450919 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 375c577934d04e41b31ed6ef90ff4fd4 (DEFAULT_TABLE table=default.Table_9d39b60e1f084549aae7eafe209b9a8c [id=d4ffd8643cce48fc847b7c65f57692d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.451256 1039 tablet_service.cc:1511] Processing CreateTablet for tablet c2ca142f6cc84cc78e13cbf495ad6400 (DEFAULT_TABLE table=default.Table_58fcb5c4647344929d53cd74264f0cde [id=a91c39bd30114c629e9cdf38aa2a7ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.451575 1192 tablet_bootstrap.cc:654] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.452925 893 tablet_service.cc:1511] Processing CreateTablet for tablet bf8cd47ad89246fe8a7726aed35cf657 (DEFAULT_TABLE table=default.Table_e1ef4766e04c4030a2f1a81c5c761f0a [id=e531bb5a1a7642df9c2eb93e4e4901c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.453181 895 tablet_service.cc:1511] Processing CreateTablet for tablet 54b1595a9cf343cc8c60ae5ef8615029 (DEFAULT_TABLE table=default.Table_1a78091a693742a28eef4e5ea7e4cb0d [id=d5ccdb66feea46f58ea8ec86c0796fd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.453410 896 tablet_service.cc:1511] Processing CreateTablet for tablet 1276071ff0224382b2ffb4ade81d96f2 (DEFAULT_TABLE table=default.Table_65b8b2d0dc4e4a1b84fbeebb0af17087 [id=d7e17976adc94089a95e8d15fbdb5d0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.453835 899 tablet_service.cc:1511] Processing CreateTablet for tablet 82e6b4af46d0479c860c8a88f14d9bdc (DEFAULT_TABLE table=default.Table_bbe41b97de514a868fc05e0bb96895bc [id=6405118fa6f643ce94bdab69713b815d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.454241 892 tablet_service.cc:1511] Processing CreateTablet for tablet 50797706bd3a40099d64c292c32bf1f0 (DEFAULT_TABLE table=default.Table_b38a7f54b0584662954227bde2b75aeb [id=089bc577e3f14d10abaff39c002261f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.455111 886 tablet_service.cc:1511] Processing CreateTablet for tablet 04e36dc0843b438fa14a5c64e4f0d430 (DEFAULT_TABLE table=default.Table_9ebc1905db49466db1697dab76e8e7b2 [id=3e8d91b1df70488c88a1bb4c42f7e642]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.455521 900 tablet_service.cc:1511] Processing CreateTablet for tablet 0851460d14b64c4d91ab7318f982dba9 (DEFAULT_TABLE table=default.Table_8d6b895b77014dab9e9cbd601d9d9ac2 [id=6287d457716b4b84bc9efbb9d9fde03c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.455971 888 tablet_service.cc:1511] Processing CreateTablet for tablet 574de1bb197845f386d2cb070454f845 (DEFAULT_TABLE table=default.Table_4f6998bf4b4e4215a968b6a952754ff2 [id=9d8c7d2f1cce4792a91ad2c27dca4567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.456369 894 tablet_service.cc:1511] Processing CreateTablet for tablet 9951d4dcafd64f8180125bb0c25c67ef (DEFAULT_TABLE table=default.Table_8345aacaa215426e86af44475fc967ee [id=519692f2bcb2440da883c12a330f324f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.456765 901 tablet_service.cc:1511] Processing CreateTablet for tablet 267134453b214104967e80ec03480933 (DEFAULT_TABLE table=default.Table_09064f2784da477896e7e01c6581b826 [id=bedd8717e01e4c12922804581681b0e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.462581 756 tablet_service.cc:1511] Processing CreateTablet for tablet 9951d4dcafd64f8180125bb0c25c67ef (DEFAULT_TABLE table=default.Table_8345aacaa215426e86af44475fc967ee [id=519692f2bcb2440da883c12a330f324f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:15.465062 996 consensus_peers.cc:597] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7dc92bc15da14504a1ff5feda5aff7cf. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:15.467124 2559 raft_consensus.cc:515] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.467717 2559 leader_election.cc:290] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:15.467965 1055 raft_consensus.cc:2468] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:15.468658 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 9951d4dcafd64f8180125bb0c25c67ef (DEFAULT_TABLE table=default.Table_8345aacaa215426e86af44475fc967ee [id=519692f2bcb2440da883c12a330f324f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.468375 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 50797706bd3a40099d64c292c32bf1f0 (DEFAULT_TABLE table=default.Table_b38a7f54b0584662954227bde2b75aeb [id=089bc577e3f14d10abaff39c002261f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.469642 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7f6431067543b69688a574a55c433c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.470139 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9951d4dcafd64f8180125bb0c25c67ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.470817 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e3e058b5c042039dfc7322f15e2979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.474717 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503e6289258046f79532ef7b97d4a1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.474921 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1276071ff0224382b2ffb4ade81d96f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.475188 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b1595a9cf343cc8c60ae5ef8615029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.475394 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574de1bb197845f386d2cb070454f845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.471357 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e3e058b5c042039dfc7322f15e2979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.475772 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e6b4af46d0479c860c8a88f14d9bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.476121 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e36dc0843b438fa14a5c64e4f0d430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.476619 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290d1bf172f949089e013d24ec64435d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.477046 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50797706bd3a40099d64c292c32bf1f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.477190 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c00212468b4461589d5f341d7d6b0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.477479 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503e6289258046f79532ef7b97d4a1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.477624 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1276071ff0224382b2ffb4ade81d96f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.478006 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84f659c29914d318686f26f4b9fdf94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.478155 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574de1bb197845f386d2cb070454f845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.478449 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85c6c37a1014000b617d072bba1bdc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.478607 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e36dc0843b438fa14a5c64e4f0d430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.478763 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375c577934d04e41b31ed6ef90ff4fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.478925 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0851460d14b64c4d91ab7318f982dba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.479314 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f55bafac7924ba28feb92839909aac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.479449 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ca142f6cc84cc78e13cbf495ad6400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.482460 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8cd47ad89246fe8a7726aed35cf657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.485113 757 tablet_service.cc:1511] Processing CreateTablet for tablet d7e3944f0ece4450823521e689224485 (DEFAULT_TABLE table=default.Table_2db86dd551a14e588331c28f7ad6e0d4 [id=e2339dfc16674617b08916b7ccb9d812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.485478 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e3944f0ece4450823521e689224485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.486409 756 tablet_service.cc:1511] Processing CreateTablet for tablet 988e861f59cf49c38582ed65901c252f (DEFAULT_TABLE table=default.Table_0d790574e48845f386fb32c35473162b [id=f30ccab6bc9146f0be272df22e7191a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.486765 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84f659c29914d318686f26f4b9fdf94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.486786 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988e861f59cf49c38582ed65901c252f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.488575 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9951d4dcafd64f8180125bb0c25c67ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.491986 756 tablet_service.cc:1511] Processing CreateTablet for tablet 00333a4716c74cb7a14ed38beb9c478e (DEFAULT_TABLE table=default.Table_26225edcf68948129e11a93186e1cf9d [id=4b363613876a496dac943bdc919d7bf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.492300 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00333a4716c74cb7a14ed38beb9c478e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.492610 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f55bafac7924ba28feb92839909aac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.494817 755 tablet_service.cc:1511] Processing CreateTablet for tablet 191965ba869541fca128dcb93fe8e5b5 (DEFAULT_TABLE table=default.Table_c72cfa1b4cd747f78d9abb8b2595745b [id=ef88a624822c46aeb55790e85568d719]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.495122 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 191965ba869541fca128dcb93fe8e5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.495558 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290d1bf172f949089e013d24ec64435d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.496400 746 tablet_service.cc:1511] Processing CreateTablet for tablet 1d98a5dc581f4594a832f6390837cd57 (DEFAULT_TABLE table=default.Table_52ed654c2a7e47f588674617cd3a57a0 [id=dcfd80d7e23340c3b865641a6e511579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.496600 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85c6c37a1014000b617d072bba1bdc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.497478 756 tablet_service.cc:1511] Processing CreateTablet for tablet 3472481723b94e5eac9cdaa57102ac6d (DEFAULT_TABLE table=default.Table_87cb94f05bdc4cfabca5fbe1b1102f51 [id=56731dfa0e3d4984b0feb85926934c6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.500573 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c00212468b4461589d5f341d7d6b0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.500721 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e6b4af46d0479c860c8a88f14d9bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.501112 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50797706bd3a40099d64c292c32bf1f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.504576 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7f6431067543b69688a574a55c433c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.504583 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267134453b214104967e80ec03480933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.504899 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85c6c37a1014000b617d072bba1bdc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.505110 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e6b4af46d0479c860c8a88f14d9bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.505160 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8cd47ad89246fe8a7726aed35cf657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.505291 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f55bafac7924ba28feb92839909aac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.505653 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b1595a9cf343cc8c60ae5ef8615029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.505825 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84f659c29914d318686f26f4b9fdf94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.505963 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b1595a9cf343cc8c60ae5ef8615029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.506234 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290d1bf172f949089e013d24ec64435d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.506531 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c00212468b4461589d5f341d7d6b0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.506721 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503e6289258046f79532ef7b97d4a1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.506981 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50797706bd3a40099d64c292c32bf1f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.507241 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375c577934d04e41b31ed6ef90ff4fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.507370 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1276071ff0224382b2ffb4ade81d96f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.507543 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e3e058b5c042039dfc7322f15e2979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.507803 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8cd47ad89246fe8a7726aed35cf657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.507941 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ca142f6cc84cc78e13cbf495ad6400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.508265 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9951d4dcafd64f8180125bb0c25c67ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.508632 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7f6431067543b69688a574a55c433c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.508976 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e36dc0843b438fa14a5c64e4f0d430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.509328 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574de1bb197845f386d2cb070454f845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.509658 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0851460d14b64c4d91ab7318f982dba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.510111 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267134453b214104967e80ec03480933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.510499 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0851460d14b64c4d91ab7318f982dba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.510876 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375c577934d04e41b31ed6ef90ff4fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.511214 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ca142f6cc84cc78e13cbf495ad6400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.512447 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267134453b214104967e80ec03480933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.514997 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe373c3bb094972b0e17fcb1587987a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:15.515837 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe373c3bb094972b0e17fcb1587987a" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:15.515985 1055 raft_consensus.cc:3060] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.517045 1037 tablet_service.cc:1511] Processing CreateTablet for tablet d7e3944f0ece4450823521e689224485 (DEFAULT_TABLE table=default.Table_2db86dd551a14e588331c28f7ad6e0d4 [id=e2339dfc16674617b08916b7ccb9d812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.518641 858 leader_election.cc:304] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:15.519006 2583 raft_consensus.cc:493] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.519125 2583 raft_consensus.cc:515] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.519716 2583 leader_election.cc:290] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:15.519891 2559 raft_consensus.cc:2804] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:15.520001 2559 raft_consensus.cc:697] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:15.520234 2559 consensus_queue.cc:237] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:15.521252 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 52096.3us
I20260616 19:52:15.522518 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ac2e31a1ba40b39145c26a1e4e0884" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:15.522538 757 tablet_service.cc:1511] Processing CreateTablet for tablet d8b843fe456b46aea6c6277416f24719 (DEFAULT_TABLE table=default.Table_3dea2593211d4e4c990c543a009c1ad3 [id=f91f39ad9c5449bb9610c857f62c583b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:15.522984 860 leader_election.cc:343] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.524142 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 988e861f59cf49c38582ed65901c252f (DEFAULT_TABLE table=default.Table_0d790574e48845f386fb32c35473162b [id=f30ccab6bc9146f0be272df22e7191a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.524773 1192 tablet_bootstrap.cc:492] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:15.524938 1192 ts_tablet_manager.cc:1403] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.090s user 0.002s sys 0.002s
I20260616 19:52:15.527269 1192 raft_consensus.cc:359] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.529683 758 tablet_service.cc:1511] Processing CreateTablet for tablet 67f52c5f3b6549d5bf448b4a73fef05e (DEFAULT_TABLE table=default.Table_1335dee9b9ef4807bc77bb4ccdba2f37 [id=05c0d4fc9b294d64bb8ef0474ce26a77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.530364 2287 raft_consensus.cc:493] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.530493 2287 raft_consensus.cc:515] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.530603 1192 raft_consensus.cc:385] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.531560 1192 raft_consensus.cc:740] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.532560 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ac2e31a1ba40b39145c26a1e4e0884" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:15.532763 1057 raft_consensus.cc:2393] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
I20260616 19:52:15.532804 2287 leader_election.cc:290] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:15.531847 1192 consensus_queue.cc:260] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.536037 1192 ts_tablet_manager.cc:1434] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260616 19:52:15.536211 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7b177800174706a985c11e5876b9d3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:15.536414 1192 tablet_bootstrap.cc:492] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:52:15.536747 993 leader_election.cc:343] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.538511 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 00333a4716c74cb7a14ed38beb9c478e (DEFAULT_TABLE table=default.Table_26225edcf68948129e11a93186e1cf9d [id=4b363613876a496dac943bdc919d7bf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.539139 719 leader_election.cc:304] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:15.539546 2628 raft_consensus.cc:3060] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:15.543280 860 consensus_peers.cc:597] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:15.543241 1196 consensus_queue.cc:260] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.544029 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7b177800174706a985c11e5876b9d3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:15.544596 996 leader_election.cc:343] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.544700 1192 tablet_bootstrap.cc:654] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.544802 996 leader_election.cc:304] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:15.545051 2287 raft_consensus.cc:2749] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:15.545724 1196 ts_tablet_manager.cc:1434] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.140s user 0.000s sys 0.001s
I20260616 19:52:15.546037 1196 tablet_bootstrap.cc:492] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:15.548981 1196 tablet_bootstrap.cc:654] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.558529 1196 tablet_bootstrap.cc:492] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:15.558735 1196 ts_tablet_manager.cc:1403] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20260616 19:52:15.559540 1196 raft_consensus.cc:359] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.559792 1196 raft_consensus.cc:385] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.559922 1196 raft_consensus.cc:740] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.560225 1196 consensus_queue.cc:260] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.560843 1196 ts_tablet_manager.cc:1434] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:52:15.561132 1196 tablet_bootstrap.cc:492] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:15.562227 2297 raft_consensus.cc:515] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.562866 2297 leader_election.cc:290] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:15.563158 1055 raft_consensus.cc:2468] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:15.563513 2628 raft_consensus.cc:2749] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:15.563773 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 191965ba869541fca128dcb93fe8e5b5 (DEFAULT_TABLE table=default.Table_c72cfa1b4cd747f78d9abb8b2595745b [id=ef88a624822c46aeb55790e85568d719]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.564767 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269c1dea941c481fb6fd2e4d59c877c0" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:15.565173 858 leader_election.cc:304] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:15.565642 2559 raft_consensus.cc:2804] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:15.565757 2559 raft_consensus.cc:697] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:15.565963 2559 consensus_queue.cc:237] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.566380 1193 ts_tablet_manager.cc:1929] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:15.566476 1193 log.cc:1199] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/2e316e44693d473dad901eeb95299988
I20260616 19:52:15.566847 1193 ts_tablet_manager.cc:1950] T 2e316e44693d473dad901eeb95299988 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:52:15.567644 860 leader_election.cc:343] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.567967 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269c1dea941c481fb6fd2e4d59c877c0" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:15.568131 1055 raft_consensus.cc:3060] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.568704 1191 ts_tablet_manager.cc:1929] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:15.568985 1190 ts_tablet_manager.cc:1929] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:15.570858 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e3944f0ece4450823521e689224485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.571012 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 191965ba869541fca128dcb93fe8e5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.571185 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00333a4716c74cb7a14ed38beb9c478e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.572623 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988e861f59cf49c38582ed65901c252f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.579664 895 tablet_service.cc:1511] Processing CreateTablet for tablet d7e3944f0ece4450823521e689224485 (DEFAULT_TABLE table=default.Table_2db86dd551a14e588331c28f7ad6e0d4 [id=e2339dfc16674617b08916b7ccb9d812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.580096 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e3944f0ece4450823521e689224485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.580866 1196 tablet_bootstrap.cc:654] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.583374 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d98a5dc581f4594a832f6390837cd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.583580 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3472481723b94e5eac9cdaa57102ac6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.583797 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f52c5f3b6549d5bf448b4a73fef05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.584355 2559 raft_consensus.cc:493] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.584488 2559 raft_consensus.cc:515] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.585359 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a2855b7dec4244a3fc52bdca7e7eb3" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:15.585517 775 raft_consensus.cc:2468] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:15.586737 860 leader_election.cc:304] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:15.586784 890 tablet_service.cc:1511] Processing CreateTablet for tablet 988e861f59cf49c38582ed65901c252f (DEFAULT_TABLE table=default.Table_0d790574e48845f386fb32c35473162b [id=f30ccab6bc9146f0be272df22e7191a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.587037 2297 raft_consensus.cc:2804] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:15.587102 2297 raft_consensus.cc:493] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:15.587154 2297 raft_consensus.cc:3060] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.589761 2559 leader_election.cc:290] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:15.594310 1196 tablet_bootstrap.cc:492] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:15.594421 1196 ts_tablet_manager.cc:1403] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.006s
I20260616 19:52:15.595186 1196 raft_consensus.cc:359] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.595328 1196 raft_consensus.cc:385] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.595369 1196 raft_consensus.cc:740] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.595579 1196 consensus_queue.cc:260] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.596138 1196 ts_tablet_manager.cc:1434] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:52:15.596542 1196 tablet_bootstrap.cc:492] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:15.598064 1196 tablet_bootstrap.cc:654] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.599463 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b843fe456b46aea6c6277416f24719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.601300 1196 tablet_bootstrap.cc:492] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:15.601398 1196 ts_tablet_manager.cc:1403] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260616 19:52:15.602192 1196 raft_consensus.cc:359] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.602350 1196 raft_consensus.cc:385] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.602407 1196 raft_consensus.cc:740] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.602617 1196 consensus_queue.cc:260] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.603233 1196 ts_tablet_manager.cc:1434] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:52:15.603466 1196 tablet_bootstrap.cc:492] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:15.604939 1196 tablet_bootstrap.cc:654] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.612839 1190 log.cc:1199] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/49ab6193c479400da00e1fa80a5274a2
I20260616 19:52:15.613302 1196 tablet_bootstrap.cc:492] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:15.613299 1190 ts_tablet_manager.cc:1950] T 49ab6193c479400da00e1fa80a5274a2 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:15.613416 1196 ts_tablet_manager.cc:1403] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.001s
I20260616 19:52:15.614091 1196 raft_consensus.cc:359] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.614239 1196 raft_consensus.cc:385] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.614282 1196 raft_consensus.cc:740] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.614506 1196 consensus_queue.cc:260] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.615036 1196 ts_tablet_manager.cc:1434] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:15.615271 1196 tablet_bootstrap.cc:492] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:15.616977 1196 tablet_bootstrap.cc:654] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.620883 1196 tablet_bootstrap.cc:492] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:15.620990 1196 ts_tablet_manager.cc:1403] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260616 19:52:15.621639 1196 raft_consensus.cc:359] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.621814 1196 raft_consensus.cc:385] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.621863 1196 raft_consensus.cc:740] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.622071 1196 consensus_queue.cc:260] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.622591 1196 ts_tablet_manager.cc:1434] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:15.622848 1196 tablet_bootstrap.cc:492] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:15.626595 2557 consensus_queue.cc:1048] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:15.631115 763 tablet_service.cc:1511] Processing CreateTablet for tablet 6c2f9646e6a4446f9322e8763d7549ca (DEFAULT_TABLE table=default.Table_aced0d28db084d7c9ea82e3d772c5c80 [id=df9db19b065a48239233dba195f5fd90]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:15.631618 719 consensus_peers.cc:597] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a718fefe07141119b7ef7edcbf61123. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:15.631807 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c2f9646e6a4446f9322e8763d7549ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.634586 899 tablet_service.cc:1511] Processing CreateTablet for tablet 00333a4716c74cb7a14ed38beb9c478e (DEFAULT_TABLE table=default.Table_26225edcf68948129e11a93186e1cf9d [id=4b363613876a496dac943bdc919d7bf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.634905 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a9e8877705840329d6a063bb5194965 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:15.635213 749 tablet_service.cc:1511] Processing CreateTablet for tablet a889853940f2445aa808904c14a883e8 (DEFAULT_TABLE table=default.Table_6dbb237ba04f42998b1557760ce6f8c3 [id=0c107d3e88f74db3a7cee67f635c8124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.635524 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a889853940f2445aa808904c14a883e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.636191 1196 tablet_bootstrap.cc:654] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.639868 752 tablet_service.cc:1511] Processing CreateTablet for tablet 7991a88954bc49ff888c5270108a3843 (DEFAULT_TABLE table=default.Table_8ab332529d7746c3b8cf64f5957b0c3e [id=4f6fbd55e4b84ce28111fb1d4428797e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.640887 2287 raft_consensus.cc:493] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.641022 2287 raft_consensus.cc:515] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.646063 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7991a88954bc49ff888c5270108a3843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.642235 751 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8fdd3a52974113af28706dd8b74d4e (DEFAULT_TABLE table=default.Table_4977207a3a3e4366a30e0cffb72a5682 [id=7d4afb1970d14d7f9c6cedca339272fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.648789 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8fdd3a52974113af28706dd8b74d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.655201 752 tablet_service.cc:1511] Processing CreateTablet for tablet 2f944517046f463d8daf2d2109249103 (DEFAULT_TABLE table=default.Table_6b52ddbd352c45ff92fe44ae26a29462 [id=732806f0d5e84c38b4580e49021826a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.656055 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f944517046f463d8daf2d2109249103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.664911 2297 raft_consensus.cc:515] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.665737 2297 leader_election.cc:290] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:15.670933 898 tablet_service.cc:1511] Processing CreateTablet for tablet 191965ba869541fca128dcb93fe8e5b5 (DEFAULT_TABLE table=default.Table_c72cfa1b4cd747f78d9abb8b2595745b [id=ef88a624822c46aeb55790e85568d719]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.711206 746 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3176db23f74c72b00f4a9b65511f91 (DEFAULT_TABLE table=default.Table_3dbb4ec5745241608403a4e108e679c2 [id=0eaa5c235665493abe5e3a295b313f44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.711702 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3176db23f74c72b00f4a9b65511f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.712870 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 191965ba869541fca128dcb93fe8e5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.677616 902 tablet_service.cc:1511] Processing CreateTablet for tablet 3472481723b94e5eac9cdaa57102ac6d (DEFAULT_TABLE table=default.Table_87cb94f05bdc4cfabca5fbe1b1102f51 [id=56731dfa0e3d4984b0feb85926934c6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.714461 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3472481723b94e5eac9cdaa57102ac6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.683847 887 tablet_service.cc:1511] Processing CreateTablet for tablet d8b843fe456b46aea6c6277416f24719 (DEFAULT_TABLE table=default.Table_3dea2593211d4e4c990c543a009c1ad3 [id=f91f39ad9c5449bb9610c857f62c583b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.720363 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b843fe456b46aea6c6277416f24719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.684976 885 tablet_service.cc:1511] Processing CreateTablet for tablet 1d98a5dc581f4594a832f6390837cd57 (DEFAULT_TABLE table=default.Table_52ed654c2a7e47f588674617cd3a57a0 [id=dcfd80d7e23340c3b865641a6e511579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.688165 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a9e8877705840329d6a063bb5194965 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:15.699302 891 tablet_service.cc:1511] Processing CreateTablet for tablet 6c2f9646e6a4446f9322e8763d7549ca (DEFAULT_TABLE table=default.Table_aced0d28db084d7c9ea82e3d772c5c80 [id=df9db19b065a48239233dba195f5fd90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.705122 2559 raft_consensus.cc:493] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.722929 2559 raft_consensus.cc:515] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.724243 2559 leader_election.cc:290] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:15.724541 2628 raft_consensus.cc:493] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.724681 2628 raft_consensus.cc:515] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.724838 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c2f9646e6a4446f9322e8763d7549ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.725248 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988e861f59cf49c38582ed65901c252f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.725543 903 tablet_service.cc:1511] Processing CreateTablet for tablet 2cdf62d35c2f4b398929988f94ea72a3 (DEFAULT_TABLE table=default.Table_1d5b4585972f43468ed8b94000e5773f [id=d98489f5da2645579a9be7d8c9284712]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.725841 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cdf62d35c2f4b398929988f94ea72a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.729482 893 tablet_service.cc:1511] Processing CreateTablet for tablet 2f944517046f463d8daf2d2109249103 (DEFAULT_TABLE table=default.Table_6b52ddbd352c45ff92fe44ae26a29462 [id=732806f0d5e84c38b4580e49021826a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.732079 888 tablet_service.cc:1511] Processing CreateTablet for tablet ca4b3ce8e8644878a4d8a85be330422b (DEFAULT_TABLE table=default.Table_b013e93d172843e4bf4f985e35a4343b [id=64e95fb9d308409b85003b9682148b74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.733160 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1000) took 4172 ms. Trace:
I20260616 19:52:15.733278 1190 rpcz_store.cc:276] 0616 19:52:11.560874 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.561312 (+ 438us) service_pool.cc:224] Handling call
0616 19:52:15.380515 (+3819203us) ts_tablet_manager.cc:1151] Deleting tablet 49ab6193c479400da00e1fa80a5274a2
0616 19:52:15.380524 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.504892 (+124368us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.568934 (+ 64042us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.733141 (+164207us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3819064}
I20260616 19:52:15.733665 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1001) took 4168 ms. Trace:
I20260616 19:52:15.733748 1190 rpcz_store.cc:276] 0616 19:52:11.565386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.565431 (+ 45us) service_pool.cc:224] Handling call
0616 19:52:15.733541 (+4168110us) ts_tablet_manager.cc:1151] Deleting tablet c204a0af6eac4bc2897b48be50070860
0616 19:52:15.733550 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.733644 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4167957}
I20260616 19:52:15.734050 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 998) took 4173 ms. Trace:
I20260616 19:52:15.734133 1190 rpcz_store.cc:276] 0616 19:52:11.560620 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.568011 (+ 7391us) service_pool.cc:224] Handling call
0616 19:52:15.733950 (+4165939us) ts_tablet_manager.cc:1151] Deleting tablet 89432adb0a4b442bbc5e46ee43a3e1b2
0616 19:52:15.733958 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.734034 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4165756}
I20260616 19:52:15.734364 1190 tablet_replica.cc:333] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:15.734535 1190 raft_consensus.cc:2243] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:15.734647 1190 pending_rounds.cc:70] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:52:15.734678 1190 pending_rounds.cc:77] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595517101477888 op_type: NO_OP noop_request { }
I20260616 19:52:15.734763 1190 raft_consensus.cc:2889] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:15.734830 1190 raft_consensus.cc:2272] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:15.735296 1190 ts_tablet_manager.cc:1916] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:15.736074 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 49ab6193c479400da00e1fa80a5274a2 (table default.Table_8b66b38f443d4eaebf8391a80ef74818 [id=1f077f42ac19492597ea7cd3027cae10]) successfully deleted
W20260616 19:52:15.736325 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c204a0af6eac4bc2897b48be50070860 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c204a0af6eac4bc2897b48be50070860 already in progress: creating tablet
I20260616 19:52:15.736353 422 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-tasknFdngH/build/asan/bin/kudu pid 1210
W20260616 19:52:15.736573 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 89432adb0a4b442bbc5e46ee43a3e1b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89432adb0a4b442bbc5e46ee43a3e1b2 already in progress: creating tablet
I20260616 19:52:15.736963 756 tablet_service.cc:1511] Processing CreateTablet for tablet 2cdf62d35c2f4b398929988f94ea72a3 (DEFAULT_TABLE table=default.Table_1d5b4585972f43468ed8b94000e5773f [id=d98489f5da2645579a9be7d8c9284712]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.737785 754 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9beca7b7d749bea74949dde5a1a6cb (DEFAULT_TABLE table=default.Table_aee030c17ec146b0b77a8cfc6e4af008 [id=d1dbf5b9407644a48893bad8d11b16e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.738338 900 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3176db23f74c72b00f4a9b65511f91 (DEFAULT_TABLE table=default.Table_3dbb4ec5745241608403a4e108e679c2 [id=0eaa5c235665493abe5e3a295b313f44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.738909 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00333a4716c74cb7a14ed38beb9c478e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.740316 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f944517046f463d8daf2d2109249103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.742218 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d98a5dc581f4594a832f6390837cd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.712211 892 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8fdd3a52974113af28706dd8b74d4e (DEFAULT_TABLE table=default.Table_4977207a3a3e4366a30e0cffb72a5682 [id=7d4afb1970d14d7f9c6cedca339272fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.684612 889 tablet_service.cc:1511] Processing CreateTablet for tablet 67f52c5f3b6549d5bf448b4a73fef05e (DEFAULT_TABLE table=default.Table_1335dee9b9ef4807bc77bb4ccdba2f37 [id=05c0d4fc9b294d64bb8ef0474ce26a77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.708796 896 tablet_service.cc:1511] Processing CreateTablet for tablet 7991a88954bc49ff888c5270108a3843 (DEFAULT_TABLE table=default.Table_8ab332529d7746c3b8cf64f5957b0c3e [id=4f6fbd55e4b84ce28111fb1d4428797e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.744133 761 tablet_service.cc:1511] Processing CreateTablet for tablet ca4b3ce8e8644878a4d8a85be330422b (DEFAULT_TABLE table=default.Table_b013e93d172843e4bf4f985e35a4343b [id=64e95fb9d308409b85003b9682148b74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.744484 886 tablet_service.cc:1511] Processing CreateTablet for tablet 21dbc443c4754052b0c2abe9de3a3927 (DEFAULT_TABLE table=default.Table_6a864fa5eeba49da95a681f3d1de9030 [id=e03071ab7b1e49c0ac7234b9c2906e8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.746084 2628 leader_election.cc:290] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:15.742190 894 tablet_service.cc:1511] Processing CreateTablet for tablet 3519b095ba404049a6799b58160061ac (DEFAULT_TABLE table=default.Table_8137db8cd2914dd79478b66ddbff1c19 [id=5121c7167c5240e6a0474addd27be0d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.745623 897 tablet_service.cc:1511] Processing CreateTablet for tablet a889853940f2445aa808904c14a883e8 (DEFAULT_TABLE table=default.Table_6dbb237ba04f42998b1557760ce6f8c3 [id=0c107d3e88f74db3a7cee67f635c8124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.749994 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1079) took 1987 ms. Trace:
I20260616 19:52:15.745985 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4b3ce8e8644878a4d8a85be330422b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.750084 1193 rpcz_store.cc:276] 0616 19:52:13.762342 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.792597 (+ 30255us) service_pool.cc:224] Handling call
0616 19:52:15.369569 (+1576972us) ts_tablet_manager.cc:1151] Deleting tablet 2e316e44693d473dad901eeb95299988
0616 19:52:15.369578 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.469587 (+100009us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.566320 (+ 96733us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.749974 (+183654us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1540028}
I20260616 19:52:15.748975 904 tablet_service.cc:1511] Processing CreateTablet for tablet 14a703acc7804dedbf29b15893e63402 (DEFAULT_TABLE table=default.Table_2c2be2e62d114c318e2d9fe6b6f2421f [id=7246d1b3c155431fa46c4624e274e5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.752815 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a703acc7804dedbf29b15893e63402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.754091 2628 raft_consensus.cc:493] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.754896 2628 raft_consensus.cc:515] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.755452 2628 leader_election.cc:290] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:15.756112 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1696a3c9f24001a4aaf99725f73f62" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:15.756304 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cdf62d35c2f4b398929988f94ea72a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.756331 1059 raft_consensus.cc:2393] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
I20260616 19:52:15.757748 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647b1abeb3c14b11b9a5c62b67e83cf8" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:15.757907 922 raft_consensus.cc:2468] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:15.758384 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3176db23f74c72b00f4a9b65511f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.760448 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a889853940f2445aa808904c14a883e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.765453 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21dbc443c4754052b0c2abe9de3a3927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.767900 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3519b095ba404049a6799b58160061ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.771166 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896d5aa87f14e5593d01085bb6d434f" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:15.775490 757 tablet_service.cc:1511] Processing CreateTablet for tablet 3519b095ba404049a6799b58160061ac (DEFAULT_TABLE table=default.Table_8137db8cd2914dd79478b66ddbff1c19 [id=5121c7167c5240e6a0474addd27be0d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.777433 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 2e316e44693d473dad901eeb95299988 (table default.Table_032fed7521604405ba49b2f399e0f628 [id=5aaccdcce80844bbb73b04f81bde9373]) successfully deleted
I20260616 19:52:15.779362 718 leader_election.cc:304] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:15.779793 2628 raft_consensus.cc:2804] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:15.779863 2628 raft_consensus.cc:493] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:15.779917 2628 raft_consensus.cc:3060] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:15.779973 860 leader_election.cc:343] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.775779 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8708321fb0f4c409a66df75da4c6c0e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:15.786036 996 leader_election.cc:343] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.787458 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f52c5f3b6549d5bf448b4a73fef05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.787673 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1696a3c9f24001a4aaf99725f73f62" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:15.788439 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a2855b7dec4244a3fc52bdca7e7eb3" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:15.788700 781 raft_consensus.cc:3060] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.789561 718 leader_election.cc:304] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:15.789851 2583 raft_consensus.cc:3060] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.790490 901 tablet_service.cc:1511] Processing CreateTablet for tablet e73fd3b0fbe64db5a1ebf6d733c5895c (DEFAULT_TABLE table=default.Table_4b58578dcfc347a2950facb364ee0924 [id=7f25c990c0ea4726a2bead9b2e09723d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.790946 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8fdd3a52974113af28706dd8b74d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.793443 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7991a88954bc49ff888c5270108a3843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.799860 887 tablet_service.cc:1511] Processing CreateTablet for tablet 2e3d7956d734403e8acb1f728e971c8e (DEFAULT_TABLE table=default.Table_c95433a6363d436ab8db4357fc5dc6ce [id=b0cdc7831b2345beb0a4016ee5e89a2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.800231 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e3d7956d734403e8acb1f728e971c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.813376 897 tablet_service.cc:1511] Processing CreateTablet for tablet f4f5e8729c6149ee92964f08caff6bbf (DEFAULT_TABLE table=default.Table_fe7bc05510b54924b11d62344defe4a5 [id=e4e92802c23346348e46097d3b85e04b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.821408 1196 tablet_bootstrap.cc:492] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:15.821564 1196 ts_tablet_manager.cc:1403] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.199s user 0.011s sys 0.019s
I20260616 19:52:15.822319 1196 raft_consensus.cc:359] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.822492 1196 raft_consensus.cc:385] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.822546 1196 raft_consensus.cc:740] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.822750 1196 consensus_queue.cc:260] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.744408 890 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9beca7b7d749bea74949dde5a1a6cb (DEFAULT_TABLE table=default.Table_aee030c17ec146b0b77a8cfc6e4af008 [id=d1dbf5b9407644a48893bad8d11b16e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.826992 764 tablet_service.cc:1511] Processing CreateTablet for tablet 21dbc443c4754052b0c2abe9de3a3927 (DEFAULT_TABLE table=default.Table_6a864fa5eeba49da95a681f3d1de9030 [id=e03071ab7b1e49c0ac7234b9c2906e8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.827133 759 tablet_service.cc:1511] Processing CreateTablet for tablet 14a703acc7804dedbf29b15893e63402 (DEFAULT_TABLE table=default.Table_2c2be2e62d114c318e2d9fe6b6f2421f [id=7246d1b3c155431fa46c4624e274e5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.827528 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21dbc443c4754052b0c2abe9de3a3927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.827910 762 tablet_service.cc:1511] Processing CreateTablet for tablet e73fd3b0fbe64db5a1ebf6d733c5895c (DEFAULT_TABLE table=default.Table_4b58578dcfc347a2950facb364ee0924 [id=7f25c990c0ea4726a2bead9b2e09723d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.827970 753 tablet_service.cc:1511] Processing CreateTablet for tablet 2e3d7956d734403e8acb1f728e971c8e (DEFAULT_TABLE table=default.Table_c95433a6363d436ab8db4357fc5dc6ce [id=b0cdc7831b2345beb0a4016ee5e89a2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.828070 1193 tablet_replica.cc:333] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:15.828544 1193 raft_consensus.cc:2243] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:15.828715 1193 raft_consensus.cc:2272] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:15.829638 885 tablet_service.cc:1511] Processing CreateTablet for tablet 78cef79e6b324df7943e6f499516c5d9 (DEFAULT_TABLE table=default.Table_8f2f5974ba694802a093f7c3adbacd48 [id=85bdc981552e4f50a725c53285275af3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.829731 1193 ts_tablet_manager.cc:1916] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:15.830206 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e73fd3b0fbe64db5a1ebf6d733c5895c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.831796 904 tablet_service.cc:1511] Processing CreateTablet for tablet 68d63a5978ca45b99929405ce1a35ac2 (DEFAULT_TABLE table=default.Table_838d3611ece94aee9524fc9a2d485353 [id=eb0ea3ba9ba04c76b890aac44b32c082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.834859 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a703acc7804dedbf29b15893e63402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.836833 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e3d7956d734403e8acb1f728e971c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.838852 750 tablet_service.cc:1511] Processing CreateTablet for tablet f4f5e8729c6149ee92964f08caff6bbf (DEFAULT_TABLE table=default.Table_fe7bc05510b54924b11d62344defe4a5 [id=e4e92802c23346348e46097d3b85e04b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.840024 748 tablet_service.cc:1511] Processing CreateTablet for tablet 78cef79e6b324df7943e6f499516c5d9 (DEFAULT_TABLE table=default.Table_8f2f5974ba694802a093f7c3adbacd48 [id=85bdc981552e4f50a725c53285275af3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.841638 765 tablet_service.cc:1511] Processing CreateTablet for tablet 68d63a5978ca45b99929405ce1a35ac2 (DEFAULT_TABLE table=default.Table_838d3611ece94aee9524fc9a2d485353 [id=eb0ea3ba9ba04c76b890aac44b32c082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.842150 1438 generic_service.cc:196] Checking for leaks (request via RPC)
I20260616 19:52:15.842746 747 tablet_service.cc:1511] Processing CreateTablet for tablet 702f59658ae74034a1b9669eb5ee300b (DEFAULT_TABLE table=default.Table_fa35967391724eb79fe0160539f718b2 [id=a43964c3b0d747919baa5c46ff4d5231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.843694 755 tablet_service.cc:1511] Processing CreateTablet for tablet 869c51a0cda04e9dbe3b5597f844f4a6 (DEFAULT_TABLE table=default.Table_c82ec79589b348c98b547e71862d6280 [id=a0f03f89bec647268f90cb43c150bd4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.844974 760 tablet_service.cc:1511] Processing CreateTablet for tablet 86a21541ca394b3c9f3db345a60c3fa7 (DEFAULT_TABLE table=default.Table_7c51501edf0e42cd9653b3bc4414d838 [id=b46f619ca12a47d6a7a6690fa4074620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.846454 751 tablet_service.cc:1511] Processing CreateTablet for tablet 67f092298661466aa8432baa61559325 (DEFAULT_TABLE table=default.Table_3eb946a084f04151b6389333e33cc455 [id=7f93af071ac3468d96a77ec9f833e1fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.847708 749 tablet_service.cc:1511] Processing CreateTablet for tablet 55eb81576ac14c2ca7c35aef3dded006 (DEFAULT_TABLE table=default.Table_1c02cec36bb14929ab52e7240773c239 [id=a3c2ac7ed4d1490886677b15ac66de7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.848548 903 tablet_service.cc:1511] Processing CreateTablet for tablet 702f59658ae74034a1b9669eb5ee300b (DEFAULT_TABLE table=default.Table_fa35967391724eb79fe0160539f718b2 [id=a43964c3b0d747919baa5c46ff4d5231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.849136 2641 consensus_queue.cc:1048] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:15.850910 718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 60924.3us
I20260616 19:52:15.852049 886 tablet_service.cc:1511] Processing CreateTablet for tablet 869c51a0cda04e9dbe3b5597f844f4a6 (DEFAULT_TABLE table=default.Table_c82ec79589b348c98b547e71862d6280 [id=a0f03f89bec647268f90cb43c150bd4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.877379 758 tablet_service.cc:1511] Processing CreateTablet for tablet 577b529dca234e07b3db1e0334fe4270 (DEFAULT_TABLE table=default.Table_1305053f736840b0934912ca14c3eea9 [id=d5f0c1f03d0e4883acb2a66f40b4b429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.878676 2628 raft_consensus.cc:515] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.880554 2628 leader_election.cc:290] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:15.885015 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f5e8729c6149ee92964f08caff6bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.885968 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cef79e6b324df7943e6f499516c5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.886467 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 869c51a0cda04e9dbe3b5597f844f4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.886983 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702f59658ae74034a1b9669eb5ee300b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.887480 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577b529dca234e07b3db1e0334fe4270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.888043 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f092298661466aa8432baa61559325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.888584 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55eb81576ac14c2ca7c35aef3dded006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.889112 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86a21541ca394b3c9f3db345a60c3fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.890126 2297 raft_consensus.cc:493] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.890343 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d63a5978ca45b99929405ce1a35ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.890326 2297 raft_consensus.cc:515] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.890895 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4b3ce8e8644878a4d8a85be330422b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.891382 2297 leader_election.cc:290] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:15.892258 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9beca7b7d749bea74949dde5a1a6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.892526 2297 raft_consensus.cc:493] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.892644 2297 raft_consensus.cc:515] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.893414 2297 leader_election.cc:290] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:15.904958 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0d3e7da3c74f5ea5dc4aac80a01c82" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:15.907601 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f309caaa9042f99432a61fd2ebb089" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:15.908371 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647b1abeb3c14b11b9a5c62b67e83cf8" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:15.908557 921 raft_consensus.cc:3060] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.908902 2297 consensus_queue.cc:1048] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:15.911736 860 leader_election.cc:343] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:15.912092 860 leader_election.cc:343] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:15.927811 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3519b095ba404049a6799b58160061ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.929582 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e73fd3b0fbe64db5a1ebf6d733c5895c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.929879 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702f59658ae74034a1b9669eb5ee300b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.932515 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9beca7b7d749bea74949dde5a1a6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.933295 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cef79e6b324df7943e6f499516c5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.933845 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d63a5978ca45b99929405ce1a35ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.934533 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f5e8729c6149ee92964f08caff6bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.852963 891 tablet_service.cc:1511] Processing CreateTablet for tablet 86a21541ca394b3c9f3db345a60c3fa7 (DEFAULT_TABLE table=default.Table_7c51501edf0e42cd9653b3bc4414d838 [id=b46f619ca12a47d6a7a6690fa4074620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.853197 1192 tablet_bootstrap.cc:492] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:15.853366 902 tablet_service.cc:1511] Processing CreateTablet for tablet 67f092298661466aa8432baa61559325 (DEFAULT_TABLE table=default.Table_3eb946a084f04151b6389333e33cc455 [id=7f93af071ac3468d96a77ec9f833e1fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.938839 1192 ts_tablet_manager.cc:1403] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.403s user 0.004s sys 0.000s
I20260616 19:52:15.939832 1192 raft_consensus.cc:359] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.940057 1192 raft_consensus.cc:385] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.940116 1192 raft_consensus.cc:740] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.940335 1192 consensus_queue.cc:260] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.940939 1192 ts_tablet_manager.cc:1434] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:15.727252 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647b1abeb3c14b11b9a5c62b67e83cf8" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:15.941468 1057 raft_consensus.cc:2468] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:15.943436 2287 leader_election.cc:290] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:15.944276 1191 log.cc:1199] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/802d30c340494490896c8da33d110708
I20260616 19:52:15.944594 1191 ts_tablet_manager.cc:1950] T 802d30c340494490896c8da33d110708 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:15.944881 2297 consensus_queue.cc:1048] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:15.945250 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1031) took 3819 ms. Trace:
I20260616 19:52:15.945323 1191 rpcz_store.cc:276] 0616 19:52:12.126171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.132063 (+ 5892us) service_pool.cc:224] Handling call
0616 19:52:15.374284 (+3242221us) ts_tablet_manager.cc:1151] Deleting tablet 802d30c340494490896c8da33d110708
0616 19:52:15.374292 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.470809 (+ 96517us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.568637 (+ 97828us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.945232 (+376595us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3242059}
I20260616 19:52:15.945408 2645 raft_consensus.cc:493] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.945585 1191 tablet_replica.cc:333] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:15.945545 2645 raft_consensus.cc:515] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.945729 1191 raft_consensus.cc:2243] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:15.945834 1191 raft_consensus.cc:2272] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:15.946139 2645 leader_election.cc:290] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:15.946261 1191 ts_tablet_manager.cc:1916] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:15.946846 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d30c340494490896c8da33d110708" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:15.947006 1658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s user 0.030s sys 0.084s
I20260616 19:52:15.947017 922 raft_consensus.cc:2468] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
W20260616 19:52:15.947158 1658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s user 0.030s sys 0.084s
I20260616 19:52:15.947898 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ba342fba19324583bf4aabd1e4d2cf78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:15.948022 718 leader_election.cc:304] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:52:15.948434 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba342fba19324583bf4aabd1e4d2cf78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:15.948565 2628 raft_consensus.cc:2804] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:15.948637 2628 raft_consensus.cc:493] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:15.948714 2628 raft_consensus.cc:3060] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:15.951632 895 tablet_service.cc:1511] Processing CreateTablet for tablet 55eb81576ac14c2ca7c35aef3dded006 (DEFAULT_TABLE table=default.Table_1c02cec36bb14929ab52e7240773c239 [id=a3c2ac7ed4d1490886677b15ac66de7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.952675 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6335468b43594dd68c34567f2d697b0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:15.953292 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6335468b43594dd68c34567f2d697b0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:15.953943 1192 tablet_bootstrap.cc:492] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:15.954239 898 tablet_service.cc:1511] Processing CreateTablet for tablet 577b529dca234e07b3db1e0334fe4270 (DEFAULT_TABLE table=default.Table_1305053f736840b0934912ca14c3eea9 [id=d5f0c1f03d0e4883acb2a66f40b4b429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.955295 1198 tablet_bootstrap.cc:492] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:15.955412 1198 ts_tablet_manager.cc:1403] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.586s user 0.005s sys 0.004s
I20260616 19:52:15.955783 1192 tablet_bootstrap.cc:654] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:15.957204 2287 raft_consensus.cc:493] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:15.961270 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 869c51a0cda04e9dbe3b5597f844f4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.975394 1192 tablet_bootstrap.cc:492] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:15.975399 781 raft_consensus.cc:2468] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:15.975673 1192 ts_tablet_manager.cc:1403] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.002s
I20260616 19:52:15.975874 921 raft_consensus.cc:2468] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:15.976100 752 tablet_service.cc:1511] Processing CreateTablet for tablet 58e43fd6e85c444fb330d6d1224ba3e3 (DEFAULT_TABLE table=default.Table_de1900d5d6c048b49ac5e89381ff03ff [id=6b500ffee2b24089954a2875cdb9fc79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.976751 1192 raft_consensus.cc:359] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:15.977041 1192 raft_consensus.cc:385] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:15.977152 1192 raft_consensus.cc:740] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:15.977622 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f092298661466aa8432baa61559325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.977514 1192 consensus_queue.cc:260] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:15.978176 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86a21541ca394b3c9f3db345a60c3fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.978689 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55eb81576ac14c2ca7c35aef3dded006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.979012 1192 ts_tablet_manager.cc:1434] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:15.979411 1192 tablet_bootstrap.cc:492] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:15.980221 1193 ts_tablet_manager.cc:1929] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:15.980378 1193 log.cc:1199] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/f1a09d62e68148349b337c5075763672
I20260616 19:52:15.980870 1193 ts_tablet_manager.cc:1950] T f1a09d62e68148349b337c5075763672 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:15.981665 756 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4fa8733d9e42158a1c8be804bc0c72 (DEFAULT_TABLE table=default.Table_0363a58ed2604e7b9292a1dd3d8a78ca [id=a360c39bb254411889ddb79d7cdc6184]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.982045 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4fa8733d9e42158a1c8be804bc0c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.981665 763 tablet_service.cc:1511] Processing CreateTablet for tablet be76abf48f9844b8945cf0d2f642fddd (DEFAULT_TABLE table=default.Table_58006924fee94c2793516ba75c6297d6 [id=2d0414c36c564229b80c11073d921a5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:15.982734 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be76abf48f9844b8945cf0d2f642fddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:15.985924 1190 ts_tablet_manager.cc:1929] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:15.986608 860 leader_election.cc:304] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:15.987058 2297 raft_consensus.cc:2804] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:15.987505 718 leader_election.cc:304] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:15.993359 2642 raft_consensus.cc:2804] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:15.993537 2642 raft_consensus.cc:697] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:15.993898 2642 consensus_queue.cc:237] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.995446 1196 ts_tablet_manager.cc:1434] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.174s user 0.001s sys 0.009s
I20260616 19:52:15.995795 1196 tablet_bootstrap.cc:492] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:15.997439 1196 tablet_bootstrap.cc:654] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:16.000814 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 1a95eafa064b4b95b5281915ea5bd9f7 (table default.Table_2cf157e2fe134e2c80976c8deaf8deba [id=973ba262057d42418fc1e3b6e2145eb0], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1a95eafa064b4b95b5281915ea5bd9f7 consensus state has no leader
I20260616 19:52:16.001595 1198 raft_consensus.cc:359] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.001782 1198 raft_consensus.cc:385] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.001838 1198 raft_consensus.cc:740] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.002036 1198 consensus_queue.cc:260] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:15.957345 2287 raft_consensus.cc:515] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.005538 2287 leader_election.cc:290] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:15.998623 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e43fd6e85c444fb330d6d1224ba3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.010514 1190 log.cc:1199] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/cbd1070277a14fd98af5fa45925e4f0f
I20260616 19:52:16.010982 1190 ts_tablet_manager.cc:1950] T cbd1070277a14fd98af5fa45925e4f0f P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:16.012180 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577b529dca234e07b3db1e0334fe4270. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:16.015967 1030 consensus_meta.cc:287] T bf8cd47ad89246fe8a7726aed35cf657 P 61c874fef3684d10a272a9c7f280e0e2: Time spent flushing consensus metadata: real 0.529s user 0.004s sys 0.000s
I20260616 19:52:16.016722 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 1d98a5dc581f4594a832f6390837cd57 (DEFAULT_TABLE table=default.Table_52ed654c2a7e47f588674617cd3a57a0 [id=dcfd80d7e23340c3b865641a6e511579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.017102 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d98a5dc581f4594a832f6390837cd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.017110 2297 raft_consensus.cc:697] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:16.019578 2287 raft_consensus.cc:493] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.019740 2287 raft_consensus.cc:515] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.020413 2287 leader_election.cc:290] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:16.028249 1025 consensus_meta.cc:287] T 6f55bafac7924ba28feb92839909aac9 P 61c874fef3684d10a272a9c7f280e0e2: Time spent flushing consensus metadata: real 0.532s user 0.006s sys 0.000s
I20260616 19:52:16.028167 2297 consensus_queue.cc:237] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.034248 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 3472481723b94e5eac9cdaa57102ac6d (DEFAULT_TABLE table=default.Table_87cb94f05bdc4cfabca5fbe1b1102f51 [id=56731dfa0e3d4984b0feb85926934c6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.034781 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3472481723b94e5eac9cdaa57102ac6d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:16.036715 1027 consensus_meta.cc:287] T 8c00212468b4461589d5f341d7d6b0fe P 61c874fef3684d10a272a9c7f280e0e2: Time spent flushing consensus metadata: real 0.533s user 0.002s sys 0.004s
W20260616 19:52:16.037122 1029 consensus_meta.cc:287] T b85c6c37a1014000b617d072bba1bdc2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent flushing consensus metadata: real 0.538s user 0.006s sys 0.000s
I20260616 19:52:16.042214 1040 tablet_service.cc:1511] Processing CreateTablet for tablet d8b843fe456b46aea6c6277416f24719 (DEFAULT_TABLE table=default.Table_3dea2593211d4e4c990c543a009c1ad3 [id=f91f39ad9c5449bb9610c857f62c583b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.043802 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b843fe456b46aea6c6277416f24719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.044687 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 67f52c5f3b6549d5bf448b4a73fef05e (DEFAULT_TABLE table=default.Table_1335dee9b9ef4807bc77bb4ccdba2f37 [id=05c0d4fc9b294d64bb8ef0474ce26a77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.046414 1192 tablet_bootstrap.cc:654] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.047987 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 6c2f9646e6a4446f9322e8763d7549ca (DEFAULT_TABLE table=default.Table_aced0d28db084d7c9ea82e3d772c5c80 [id=df9db19b065a48239233dba195f5fd90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.051249 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f52c5f3b6549d5bf448b4a73fef05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.051513 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c2f9646e6a4446f9322e8763d7549ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.055371 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e68e2c6caff4ac38aa52b8b29f5ace6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:16.059381 994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s user 0.077s sys 0.179s
I20260616 19:52:16.061333 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 170cf5905025434995e7c9cdc802211b
I20260616 19:52:16.078320 2583 raft_consensus.cc:2749] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:16.091459 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95c684f5fe54f7dad6300efb0c18780" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:16.093199 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647b1abeb3c14b11b9a5c62b67e83cf8" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:16.093391 1057 raft_consensus.cc:3060] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.097663 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 5c6add7925294880a5a20eb3d189d1ee
I20260616 19:52:16.098238 453 catalog_manager.cc:6784] ReplaceTablet: tablet 5c6add7925294880a5a20eb3d189d1ee deleted and replaced by tablet fbf9ad5680074ee0ac4948f82a8bd4a5
I20260616 19:52:16.098358 453 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:41696 (request call id 1428) took 1484 ms. Trace:
I20260616 19:52:16.098435 453 rpcz_store.cc:276] 0616 19:52:14.613864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.701315 (+ 87451us) service_pool.cc:224] Handling call
0616 19:52:14.705565 (+ 4250us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x616000043354. stack: 00007f23ba003086 00007f23ba002e40 00007f23b8fbc3ad 000000000099c914 000000000099c8dd 00007f23c94726bd 00007f23c94727b3 00007f23c603ab21 00007f23cdd9f95d 00007f23cdf3f54b 00007f23c499b107 00007f23c499ae35 00007f23c109b88e 00007f23c109a76e 00007f23c10a09a8 00007f23c10a130f
0616 19:52:16.098337 (+1392772us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:15.991490 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:15.991656 (+ 166us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:15.991665 (+ 9us) write_op.cc:435] Acquired schema lock
0616 19:52:15.991670 (+ 5us) tablet.cc:662] Decoding operations
0616 19:52:15.991833 (+ 163us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:15.991846 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:15.991851 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:15.991929 (+ 78us) tablet.cc:701] Row locks acquired
0616 19:52:15.991931 (+ 2us) write_op.cc:260] PREPARE: finished
0616 19:52:15.991959 (+ 28us) write_op.cc:270] Start()
0616 19:52:15.991985 (+ 26us) write_op.cc:276] Timestamp: P: 1781639535991910 usec, L: 0
0616 19:52:15.991988 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:15.992132 (+ 144us) log.cc:844] Serialized 628 byte log entry
0616 19:52:16.065396 (+ 73264us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.096772 (+ 31376us) write_op.cc:301] APPLY: starting
0616 19:52:16.096792 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.096855 (+ 63us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.096883 (+ 28us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.096998 (+ 115us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.097051 (+ 53us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0616 19:52:16.097059 (+ 8us) write_op.cc:312] APPLY: finished
0616 19:52:16.097141 (+ 82us) log.cc:844] Serialized 29 byte log entry
0616 19:52:16.097389 (+ 248us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.097411 (+ 22us) write_op.cc:454] Released schema lock
0616 19:52:16.097418 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":9020288,"child_traces":[["op",{"apply.queue_time_us":31022,"num_ops":2,"prepare.queue_time_us":576868,"prepare.run_cpu_time_us":733,"prepare.run_wall_time_us":12217,"replication_time_us":73376}]]}
W20260616 19:52:16.102258 456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:35519 (request call id 181) took 1246 ms (client timeout 1000 ms). Trace:
W20260616 19:52:16.102367 456 rpcz_store.cc:269] 0616 19:52:14.856271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.862649 (+ 6378us) service_pool.cc:224] Handling call
0616 19:52:16.102236 (+1239587us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.003767 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.003930 (+ 163us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.003939 (+ 9us) write_op.cc:435] Acquired schema lock
0616 19:52:16.003943 (+ 4us) tablet.cc:662] Decoding operations
0616 19:52:16.004083 (+ 140us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.004098 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.004106 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0616 19:52:16.004187 (+ 81us) tablet.cc:701] Row locks acquired
0616 19:52:16.004191 (+ 4us) write_op.cc:260] PREPARE: finished
0616 19:52:16.004225 (+ 34us) write_op.cc:270] Start()
0616 19:52:16.004260 (+ 35us) write_op.cc:276] Timestamp: P: 1781639536004175 usec, L: 0
0616 19:52:16.004265 (+ 5us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.065824 (+ 61559us) log.cc:844] Serialized 533 byte log entry
0616 19:52:16.068452 (+ 2628us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x616000043354. stack: 00007f23ba003086 00007f23ba002e40 00007f23b8fbc3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f23c600cf22 00007f23c73ee305 00007f23c73ece29 00007f23c73f5250 00007f23c73f505d 0000000000aa681c 00007f23ba048f6f 00007f23ba04c28b 00007f23ba04c108 0000000000aa681c
0616 19:52:16.072941 (+ 4489us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.101039 (+ 28098us) write_op.cc:301] APPLY: starting
0616 19:52:16.101055 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.101099 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.101105 (+ 6us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.101159 (+ 54us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.101200 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0616 19:52:16.101210 (+ 10us) write_op.cc:312] APPLY: finished
0616 19:52:16.101292 (+ 82us) log.cc:844] Serialized 23 byte log entry
0616 19:52:16.101552 (+ 260us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.101570 (+ 18us) write_op.cc:454] Released schema lock
0616 19:52:16.101578 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":28036,"apply.run_cpu_time_us":432,"apply.run_wall_time_us":620,"num_ops":1,"prepare.queue_time_us":588015,"prepare.run_cpu_time_us":1954,"prepare.run_wall_time_us":64764,"raft.queue_time_us":950,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":241,"replication_time_us":68643,"spinlock_wait_cycles":141035776,"threads_started":1}]]}
W20260616 19:52:16.105093 994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s user 0.077s sys 0.179s
I20260616 19:52:16.107101 2643 raft_consensus.cc:493] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.107223 2643 raft_consensus.cc:515] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.107674 2287 raft_consensus.cc:493] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.107784 2287 raft_consensus.cc:515] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.108359 2287 leader_election.cc:290] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.129983 2287 raft_consensus.cc:493] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.130143 2287 raft_consensus.cc:515] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.130685 2287 leader_election.cc:290] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.132025 2557 raft_consensus.cc:493] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.132174 2557 raft_consensus.cc:515] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.132879 2557 leader_election.cc:290] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:16.134073 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a817b1d4c7b640db8894bc801878caae" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:16.134788 860 leader_election.cc:343] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.142288 2643 leader_election.cc:290] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.143390 888 tablet_service.cc:1511] Processing CreateTablet for tablet 58e43fd6e85c444fb330d6d1224ba3e3 (DEFAULT_TABLE table=default.Table_de1900d5d6c048b49ac5e89381ff03ff [id=6b500ffee2b24089954a2875cdb9fc79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.143963 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e43fd6e85c444fb330d6d1224ba3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.148310 899 tablet_service.cc:1511] Processing CreateTablet for tablet be76abf48f9844b8945cf0d2f642fddd (DEFAULT_TABLE table=default.Table_58006924fee94c2793516ba75c6297d6 [id=2d0414c36c564229b80c11073d921a5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.152251 893 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4fa8733d9e42158a1c8be804bc0c72 (DEFAULT_TABLE table=default.Table_0363a58ed2604e7b9292a1dd3d8a78ca [id=a360c39bb254411889ddb79d7cdc6184]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.153733 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a2855b7dec4244a3fc52bdca7e7eb3" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:16.153908 1058 raft_consensus.cc:2468] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
W20260616 19:52:16.155591 719 consensus_peers.cc:597] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb1c2030b3a14c6aafaa961869606f31. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:16.159773 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a2855b7dec4244a3fc52bdca7e7eb3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:16.159982 784 raft_consensus.cc:2393] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61c874fef3684d10a272a9c7f280e0e2 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
I20260616 19:52:16.160614 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141b6c7013648a4b716642ccb4eccd6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:16.160739 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 170cf5905025434995e7c9cdc802211b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:15 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.160924 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c6add7925294880a5a20eb3d189d1ee with delete_type TABLET_DATA_DELETED (replaced by tablet fbf9ad5680074ee0ac4948f82a8bd4a5) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.161350 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f2d259a31c4f4eaeceaba57fb978b2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:16.161581 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be76abf48f9844b8945cf0d2f642fddd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:16.162295 719 leader_election.cc:343] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 802d30c340494490896c8da33d110708
I20260616 19:52:16.162709 2654 raft_consensus.cc:493] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.164119 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4fa8733d9e42158a1c8be804bc0c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.165949 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a2855b7dec4244a3fc52bdca7e7eb3" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:16.166167 1059 raft_consensus.cc:3060] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.166533 1198 ts_tablet_manager.cc:1434] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.211s user 0.008s sys 0.008s
I20260616 19:52:16.167016 1198 tablet_bootstrap.cc:492] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:16.169595 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ca1174d132374ac18b552a80f5b61d87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:16.170192 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca1174d132374ac18b552a80f5b61d87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.171033 1196 tablet_bootstrap.cc:492] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.171401 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_58006924fee94c2793516ba75c6297d6" } new_table_name: "default.Table_37a397ac78fb4c5da35209b69d58e8fb" modify_external_catalogs: true
I20260616 19:52:16.171190 1196 ts_tablet_manager.cc:1403] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.175s user 0.004s sys 0.020s
I20260616 19:52:16.173373 1196 raft_consensus.cc:359] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.173925 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0d3438f6bffd41d9b903bdd1ac90f560" } new_table_name: "default.Table_db90a226e6574fb1a9bad16239cffa4f" modify_external_catalogs: true
I20260616 19:52:16.175931 1196 raft_consensus.cc:385] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.176381 1196 raft_consensus.cc:740] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.178056 1057 raft_consensus.cc:2468] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:16.178117 996 leader_election.cc:343] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:16.178674 1055 consensus_meta.cc:287] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2: Time spent flushing consensus metadata: real 0.610s user 0.002s sys 0.001s
W20260616 19:52:16.178462 996 leader_election.cc:343] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.179773 1196 consensus_queue.cc:260] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:16.179996 996 leader_election.cc:343] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:16.180198 996 leader_election.cc:343] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.182022 1196 ts_tablet_manager.cc:1434] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260616 19:52:16.163782 2654 raft_consensus.cc:515] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.185582 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a12cd3744782442f94dc6e76727cca1c
I20260616 19:52:16.183755 1196 tablet_bootstrap.cc:492] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:16.185959 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 170cf5905025434995e7c9cdc802211b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:15 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.186134 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c6add7925294880a5a20eb3d189d1ee with delete_type TABLET_DATA_DELETED (replaced by tablet fbf9ad5680074ee0ac4948f82a8bd4a5) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.186209 458 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:41696 (request call id 1441) took 1252 ms. Trace:
I20260616 19:52:16.186257 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 67ac2e31a1ba40b39145c26a1e4e0884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.186314 458 rpcz_store.cc:276] 0616 19:52:14.933961 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.089392 (+155431us) service_pool.cc:224] Handling call
0616 19:52:15.089878 (+ 486us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0616 19:52:15.090014 (+ 136us) catalog_manager.cc:2840] Modifying in-memory table state
0616 19:52:15.090063 (+ 49us) catalog_manager.cc:2849] Locking tablets
0616 19:52:15.416163 (+326100us) catalog_manager.cc:2863] Removing table and tablets from system table
0616 19:52:16.185406 (+769243us) catalog_manager.cc:2881] Removing table from by-name map
0616 19:52:16.185492 (+ 86us) catalog_manager.cc:2897] Committing in-memory state
0616 19:52:16.185542 (+ 50us) catalog_manager.cc:2901] Aborting table tasks
0616 19:52:16.186187 (+ 645us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.068554 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.068672 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.068677 (+ 5us) write_op.cc:435] Acquired schema lock
0616 19:52:16.068680 (+ 3us) tablet.cc:662] Decoding operations
0616 19:52:16.068796 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.068807 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.068811 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:16.068905 (+ 94us) tablet.cc:701] Row locks acquired
0616 19:52:16.068908 (+ 3us) write_op.cc:260] PREPARE: finished
0616 19:52:16.068937 (+ 29us) write_op.cc:270] Start()
0616 19:52:16.068965 (+ 28us) write_op.cc:276] Timestamp: P: 1781639536068881 usec, L: 0
0616 19:52:16.068968 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.069107 (+ 139us) log.cc:844] Serialized 731 byte log entry
0616 19:52:16.169261 (+100154us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.183530 (+ 14269us) write_op.cc:301] APPLY: starting
0616 19:52:16.183547 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.183589 (+ 42us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.183640 (+ 51us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.183731 (+ 91us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.183764 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0616 19:52:16.183771 (+ 7us) write_op.cc:312] APPLY: finished
0616 19:52:16.183846 (+ 75us) log.cc:844] Serialized 29 byte log entry
0616 19:52:16.185294 (+ 1448us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.185318 (+ 24us) write_op.cc:454] Released schema lock
0616 19:52:16.185325 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:16.185405 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.185408 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":14193,"apply.run_cpu_time_us":504,"apply.run_wall_time_us":1875,"num_ops":2,"prepare.queue_time_us":651777,"prepare.run_cpu_time_us":646,"prepare.run_wall_time_us":10521,"raft.queue_time_us":310,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":100258}]]}
I20260616 19:52:16.190940 1196 tablet_bootstrap.cc:654] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.182135 2628 raft_consensus.cc:515] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.199662 2628 leader_election.cc:290] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.178754 1055 raft_consensus.cc:2468] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:16.206140 1196 tablet_bootstrap.cc:492] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
W20260616 19:52:16.207592 1033 consensus_meta.cc:287] T cc7f6431067543b69688a574a55c433c P 61c874fef3684d10a272a9c7f280e0e2: Time spent flushing consensus metadata: real 0.638s user 0.003s sys 0.000s
I20260616 19:52:16.208134 755 tablet_service.cc:1558] Processing DeleteTablet for tablet a12cd3744782442f94dc6e76727cca1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:15 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.208428 1196 ts_tablet_manager.cc:1403] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.001s
I20260616 19:52:16.209534 889 tablet_service.cc:1558] Processing DeleteTablet for tablet a12cd3744782442f94dc6e76727cca1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:15 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.209637 1196 raft_consensus.cc:359] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.209779 1196 raft_consensus.cc:385] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.209822 1196 raft_consensus.cc:740] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.210018 1196 consensus_queue.cc:260] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.214836 1196 ts_tablet_manager.cc:1434] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260616 19:52:16.215121 1196 tablet_bootstrap.cc:492] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:16.216313 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1081) took 2453 ms. Trace:
I20260616 19:52:16.216400 1193 rpcz_store.cc:276] 0616 19:52:13.762958 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.792873 (+ 29915us) service_pool.cc:224] Handling call
0616 19:52:15.750366 (+1957493us) ts_tablet_manager.cc:1151] Deleting tablet f1a09d62e68148349b337c5075763672
0616 19:52:15.828026 (+ 77660us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.884442 (+ 56416us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.980164 (+ 95722us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.216289 (+236125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4985,"tablet-delete.queue_time_us":1920682}
I20260616 19:52:16.216796 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1083) took 2361 ms. Trace:
I20260616 19:52:16.216953 1196 tablet_bootstrap.cc:654] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.216871 1193 rpcz_store.cc:276] 0616 19:52:13.854931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.855391 (+ 460us) service_pool.cc:224] Handling call
0616 19:52:16.216670 (+2361279us) ts_tablet_manager.cc:1151] Deleting tablet a6565379687e4ddfb471b513939775be
0616 19:52:16.216679 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.216779 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2345886}
I20260616 19:52:16.217134 1193 tablet_replica.cc:333] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:16.217314 1193 raft_consensus.cc:2243] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:16.217456 1193 raft_consensus.cc:2272] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:16.217962 1193 ts_tablet_manager.cc:1916] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:16.222981 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet f1a09d62e68148349b337c5075763672 (table default.Table_9a89b6471d8c42e594c15f43327d9572 [id=e2e41de8962e4ce081aa7c1ac71f8064]) successfully deleted
W20260616 19:52:16.223227 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a6565379687e4ddfb471b513939775be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6565379687e4ddfb471b513939775be already in progress: creating tablet
I20260616 19:52:16.227685 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9f1940f3d73d472c9c68a10539848e9d
I20260616 19:52:16.228207 454 catalog_manager.cc:6784] ReplaceTablet: tablet 9f1940f3d73d472c9c68a10539848e9d deleted and replaced by tablet d8f48eaed58f4b63bc955540fd22cf02
I20260616 19:52:16.228294 454 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:41696 (request call id 1449) took 1114 ms. Trace:
I20260616 19:52:16.228363 454 rpcz_store.cc:276] 0616 19:52:15.113845 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.256845 (+143000us) service_pool.cc:224] Handling call
0616 19:52:16.228279 (+971434us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.079124 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.079245 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.079251 (+ 6us) write_op.cc:435] Acquired schema lock
0616 19:52:16.079253 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:16.079366 (+ 113us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.079377 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.079381 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:16.079457 (+ 76us) tablet.cc:701] Row locks acquired
0616 19:52:16.079459 (+ 2us) write_op.cc:260] PREPARE: finished
0616 19:52:16.079490 (+ 31us) write_op.cc:270] Start()
0616 19:52:16.079522 (+ 32us) write_op.cc:276] Timestamp: P: 1781639536079431 usec, L: 0
0616 19:52:16.079525 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.173345 (+ 93820us) log.cc:844] Serialized 628 byte log entry
0616 19:52:16.175057 (+ 1712us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x616000043354. stack: 00007f23ba003086 00007f23ba002e40 00007f23b8fbc3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f23c600cf22 00007f23c73ee305 00007f23c73ece29 00007f23c73f5250 00007f23c73f505d 0000000000aa681c 00007f23ba048f6f 00007f23ba04c28b 00007f23ba04c108 0000000000aa681c
0616 19:52:16.225171 (+ 50114us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.225916 (+ 745us) write_op.cc:301] APPLY: starting
0616 19:52:16.225941 (+ 25us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.226005 (+ 64us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.226009 (+ 4us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.226161 (+ 152us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.226237 (+ 76us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0616 19:52:16.226249 (+ 12us) write_op.cc:312] APPLY: finished
0616 19:52:16.226359 (+ 110us) log.cc:844] Serialized 29 byte log entry
0616 19:52:16.227192 (+ 833us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.227220 (+ 28us) write_op.cc:454] Released schema lock
0616 19:52:16.227230 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":667,"num_ops":2,"prepare.queue_time_us":662187,"prepare.run_cpu_time_us":1737,"prepare.run_wall_time_us":95992,"raft.queue_time_us":2481,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":284,"replication_time_us":145590,"spinlock_wait_cycles":215372544}]]}
I20260616 19:52:16.234351 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a9e8877705840329d6a063bb5194965 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:14 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.234766 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 7991a88954bc49ff888c5270108a3843 (DEFAULT_TABLE table=default.Table_8ab332529d7746c3b8cf64f5957b0c3e [id=4f6fbd55e4b84ce28111fb1d4428797e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.234766 1032 tablet_service.cc:1511] Processing CreateTablet for tablet a889853940f2445aa808904c14a883e8 (DEFAULT_TABLE table=default.Table_6dbb237ba04f42998b1557760ce6f8c3 [id=0c107d3e88f74db3a7cee67f635c8124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.237571 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8fdd3a52974113af28706dd8b74d4e (DEFAULT_TABLE table=default.Table_4977207a3a3e4366a30e0cffb72a5682 [id=7d4afb1970d14d7f9c6cedca339272fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.237835 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 992) took 4863 ms. Trace:
I20260616 19:52:16.237936 1190 rpcz_store.cc:276] 0616 19:52:11.374090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.374164 (+ 74us) service_pool.cc:224] Handling call
0616 19:52:15.734324 (+4360160us) ts_tablet_manager.cc:1151] Deleting tablet cbd1070277a14fd98af5fa45925e4f0f
0616 19:52:15.734332 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:15.891447 (+157115us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:15.985872 (+ 94425us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.237804 (+251932us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4149479}
I20260616 19:52:16.238302 1190 tablet_replica.cc:333] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:16.238461 1190 raft_consensus.cc:2243] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:16.238457 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f1940f3d73d472c9c68a10539848e9d with delete_type TABLET_DATA_DELETED (replaced by tablet d8f48eaed58f4b63bc955540fd22cf02) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.238729 1190 raft_consensus.cc:2272] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:16.239252 1190 ts_tablet_manager.cc:1916] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:16.240216 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8fdd3a52974113af28706dd8b74d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.240942 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a889853940f2445aa808904c14a883e8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:16.241398 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 364efb99afe14132b7857f694ba3be2b consensus state has no leader
I20260616 19:52:16.242453 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ba092edcdecf485e96a392b3ea79b01a
I20260616 19:52:16.242902 452 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:41696 (request call id 1439) took 1385 ms. Trace:
I20260616 19:52:16.183946 2664 raft_consensus.cc:493] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.243000 452 rpcz_store.cc:276] 0616 19:52:14.857663 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.076824 (+219161us) service_pool.cc:224] Handling call
0616 19:52:15.077168 (+ 344us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0616 19:52:15.077300 (+ 132us) catalog_manager.cc:2840] Modifying in-memory table state
0616 19:52:15.077366 (+ 66us) catalog_manager.cc:2849] Locking tablets
0616 19:52:15.419746 (+342380us) catalog_manager.cc:2863] Removing table and tablets from system table
0616 19:52:16.242298 (+822552us) catalog_manager.cc:2881] Removing table from by-name map
0616 19:52:16.242377 (+ 79us) catalog_manager.cc:2897] Committing in-memory state
0616 19:52:16.242429 (+ 52us) catalog_manager.cc:2901] Aborting table tasks
0616 19:52:16.242887 (+ 458us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.175979 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.176069 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.176074 (+ 5us) write_op.cc:435] Acquired schema lock
0616 19:52:16.176076 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:16.176154 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.176161 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.176166 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:16.176250 (+ 84us) tablet.cc:701] Row locks acquired
0616 19:52:16.176252 (+ 2us) write_op.cc:260] PREPARE: finished
0616 19:52:16.176276 (+ 24us) write_op.cc:270] Start()
0616 19:52:16.176298 (+ 22us) write_op.cc:276] Timestamp: P: 1781639536176253 usec, L: 0
0616 19:52:16.176302 (+ 4us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.176419 (+ 117us) log.cc:844] Serialized 762 byte log entry
0616 19:52:16.225329 (+ 48910us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.240390 (+ 15061us) write_op.cc:301] APPLY: starting
0616 19:52:16.240409 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.240454 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.240501 (+ 47us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.240584 (+ 83us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.240627 (+ 43us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0616 19:52:16.240638 (+ 11us) write_op.cc:312] APPLY: finished
0616 19:52:16.240711 (+ 73us) log.cc:844] Serialized 29 byte log entry
0616 19:52:16.241740 (+ 1029us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.241759 (+ 19us) write_op.cc:454] Released schema lock
0616 19:52:16.241768 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":15001,"apply.run_cpu_time_us":515,"apply.run_wall_time_us":1455,"num_ops":2,"prepare.queue_time_us":755716,"prepare.run_cpu_time_us":527,"prepare.run_wall_time_us":792,"raft.queue_time_us":1160,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":49005,"threads_started":1}]]}
I20260616 19:52:16.243615 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 7ffc15f90dc24de49455205d5de6b58e from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:16.244525 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d30c340494490896c8da33d110708" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:16.244688 921 raft_consensus.cc:3060] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.247143 749 tablet_service.cc:1558] Processing DeleteTablet for tablet ba092edcdecf485e96a392b3ea79b01a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:15 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.250449 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0d3e7da3c74f5ea5dc4aac80a01c82" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:16.250674 1055 raft_consensus.cc:2468] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:16.256608 2628 raft_consensus.cc:493] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.256776 2628 raft_consensus.cc:515] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.257125 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet cbd1070277a14fd98af5fa45925e4f0f (table default.Table_60ef6fc2bcf94a838594d3da8ec82c32 [id=72296d61a39e47389db261a68e679483]) successfully deleted
I20260616 19:52:16.257560 2628 leader_election.cc:290] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.260062 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9fb65cbb56c14cbcac8456f350edf882"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:16.260687 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fb65cbb56c14cbcac8456f350edf882 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.260967 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5df56c7ad1094b8798967a22c2d0cf0c" } new_table_name: "default.Table_f655392b65644b5b9433d91cd0e31252" modify_external_catalogs: true
W20260616 19:52:16.266234 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be76abf48f9844b8945cf0d2f642fddd consensus state has no leader
W20260616 19:52:16.266774 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae290d65419740259a1887849703ddef consensus state has no leader
W20260616 19:52:16.266973 719 leader_election.cc:343] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 802d30c340494490896c8da33d110708
I20260616 19:52:16.268288 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe373c3bb094972b0e17fcb1587987a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:16.268582 1055 raft_consensus.cc:2393] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
I20260616 19:52:16.270040 2557 raft_consensus.cc:493] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61c874fef3684d10a272a9c7f280e0e2)
I20260616 19:52:16.270153 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7991a88954bc49ff888c5270108a3843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.270169 2557 raft_consensus.cc:515] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:16.276057 2557 leader_election.cc:290] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:16.288192 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe373c3bb094972b0e17fcb1587987a" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.288712 896 tablet_service.cc:1558] Processing DeleteTablet for tablet ba092edcdecf485e96a392b3ea79b01a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:15 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.290162 718 leader_election.cc:304] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:16.290465 2628 raft_consensus.cc:3060] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.296964 1198 tablet_bootstrap.cc:654] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.305862 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f309caaa9042f99432a61fd2ebb089" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:16.306128 1055 raft_consensus.cc:2468] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:16.310973 2654 leader_election.cc:290] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.313251 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5587d5aa8584cf49ef3cb113a1b64ca" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:16.313779 996 leader_election.cc:343] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.320498 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 2cdf62d35c2f4b398929988f94ea72a3 (DEFAULT_TABLE table=default.Table_1d5b4585972f43468ed8b94000e5773f [id=d98489f5da2645579a9be7d8c9284712]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.320655 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 2f944517046f463d8daf2d2109249103 (DEFAULT_TABLE table=default.Table_6b52ddbd352c45ff92fe44ae26a29462 [id=732806f0d5e84c38b4580e49021826a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.320878 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cdf62d35c2f4b398929988f94ea72a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.321079 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f944517046f463d8daf2d2109249103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.321305 1027 tablet_service.cc:1511] Processing CreateTablet for tablet ca4b3ce8e8644878a4d8a85be330422b (DEFAULT_TABLE table=default.Table_b013e93d172843e4bf4f985e35a4343b [id=64e95fb9d308409b85003b9682148b74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.321635 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3176db23f74c72b00f4a9b65511f91 (DEFAULT_TABLE table=default.Table_3dbb4ec5745241608403a4e108e679c2 [id=0eaa5c235665493abe5e3a295b313f44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.324249 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 3519b095ba404049a6799b58160061ac (DEFAULT_TABLE table=default.Table_8137db8cd2914dd79478b66ddbff1c19 [id=5121c7167c5240e6a0474addd27be0d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.330910 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a817b1d4c7b640db8894bc801878caae" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:16.331069 1058 raft_consensus.cc:2468] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:16.329442 1198 tablet_bootstrap.cc:492] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:16.331274 1198 ts_tablet_manager.cc:1403] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.164s user 0.004s sys 0.001s
W20260616 19:52:16.331259 858 leader_election.cc:343] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: e896d5aa87f14e5593d01085bb6d434f
I20260616 19:52:16.331370 858 leader_election.cc:304] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:16.331712 858 leader_election.cc:304] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:16.331933 2297 consensus_queue.cc:1048] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:16.332050 1198 raft_consensus.cc:359] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.332180 1198 raft_consensus.cc:385] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.332226 1198 raft_consensus.cc:740] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.321635 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4b3ce8e8644878a4d8a85be330422b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.332894 2559 raft_consensus.cc:2749] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:16.333047 2559 raft_consensus.cc:2804] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:16.333123 2559 raft_consensus.cc:697] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:16.333245 1198 consensus_queue.cc:260] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.333796 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3176db23f74c72b00f4a9b65511f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.336870 1198 ts_tablet_manager.cc:1434] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260616 19:52:16.337430 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9beca7b7d749bea74949dde5a1a6cb (DEFAULT_TABLE table=default.Table_aee030c17ec146b0b77a8cfc6e4af008 [id=d1dbf5b9407644a48893bad8d11b16e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.339859 1198 tablet_bootstrap.cc:492] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:16.353385 1198 tablet_bootstrap.cc:654] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.333334 2559 consensus_queue.cc:237] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.358006 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f1940f3d73d472c9c68a10539848e9d with delete_type TABLET_DATA_DELETED (replaced by tablet d8f48eaed58f4b63bc955540fd22cf02) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:16.292972 860 leader_election.cc:343] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: f52b2c5ff6264ffe8d579cb3816fc253
I20260616 19:52:16.366163 2664 raft_consensus.cc:515] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:52:16.366707 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 66690.2us
I20260616 19:52:16.368047 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a2855b7dec4244a3fc52bdca7e7eb3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.368677 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e68e2c6caff4ac38aa52b8b29f5ace6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.369594 993 leader_election.cc:304] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:16.370996 993 leader_election.cc:343] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.371134 993 leader_election.cc:304] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:16.371798 2661 raft_consensus.cc:2749] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:16.372125 1198 tablet_bootstrap.cc:492] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:16.372277 1198 ts_tablet_manager.cc:1403] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260616 19:52:16.373347 1198 raft_consensus.cc:359] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.373507 1198 raft_consensus.cc:385] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.373588 1198 raft_consensus.cc:740] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.373872 1198 consensus_queue.cc:260] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.375396 1198 ts_tablet_manager.cc:1434] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:16.375730 1198 tablet_bootstrap.cc:492] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:16.378365 1196 tablet_bootstrap.cc:492] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.378504 1196 ts_tablet_manager.cc:1403] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.163s user 0.016s sys 0.043s
I20260616 19:52:16.379192 1196 raft_consensus.cc:359] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.379357 1196 raft_consensus.cc:385] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.379410 1196 raft_consensus.cc:740] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.379630 1196 consensus_queue.cc:260] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.381943 2583 raft_consensus.cc:493] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.382071 2583 raft_consensus.cc:515] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.382725 2583 leader_election.cc:290] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.383631 1191 ts_tablet_manager.cc:1929] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:16.383739 1191 log.cc:1199] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/9d9c89216995430188b1eed4c6b26d1e
I20260616 19:52:16.384037 1191 ts_tablet_manager.cc:1950] T 9d9c89216995430188b1eed4c6b26d1e P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:16.383925 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_37e7ca7c1f6e44c08dc9ad75b1b4325e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:16.384250 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9beca7b7d749bea74949dde5a1a6cb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:16.384521 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37e7ca7c1f6e44c08dc9ad75b1b4325e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:16.384734 719 leader_election.cc:343] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: e896d5aa87f14e5593d01085bb6d434f
I20260616 19:52:16.385560 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1fac960c4cde449a9b6ab1d68cde9d22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:16.385691 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9b4c9fb1e2f641f28cbd42c2c093a835"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:16.385797 1196 ts_tablet_manager.cc:1434] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260616 19:52:16.385967 2628 raft_consensus.cc:2749] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:16.386075 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fac960c4cde449a9b6ab1d68cde9d22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.386049 1196 tablet_bootstrap.cc:492] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:16.386139 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b4c9fb1e2f641f28cbd42c2c093a835 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.387174 2664 leader_election.cc:290] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:16.387430 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cd1b270f52fc41b38b26559fc9f49692"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:16.387635 2665 log.cc:927] Time spent T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e: Append to log took a long time: real 0.110s user 0.000s sys 0.000s
I20260616 19:52:16.387745 1196 tablet_bootstrap.cc:654] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:16.387887 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd1b270f52fc41b38b26559fc9f49692 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.389124 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_56b9e6315f83488bb248451987d21c53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:16.389521 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56b9e6315f83488bb248451987d21c53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.391191 1198 tablet_bootstrap.cc:654] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.392621 1059 raft_consensus.cc:2468] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:16.392856 2654 raft_consensus.cc:2749] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:16.393198 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896d5aa87f14e5593d01085bb6d434f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.393201 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 21dbc443c4754052b0c2abe9de3a3927 (DEFAULT_TABLE table=default.Table_6a864fa5eeba49da95a681f3d1de9030 [id=e03071ab7b1e49c0ac7234b9c2906e8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.393383 919 raft_consensus.cc:2468] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:16.393574 1193 ts_tablet_manager.cc:1929] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:16.393678 1193 log.cc:1199] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/d5c82b71969e4cbcb890d16e1cdd5348
I20260616 19:52:16.393822 718 leader_election.cc:304] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:16.394025 1193 ts_tablet_manager.cc:1950] T d5c82b71969e4cbcb890d16e1cdd5348 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:16.394199 2628 raft_consensus.cc:2804] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:16.394285 2628 raft_consensus.cc:493] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:16.394273 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 14a703acc7804dedbf29b15893e63402 (DEFAULT_TABLE table=default.Table_2c2be2e62d114c318e2d9fe6b6f2421f [id=7246d1b3c155431fa46c4624e274e5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.394359 2628 raft_consensus.cc:3060] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.394460 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3519b095ba404049a6799b58160061ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.395042 1021 tablet_service.cc:1511] Processing CreateTablet for tablet e73fd3b0fbe64db5a1ebf6d733c5895c (DEFAULT_TABLE table=default.Table_4b58578dcfc347a2950facb364ee0924 [id=7f25c990c0ea4726a2bead9b2e09723d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.395339 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e73fd3b0fbe64db5a1ebf6d733c5895c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.397852 2664 raft_consensus.cc:493] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.401532 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 2e3d7956d734403e8acb1f728e971c8e (DEFAULT_TABLE table=default.Table_c95433a6363d436ab8db4357fc5dc6ce [id=b0cdc7831b2345beb0a4016ee5e89a2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.401896 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e3d7956d734403e8acb1f728e971c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.403369 1023 tablet_service.cc:1511] Processing CreateTablet for tablet f4f5e8729c6149ee92964f08caff6bbf (DEFAULT_TABLE table=default.Table_fe7bc05510b54924b11d62344defe4a5 [id=e4e92802c23346348e46097d3b85e04b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.403757 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f5e8729c6149ee92964f08caff6bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.404628 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f724dc23024a7297cfb8689f199600" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:16.405059 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 78cef79e6b324df7943e6f499516c5d9 (DEFAULT_TABLE table=default.Table_8f2f5974ba694802a093f7c3adbacd48 [id=85bdc981552e4f50a725c53285275af3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:16.405182 860 leader_election.cc:343] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.405406 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cef79e6b324df7943e6f499516c5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.406879 2583 raft_consensus.cc:493] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.406984 2583 raft_consensus.cc:515] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.407514 2583 leader_election.cc:290] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.408349 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 68d63a5978ca45b99929405ce1a35ac2 (DEFAULT_TABLE table=default.Table_838d3611ece94aee9524fc9a2d485353 [id=eb0ea3ba9ba04c76b890aac44b32c082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.408650 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d63a5978ca45b99929405ce1a35ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.409871 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95c684f5fe54f7dad6300efb0c18780" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.410277 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21dbc443c4754052b0c2abe9de3a3927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.410640 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8708321fb0f4c409a66df75da4c6c0e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.411943 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 702f59658ae74034a1b9669eb5ee300b (DEFAULT_TABLE table=default.Table_fa35967391724eb79fe0160539f718b2 [id=a43964c3b0d747919baa5c46ff4d5231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.412596 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 869c51a0cda04e9dbe3b5597f844f4a6 (DEFAULT_TABLE table=default.Table_c82ec79589b348c98b547e71862d6280 [id=a0f03f89bec647268f90cb43c150bd4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.413249 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 86a21541ca394b3c9f3db345a60c3fa7 (DEFAULT_TABLE table=default.Table_7c51501edf0e42cd9653b3bc4414d838 [id=b46f619ca12a47d6a7a6690fa4074620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.413909 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 67f092298661466aa8432baa61559325 (DEFAULT_TABLE table=default.Table_3eb946a084f04151b6389333e33cc455 [id=7f93af071ac3468d96a77ec9f833e1fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.397958 2664 raft_consensus.cc:515] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:16.414537 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 55eb81576ac14c2ca7c35aef3dded006 (DEFAULT_TABLE table=default.Table_1c02cec36bb14929ab52e7240773c239 [id=a3c2ac7ed4d1490886677b15ac66de7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.414642 2664 leader_election.cc:290] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:16.417008 993 leader_election.cc:343] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.417160 993 leader_election.cc:304] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:16.417562 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1032) took 4249 ms. Trace:
W20260616 19:52:16.417640 993 leader_election.cc:343] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.417783 993 leader_election.cc:304] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:16.418063 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269c1dea941c481fb6fd2e4d59c877c0" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:16.418243 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a703acc7804dedbf29b15893e63402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.418210 2654 raft_consensus.cc:2749] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:16.418332 1054 raft_consensus.cc:2393] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
I20260616 19:52:16.418407 2654 raft_consensus.cc:2749] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:16.418665 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55eb81576ac14c2ca7c35aef3dded006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.419118 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f092298661466aa8432baa61559325. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:16.419153 860 leader_election.cc:343] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 47b548b6b7f746fe9fd67c2e6563e961
I20260616 19:52:16.419507 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 869c51a0cda04e9dbe3b5597f844f4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.422463 2664 consensus_queue.cc:1048] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:16.423287 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141b6c7013648a4b716642ccb4eccd6" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.424201 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f2d259a31c4f4eaeceaba57fb978b2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.424757 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 577b529dca234e07b3db1e0334fe4270 (DEFAULT_TABLE table=default.Table_1305053f736840b0934912ca14c3eea9 [id=d5f0c1f03d0e4883acb2a66f40b4b429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.427129 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 58e43fd6e85c444fb330d6d1224ba3e3 (DEFAULT_TABLE table=default.Table_de1900d5d6c048b49ac5e89381ff03ff [id=6b500ffee2b24089954a2875cdb9fc79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.427167 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4fa8733d9e42158a1c8be804bc0c72 (DEFAULT_TABLE table=default.Table_0363a58ed2604e7b9292a1dd3d8a78ca [id=a360c39bb254411889ddb79d7cdc6184]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.429651 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86a21541ca394b3c9f3db345a60c3fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.417692 1191 rpcz_store.cc:276] 0616 19:52:12.166959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.167018 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:15.945545 (+3778527us) ts_tablet_manager.cc:1151] Deleting tablet 9d9c89216995430188b1eed4c6b26d1e
0616 19:52:15.945554 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.182456 (+236902us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.383574 (+201118us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.416301 (+ 32727us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3778364}
I20260616 19:52:16.432193 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 9d9c89216995430188b1eed4c6b26d1e (table default.Table_52ebd4cc32a242b6af90514f289aaffd [id=a02891a271e04ca084884abd17c9bee1]) successfully deleted
W20260616 19:52:16.432546 993 leader_election.cc:343] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.432677 993 leader_election.cc:304] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:16.432744 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 170cf5905025434995e7c9cdc802211b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:15 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.432925 2626 raft_consensus.cc:2749] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:16.433034 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c6add7925294880a5a20eb3d189d1ee with delete_type TABLET_DATA_DELETED (replaced by tablet fbf9ad5680074ee0ac4948f82a8bd4a5) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.433194 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet a12cd3744782442f94dc6e76727cca1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:15 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:16.433349 993 leader_election.cc:343] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.433466 993 leader_election.cc:304] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:16.433525 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f1940f3d73d472c9c68a10539848e9d with delete_type TABLET_DATA_DELETED (replaced by tablet d8f48eaed58f4b63bc955540fd22cf02) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.433712 2626 raft_consensus.cc:2749] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:16.433770 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet ba092edcdecf485e96a392b3ea79b01a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:15 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.434003 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1034) took 4247 ms. Trace:
I20260616 19:52:16.424362 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5587d5aa8584cf49ef3cb113a1b64ca" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.434093 1191 rpcz_store.cc:276] 0616 19:52:12.186402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.186458 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:16.430248 (+4243790us) ts_tablet_manager.cc:1151] Deleting tablet d55200fc438d407e9930400424b88024
0616 19:52:16.433871 (+ 3623us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.433962 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4243602}
I20260616 19:52:16.434444 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1039) took 4064 ms. Trace:
I20260616 19:52:16.434525 1191 rpcz_store.cc:276] 0616 19:52:12.370180 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.370372 (+ 192us) service_pool.cc:224] Handling call
0616 19:52:16.434332 (+4063960us) ts_tablet_manager.cc:1151] Deleting tablet 1b3c170ea2a34e72824dc90f15534745
0616 19:52:16.434340 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.434413 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4063756}
I20260616 19:52:16.434820 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1040) took 4064 ms. Trace:
I20260616 19:52:16.434890 1191 rpcz_store.cc:276] 0616 19:52:12.370315 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.370632 (+ 317us) service_pool.cc:224] Handling call
0616 19:52:16.434721 (+4064089us) ts_tablet_manager.cc:1151] Deleting tablet 4faa62f03c2a4588a776883dc54d0426
0616 19:52:16.434730 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.434792 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4063949}
I20260616 19:52:16.435165 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1041) took 4054 ms. Trace:
I20260616 19:52:16.435281 1191 rpcz_store.cc:276] 0616 19:52:12.380965 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.412081 (+ 31116us) service_pool.cc:224] Handling call
0616 19:52:16.435068 (+4022987us) ts_tablet_manager.cc:1151] Deleting tablet a0313e65e6a3441abcd663110cfcd70d
0616 19:52:16.435075 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.435135 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4022351}
I20260616 19:52:16.435568 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1042) took 4016 ms. Trace:
I20260616 19:52:16.435636 1191 rpcz_store.cc:276] 0616 19:52:12.418643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.424523 (+ 5880us) service_pool.cc:224] Handling call
0616 19:52:16.435469 (+4010946us) ts_tablet_manager.cc:1151] Deleting tablet b65c52ad5b0d48caa5da88c75c60971c
0616 19:52:16.435477 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.435540 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4010691}
I20260616 19:52:16.435906 1191 tablet_replica.cc:333] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:16.436079 1191 raft_consensus.cc:2243] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:16.436211 1191 raft_consensus.cc:2272] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:16.437430 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d55200fc438d407e9930400424b88024 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d55200fc438d407e9930400424b88024 already in progress: creating tablet
W20260616 19:52:16.437636 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 1b3c170ea2a34e72824dc90f15534745 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b3c170ea2a34e72824dc90f15534745 already in progress: creating tablet
W20260616 19:52:16.437834 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 4faa62f03c2a4588a776883dc54d0426 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4faa62f03c2a4588a776883dc54d0426 already in progress: creating tablet
W20260616 19:52:16.437964 993 leader_election.cc:343] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:16.438016 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a0313e65e6a3441abcd663110cfcd70d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0313e65e6a3441abcd663110cfcd70d already in progress: creating tablet
I20260616 19:52:16.438082 993 leader_election.cc:304] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:16.438207 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet b65c52ad5b0d48caa5da88c75c60971c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b65c52ad5b0d48caa5da88c75c60971c already in progress: creating tablet
I20260616 19:52:16.438306 2626 raft_consensus.cc:2749] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:16.438653 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702f59658ae74034a1b9669eb5ee300b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.439237 1033 tablet_service.cc:1511] Processing CreateTablet for tablet be76abf48f9844b8945cf0d2f642fddd (DEFAULT_TABLE table=default.Table_58006924fee94c2793516ba75c6297d6 [id=2d0414c36c564229b80c11073d921a5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.440558 1196 tablet_bootstrap.cc:492] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.440690 1196 ts_tablet_manager.cc:1403] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.011s
I20260616 19:52:16.441394 1196 raft_consensus.cc:359] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.441592 1196 raft_consensus.cc:385] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.441648 1196 raft_consensus.cc:740] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.441823 1191 ts_tablet_manager.cc:1916] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:16.441885 1196 consensus_queue.cc:260] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.442448 1196 ts_tablet_manager.cc:1434] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:16.442742 1196 tablet_bootstrap.cc:492] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:16.443389 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1088) took 2507 ms. Trace:
I20260616 19:52:16.443466 1193 rpcz_store.cc:276] 0616 19:52:13.936209 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.936371 (+ 162us) service_pool.cc:224] Handling call
0616 19:52:16.217085 (+2280714us) ts_tablet_manager.cc:1151] Deleting tablet d5c82b71969e4cbcb890d16e1cdd5348
0616 19:52:16.217096 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.284210 (+ 67114us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.393504 (+109294us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.443369 (+ 49865us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2278481}
I20260616 19:52:16.443819 1193 tablet_replica.cc:333] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:16.443993 1193 raft_consensus.cc:2243] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:16.444134 1196 tablet_bootstrap.cc:654] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.444283 1193 raft_consensus.cc:2272] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:16.444808 1193 ts_tablet_manager.cc:1916] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:16.445484 1198 tablet_bootstrap.cc:492] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:16.445634 1198 ts_tablet_manager.cc:1403] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.070s user 0.010s sys 0.005s
I20260616 19:52:16.446933 1198 raft_consensus.cc:359] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.447111 1198 raft_consensus.cc:385] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.447190 1198 raft_consensus.cc:740] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.447470 1198 consensus_queue.cc:260] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.448092 1198 ts_tablet_manager.cc:1434] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:16.448354 1198 tablet_bootstrap.cc:492] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:16.450104 1198 tablet_bootstrap.cc:654] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.451265 1193 ts_tablet_manager.cc:1929] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:16.451354 1193 log.cc:1199] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/8a718fefe07141119b7ef7edcbf61123
I20260616 19:52:16.451668 1193 ts_tablet_manager.cc:1950] T 8a718fefe07141119b7ef7edcbf61123 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:16.451812 1196 tablet_bootstrap.cc:492] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.451941 1196 ts_tablet_manager.cc:1403] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260616 19:52:16.452167 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet d5c82b71969e4cbcb890d16e1cdd5348 (table default.Table_ece3f5e58baa45dfb295c03ab6a85f01 [id=d5fe1c6faa0d446ca84e71bbdfb4018d]) successfully deleted
I20260616 19:52:16.452683 1196 raft_consensus.cc:359] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.452831 1196 raft_consensus.cc:385] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.452878 1196 raft_consensus.cc:740] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.452808 2628 raft_consensus.cc:515] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.453099 1196 consensus_queue.cc:260] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.453626 2628 leader_election.cc:290] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.453637 1196 ts_tablet_manager.cc:1434] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:16.454133 1196 tablet_bootstrap.cc:492] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:16.455562 1196 tablet_bootstrap.cc:654] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.457067 1198 tablet_bootstrap.cc:492] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:16.457207 1198 ts_tablet_manager.cc:1403] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260616 19:52:16.458856 1198 raft_consensus.cc:359] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.459031 1198 raft_consensus.cc:385] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.459110 1198 raft_consensus.cc:740] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.459623 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269c1dea941c481fb6fd2e4d59c877c0" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:16.463804 719 leader_election.cc:343] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: e896d5aa87f14e5593d01085bb6d434f
I20260616 19:52:16.464635 1198 consensus_queue.cc:260] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.465278 1198 ts_tablet_manager.cc:1434] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s
I20260616 19:52:16.469558 1196 tablet_bootstrap.cc:492] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.469748 1196 ts_tablet_manager.cc:1403] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260616 19:52:16.470492 1196 raft_consensus.cc:359] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.470659 1196 raft_consensus.cc:385] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.470710 1196 raft_consensus.cc:740] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.470935 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577b529dca234e07b3db1e0334fe4270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.470943 1196 consensus_queue.cc:260] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.471408 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4fa8733d9e42158a1c8be804bc0c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.471499 1196 ts_tablet_manager.cc:1434] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:16.471755 1196 tablet_bootstrap.cc:492] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:16.471822 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be76abf48f9844b8945cf0d2f642fddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.473475 1196 tablet_bootstrap.cc:654] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.474967 890 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48636 (request call id 1152) took 1020 ms. Trace:
I20260616 19:52:16.476545 898 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48636 (request call id 1165) took 1012 ms. Trace:
I20260616 19:52:16.476625 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e43fd6e85c444fb330d6d1224ba3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.492367 1190 ts_tablet_manager.cc:1929] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:16.492597 1190 log.cc:1199] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/aabf57dd6d704645b6bf97b730dbe964
I20260616 19:52:16.493310 1196 tablet_bootstrap.cc:492] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.493446 1196 ts_tablet_manager.cc:1403] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.002s
I20260616 19:52:16.494117 1196 raft_consensus.cc:359] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.494304 1196 raft_consensus.cc:385] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.494364 1196 raft_consensus.cc:740] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.494598 1196 consensus_queue.cc:260] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.495129 1196 ts_tablet_manager.cc:1434] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:52:16.475050 890 rpcz_store.cc:276] 0616 19:52:15.454753 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.744193 (+289440us) service_pool.cc:224] Handling call
0616 19:52:15.831112 (+ 86919us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:15.831129 (+ 17us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:15.979143 (+148014us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.474809 (+495666us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.474947 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260616 19:52:16.496430 1196 tablet_bootstrap.cc:492] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:16.497992 1196 tablet_bootstrap.cc:654] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.476615 898 rpcz_store.cc:276] 0616 19:52:15.463670 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.954029 (+490359us) service_pool.cc:224] Handling call
0616 19:52:15.954417 (+ 388us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:15.954437 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.107927 (+153490us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.476394 (+368467us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.476531 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260616 19:52:16.507829 899 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48636 (request call id 1167) took 1042 ms. Trace:
W20260616 19:52:16.508644 763 consensus_meta.cc:287] T be76abf48f9844b8945cf0d2f642fddd P 7245e7dab0ec474a876537be514c8767: Time spent flushing consensus metadata: real 0.523s user 0.015s sys 0.007s
I20260616 19:52:16.510143 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1087) took 2574 ms. Trace:
I20260616 19:52:16.511575 1193 rpcz_store.cc:276] 0616 19:52:13.936070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.942636 (+ 6566us) service_pool.cc:224] Handling call
0616 19:52:16.443769 (+2501133us) ts_tablet_manager.cc:1151] Deleting tablet 8a718fefe07141119b7ef7edcbf61123
0616 19:52:16.443780 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.448504 (+ 4724us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.451220 (+ 2716us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.510123 (+ 58903us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2500971}
I20260616 19:52:16.512760 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 8a718fefe07141119b7ef7edcbf61123 (table default.Table_db902752da5f4f3ab65c0b21c57d34a9 [id=347e25a5fa42418fa9952ed1e6bf9c03]) successfully deleted
I20260616 19:52:16.512936 1190 ts_tablet_manager.cc:1950] T aabf57dd6d704645b6bf97b730dbe964 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:16.513653 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 993) took 5139 ms. Trace:
I20260616 19:52:16.513732 1190 rpcz_store.cc:276] 0616 19:52:11.374360 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.376531 (+ 2171us) service_pool.cc:224] Handling call
0616 19:52:16.238244 (+4861713us) ts_tablet_manager.cc:1151] Deleting tablet aabf57dd6d704645b6bf97b730dbe964
0616 19:52:16.238254 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.456664 (+218410us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.492313 (+ 35649us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.513635 (+ 21322us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4653325}
I20260616 19:52:16.514034 1190 tablet_replica.cc:333] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:16.514189 1190 raft_consensus.cc:2243] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:16.514300 1190 pending_rounds.cc:70] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:52:16.514328 1190 pending_rounds.cc:77] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595521975468032 op_type: NO_OP noop_request { }
I20260616 19:52:16.514405 1190 raft_consensus.cc:2889] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:16.514463 1190 raft_consensus.cc:2272] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:16.514915 1190 ts_tablet_manager.cc:1916] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:16.516948 893 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48636 (request call id 1168) took 1040 ms. Trace:
I20260616 19:52:16.517012 1191 ts_tablet_manager.cc:1929] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:16.518709 718 leader_election.cc:304] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:16.519105 2628 raft_consensus.cc:3060] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.519826 1191 log.cc:1199] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/d4a2855b7dec4244a3fc52bdca7e7eb3
I20260616 19:52:16.520195 1191 ts_tablet_manager.cc:1950] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:16.520942 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1046) took 3973 ms. Trace:
I20260616 19:52:16.521090 1191 rpcz_store.cc:276] 0616 19:52:12.547290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.547350 (+ 60us) service_pool.cc:224] Handling call
0616 19:52:16.435834 (+3888484us) ts_tablet_manager.cc:1151] Deleting tablet d4a2855b7dec4244a3fc52bdca7e7eb3
0616 19:52:16.435844 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.491115 (+ 55271us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.516963 (+ 25848us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.520923 (+ 3960us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3888254}
I20260616 19:52:16.521605 2628 raft_consensus.cc:2749] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:16.521611 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet d4a2855b7dec4244a3fc52bdca7e7eb3 (table default.Table_2b005a492d164f608d275c8e23da534a [id=29105635fc2f455a8b53ed105028ac13]) successfully deleted
I20260616 19:52:16.522071 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1048) took 3962 ms. Trace:
I20260616 19:52:16.522192 1191 rpcz_store.cc:276] 0616 19:52:12.559884 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.559943 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:16.521932 (+3961989us) ts_tablet_manager.cc:1151] Deleting tablet ee10d6f8fd5040aebd9c9592d84534fc
0616 19:52:16.521942 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.522043 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3961742}
W20260616 19:52:16.522665 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ee10d6f8fd5040aebd9c9592d84534fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee10d6f8fd5040aebd9c9592d84534fc already in progress: creating tablet
I20260616 19:52:16.522984 1191 tablet_replica.cc:333] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:16.523216 1191 raft_consensus.cc:2243] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:16.523396 1191 raft_consensus.cc:2272] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:16.523633 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet aabf57dd6d704645b6bf97b730dbe964 (table default.Table_914e42d3110442b99b33a9a77c30dd49 [id=8253e0421d10438cbb925f20579d9471]) successfully deleted
I20260616 19:52:16.524005 1191 ts_tablet_manager.cc:1916] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:16.524648 893 rpcz_store.cc:276] 0616 19:52:15.476571 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.151931 (+675360us) service_pool.cc:224] Handling call
0616 19:52:16.163959 (+ 12028us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.163981 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.427707 (+263726us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.516793 (+ 89086us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.516932 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260616 19:52:16.524811 2662 consensus_queue.cc:1048] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:16.508006 899 rpcz_store.cc:276] 0616 19:52:15.464993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.148000 (+683007us) service_pool.cc:224] Handling call
0616 19:52:16.161348 (+ 13348us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.161384 (+ 36us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.487582 (+326198us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.490888 (+ 3306us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.507807 (+ 16919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260616 19:52:16.526028 2628 raft_consensus.cc:493] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.526153 2628 raft_consensus.cc:515] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.526522 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1089) took 2568 ms. Trace:
I20260616 19:52:16.526593 1193 rpcz_store.cc:276] 0616 19:52:13.957649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.958756 (+ 1107us) service_pool.cc:224] Handling call
0616 19:52:16.526406 (+2567650us) ts_tablet_manager.cc:1151] Deleting tablet 1d5efc4005fa447091cbc9aa28ac3922
0616 19:52:16.526415 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.526506 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2567426}
I20260616 19:52:16.526959 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a817b1d4c7b640db8894bc801878caae" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:52:16.527042 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1d5efc4005fa447091cbc9aa28ac3922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d5efc4005fa447091cbc9aa28ac3922 already in progress: creating tablet
I20260616 19:52:16.527107 1059 raft_consensus.cc:2468] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:16.527457 719 leader_election.cc:304] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:16.527666 2646 raft_consensus.cc:2804] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:16.527719 2646 raft_consensus.cc:493] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:16.527778 2646 raft_consensus.cc:3060] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.530588 2646 raft_consensus.cc:515] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.531206 2646 leader_election.cc:290] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.531587 888 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48636 (request call id 1166) took 1067 ms. Trace:
I20260616 19:52:16.531711 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a817b1d4c7b640db8894bc801878caae" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:16.531837 1059 raft_consensus.cc:3060] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.533053 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a817b1d4c7b640db8894bc801878caae" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:16.533200 915 raft_consensus.cc:3060] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.533820 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a817b1d4c7b640db8894bc801878caae" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:16.534461 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1c9ea41e7064ec9814f0d4a6f022e94 has no consensus state
I20260616 19:52:16.534475 2628 leader_election.cc:290] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.534633 457 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:41696 (request call id 1464) took 1074 ms. Trace:
I20260616 19:52:16.534714 457 rpcz_store.cc:276] 0616 19:52:15.460666 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.260783 (+800117us) service_pool.cc:224] Handling call
0616 19:52:16.262496 (+ 1713us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0616 19:52:16.262696 (+ 200us) catalog_manager.cc:3750] Apply alter schema
0616 19:52:16.262877 (+ 181us) catalog_manager.cc:3782] Acquired catalog manager lock
0616 19:52:16.262956 (+ 79us) catalog_manager.cc:3940] Updating metadata on disk
0616 19:52:16.534244 (+271288us) catalog_manager.cc:3971] Committing alterations to in-memory state
0616 19:52:16.534590 (+ 346us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.290941 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.291118 (+ 177us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.291127 (+ 9us) write_op.cc:435] Acquired schema lock
0616 19:52:16.291136 (+ 9us) tablet.cc:662] Decoding operations
0616 19:52:16.291273 (+ 137us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.291294 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.291302 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0616 19:52:16.291393 (+ 91us) tablet.cc:701] Row locks acquired
0616 19:52:16.291397 (+ 4us) write_op.cc:260] PREPARE: finished
0616 19:52:16.291446 (+ 49us) write_op.cc:270] Start()
0616 19:52:16.291492 (+ 46us) write_op.cc:276] Timestamp: P: 1781639536291406 usec, L: 0
0616 19:52:16.291498 (+ 6us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.383294 (+ 91796us) log.cc:844] Serialized 405 byte log entry
0616 19:52:16.383871 (+ 577us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x616000043354. stack: 00007f23ba003086 00007f23ba002e40 00007f23b8fbc3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f23c600cf22 00007f23c73ee305 00007f23c73ece29 00007f23c73f5250 00007f23c73f505d 0000000000aa681c 00007f23ba048f6f 00007f23ba04c28b 00007f23ba04c108 0000000000aa681c
0616 19:52:16.533314 (+149443us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.533437 (+ 123us) write_op.cc:301] APPLY: starting
0616 19:52:16.533458 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.533514 (+ 56us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.533517 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.533574 (+ 57us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.533611 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0616 19:52:16.533618 (+ 7us) write_op.cc:312] APPLY: finished
0616 19:52:16.533770 (+ 152us) log.cc:844] Serialized 23 byte log entry
0616 19:52:16.533845 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.533866 (+ 21us) write_op.cc:454] Released schema lock
0616 19:52:16.533873 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:16.533948 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.533952 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":39,"apply.run_cpu_time_us":510,"apply.run_wall_time_us":510,"num_ops":1,"prepare.queue_time_us":27499,"prepare.run_cpu_time_us":2157,"prepare.run_wall_time_us":93309,"raft.queue_time_us":37,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":223,"replication_time_us":241774,"spinlock_wait_cycles":210604416}]]}
I20260616 19:52:16.535528 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c71dd033f51a440cbf2753ecd22014bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:16.536115 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c71dd033f51a440cbf2753ecd22014bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.536125 915 raft_consensus.cc:2468] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:16.536643 718 leader_election.cc:304] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:16.536906 2628 raft_consensus.cc:2804] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:16.537017 2628 raft_consensus.cc:697] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:16.537242 2628 consensus_queue.cc:237] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.531687 888 rpcz_store.cc:276] 0616 19:52:15.463947 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.143046 (+679099us) service_pool.cc:224] Handling call
0616 19:52:16.143642 (+ 596us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.143679 (+ 37us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.509489 (+365810us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.531439 (+ 21950us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.531573 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260616 19:52:16.540628 1196 tablet_bootstrap.cc:492] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.541558 1196 ts_tablet_manager.cc:1403] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.001s
I20260616 19:52:16.542868 1196 raft_consensus.cc:359] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.544243 1196 raft_consensus.cc:385] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.544456 1196 raft_consensus.cc:740] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.544958 1196 consensus_queue.cc:260] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.549016 1192 tablet_bootstrap.cc:492] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:16.549160 1192 ts_tablet_manager.cc:1403] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.570s user 0.019s sys 0.005s
I20260616 19:52:16.549875 1192 raft_consensus.cc:359] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.550040 1192 raft_consensus.cc:385] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.550098 1192 raft_consensus.cc:740] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.551434 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1090) took 2588 ms. Trace:
I20260616 19:52:16.551568 1193 rpcz_store.cc:276] 0616 19:52:13.962812 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.964149 (+ 1337us) service_pool.cc:224] Handling call
0616 19:52:16.551305 (+2587156us) ts_tablet_manager.cc:1151] Deleting tablet 296dd76b85b244769d9e4c51163a4e4a
0616 19:52:16.551316 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.551415 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2586972}
I20260616 19:52:16.551810 1196 ts_tablet_manager.cc:1434] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260616 19:52:16.552073 1196 tablet_bootstrap.cc:492] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:16.552093 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 296dd76b85b244769d9e4c51163a4e4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 296dd76b85b244769d9e4c51163a4e4a already in progress: creating tablet
I20260616 19:52:16.552551 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1091) took 2573 ms. Trace:
I20260616 19:52:16.552881 1059 raft_consensus.cc:2468] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:16.556245 459 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41696 (request call id 1465) took 1029 ms. Trace:
I20260616 19:52:16.556370 459 rpcz_store.cc:276] 0616 19:52:15.526646 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.265050 (+738404us) service_pool.cc:224] Handling call
0616 19:52:16.385505 (+120455us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x616000043354. stack: 00007f23ba003086 00007f23ba002e40 00007f23b8fbc3ad 000000000099c914 000000000099c8dd 00007f23c94726bd 00007f23c94727b3 00007f23c603ab21 00007f23cdd9f95d 00007f23cdf326c3 00007f23c498e7c6 00007f23c498e4f5 00007f23c109b88e 00007f23c109a76e 00007f23c10a09a8 00007f23c10a130f
0616 19:52:16.386158 (+ 653us) catalog_manager.cc:2126] Acquired catalog manager lock
0616 19:52:16.386604 (+ 446us) catalog_manager.cc:2172] Created new table and tablet info
0616 19:52:16.555949 (+169345us) catalog_manager.cc:2232] Wrote table and tablets to system table
0616 19:52:16.556088 (+ 139us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0616 19:52:16.556195 (+ 107us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.410678 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.410774 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.410778 (+ 4us) write_op.cc:435] Acquired schema lock
0616 19:52:16.410780 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:16.410844 (+ 64us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.410852 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.410857 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:16.410912 (+ 55us) tablet.cc:701] Row locks acquired
0616 19:52:16.410915 (+ 3us) write_op.cc:260] PREPARE: finished
0616 19:52:16.410939 (+ 24us) write_op.cc:270] Start()
0616 19:52:16.410961 (+ 22us) write_op.cc:276] Timestamp: P: 1781639536410893 usec, L: 0
0616 19:52:16.410964 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.411087 (+ 123us) log.cc:844] Serialized 433 byte log entry
0616 19:52:16.553384 (+142297us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.555367 (+ 1983us) write_op.cc:301] APPLY: starting
0616 19:52:16.555380 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.555417 (+ 37us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.555457 (+ 40us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.555593 (+ 136us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.555629 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0616 19:52:16.555640 (+ 11us) write_op.cc:312] APPLY: finished
0616 19:52:16.555731 (+ 91us) log.cc:844] Serialized 29 byte log entry
0616 19:52:16.555794 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.555811 (+ 17us) write_op.cc:454] Released schema lock
0616 19:52:16.555818 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:16.555890 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.555896 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":276438912,"child_traces":[["op",{"apply.queue_time_us":1949,"apply.run_cpu_time_us":511,"apply.run_wall_time_us":512,"num_ops":2,"prepare.queue_time_us":23670,"prepare.run_cpu_time_us":467,"prepare.run_wall_time_us":708,"replication_time_us":142407}]]}
I20260616 19:52:16.557191 452 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41696 (request call id 1463) took 1120 ms. Trace:
I20260616 19:52:16.557344 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3a297147806b42d2a05da3717d5f18d3" } new_table_name: "default.Table_12d44ad1ef7c46e595ac4de96d937d31" modify_external_catalogs: true
I20260616 19:52:16.557893 1196 tablet_bootstrap.cc:654] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.560775 461 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41696 (request call id 1461) took 1150 ms. Trace:
I20260616 19:52:16.561059 1198 tablet_bootstrap.cc:492] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:16.561030 1022 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1171) took 1094 ms. Trace:
I20260616 19:52:16.552659 1193 rpcz_store.cc:276] 0616 19:52:13.979025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.992972 (+ 13947us) service_pool.cc:224] Handling call
0616 19:52:16.552416 (+2559444us) ts_tablet_manager.cc:1151] Deleting tablet 265a37409d8e4b1bb8ea20e3970b5f69
0616 19:52:16.552425 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.552535 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2536215}
I20260616 19:52:16.561107 1022 rpcz_store.cc:276] 0616 19:52:15.466472 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.392976 (+926504us) service_pool.cc:224] Handling call
0616 19:52:16.393388 (+ 412us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.393417 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.452002 (+ 58585us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.465954 (+ 13952us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.561012 (+ 95058us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94893}
I20260616 19:52:16.560890 461 rpcz_store.cc:276] 0616 19:52:15.410470 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.242060 (+831590us) service_pool.cc:224] Handling call
0616 19:52:16.383887 (+141827us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x616000043354. stack: 00007f23ba003086 00007f23ba002e40 00007f23b8fbc3ad 000000000099c914 000000000099c8dd 00007f23c94726bd 00007f23c94727b3 00007f23c603ab21 00007f23cdd9f95d 00007f23cdf326c3 00007f23c498e7c6 00007f23c498e4f5 00007f23c109b88e 00007f23c109a76e 00007f23c10a09a8 00007f23c10a130f
0616 19:52:16.384616 (+ 729us) catalog_manager.cc:2126] Acquired catalog manager lock
0616 19:52:16.385046 (+ 430us) catalog_manager.cc:2172] Created new table and tablet info
0616 19:52:16.560527 (+175481us) catalog_manager.cc:2232] Wrote table and tablets to system table
0616 19:52:16.560631 (+ 104us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0616 19:52:16.560731 (+ 100us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.409705 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.409835 (+ 130us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.409841 (+ 6us) write_op.cc:435] Acquired schema lock
0616 19:52:16.409844 (+ 3us) tablet.cc:662] Decoding operations
0616 19:52:16.409950 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.409962 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.409967 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:16.410039 (+ 72us) tablet.cc:701] Row locks acquired
0616 19:52:16.410041 (+ 2us) write_op.cc:260] PREPARE: finished
0616 19:52:16.410075 (+ 34us) write_op.cc:270] Start()
0616 19:52:16.410107 (+ 32us) write_op.cc:276] Timestamp: P: 1781639536410027 usec, L: 0
0616 19:52:16.410110 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.410285 (+ 175us) log.cc:844] Serialized 433 byte log entry
0616 19:52:16.553342 (+143057us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.554956 (+ 1614us) write_op.cc:301] APPLY: starting
0616 19:52:16.554965 (+ 9us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.554992 (+ 27us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.555012 (+ 20us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.555089 (+ 77us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.555113 (+ 24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0616 19:52:16.555120 (+ 7us) write_op.cc:312] APPLY: finished
0616 19:52:16.555166 (+ 46us) log.cc:844] Serialized 29 byte log entry
0616 19:52:16.555221 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.555233 (+ 12us) write_op.cc:454] Released schema lock
0616 19:52:16.555239 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:16.555298 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.555304 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":325501312,"child_traces":[["op",{"apply.queue_time_us":1584,"apply.run_cpu_time_us":333,"apply.run_wall_time_us":332,"num_ops":2,"prepare.queue_time_us":8837,"prepare.run_cpu_time_us":667,"prepare.run_wall_time_us":16333,"replication_time_us":143217}]]}
I20260616 19:52:16.561532 1039 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1181) took 1030 ms. Trace:
I20260616 19:52:16.561575 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1092) took 2568 ms. Trace:
I20260616 19:52:16.561627 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_56f10142b9c14500b0b99c646a62cf9d" } modify_external_catalogs: true
I20260616 19:52:16.561622 1039 rpcz_store.cc:276] 0616 19:52:15.531845 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.413747 (+881902us) service_pool.cc:224] Handling call
0616 19:52:16.414046 (+ 299us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.414065 (+ 19us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.456341 (+ 42276us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.468396 (+ 12055us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.561493 (+ 93097us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92970}
I20260616 19:52:16.561653 1193 rpcz_store.cc:276] 0616 19:52:13.993623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.993676 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:16.561460 (+2567784us) ts_tablet_manager.cc:1151] Deleting tablet 96bf58d365a54c24b5131416d95d2b6a
0616 19:52:16.561469 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.561559 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2545216}
I20260616 19:52:16.561786 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_56f10142b9c14500b0b99c646a62cf9d" } modify_external_catalogs: true
I20260616 19:52:16.561950 1028 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1180) took 1030 ms. Trace:
I20260616 19:52:16.562075 1193 tablet_replica.cc:333] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:16.562032 1028 rpcz_store.cc:276] 0616 19:52:15.531336 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.413097 (+881761us) service_pool.cc:224] Handling call
0616 19:52:16.413387 (+ 290us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.413403 (+ 16us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.480550 (+ 67147us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.482671 (+ 2121us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.561914 (+ 79243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79099}
I20260616 19:52:16.562273 1193 raft_consensus.cc:2243] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:16.562341 1035 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1184) took 1030 ms. Trace:
I20260616 19:52:16.562418 1193 raft_consensus.cc:2272] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:16.562422 1035 rpcz_store.cc:276] 0616 19:52:15.532130 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.416106 (+883976us) service_pool.cc:224] Handling call
0616 19:52:16.427300 (+ 11194us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.427343 (+ 43us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.479572 (+ 52229us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.484173 (+ 4601us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.562324 (+ 78151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78037,"spinlock_wait_cycles":2432}
I20260616 19:52:16.562747 1026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1179) took 1031 ms. Trace:
I20260616 19:52:16.562824 1026 rpcz_store.cc:276] 0616 19:52:15.531252 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.412421 (+881169us) service_pool.cc:224] Handling call
0616 19:52:16.412765 (+ 344us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.412791 (+ 26us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.459635 (+ 46844us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.485717 (+ 26082us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.562733 (+ 77016us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76874}
I20260616 19:52:16.562927 1193 ts_tablet_manager.cc:1916] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:16.563076 456 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41696 (request call id 1466) took 1036 ms. Trace:
I20260616 19:52:16.563100 1027 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1167) took 1096 ms. Trace:
I20260616 19:52:16.563185 1027 rpcz_store.cc:276] 0616 19:52:15.466268 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.321078 (+854810us) service_pool.cc:224] Handling call
0616 19:52:16.321456 (+ 378us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.321476 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.485858 (+164382us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.487986 (+ 2128us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.563087 (+ 75101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74965}
I20260616 19:52:16.563174 456 rpcz_store.cc:276] 0616 19:52:15.526730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.265885 (+739155us) service_pool.cc:224] Handling call
0616 19:52:16.385636 (+119751us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x616000043354. stack: 00007f23ba003086 00007f23ba002e40 00007f23b8fbc3ad 000000000099c914 000000000099c8dd 00007f23c94726bd 00007f23c94727b3 00007f23c603ab21 00007f23cdd9f95d 00007f23cdf326c3 00007f23c498e7c6 00007f23c498e4f5 00007f23c109b88e 00007f23c109a76e 00007f23c10a09a8 00007f23c10a130f
0616 19:52:16.386219 (+ 583us) catalog_manager.cc:2126] Acquired catalog manager lock
0616 19:52:16.386724 (+ 505us) catalog_manager.cc:2172] Created new table and tablet info
0616 19:52:16.562888 (+176164us) catalog_manager.cc:2232] Wrote table and tablets to system table
0616 19:52:16.562968 (+ 80us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0616 19:52:16.563040 (+ 72us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.411414 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.411506 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.411510 (+ 4us) write_op.cc:435] Acquired schema lock
0616 19:52:16.411512 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:16.411570 (+ 58us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.411577 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.411582 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:16.411635 (+ 53us) tablet.cc:701] Row locks acquired
0616 19:52:16.411637 (+ 2us) write_op.cc:260] PREPARE: finished
0616 19:52:16.411658 (+ 21us) write_op.cc:270] Start()
0616 19:52:16.411678 (+ 20us) write_op.cc:276] Timestamp: P: 1781639536411613 usec, L: 0
0616 19:52:16.411681 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.411800 (+ 119us) log.cc:844] Serialized 433 byte log entry
0616 19:52:16.553420 (+141620us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.555963 (+ 2543us) write_op.cc:301] APPLY: starting
0616 19:52:16.555975 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.556010 (+ 35us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.556035 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.556138 (+ 103us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.556177 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0616 19:52:16.556187 (+ 10us) write_op.cc:312] APPLY: finished
0616 19:52:16.556248 (+ 61us) log.cc:844] Serialized 29 byte log entry
0616 19:52:16.556304 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.556320 (+ 16us) write_op.cc:454] Released schema lock
0616 19:52:16.556326 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:16.556401 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.556407 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":274904448,"child_traces":[["op",{"apply.queue_time_us":2509,"apply.run_cpu_time_us":427,"apply.run_wall_time_us":427,"num_ops":2,"prepare.queue_time_us":24331,"prepare.run_cpu_time_us":440,"prepare.run_wall_time_us":643,"replication_time_us":141727}]]}
I20260616 19:52:16.563712 1196 tablet_bootstrap.cc:492] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.563759 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 4be902fe29bb46a4bf71ee6384e6722a from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:16.563822 1196 ts_tablet_manager.cc:1403] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260616 19:52:16.564567 1196 raft_consensus.cc:359] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.564711 1196 raft_consensus.cc:385] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.564757 1196 raft_consensus.cc:740] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.564786 455 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41696 (request call id 1467) took 1037 ms. Trace:
I20260616 19:52:16.564890 455 rpcz_store.cc:276] 0616 19:52:15.526817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.266404 (+739587us) service_pool.cc:224] Handling call
0616 19:52:16.389080 (+122676us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x616000043354. stack: 00007f23ba003086 00007f23ba002e40 00007f23b8fbc3ad 000000000099c914 000000000099c8dd 00007f23c94726bd 00007f23c94727b3 00007f23c603ab21 00007f23cdd9f95d 00007f23cdf326c3 00007f23c498e7c6 00007f23c498e4f5 00007f23c109b88e 00007f23c109a76e 00007f23c10a09a8 00007f23c10a130f
0616 19:52:16.389601 (+ 521us) catalog_manager.cc:2126] Acquired catalog manager lock
0616 19:52:16.389967 (+ 366us) catalog_manager.cc:2172] Created new table and tablet info
0616 19:52:16.564532 (+174565us) catalog_manager.cc:2232] Wrote table and tablets to system table
0616 19:52:16.564637 (+ 105us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0616 19:52:16.564740 (+ 103us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.413613 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.413736 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.413740 (+ 4us) write_op.cc:435] Acquired schema lock
0616 19:52:16.413742 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:16.413824 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.413834 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.413841 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:16.413915 (+ 74us) tablet.cc:701] Row locks acquired
0616 19:52:16.413919 (+ 4us) write_op.cc:260] PREPARE: finished
0616 19:52:16.413949 (+ 30us) write_op.cc:270] Start()
0616 19:52:16.413977 (+ 28us) write_op.cc:276] Timestamp: P: 1781639536413901 usec, L: 0
0616 19:52:16.413982 (+ 5us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.414134 (+ 152us) log.cc:844] Serialized 433 byte log entry
0616 19:52:16.553482 (+139348us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.556535 (+ 3053us) write_op.cc:301] APPLY: starting
0616 19:52:16.556552 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.556578 (+ 26us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.556598 (+ 20us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.556693 (+ 95us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.556734 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0616 19:52:16.556741 (+ 7us) write_op.cc:312] APPLY: finished
0616 19:52:16.556789 (+ 48us) log.cc:844] Serialized 29 byte log entry
0616 19:52:16.556823 (+ 34us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.556834 (+ 11us) write_op.cc:454] Released schema lock
0616 19:52:16.556839 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:16.556898 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.556901 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":281590144,"child_traces":[["op",{"apply.queue_time_us":3021,"apply.run_cpu_time_us":357,"apply.run_wall_time_us":356,"num_ops":2,"prepare.queue_time_us":23258,"prepare.run_cpu_time_us":592,"prepare.run_wall_time_us":865,"replication_time_us":139487}]]}
W20260616 19:52:16.565279 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 233561us
I20260616 19:52:16.565537 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c2c67f979a81481abf747ff078acd0b4" } modify_external_catalogs: true
I20260616 19:52:16.565671 1040 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1172) took 1099 ms. Trace:
I20260616 19:52:16.565673 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c2c67f979a81481abf747ff078acd0b4" } modify_external_catalogs: true
I20260616 19:52:16.565766 1040 rpcz_store.cc:276] 0616 19:52:15.466524 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.394043 (+927519us) service_pool.cc:224] Handling call
0616 19:52:16.394478 (+ 435us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.394501 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.470072 (+ 75571us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.490013 (+ 19941us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.565636 (+ 75623us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75491}
I20260616 19:52:16.565913 858 leader_election.cc:304] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:16.566061 1038 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1176) took 1099 ms. Trace:
I20260616 19:52:16.566124 1038 rpcz_store.cc:276] 0616 19:52:15.466720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.404894 (+938174us) service_pool.cc:224] Handling call
0616 19:52:16.405219 (+ 325us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.405246 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.480002 (+ 74756us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.482954 (+ 2952us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.566049 (+ 83095us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79194}
I20260616 19:52:16.566273 858 leader_election.cc:304] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:16.566499 2679 raft_consensus.cc:2804] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:16.566569 2679 raft_consensus.cc:493] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:16.566627 2679 raft_consensus.cc:3060] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.566754 1192 consensus_queue.cc:260] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.567292 458 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet b5587d5aa8584cf49ef3cb113a1b64ca (table default.Table_0f374c454bc04298ba16dc14edb7bc9e [id=1105333647e747a39fc06efbcc95fa0d]). Expected version 1 got 0
I20260616 19:52:16.567508 458 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 41f2d259a31c4f4eaeceaba57fb978b2 (table default.Table_7ffffaef50044d8ba89e6df198946113 [id=d49c093f51b04c2fa1b1f5daadd802cf]). Expected version 3 got 0
I20260616 19:52:16.567809 458 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 2141b6c7013648a4b716642ccb4eccd6 (table default.Table_5047c84664124989b931ee92afc5b463 [id=bc83d5c728054794b2c3cc0f9b90e202]). Expected version 1 got 0
I20260616 19:52:16.568720 2662 raft_consensus.cc:2804] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:16.568801 2662 raft_consensus.cc:493] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:16.568877 2662 raft_consensus.cc:3060] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.569129 2679 raft_consensus.cc:515] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.569530 458 master_service.cc:960] ReplaceTablet: received request to replace tablet 5c74b39e66d344b99f8fc75b855c0520 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:16.569639 2679 leader_election.cc:290] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:16.569756 2679 consensus_queue.cc:1048] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:16.569967 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a1db6293d2e041c9900a691731c2ca4b" } modify_external_catalogs: true
I20260616 19:52:16.570147 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a1db6293d2e041c9900a691731c2ca4b" } modify_external_catalogs: true
I20260616 19:52:16.571488 2662 raft_consensus.cc:515] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.572152 2662 leader_election.cc:290] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:16.557289 452 rpcz_store.cc:276] 0616 19:52:15.436288 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.259888 (+823600us) service_pool.cc:224] Handling call
0616 19:52:16.263639 (+ 3751us) catalog_manager.cc:2126] Acquired catalog manager lock
0616 19:52:16.264083 (+ 444us) catalog_manager.cc:2172] Created new table and tablet info
0616 19:52:16.556989 (+292906us) catalog_manager.cc:2232] Wrote table and tablets to system table
0616 19:52:16.557072 (+ 83us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0616 19:52:16.557148 (+ 76us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.384258 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.384366 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.384371 (+ 5us) write_op.cc:435] Acquired schema lock
0616 19:52:16.384373 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:16.384459 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.384491 (+ 32us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.384495 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:16.384590 (+ 95us) tablet.cc:701] Row locks acquired
0616 19:52:16.384592 (+ 2us) write_op.cc:260] PREPARE: finished
0616 19:52:16.384630 (+ 38us) write_op.cc:270] Start()
0616 19:52:16.384667 (+ 37us) write_op.cc:276] Timestamp: P: 1781639536384582 usec, L: 0
0616 19:52:16.384670 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.384900 (+ 230us) log.cc:844] Serialized 433 byte log entry
0616 19:52:16.553221 (+168321us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.553554 (+ 333us) write_op.cc:301] APPLY: starting
0616 19:52:16.553568 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.553609 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.553646 (+ 37us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.553765 (+ 119us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.553799 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0616 19:52:16.553805 (+ 6us) write_op.cc:312] APPLY: finished
0616 19:52:16.553882 (+ 77us) log.cc:844] Serialized 29 byte log entry
0616 19:52:16.553953 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.553973 (+ 20us) write_op.cc:454] Released schema lock
0616 19:52:16.553980 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:16.554051 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.554055 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":285,"apply.run_cpu_time_us":487,"apply.run_wall_time_us":487,"num_ops":2,"prepare.queue_time_us":119804,"prepare.run_cpu_time_us":726,"prepare.run_wall_time_us":6515,"replication_time_us":168517}]]}
I20260616 19:52:16.573312 1192 ts_tablet_manager.cc:1434] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260616 19:52:16.573297 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e81c554664ed46b5b0abee87fa9b8e32" } modify_external_catalogs: true
I20260616 19:52:16.573449 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e81c554664ed46b5b0abee87fa9b8e32" } modify_external_catalogs: true
I20260616 19:52:16.573622 1192 tablet_bootstrap.cc:492] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:16.574210 1196 consensus_queue.cc:260] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.574548 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f309caaa9042f99432a61fd2ebb089" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:16.574692 781 raft_consensus.cc:3060] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.574976 1192 tablet_bootstrap.cc:654] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.575680 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0d3e7da3c74f5ea5dc4aac80a01c82" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:16.575812 784 raft_consensus.cc:3060] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.577232 781 raft_consensus.cc:2468] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:16.577656 860 leader_election.cc:304] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:16.578197 784 raft_consensus.cc:2468] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:16.578531 860 leader_election.cc:304] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:16.578581 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a7b177800174706a985c11e5876b9d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.578790 2664 raft_consensus.cc:2804] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:16.578888 2664 raft_consensus.cc:697] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:16.579136 2664 consensus_queue.cc:237] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.579339 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.579389 1196 ts_tablet_manager.cc:1434] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260616 19:52:16.579630 1196 tablet_bootstrap.cc:492] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:16.579715 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 78a0194879b04eea8573323c3ac4582a (DEFAULT_TABLE table=default.Table_9b188e63a36744d999a6225688f78a2b [id=c5b701622e3742969d7cfa4342e67ef1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.579991 2555 raft_consensus.cc:2804] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:16.580078 2555 raft_consensus.cc:697] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:16.580265 2555 consensus_queue.cc:237] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.581759 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 84ce7bf3e0004ffaa2c5e314fa69322c (table default.Table_4f1675b0cae24ecea8b9f4efebb44772 [id=4f2b128cff5248f98e3506bb72a39391]). Expected version 3 got 0
I20260616 19:52:16.582101 460 catalog_manager.cc:5696] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } }
I20260616 19:52:16.583077 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet eed22bbef8ef479dad179b96ba850d26 (table default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a]). Expected version 2 got 0
I20260616 19:52:16.584033 1196 tablet_bootstrap.cc:654] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:16.585196 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 265a37409d8e4b1bb8ea20e3970b5f69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 265a37409d8e4b1bb8ea20e3970b5f69 already in progress: creating tablet
I20260616 19:52:16.585214 2697 tablet.cc:1724] T eed22bbef8ef479dad179b96ba850d26 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260616 19:52:16.585454 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 96bf58d365a54c24b5131416d95d2b6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96bf58d365a54c24b5131416d95d2b6a already in progress: creating tablet
I20260616 19:52:16.589180 1034 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1177) took 1122 ms. Trace:
I20260616 19:52:16.589275 1034 rpcz_store.cc:276] 0616 19:52:15.466767 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.408198 (+941431us) service_pool.cc:224] Handling call
0616 19:52:16.408519 (+ 321us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.408541 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.492622 (+ 84081us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.495327 (+ 2705us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.589165 (+ 93838us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93665}
I20260616 19:52:16.589591 1029 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1168) took 1123 ms. Trace:
I20260616 19:52:16.589663 1029 rpcz_store.cc:276] 0616 19:52:15.466320 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.321456 (+855136us) service_pool.cc:224] Handling call
0616 19:52:16.321808 (+ 352us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.321835 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.495528 (+173693us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.497794 (+ 2266us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.589578 (+ 91784us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91636}
I20260616 19:52:16.590219 1023 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1175) took 1123 ms. Trace:
I20260616 19:52:16.590303 1023 rpcz_store.cc:276] 0616 19:52:15.466670 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.403129 (+936459us) service_pool.cc:224] Handling call
0616 19:52:16.403561 (+ 432us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.403591 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.497983 (+ 94392us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.500446 (+ 2463us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.590205 (+ 89759us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77545}
I20260616 19:52:16.591641 453 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41696 (request call id 1468) took 1059 ms. Trace:
I20260616 19:52:16.591899 2626 raft_consensus.cc:493] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.592005 2626 raft_consensus.cc:515] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.591753 453 rpcz_store.cc:276] 0616 19:52:15.531718 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.266912 (+735194us) service_pool.cc:224] Handling call
0616 19:52:16.387386 (+120474us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x616000043354. stack: 00007f23ba003086 00007f23ba002e40 00007f23b8fbc3ad 000000000099c914 000000000099c8dd 00007f23c94726bd 00007f23c94727b3 00007f23c603ab21 00007f23cdd9f95d 00007f23cdf326c3 00007f23c498e7c6 00007f23c498e4f5 00007f23c109b88e 00007f23c109a76e 00007f23c10a09a8 00007f23c10a130f
0616 19:52:16.387969 (+ 583us) catalog_manager.cc:2126] Acquired catalog manager lock
0616 19:52:16.388349 (+ 380us) catalog_manager.cc:2172] Created new table and tablet info
0616 19:52:16.591407 (+203058us) catalog_manager.cc:2232] Wrote table and tablets to system table
0616 19:52:16.591515 (+ 108us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0616 19:52:16.591607 (+ 92us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.412087 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.412167 (+ 80us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.412171 (+ 4us) write_op.cc:435] Acquired schema lock
0616 19:52:16.412173 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:16.412232 (+ 59us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.412240 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.412244 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:16.412300 (+ 56us) tablet.cc:701] Row locks acquired
0616 19:52:16.412302 (+ 2us) write_op.cc:260] PREPARE: finished
0616 19:52:16.412323 (+ 21us) write_op.cc:270] Start()
0616 19:52:16.412343 (+ 20us) write_op.cc:276] Timestamp: P: 1781639536412279 usec, L: 0
0616 19:52:16.412347 (+ 4us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.412455 (+ 108us) log.cc:844] Serialized 433 byte log entry
0616 19:52:16.553449 (+140994us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.590788 (+ 37339us) write_op.cc:301] APPLY: starting
0616 19:52:16.590805 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.590851 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.590888 (+ 37us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.591017 (+ 129us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.591065 (+ 48us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0616 19:52:16.591076 (+ 11us) write_op.cc:312] APPLY: finished
0616 19:52:16.591162 (+ 86us) log.cc:844] Serialized 29 byte log entry
0616 19:52:16.591241 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.591263 (+ 22us) write_op.cc:454] Released schema lock
0616 19:52:16.591271 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:16.591357 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.591363 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":276602112,"child_traces":[["op",{"apply.queue_time_us":2993,"apply.run_cpu_time_us":586,"apply.run_wall_time_us":34867,"num_ops":2,"prepare.queue_time_us":23350,"prepare.run_cpu_time_us":468,"prepare.run_wall_time_us":1471,"replication_time_us":141090}]]}
I20260616 19:52:16.592445 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6623943c0e0c496583317884ef6790ed" } new_table_name: "default.Table_57baa761ff0f4e189d6b46fada3d0d9f" modify_external_catalogs: true
I20260616 19:52:16.592626 2626 leader_election.cc:290] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.595214 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482411d57f24459d8e7ed0eeb573234d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:16.595671 996 leader_election.cc:343] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.600941 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 1f300180868342918598c1c3eb288c16 (DEFAULT_TABLE table=default.Table_323f0e585ad6419a8a9221edf79f8716 [id=18c46506faa246ab978437c4442492fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.601100 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 538c5095791d4266b885cb8cee445fa6 (DEFAULT_TABLE table=default.Table_3ea40ffcc904453a9d49c71e251e88ab [id=16749e6bcdde403ebc52fd5e51b8bf50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.601596 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 9778a8daffe14fc5a0fd2335df3df17f (DEFAULT_TABLE table=default.Table_cb3a5b66dc3a4963b7828b4a3f004534 [id=3bec466a3ef74c9cb3032a7616927078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.602295 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 3a0b37be3899486090f94c5e1a592672 (DEFAULT_TABLE table=default.Table_00b803667bdf48af929af230c36f05b8 [id=3ced149a3f7b45e19a118cd97ef5d8ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.602813 754 tablet_service.cc:1511] Processing CreateTablet for tablet 3a0b37be3899486090f94c5e1a592672 (DEFAULT_TABLE table=default.Table_00b803667bdf48af929af230c36f05b8 [id=3ced149a3f7b45e19a118cd97ef5d8ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.602825 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2dce8d638518422bba830883245f0c3b (DEFAULT_TABLE table=default.Table_95277d9a3185463f83d0690136dfa391 [id=011b7d5f4d724be19e824dc863a6c001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.603170 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0b37be3899486090f94c5e1a592672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.603186 763 tablet_service.cc:1511] Processing CreateTablet for tablet 78a0194879b04eea8573323c3ac4582a (DEFAULT_TABLE table=default.Table_9b188e63a36744d999a6225688f78a2b [id=c5b701622e3742969d7cfa4342e67ef1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.604976 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a0194879b04eea8573323c3ac4582a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.606146 764 tablet_service.cc:1511] Processing CreateTablet for tablet 1f300180868342918598c1c3eb288c16 (DEFAULT_TABLE table=default.Table_323f0e585ad6419a8a9221edf79f8716 [id=18c46506faa246ab978437c4442492fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.606303 1196 tablet_bootstrap.cc:492] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.606479 765 tablet_service.cc:1511] Processing CreateTablet for tablet 2dce8d638518422bba830883245f0c3b (DEFAULT_TABLE table=default.Table_95277d9a3185463f83d0690136dfa391 [id=011b7d5f4d724be19e824dc863a6c001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.606509 1196 ts_tablet_manager.cc:1403] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20260616 19:52:16.606830 760 tablet_service.cc:1511] Processing CreateTablet for tablet 538c5095791d4266b885cb8cee445fa6 (DEFAULT_TABLE table=default.Table_3ea40ffcc904453a9d49c71e251e88ab [id=16749e6bcdde403ebc52fd5e51b8bf50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.607172 747 tablet_service.cc:1511] Processing CreateTablet for tablet 9778a8daffe14fc5a0fd2335df3df17f (DEFAULT_TABLE table=default.Table_cb3a5b66dc3a4963b7828b4a3f004534 [id=3bec466a3ef74c9cb3032a7616927078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.607517 756 tablet_service.cc:1511] Processing CreateTablet for tablet f252ea7261ea42869e25245c7ee78c05 (DEFAULT_TABLE table=default.Table_1711b70016334d1e9cd9e043a4cd1625 [id=5e7b87ea6e424b179eaee22711702ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.607945 1033 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1185) took 1075 ms. Trace:
I20260616 19:52:16.608022 1033 rpcz_store.cc:276] 0616 19:52:15.532211 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.424394 (+892183us) service_pool.cc:224] Handling call
0616 19:52:16.439398 (+ 15004us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.439425 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.510979 (+ 71554us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.513798 (+ 2819us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.607928 (+ 94130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93959}
I20260616 19:52:16.608062 1196 raft_consensus.cc:359] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.608405 1196 raft_consensus.cc:385] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.608554 1196 raft_consensus.cc:740] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.608805 1024 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1186) took 1076 ms. Trace:
I20260616 19:52:16.608886 1024 rpcz_store.cc:276] 0616 19:52:15.532286 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.426993 (+894707us) service_pool.cc:224] Handling call
0616 19:52:16.438489 (+ 11496us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.438519 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.507597 (+ 69078us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.515360 (+ 7763us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.608793 (+ 93433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93276}
I20260616 19:52:16.609119 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f300180868342918598c1c3eb288c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.608968 1196 consensus_queue.cc:260] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.609207 1037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1178) took 1142 ms. Trace:
I20260616 19:52:16.609282 1037 rpcz_store.cc:276] 0616 19:52:15.466817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.411781 (+944964us) service_pool.cc:224] Handling call
0616 19:52:16.412105 (+ 324us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.412127 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.476962 (+ 64835us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.518984 (+ 42022us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.609193 (+ 90209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90055}
I20260616 19:52:16.609630 1031 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1183) took 1077 ms. Trace:
I20260616 19:52:16.609699 1031 rpcz_store.cc:276] 0616 19:52:15.532058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.415839 (+883781us) service_pool.cc:224] Handling call
0616 19:52:16.424944 (+ 9105us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.424967 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.503648 (+ 78681us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.519363 (+ 15715us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.609617 (+ 90254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90106}
I20260616 19:52:16.610038 1025 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51610 (request call id 1182) took 1078 ms. Trace:
I20260616 19:52:16.610106 1025 rpcz_store.cc:276] 0616 19:52:15.531928 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.414369 (+882441us) service_pool.cc:224] Handling call
0616 19:52:16.414686 (+ 317us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:52:16.414719 (+ 33us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:52:16.486295 (+ 71576us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.519698 (+ 33403us) tablet_replica.cc:206] Creating consensus instance
0616 19:52:16.610025 (+ 90327us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90179}
W20260616 19:52:16.611339 445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:43055, user_credentials={real_user=slave}} blocked reactor thread for 58429.2us
I20260616 19:52:16.612332 1196 ts_tablet_manager.cc:1434] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260616 19:52:16.615048 890 tablet_service.cc:1511] Processing CreateTablet for tablet 538c5095791d4266b885cb8cee445fa6 (DEFAULT_TABLE table=default.Table_3ea40ffcc904453a9d49c71e251e88ab [id=16749e6bcdde403ebc52fd5e51b8bf50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.615437 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538c5095791d4266b885cb8cee445fa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.619531 902 tablet_service.cc:1511] Processing CreateTablet for tablet 9778a8daffe14fc5a0fd2335df3df17f (DEFAULT_TABLE table=default.Table_cb3a5b66dc3a4963b7828b4a3f004534 [id=3bec466a3ef74c9cb3032a7616927078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.619832 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9778a8daffe14fc5a0fd2335df3df17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.620746 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dce8d638518422bba830883245f0c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.625273 457 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41696 (request call id 1469) took 1074 ms. Trace:
I20260616 19:52:16.625538 898 tablet_service.cc:1511] Processing CreateTablet for tablet 2dce8d638518422bba830883245f0c3b (DEFAULT_TABLE table=default.Table_95277d9a3185463f83d0690136dfa391 [id=011b7d5f4d724be19e824dc863a6c001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.625676 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 4be902fe29bb46a4bf71ee6384e6722a
I20260616 19:52:16.625852 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dce8d638518422bba830883245f0c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.625893 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538c5095791d4266b885cb8cee445fa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.626179 456 catalog_manager.cc:6784] ReplaceTablet: tablet 4be902fe29bb46a4bf71ee6384e6722a deleted and replaced by tablet d7cb00d193774b679027abd23689d112
I20260616 19:52:16.626451 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_28a18e68feba4a7789a6693a706adb55" } modify_external_catalogs: true
I20260616 19:52:16.626600 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_28a18e68feba4a7789a6693a706adb55" } modify_external_catalogs: true
I20260616 19:52:16.625401 457 rpcz_store.cc:276] 0616 19:52:15.550750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.535359 (+984609us) service_pool.cc:224] Handling call
0616 19:52:16.536218 (+ 859us) catalog_manager.cc:2126] Acquired catalog manager lock
0616 19:52:16.536689 (+ 471us) catalog_manager.cc:2172] Created new table and tablet info
0616 19:52:16.625005 (+ 88316us) catalog_manager.cc:2232] Wrote table and tablets to system table
0616 19:52:16.625128 (+ 123us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0616 19:52:16.625222 (+ 94us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.537291 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.537389 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.537394 (+ 5us) write_op.cc:435] Acquired schema lock
0616 19:52:16.537396 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:16.537477 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.537488 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.537492 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:16.537563 (+ 71us) tablet.cc:701] Row locks acquired
0616 19:52:16.537565 (+ 2us) write_op.cc:260] PREPARE: finished
0616 19:52:16.537597 (+ 32us) write_op.cc:270] Start()
0616 19:52:16.537628 (+ 31us) write_op.cc:276] Timestamp: P: 1781639536537536 usec, L: 0
0616 19:52:16.537632 (+ 4us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.537807 (+ 175us) log.cc:844] Serialized 433 byte log entry
0616 19:52:16.621604 (+ 83797us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.621991 (+ 387us) write_op.cc:301] APPLY: starting
0616 19:52:16.622007 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.622050 (+ 43us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.622076 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.622180 (+ 104us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.622215 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0616 19:52:16.622222 (+ 7us) write_op.cc:312] APPLY: finished
0616 19:52:16.622300 (+ 78us) log.cc:844] Serialized 29 byte log entry
0616 19:52:16.622368 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.622392 (+ 24us) write_op.cc:454] Released schema lock
0616 19:52:16.622402 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:16.622481 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.622485 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":338,"apply.run_cpu_time_us":478,"apply.run_wall_time_us":478,"num_ops":2,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":581,"prepare.run_wall_time_us":581,"replication_time_us":83934}]]}
I20260616 19:52:16.628073 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a632f56f49de487f99b7e68978a6ae78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:16.628645 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a632f56f49de487f99b7e68978a6ae78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.628994 1196 tablet_bootstrap.cc:492] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:16.629788 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 43e9d7a232f6444dbec3a3954bd47641
W20260616 19:52:16.629992 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a95c684f5fe54f7dad6300efb0c18780 consensus state has no leader
I20260616 19:52:16.630326 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1516f5dc3b2b4de48c2c4076d1cb1205" } new_table_name: "default.Table_2ae975bcbcb5466c99f5c77eb216d950" modify_external_catalogs: true
I20260616 19:52:16.630352 899 tablet_service.cc:1511] Processing CreateTablet for tablet 1f300180868342918598c1c3eb288c16 (DEFAULT_TABLE table=default.Table_323f0e585ad6419a8a9221edf79f8716 [id=18c46506faa246ab978437c4442492fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.630411 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a05dd0b3957b4fb1954090bc8cefe859"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:16.630653 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f300180868342918598c1c3eb288c16. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:16.630864 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a05dd0b3957b4fb1954090bc8cefe859 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.632027 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ad0b7615a5934617be3d8e18a220fa31
I20260616 19:52:16.632025 1196 tablet_bootstrap.cc:654] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.632700 893 tablet_service.cc:1511] Processing CreateTablet for tablet 3a0b37be3899486090f94c5e1a592672 (DEFAULT_TABLE table=default.Table_00b803667bdf48af929af230c36f05b8 [id=3ced149a3f7b45e19a118cd97ef5d8ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.632613 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0dae2e2b86304f1e918ba87baa81fc0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:16.632977 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0b37be3899486090f94c5e1a592672. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:16.633176 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0dae2e2b86304f1e918ba87baa81fc0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.634249 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 14a234e4e45f4b68be478bd4fe409225
I20260616 19:52:16.634850 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cb98fbb879cb4612a266b8db4ec3972a" } new_table_name: "default.Table_6db27a94dd254a88a1a094845a659b27" modify_external_catalogs: true
I20260616 19:52:16.636498 888 tablet_service.cc:1511] Processing CreateTablet for tablet 78a0194879b04eea8573323c3ac4582a (DEFAULT_TABLE table=default.Table_9b188e63a36744d999a6225688f78a2b [id=c5b701622e3742969d7cfa4342e67ef1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.636940 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a0194879b04eea8573323c3ac4582a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.637490 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 4be902fe29bb46a4bf71ee6384e6722a with delete_type TABLET_DATA_DELETED (replaced by tablet d7cb00d193774b679027abd23689d112) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.638237 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 43e9d7a232f6444dbec3a3954bd47641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.639009 761 tablet_service.cc:1558] Processing DeleteTablet for tablet ad0b7615a5934617be3d8e18a220fa31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.639703 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 14a234e4e45f4b68be478bd4fe409225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.639946 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f252ea7261ea42869e25245c7ee78c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.640431 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9778a8daffe14fc5a0fd2335df3df17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.643069 454 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 84ce7bf3e0004ffaa2c5e314fa69322c (table default.Table_4f1675b0cae24ecea8b9f4efebb44772 [id=4f2b128cff5248f98e3506bb72a39391]). Expected version 3 got 0
I20260616 19:52:16.645262 459 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:41696 (request call id 1470) took 1058 ms. Trace:
I20260616 19:52:16.645371 459 rpcz_store.cc:276] 0616 19:52:15.586574 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.557146 (+970572us) service_pool.cc:224] Handling call
0616 19:52:16.557525 (+ 379us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0616 19:52:16.557739 (+ 214us) catalog_manager.cc:3750] Apply alter schema
0616 19:52:16.557928 (+ 189us) catalog_manager.cc:3782] Acquired catalog manager lock
0616 19:52:16.558003 (+ 75us) catalog_manager.cc:3940] Updating metadata on disk
0616 19:52:16.624531 (+ 66528us) catalog_manager.cc:3971] Committing alterations to in-memory state
0616 19:52:16.645219 (+ 20688us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.558531 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.558625 (+ 94us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.558633 (+ 8us) write_op.cc:435] Acquired schema lock
0616 19:52:16.558637 (+ 4us) tablet.cc:662] Decoding operations
0616 19:52:16.558765 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.558779 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.558786 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0616 19:52:16.558865 (+ 79us) tablet.cc:701] Row locks acquired
0616 19:52:16.558869 (+ 4us) write_op.cc:260] PREPARE: finished
0616 19:52:16.558910 (+ 41us) write_op.cc:270] Start()
0616 19:52:16.558945 (+ 35us) write_op.cc:276] Timestamp: P: 1781639536558844 usec, L: 0
0616 19:52:16.558950 (+ 5us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.559176 (+ 226us) log.cc:844] Serialized 405 byte log entry
0616 19:52:16.621677 (+ 62501us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.622555 (+ 878us) write_op.cc:301] APPLY: starting
0616 19:52:16.622566 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.622594 (+ 28us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.622616 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.622659 (+ 43us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.622695 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0616 19:52:16.622704 (+ 9us) write_op.cc:312] APPLY: finished
0616 19:52:16.622775 (+ 71us) log.cc:844] Serialized 23 byte log entry
0616 19:52:16.622815 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.622826 (+ 11us) write_op.cc:454] Released schema lock
0616 19:52:16.622831 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:16.622892 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.622895 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":844,"apply.run_cpu_time_us":332,"apply.run_wall_time_us":332,"num_ops":1,"prepare.queue_time_us":75,"prepare.run_cpu_time_us":707,"prepare.run_wall_time_us":706,"replication_time_us":62711}]]}
I20260616 19:52:16.649299 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7de044cb57e941ab9471ffe3bd7eeccb
I20260616 19:52:16.651703 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 14a234e4e45f4b68be478bd4fe409225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.652076 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 43e9d7a232f6444dbec3a3954bd47641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.652357 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 4be902fe29bb46a4bf71ee6384e6722a with delete_type TABLET_DATA_DELETED (replaced by tablet d7cb00d193774b679027abd23689d112) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.652366 2628 raft_consensus.cc:493] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.652513 2628 raft_consensus.cc:515] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.652637 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 7de044cb57e941ab9471ffe3bd7eeccb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.653134 2628 leader_election.cc:290] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.653823 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe784716b3c4293bd4eddf57f6c9048" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:16.654001 1059 raft_consensus.cc:2468] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:16.654433 719 leader_election.cc:304] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:16.654922 2628 raft_consensus.cc:2804] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:16.655004 2628 raft_consensus.cc:493] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:16.655071 2628 raft_consensus.cc:3060] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:16.655428 460 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:35519 (request call id 182) took 791 ms (client timeout 1000 ms). Trace:
W20260616 19:52:16.655597 460 rpcz_store.cc:269] 0616 19:52:15.863659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.062122 (+198463us) service_pool.cc:224] Handling call
0616 19:52:16.066417 (+ 4295us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x616000043354. stack: 00007f23ba003086 00007f23ba002e40 00007f23b8fbc3ad 000000000099c914 000000000099c8dd 00007f23c94726bd 00007f23c94727b3 00007f23c603ab21 00007f23cdd9f95d 00007f23cdf2cf08 00007f23c498bca6 00007f23c498b9d5 00007f23c109b88e 00007f23c109a76e 00007f23c10a09a8 00007f23c10a130f
0616 19:52:16.655362 (+588945us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:16.584032 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:16.584138 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:16.584143 (+ 5us) write_op.cc:435] Acquired schema lock
0616 19:52:16.584145 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:16.584248 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:16.584260 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:16.584264 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0616 19:52:16.584323 (+ 59us) tablet.cc:701] Row locks acquired
0616 19:52:16.584325 (+ 2us) write_op.cc:260] PREPARE: finished
0616 19:52:16.584358 (+ 33us) write_op.cc:270] Start()
0616 19:52:16.584386 (+ 28us) write_op.cc:276] Timestamp: P: 1781639536584293 usec, L: 0
0616 19:52:16.584389 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:16.584548 (+ 159us) log.cc:844] Serialized 533 byte log entry
0616 19:52:16.621860 (+ 37312us) op_driver.cc:464] REPLICATION: finished
0616 19:52:16.624298 (+ 2438us) write_op.cc:301] APPLY: starting
0616 19:52:16.624306 (+ 8us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:16.624328 (+ 22us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:16.624362 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:16.624391 (+ 29us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:16.624413 (+ 22us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0616 19:52:16.624420 (+ 7us) write_op.cc:312] APPLY: finished
0616 19:52:16.635936 (+ 11516us) log.cc:844] Serialized 23 byte log entry
0616 19:52:16.635998 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.636011 (+ 13us) write_op.cc:454] Released schema lock
0616 19:52:16.636017 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:16.636075 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:16.636079 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":24,"spinlock_wait_cycles":6708992,"child_traces":[["op",{"apply.queue_time_us":2402,"apply.run_cpu_time_us":338,"apply.run_wall_time_us":11767,"num_ops":1,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":586,"prepare.run_wall_time_us":585,"replication_time_us":37460}]]}
W20260616 19:52:16.659838 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 93239.7us
I20260616 19:52:16.522102 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896d5aa87f14e5593d01085bb6d434f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:16.666570 922 raft_consensus.cc:3060] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.668341 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet ad0b7615a5934617be3d8e18a220fa31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.669063 922 raft_consensus.cc:2468] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:16.660076 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 43e9d7a232f6444dbec3a3954bd47641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.660224 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 14a234e4e45f4b68be478bd4fe409225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.669389 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 7de044cb57e941ab9471ffe3bd7eeccb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.660634 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 269c1dea941c481fb6fd2e4d59c877c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b0f5388a73143569012ed714e53a8be) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.660750 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 7de044cb57e941ab9471ffe3bd7eeccb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.660869 894 tablet_service.cc:1558] Processing DeleteTablet for tablet c239a24dbdc047f9beb2ed7e1492acfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.660974 897 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.661075 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1696a3c9f24001a4aaf99725f73f62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.661108 885 tablet_service.cc:1558] Processing DeleteTablet for tablet e6f309caaa9042f99432a61fd2ebb089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.661361 892 tablet_service.cc:1558] Processing DeleteTablet for tablet a817b1d4c7b640db8894bc801878caae with delete_type TABLET_DATA_DELETED (replaced by tablet cf23aef677064e43bbba3ffba26f2719) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.661605 901 tablet_service.cc:1558] Processing DeleteTablet for tablet c7f724dc23024a7297cfb8689f199600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.661751 886 tablet_service.cc:1558] Processing DeleteTablet for tablet aabf57dd6d704645b6bf97b730dbe964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.662204 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 647b1abeb3c14b11b9a5c62b67e83cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.662307 902 tablet_service.cc:1558] Processing DeleteTablet for tablet ad0b7615a5934617be3d8e18a220fa31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.662549 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 802d30c340494490896c8da33d110708 with delete_type TABLET_DATA_DELETED (replaced by tablet c5047956478f488dbb4734bbaa138c00) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.662863 889 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a2855b7dec4244a3fc52bdca7e7eb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.663487 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe784716b3c4293bd4eddf57f6c9048" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.670303 915 raft_consensus.cc:2468] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:16.670780 718 leader_election.cc:304] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:16.671200 2646 raft_consensus.cc:2804] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:16.671326 2646 raft_consensus.cc:697] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:16.671550 2646 consensus_queue.cc:237] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.671821 1037 tablet_service.cc:1511] Processing CreateTablet for tablet f252ea7261ea42869e25245c7ee78c05 (DEFAULT_TABLE table=default.Table_1711b70016334d1e9cd9e043a4cd1625 [id=5e7b87ea6e424b179eaee22711702ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.674273 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 25f8901f52a14e8fb7412bac53212bd6 (DEFAULT_TABLE table=default.Table_0d0dc8e6e8b94b42a633512f5d869265 [id=718b15ad151c47408300aa60b0f09239]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.659332 2628 raft_consensus.cc:515] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.678464 2679 consensus_queue.cc:1048] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:16.680366 858 consensus_peers.cc:597] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:16.680763 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe784716b3c4293bd4eddf57f6c9048" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:16.680938 1059 raft_consensus.cc:3060] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.681206 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe784716b3c4293bd4eddf57f6c9048" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:16.681183 2628 leader_election.cc:290] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.681340 915 raft_consensus.cc:3060] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.681672 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 4be902fe29bb46a4bf71ee6384e6722a with delete_type TABLET_DATA_DELETED (replaced by tablet d7cb00d193774b679027abd23689d112) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.683530 1059 raft_consensus.cc:2468] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:16.683787 915 raft_consensus.cc:2468] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:16.683981 719 leader_election.cc:304] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:16.681051 858 leader_election.cc:304] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:16.684378 2628 raft_consensus.cc:2804] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:16.684967 2679 raft_consensus.cc:2764] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260616 19:52:16.685079 2628 raft_consensus.cc:697] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
W20260616 19:52:16.685559 858 leader_election.cc:343] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: f52b2c5ff6264ffe8d579cb3816fc253
I20260616 19:52:16.686288 858 leader_election.cc:304] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:16.686949 2679 raft_consensus.cc:2749] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:16.686143 2628 consensus_queue.cc:237] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.688849 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0d3e7da3c74f5ea5dc4aac80a01c82" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:16.688939 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f309caaa9042f99432a61fd2ebb089" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:16.689025 1060 raft_consensus.cc:3060] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.689043 1054 raft_consensus.cc:3060] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.689991 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f724dc23024a7297cfb8689f199600" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:16.690129 1057 raft_consensus.cc:2468] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:16.691409 1060 raft_consensus.cc:2468] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:16.691475 1054 raft_consensus.cc:2468] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:16.521382 1190 ts_tablet_manager.cc:1929] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:16.706956 1190 log.cc:1199] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/47b548b6b7f746fe9fd67c2e6563e961
I20260616 19:52:16.707418 1190 ts_tablet_manager.cc:1950] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:16.707957 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 994) took 5333 ms. Trace:
I20260616 19:52:16.708060 1190 rpcz_store.cc:276] 0616 19:52:11.374557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.376751 (+ 2194us) service_pool.cc:224] Handling call
0616 19:52:16.513994 (+5137243us) ts_tablet_manager.cc:1151] Deleting tablet 47b548b6b7f746fe9fd67c2e6563e961
0616 19:52:16.514003 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.518929 (+ 4926us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.521340 (+ 2411us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.707935 (+186595us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4929038}
I20260616 19:52:16.708732 1190 tablet_replica.cc:333] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:16.709017 1190 raft_consensus.cc:2243] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:16.713541 2702 tablet.cc:1724] T eed22bbef8ef479dad179b96ba850d26 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:16.717487 1196 tablet_bootstrap.cc:492] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.717834 1196 ts_tablet_manager.cc:1403] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.010s
W20260616 19:52:16.721469 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 138819us
I20260616 19:52:16.723663 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482411d57f24459d8e7ed0eeb573234d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.725024 1196 raft_consensus.cc:359] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.725379 1196 raft_consensus.cc:385] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.725555 1196 raft_consensus.cc:740] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.726020 1196 consensus_queue.cc:260] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.729135 1196 ts_tablet_manager.cc:1434] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
W20260616 19:52:16.735239 445 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 69982us
W20260616 19:52:16.735342 448 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 67160.8us
I20260616 19:52:16.735937 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 47b548b6b7f746fe9fd67c2e6563e961 (table default.Table_60ba0f6f88634456a3d4afc9f759c4a7 [id=9c7b653f62ef4b74946cc87069f8df6e]) successfully deleted
I20260616 19:52:16.736533 2664 raft_consensus.cc:493] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.736666 2664 raft_consensus.cc:515] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.736750 754 tablet_service.cc:1511] Processing CreateTablet for tablet ea986e578afb4c838b15ca7be5f2cc0a (DEFAULT_TABLE table=default.Table_2a5f3eb8fe14467f80b2d3222e2f2963 [id=325697368ea746e99d802a27c9bb43a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.737162 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea986e578afb4c838b15ca7be5f2cc0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.737629 2664 leader_election.cc:290] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:16.739282 993 leader_election.cc:343] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.739399 993 leader_election.cc:304] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:16.739846 2626 raft_consensus.cc:2749] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:16.740242 422 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-tasknFdngH/build/asan/bin/kudu pid 1210: Timed out: CheckLeaks RPC to 127.0.105.188:34219 timed out after 1.000s (SENT)
I20260616 19:52:16.740425 422 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasknFdngH/build/asan/bin/kudu with pid 1210
I20260616 19:52:16.741506 2662 consensus_queue.cc:1048] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:16.741672 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc5116ef5df4140a96f03c003337c68" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:16.741879 775 raft_consensus.cc:2468] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:16.742625 860 leader_election.cc:304] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:16.742843 2662 raft_consensus.cc:2804] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:16.742909 2662 raft_consensus.cc:493] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:16.742974 2662 raft_consensus.cc:3060] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.745759 2662 raft_consensus.cc:515] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.746315 2662 leader_election.cc:290] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:16.758405 2661 raft_consensus.cc:493] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.758559 2661 raft_consensus.cc:515] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.759194 2661 leader_election.cc:290] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.759704 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08db2c1398b946c180d81b88504c1d9c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:16.760008 1196 tablet_bootstrap.cc:492] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:16.760186 996 leader_election.cc:343] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.764099 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9778a8daffe14fc5a0fd2335df3df17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.765376 1198 tablet_bootstrap.cc:654] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.765990 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a0194879b04eea8573323c3ac4582a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.766999 1191 ts_tablet_manager.cc:1929] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:16.767098 1191 log.cc:1199] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/2e1696a3c9f24001a4aaf99725f73f62
I20260616 19:52:16.767401 1191 ts_tablet_manager.cc:1950] T 2e1696a3c9f24001a4aaf99725f73f62 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:16.767647 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0b37be3899486090f94c5e1a592672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.768750 2628 raft_consensus.cc:493] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.768862 2628 raft_consensus.cc:515] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.769424 2628 leader_election.cc:290] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:16.770035 719 leader_election.cc:343] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: afc58b2bda2a43f18f157469b591854b
I20260616 19:52:16.770216 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538c5095791d4266b885cb8cee445fa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.771798 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f252ea7261ea42869e25245c7ee78c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.772297 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dce8d638518422bba830883245f0c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.776978 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc5116ef5df4140a96f03c003337c68" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:16.777155 1055 raft_consensus.cc:2468] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:16.777575 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25f8901f52a14e8fb7412bac53212bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.778898 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc5116ef5df4140a96f03c003337c68" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:16.779031 1055 raft_consensus.cc:3060] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.781505 1055 raft_consensus.cc:2468] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:16.782269 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f300180868342918598c1c3eb288c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.782981 1196 tablet_bootstrap.cc:654] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.784564 1190 raft_consensus.cc:2272] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:16.785143 1190 ts_tablet_manager.cc:1916] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:16.793278 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08db2c1398b946c180d81b88504c1d9c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:16.793385 718 leader_election.cc:343] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Not found: Tablet not found: afc58b2bda2a43f18f157469b591854b
I20260616 19:52:16.793490 718 leader_election.cc:304] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:16.793684 2642 raft_consensus.cc:2749] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:16.739290 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7aeeccc151924d7f9851b501e784bde7" } new_table_name: "default.Table_a8c2577365414efab85e2417e855994f" modify_external_catalogs: true
W20260616 19:52:16.794634 993 leader_election.cc:343] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.794767 993 leader_election.cc:304] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:16.795106 2661 raft_consensus.cc:2749] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:16.761680 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d5b58242e0e1482bb075c36a0a36d598"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:16.795687 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5b58242e0e1482bb075c36a0a36d598 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.796103 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc5116ef5df4140a96f03c003337c68" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:16.796366 784 raft_consensus.cc:3060] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:16.796905 445 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 60941.1us
I20260616 19:52:16.797214 1198 tablet_bootstrap.cc:492] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:16.797366 1198 ts_tablet_manager.cc:1403] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.236s user 0.013s sys 0.009s
I20260616 19:52:16.794689 763 tablet_service.cc:1511] Processing CreateTablet for tablet 25f8901f52a14e8fb7412bac53212bd6 (DEFAULT_TABLE table=default.Table_0d0dc8e6e8b94b42a633512f5d869265 [id=718b15ad151c47408300aa60b0f09239]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.797951 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25f8901f52a14e8fb7412bac53212bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.798056 1198 raft_consensus.cc:359] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.798202 1198 raft_consensus.cc:385] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.798272 1198 raft_consensus.cc:740] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.798468 1198 consensus_queue.cc:260] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.798905 1198 ts_tablet_manager.cc:1434] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260616 19:52:16.799247 1198 tablet_bootstrap.cc:492] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:16.799816 784 raft_consensus.cc:2468] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:16.800227 893 tablet_service.cc:1511] Processing CreateTablet for tablet f252ea7261ea42869e25245c7ee78c05 (DEFAULT_TABLE table=default.Table_1711b70016334d1e9cd9e043a4cd1625 [id=5e7b87ea6e424b179eaee22711702ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.800601 1198 tablet_bootstrap.cc:654] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:16.801407 858 leader_election.cc:343] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 47b548b6b7f746fe9fd67c2e6563e961
I20260616 19:52:16.801579 858 leader_election.cc:304] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
W20260616 19:52:16.801826 858 raft_consensus.cc:2686] T 47b548b6b7f746fe9fd67c2e6563e961 P ae28da1c4102450ab76eb2946a5cbf2e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:52:16.803066 2662 consensus_queue.cc:1048] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:16.809512 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 61ed3f9808114580bcbb53d9b3b3889f (DEFAULT_TABLE table=default.Table_3242a9af55a549e895eea5daa4ff2f9d [id=aa05d698683f4911a6aa620ffd4875d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.809935 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ed3f9808114580bcbb53d9b3b3889f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.814356 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f252ea7261ea42869e25245c7ee78c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.823102 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1049) took 4259 ms. Trace:
I20260616 19:52:16.823258 1191 rpcz_store.cc:276] 0616 19:52:12.563318 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.567360 (+ 4042us) service_pool.cc:224] Handling call
0616 19:52:16.522944 (+3955584us) ts_tablet_manager.cc:1151] Deleting tablet 2e1696a3c9f24001a4aaf99725f73f62
0616 19:52:16.522952 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.527125 (+ 4173us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.766954 (+239829us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.823078 (+ 56124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3955330}
I20260616 19:52:16.823768 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 2e1696a3c9f24001a4aaf99725f73f62 (table default.Table_186eb03ebeeb4351b7cd0feeaebd1ef3 [id=9f49b3a822224b5082a631394c44a5b2]) successfully deleted
I20260616 19:52:16.823840 1191 tablet_replica.cc:333] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:16.824004 1191 raft_consensus.cc:2243] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:16.824281 1191 raft_consensus.cc:2272] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:16.809195 1196 tablet_bootstrap.cc:492] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.815487 2646 raft_consensus.cc:493] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.835731 2646 raft_consensus.cc:515] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.836568 858 leader_election.cc:304] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:16.836812 2662 raft_consensus.cc:2804] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:16.836879 2662 raft_consensus.cc:493] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:16.836941 2662 raft_consensus.cc:3060] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.824313 2642 raft_consensus.cc:493] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.837528 2642 raft_consensus.cc:515] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.838085 2642 leader_election.cc:290] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:16.838745 2646 leader_election.cc:290] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.839444 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d825bcf365f424fb99a10afe3e96501" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:16.839600 1055 raft_consensus.cc:2468] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:16.839973 719 leader_election.cc:304] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:16.840057 2662 raft_consensus.cc:515] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.840240 2646 raft_consensus.cc:2804] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:16.840299 2646 raft_consensus.cc:493] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:16.840353 2646 raft_consensus.cc:3060] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.840721 2662 leader_election.cc:290] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:16.842290 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f724dc23024a7297cfb8689f199600" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:16.842446 784 raft_consensus.cc:3060] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.842659 2646 raft_consensus.cc:515] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.843513 2646 leader_election.cc:290] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.843945 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d825bcf365f424fb99a10afe3e96501" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:16.844086 1055 raft_consensus.cc:3060] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.844368 860 leader_election.cc:304] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:16.846171 1191 ts_tablet_manager.cc:1916] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:16.846946 1055 raft_consensus.cc:2468] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:16.847322 719 leader_election.cc:304] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:16.847401 1192 tablet_bootstrap.cc:492] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:16.847543 1192 ts_tablet_manager.cc:1403] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.274s user 0.002s sys 0.002s
I20260616 19:52:16.847735 2646 raft_consensus.cc:2804] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:16.847908 2646 raft_consensus.cc:697] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:16.848100 2646 consensus_queue.cc:237] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.849162 784 raft_consensus.cc:2468] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:16.849586 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a59409d014404ee6b446c5b405c04bc1
I20260616 19:52:16.849599 899 tablet_service.cc:1511] Processing CreateTablet for tablet 25f8901f52a14e8fb7412bac53212bd6 (DEFAULT_TABLE table=default.Table_0d0dc8e6e8b94b42a633512f5d869265 [id=718b15ad151c47408300aa60b0f09239]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.849839 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d825bcf365f424fb99a10afe3e96501" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:16.850016 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25f8901f52a14e8fb7412bac53212bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.850217 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d825bcf365f424fb99a10afe3e96501" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:16.850258 718 leader_election.cc:343] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.850509 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f724dc23024a7297cfb8689f199600" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.850669 915 raft_consensus.cc:2393] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
W20260616 19:52:16.850776 718 leader_election.cc:343] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.851379 1196 ts_tablet_manager.cc:1403] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.092s user 0.004s sys 0.000s
I20260616 19:52:16.852203 1196 raft_consensus.cc:359] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.852376 1196 raft_consensus.cc:385] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.852427 1196 raft_consensus.cc:740] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.852681 1196 consensus_queue.cc:260] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.853348 1196 ts_tablet_manager.cc:1434] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:16.853619 1196 tablet_bootstrap.cc:492] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:16.854177 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab68d403f07148de90b6094d607db866 consensus state has no leader
I20260616 19:52:16.855057 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet a59409d014404ee6b446c5b405c04bc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.857975 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f724dc23024a7297cfb8689f199600" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:16.858525 1058 raft_consensus.cc:2468] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:16.859139 719 leader_election.cc:304] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:16.859529 2642 raft_consensus.cc:2764] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260616 19:52:16.860292 2559 raft_consensus.cc:2804] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:16.860432 2559 raft_consensus.cc:697] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:16.860668 2559 consensus_queue.cc:237] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.861057 1198 tablet_bootstrap.cc:492] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:16.861195 1198 ts_tablet_manager.cc:1403] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.062s user 0.001s sys 0.005s
I20260616 19:52:16.862066 1192 raft_consensus.cc:359] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:16.862390 995 connection.cc:573] client connection to 127.0.105.188:34219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260616 19:52:16.863243 902 tablet_service.cc:1558] Processing DeleteTablet for tablet a59409d014404ee6b446c5b405c04bc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:16.863303 898 tablet_service.cc:1511] Processing CreateTablet for tablet 61ed3f9808114580bcbb53d9b3b3889f (DEFAULT_TABLE table=default.Table_3242a9af55a549e895eea5daa4ff2f9d [id=aa05d698683f4911a6aa620ffd4875d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.863714 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ed3f9808114580bcbb53d9b3b3889f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.863941 1196 tablet_bootstrap.cc:654] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:16.864337 858 consensus_peers.cc:597] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:16.828835 1193 ts_tablet_manager.cc:1929] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:16.865733 1193 log.cc:1199] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/49ab6193c479400da00e1fa80a5274a2
I20260616 19:52:16.866321 1193 ts_tablet_manager.cc:1950] T 49ab6193c479400da00e1fa80a5274a2 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:16.862280 1192 raft_consensus.cc:385] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.867695 1192 raft_consensus.cc:740] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.868093 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1095) took 2839 ms. Trace:
I20260616 19:52:16.868046 1192 consensus_queue.cc:260] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.869045 1192 ts_tablet_manager.cc:1434] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260616 19:52:16.834146 2628 consensus_queue.cc:1048] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:16.869657 1193 rpcz_store.cc:276] 0616 19:52:14.029135 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.030581 (+ 1446us) service_pool.cc:224] Handling call
0616 19:52:16.562031 (+2531450us) ts_tablet_manager.cc:1151] Deleting tablet 49ab6193c479400da00e1fa80a5274a2
0616 19:52:16.562040 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.701660 (+139620us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.828729 (+127069us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.868075 (+ 39346us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2531155}
I20260616 19:52:16.870014 1192 tablet_bootstrap.cc:492] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:16.871881 1192 tablet_bootstrap.cc:654] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.872144 461 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 84ce7bf3e0004ffaa2c5e314fa69322c (table default.Table_4f1675b0cae24ecea8b9f4efebb44772 [id=4f2b128cff5248f98e3506bb72a39391]). Expected version 3 got 0
I20260616 19:52:16.872689 461 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet dbe373c3bb094972b0e17fcb1587987a (table default.Table_12d44ad1ef7c46e595ac4de96d937d31 [id=fdd0430505e44bbabac45088b8930d0e]). Expected version 1 got 0
I20260616 19:52:16.873059 461 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 31db3862f78943519bcd9531c5530048 (table default.Table_8cda9a799036458f9543a8a8aac3ee5a [id=c72157c1e0f943e4af149e7f692209ee]). Expected version 1 got 0
I20260616 19:52:16.877525 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1096) took 2838 ms. Trace:
I20260616 19:52:16.877689 1193 rpcz_store.cc:276] 0616 19:52:14.038743 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.039707 (+ 964us) service_pool.cc:224] Handling call
0616 19:52:16.877350 (+2837643us) ts_tablet_manager.cc:1151] Deleting tablet ce0963f38738468eb1518deadb3f119d
0616 19:52:16.877364 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.877502 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2837409}
I20260616 19:52:16.878304 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1105) took 2633 ms. Trace:
W20260616 19:52:16.878687 447 connection.cc:573] client connection to 127.0.105.188:34219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260616 19:52:16.878618 1193 rpcz_store.cc:276] 0616 19:52:14.244496 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.244548 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:16.878019 (+2633471us) ts_tablet_manager.cc:1151] Deleting tablet 150af2d5b0614adc8ae7a2bdac076a87
0616 19:52:16.878030 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.878280 (+ 250us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2633283}
W20260616 19:52:16.878829 447 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 2 similar messages]
I20260616 19:52:16.878932 1193 tablet_replica.cc:333] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:16.879393 1193 raft_consensus.cc:2243] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:16.879619 1193 raft_consensus.cc:2272] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:16.880323 1193 ts_tablet_manager.cc:1916] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:16.885296 1196 tablet_bootstrap.cc:492] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.885426 1196 ts_tablet_manager.cc:1403] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.002s
I20260616 19:52:16.886116 1196 raft_consensus.cc:359] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.886279 1196 raft_consensus.cc:385] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.886341 1196 raft_consensus.cc:740] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.886407 1198 raft_consensus.cc:359] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.886546 1196 consensus_queue.cc:260] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.886622 1198 raft_consensus.cc:385] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.886693 1198 raft_consensus.cc:740] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.886914 1198 consensus_queue.cc:260] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.887107 1196 ts_tablet_manager.cc:1434] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:52:16.887362 1196 tablet_bootstrap.cc:492] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:16.887393 1198 ts_tablet_manager.cc:1434] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.026s user 0.001s sys 0.001s
I20260616 19:52:16.887919 899 tablet_service.cc:1511] Processing CreateTablet for tablet ea986e578afb4c838b15ca7be5f2cc0a (DEFAULT_TABLE table=default.Table_2a5f3eb8fe14467f80b2d3222e2f2963 [id=325697368ea746e99d802a27c9bb43a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.888309 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea986e578afb4c838b15ca7be5f2cc0a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:16.889242 2722 negotiation.cc:336] Failed RPC negotiation. Trace:
0616 19:52:16.868945 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.188:34219 (local address 127.0.105.129:43567)
0616 19:52:16.884217 (+ 15272us) negotiation.cc:107] Waiting for socket to connect
0616 19:52:16.884372 (+ 155us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":15166,"threads_started":1}
I20260616 19:52:16.890059 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f724dc23024a7297cfb8689f199600" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:16.890244 1055 raft_consensus.cc:3060] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.891158 1196 tablet_bootstrap.cc:654] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:16.891642 2720 negotiation.cc:336] Failed RPC negotiation. Trace:
0616 19:52:16.863712 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.188:34219 (local address 127.0.105.131:36901)
0616 19:52:16.891358 (+ 27646us) negotiation.cc:107] Waiting for socket to connect
0616 19:52:16.891470 (+ 112us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":27544,"threads_started":1}
I20260616 19:52:16.892869 1055 raft_consensus.cc:2468] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:16.893514 1192 tablet_bootstrap.cc:492] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:16.893708 1192 ts_tablet_manager.cc:1403] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20260616 19:52:16.897261 2583 consensus_queue.cc:1048] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:16.905956 1196 tablet_bootstrap.cc:492] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:16.906184 1196 ts_tablet_manager.cc:1403] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.004s
I20260616 19:52:16.906934 1196 raft_consensus.cc:359] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.907135 1196 raft_consensus.cc:385] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.907218 1196 raft_consensus.cc:740] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.907459 1196 consensus_queue.cc:260] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.907994 1196 ts_tablet_manager.cc:1434] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:52:16.909739 1198 tablet_bootstrap.cc:492] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:16.911190 1198 tablet_bootstrap.cc:654] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.911427 1196 tablet_bootstrap.cc:492] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:16.879168 859 connection.cc:573] client connection to 127.0.105.188:34219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260616 19:52:16.920625 858 leader_election.cc:304] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:16.920887 2662 raft_consensus.cc:2804] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:16.921006 2662 raft_consensus.cc:697] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:16.921281 2662 consensus_queue.cc:237] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.876093 1190 ts_tablet_manager.cc:1929] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:16.924821 1190 log.cc:1199] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/64aa32856ca34743933931fb51f2bd7b
I20260616 19:52:16.925449 1190 ts_tablet_manager.cc:1950] T 64aa32856ca34743933931fb51f2bd7b P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:16.927253 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1002) took 5214 ms. Trace:
I20260616 19:52:16.928002 1196 tablet_bootstrap.cc:654] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.927585 921 raft_consensus.cc:2468] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:16.928695 718 leader_election.cc:304] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:16.929147 2646 raft_consensus.cc:2804] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:16.929427 2646 raft_consensus.cc:697] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:16.929724 2646 consensus_queue.cc:237] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.936667 455 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 31db3862f78943519bcd9531c5530048 (table default.Table_8cda9a799036458f9543a8a8aac3ee5a [id=c72157c1e0f943e4af149e7f692209ee]). Expected version 1 got 0
I20260616 19:52:16.937033 455 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet dbe373c3bb094972b0e17fcb1587987a (table default.Table_12d44ad1ef7c46e595ac4de96d937d31 [id=fdd0430505e44bbabac45088b8930d0e]). Expected version 1 got 0
I20260616 19:52:16.927908 1190 rpcz_store.cc:276] 0616 19:52:11.713049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.714294 (+ 1245us) service_pool.cc:224] Handling call
0616 19:52:16.708679 (+4994385us) ts_tablet_manager.cc:1151] Deleting tablet 64aa32856ca34743933931fb51f2bd7b
0616 19:52:16.708691 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.812023 (+103332us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.876045 (+ 64022us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.927232 (+ 51187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75280,"tablet-delete.queue_time_us":4994215}
I20260616 19:52:16.940693 2583 raft_consensus.cc:493] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.940814 2583 raft_consensus.cc:515] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.941425 2583 leader_election.cc:290] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.942139 1190 tablet_replica.cc:333] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:16.942328 1190 raft_consensus.cc:2243] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:16.942632 1190 pending_rounds.cc:70] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:52:16.942699 1190 pending_rounds.cc:77] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595525217308672 op_type: NO_OP noop_request { }
I20260616 19:52:16.942793 1190 raft_consensus.cc:2889] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:16.942880 1190 raft_consensus.cc:2272] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:16.943398 1190 ts_tablet_manager.cc:1916] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:16.944631 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8b9d6b95a74dbe97461b4bc9984fe3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:16.945124 718 leader_election.cc:343] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.926442 1192 raft_consensus.cc:359] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.945554 1192 raft_consensus.cc:385] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:16.945626 1192 raft_consensus.cc:740] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:16.946219 1192 consensus_queue.cc:260] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.946858 1192 ts_tablet_manager.cc:1434] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
W20260616 19:52:16.947099 447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.188:34219, user_credentials={real_user=slave}} blocked reactor thread for 68267.2us
I20260616 19:52:16.941943 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8b9d6b95a74dbe97461b4bc9984fe3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:16.947865 1055 raft_consensus.cc:2468] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:16.948298 719 leader_election.cc:304] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:16.948668 2583 raft_consensus.cc:2804] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:16.948741 2583 raft_consensus.cc:493] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:16.948794 2583 raft_consensus.cc:3060] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.951143 2583 raft_consensus.cc:515] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.952692 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8b9d6b95a74dbe97461b4bc9984fe3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:16.952879 1055 raft_consensus.cc:3060] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.953421 1193 ts_tablet_manager.cc:1929] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:16.953506 1193 log.cc:1199] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/731556662b62419dae76149b22469ebd
I20260616 19:52:16.953828 1193 ts_tablet_manager.cc:1950] T 731556662b62419dae76149b22469ebd P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:16.954499 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1101) took 2710 ms. Trace:
I20260616 19:52:16.954574 1193 rpcz_store.cc:276] 0616 19:52:14.244194 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.278808 (+ 34614us) service_pool.cc:224] Handling call
0616 19:52:16.878886 (+2600078us) ts_tablet_manager.cc:1151] Deleting tablet 731556662b62419dae76149b22469ebd
0616 19:52:16.878896 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.936729 (+ 57833us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.953370 (+ 16641us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.954480 (+ 1110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2599783}
I20260616 19:52:16.955489 1055 raft_consensus.cc:2468] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:16.955951 719 leader_election.cc:304] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:16.956176 2642 raft_consensus.cc:2804] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:16.956269 2642 raft_consensus.cc:697] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
W20260616 19:52:16.915596 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 71243us
I20260616 19:52:16.956486 2642 consensus_queue.cc:237] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.958576 460 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet a95c684f5fe54f7dad6300efb0c18780 (table default.Table_57baa761ff0f4e189d6b46fada3d0d9f [id=02d0cb31737b4289988e982dd24ae298]). Expected version 1 got 0
I20260616 19:52:16.959925 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 49ab6193c479400da00e1fa80a5274a2 (table default.Table_8b66b38f443d4eaebf8391a80ef74818 [id=1f077f42ac19492597ea7cd3027cae10]) successfully deleted
W20260616 19:52:16.960114 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet ce0963f38738468eb1518deadb3f119d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce0963f38738468eb1518deadb3f119d already in progress: creating tablet
W20260616 19:52:16.960289 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 150af2d5b0614adc8ae7a2bdac076a87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 150af2d5b0614adc8ae7a2bdac076a87 already in progress: creating tablet
I20260616 19:52:16.960441 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 731556662b62419dae76149b22469ebd (table default.Table_465ef4c1c4044473a6e721ae45cbd7a1 [id=c49098557d4b4b0d9a720713127e4b53]) successfully deleted
I20260616 19:52:16.960772 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1108) took 2659 ms. Trace:
I20260616 19:52:16.961233 2628 raft_consensus.cc:493] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.960841 1193 rpcz_store.cc:276] 0616 19:52:14.301053 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.301116 (+ 63us) service_pool.cc:224] Handling call
0616 19:52:16.960668 (+2659552us) ts_tablet_manager.cc:1151] Deleting tablet bd7b91e00d6c4f70b0eda75fe83d617e
0616 19:52:16.960677 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.960756 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2659341}
I20260616 19:52:16.961349 2628 raft_consensus.cc:515] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:16.961589 1193 tablet_replica.cc:333] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:16.961907 2628 leader_election.cc:290] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:16.962348 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2d4da3ce99c746bf9df636a9abb9831d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:16.962893 860 consensus_peers.cc:597] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 731556662b62419dae76149b22469ebd. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:16.962896 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d4da3ce99c746bf9df636a9abb9831d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.964115 2697 tablet.cc:1724] T dbe373c3bb094972b0e17fcb1587987a P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:16.964082 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c974894ab3f54d5d899d7affcfe26f57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:16.964538 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c974894ab3f54d5d899d7affcfe26f57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.965188 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_73c66b0e09f54a7588be8629dc7a8492" } new_table_name: "default.Table_af21cdd08925496bbccaea24c3e228a1" modify_external_catalogs: true
I20260616 19:52:16.965595 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1dfa3e8f31e44cca9b69c60f7bba81d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:16.966022 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1dfa3e8f31e44cca9b69c60f7bba81d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:16.966398 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb9509607ee04d7bb3b412f539af21ce consensus state has no leader
I20260616 19:52:16.966701 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7df49770c7714ce0a900effba2931b9e" } modify_external_catalogs: true
I20260616 19:52:16.966856 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7df49770c7714ce0a900effba2931b9e" } modify_external_catalogs: true
I20260616 19:52:16.966962 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_54440d81ff5a4fa59cde855e84964b07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:16.967399 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54440d81ff5a4fa59cde855e84964b07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:16.973053 1192 tablet_bootstrap.cc:492] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:16.973951 763 tablet_service.cc:1511] Processing CreateTablet for tablet 61ed3f9808114580bcbb53d9b3b3889f (DEFAULT_TABLE table=default.Table_3242a9af55a549e895eea5daa4ff2f9d [id=aa05d698683f4911a6aa620ffd4875d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.974320 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ed3f9808114580bcbb53d9b3b3889f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.974581 1192 tablet_bootstrap.cc:654] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:16.975811 1193 raft_consensus.cc:2243] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:16.975960 1193 raft_consensus.cc:2272] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:16.976438 1193 ts_tablet_manager.cc:1916] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:16.976724 754 tablet_service.cc:1511] Processing CreateTablet for tablet fbfd376310eb43c7a672a093136e8916 (DEFAULT_TABLE table=default.Table_0f1f9211c91e4a50918fa11912d3b839 [id=9cbb48e9c61043e7a09cdcc4dc59528d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.977047 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfd376310eb43c7a672a093136e8916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.980154 2702 tablet.cc:1724] T dbe373c3bb094972b0e17fcb1587987a P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:16.980409 756 tablet_service.cc:1558] Processing DeleteTablet for tablet a59409d014404ee6b446c5b405c04bc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.980580 760 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a2855b7dec4244a3fc52bdca7e7eb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.980690 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1696a3c9f24001a4aaf99725f73f62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.980809 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 647b1abeb3c14b11b9a5c62b67e83cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.980916 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 802d30c340494490896c8da33d110708 with delete_type TABLET_DATA_DELETED (replaced by tablet c5047956478f488dbb4734bbaa138c00) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.981010 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a718fefe07141119b7ef7edcbf61123 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.981104 752 tablet_service.cc:1558] Processing DeleteTablet for tablet afc58b2bda2a43f18f157469b591854b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:09 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.981210 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 269c1dea941c481fb6fd2e4d59c877c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b0f5388a73143569012ed714e53a8be) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:16.985036 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c74b39e66d344b99f8fc75b855c0520" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.986706 1191 ts_tablet_manager.cc:1929] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:16.986838 1191 log.cc:1199] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/67ac2e31a1ba40b39145c26a1e4e0884
I20260616 19:52:16.987200 1191 ts_tablet_manager.cc:1950] T 67ac2e31a1ba40b39145c26a1e4e0884 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:16.987933 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1047) took 4435 ms. Trace:
I20260616 19:52:16.988013 1191 rpcz_store.cc:276] 0616 19:52:12.552401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.572845 (+ 20444us) service_pool.cc:224] Handling call
0616 19:52:16.823794 (+4250949us) ts_tablet_manager.cc:1151] Deleting tablet 67ac2e31a1ba40b39145c26a1e4e0884
0616 19:52:16.823805 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.913961 (+ 90156us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.986636 (+ 72675us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:16.987915 (+ 1279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4249163}
I20260616 19:52:16.988381 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1052) took 4390 ms. Trace:
I20260616 19:52:16.988488 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8956120045dd4a45a8b94f46fe2d8ad9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:16.989120 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8956120045dd4a45a8b94f46fe2d8ad9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:16.990674 718 leader_election.cc:343] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:16.991616 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 67ac2e31a1ba40b39145c26a1e4e0884 (table default.Table_a438724efd6349269d52e1958ce629fc [id=979c551af45f4055ac350d0db71fa793]) successfully deleted
W20260616 19:52:16.991935 860 consensus_peers.cc:597] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1a09d62e68148349b337c5075763672. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:16.993544 2628 raft_consensus.cc:493] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:16.993685 2628 raft_consensus.cc:515] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.994289 2628 leader_election.cc:290] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.994894 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31db3862f78943519bcd9531c5530048" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:16.995096 915 raft_consensus.cc:2468] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:16.995494 718 leader_election.cc:304] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:16.995755 2628 raft_consensus.cc:2804] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:16.995841 2628 raft_consensus.cc:493] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:16.995913 2628 raft_consensus.cc:3060] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:16.998273 2628 raft_consensus.cc:515] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:16.998867 2628 leader_election.cc:290] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:16.999483 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31db3862f78943519bcd9531c5530048" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:16.999671 915 raft_consensus.cc:3060] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:17.000314 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet bd7b91e00d6c4f70b0eda75fe83d617e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd7b91e00d6c4f70b0eda75fe83d617e already in progress: creating tablet
I20260616 19:52:17.002225 752 tablet_service.cc:1511] Processing CreateTablet for tablet a43f9a63e3d843c6918880c3472ff82a (DEFAULT_TABLE table=default.Table_8eb987854b2d4a2aa71dc4e1315916f3 [id=f2e62b247db84558b1c62d62065b270c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.002568 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43f9a63e3d843c6918880c3472ff82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.003168 1193 ts_tablet_manager.cc:1929] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.004295 1193 log.cc:1199] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/c6939d108a7948bb9e56311a34d95486
I20260616 19:52:17.004810 1193 ts_tablet_manager.cc:1950] T c6939d108a7948bb9e56311a34d95486 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:17.005301 915 raft_consensus.cc:2468] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:17.011693 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 1f97b0a0e70e4fb2b318ffbbcb0ed790 (table default.Table_0f1fc65bff7e42619d3aa73728761fc7 [id=d65edabb0a6d4e4993571e661fba01cd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1f97b0a0e70e4fb2b318ffbbcb0ed790 consensus state has no leader
I20260616 19:52:17.017675 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 64aa32856ca34743933931fb51f2bd7b (table default.Table_9d7e4f47840e4f26bc2ee3c1ae553a0c [id=fb8670837a3f4c7086c4f112b7319a38]) successfully deleted
I20260616 19:52:17.019038 899 tablet_service.cc:1511] Processing CreateTablet for tablet fbfd376310eb43c7a672a093136e8916 (DEFAULT_TABLE table=default.Table_0f1f9211c91e4a50918fa11912d3b839 [id=9cbb48e9c61043e7a09cdcc4dc59528d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.946736 2730 tablet.cc:1724] T eed22bbef8ef479dad179b96ba850d26 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:17.019567 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfd376310eb43c7a672a093136e8916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.019718 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8b9d6b95a74dbe97461b4bc9984fe3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:17.004743 757 tablet_service.cc:1511] Processing CreateTablet for tablet f142f10b6749427aa9c1ab35fc163d5f (DEFAULT_TABLE table=default.Table_af9d4f3f9d8a44578de13634217e4d31 [id=68112a5f5a56463bb08bb1157e2baf7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.007133 718 leader_election.cc:304] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:17.021198 2642 raft_consensus.cc:2804] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:17.021204 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f142f10b6749427aa9c1ab35fc163d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.021337 2642 raft_consensus.cc:697] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
W20260616 19:52:17.021436 718 leader_election.cc:343] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.021560 2642 consensus_queue.cc:237] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.008826 2583 leader_election.cc:290] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.012787 754 tablet_service.cc:1511] Processing CreateTablet for tablet e1c9ea41e7064ec9814f0d4a6f022e94 (DEFAULT_TABLE table=default.Table_f655392b65644b5b9433d91cd0e31252 [id=19cd76a1d36f499d96b0b016f39adf0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.023106 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c9ea41e7064ec9814f0d4a6f022e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.025199 893 tablet_service.cc:1511] Processing CreateTablet for tablet e1c9ea41e7064ec9814f0d4a6f022e94 (DEFAULT_TABLE table=default.Table_f655392b65644b5b9433d91cd0e31252 [id=19cd76a1d36f499d96b0b016f39adf0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.025528 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c9ea41e7064ec9814f0d4a6f022e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.027204 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1110) took 2705 ms. Trace:
I20260616 19:52:17.027287 1193 rpcz_store.cc:276] 0616 19:52:14.321614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.330575 (+ 8961us) service_pool.cc:224] Handling call
0616 19:52:16.961547 (+2630972us) ts_tablet_manager.cc:1151] Deleting tablet c6939d108a7948bb9e56311a34d95486
0616 19:52:16.961555 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.989926 (+ 28371us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.003127 (+ 13201us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.027184 (+ 24057us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2630714}
I20260616 19:52:17.027611 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1113) took 2642 ms. Trace:
I20260616 19:52:17.027666 1193 rpcz_store.cc:276] 0616 19:52:14.385038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.385097 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:17.027511 (+2642414us) ts_tablet_manager.cc:1151] Deleting tablet 70e1f138c3154dfbb93aca7bed67719d
0616 19:52:17.027519 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.027599 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2642216}
I20260616 19:52:17.027882 1193 tablet_replica.cc:333] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.028033 1193 raft_consensus.cc:2243] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:17.028331 1193 raft_consensus.cc:2272] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.029268 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet c6939d108a7948bb9e56311a34d95486 (table default.Table_8dbc007d3ffb483d8f4ca4fefdde8a2b [id=794886751c914a4b9a139e477021e487]) successfully deleted
W20260616 19:52:17.029510 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 70e1f138c3154dfbb93aca7bed67719d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70e1f138c3154dfbb93aca7bed67719d already in progress: creating tablet
I20260616 19:52:17.033291 898 tablet_service.cc:1511] Processing CreateTablet for tablet f142f10b6749427aa9c1ab35fc163d5f (DEFAULT_TABLE table=default.Table_af9d4f3f9d8a44578de13634217e4d31 [id=68112a5f5a56463bb08bb1157e2baf7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.033681 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f142f10b6749427aa9c1ab35fc163d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.034624 461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_88164ea8eb77409cae10a4349d05b55b [id=51b9d37619484805a50cadd93ff7503a] alter complete (version 2)
I20260616 19:52:16.991848 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet c48314f8e45d4b198306f0ae6e40def7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.988449 1191 rpcz_store.cc:276] 0616 19:52:12.598090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.598456 (+ 366us) service_pool.cc:224] Handling call
0616 19:52:16.988264 (+4389808us) ts_tablet_manager.cc:1151] Deleting tablet 01d862f2ce2e4051bcbc71ba8f24846e
0616 19:52:16.988276 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.988366 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4389628}
I20260616 19:52:16.991901 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet a0cb7a1acf35403192254bf5cd1170a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:16.992162 1038 tablet_service.cc:1511] Processing CreateTablet for tablet fbfd376310eb43c7a672a093136e8916 (DEFAULT_TABLE table=default.Table_0f1f9211c91e4a50918fa11912d3b839 [id=9cbb48e9c61043e7a09cdcc4dc59528d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:16.992435 1040 tablet_service.cc:1511] Processing CreateTablet for tablet e1c9ea41e7064ec9814f0d4a6f022e94 (DEFAULT_TABLE table=default.Table_f655392b65644b5b9433d91cd0e31252 [id=19cd76a1d36f499d96b0b016f39adf0b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:17.037485 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 01d862f2ce2e4051bcbc71ba8f24846e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01d862f2ce2e4051bcbc71ba8f24846e already in progress: creating tablet
I20260616 19:52:16.992622 1027 tablet_service.cc:1511] Processing CreateTablet for tablet f142f10b6749427aa9c1ab35fc163d5f (DEFAULT_TABLE table=default.Table_af9d4f3f9d8a44578de13634217e4d31 [id=68112a5f5a56463bb08bb1157e2baf7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.037756 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c9ea41e7064ec9814f0d4a6f022e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.037935 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f142f10b6749427aa9c1ab35fc163d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.009086 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c74b39e66d344b99f8fc75b855c0520" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.038192 1055 raft_consensus.cc:2468] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:17.038586 719 leader_election.cc:304] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:17.039592 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfd376310eb43c7a672a093136e8916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:16.992391 1025 tablet_service.cc:1511] Processing CreateTablet for tablet a43f9a63e3d843c6918880c3472ff82a (DEFAULT_TABLE table=default.Table_8eb987854b2d4a2aa71dc4e1315916f3 [id=f2e62b247db84558b1c62d62065b270c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.041013 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43f9a63e3d843c6918880c3472ff82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.042387 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 43b4c3bd370749b18fb86f7a0aae2c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.042574 746 tablet_service.cc:1558] Processing DeleteTablet for tablet bcc5116ef5df4140a96f03c003337c68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.042713 761 tablet_service.cc:1558] Processing DeleteTablet for tablet c7f724dc23024a7297cfb8689f199600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.042860 747 tablet_service.cc:1558] Processing DeleteTablet for tablet af5e277102b8480db44e5ffe88267808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.043454 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 40bdb01a15254c329d82f0d40919b880 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.043624 746 tablet_service.cc:1558] Processing DeleteTablet for tablet e6f309caaa9042f99432a61fd2ebb089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.043885 746 tablet_service.cc:1558] Processing DeleteTablet for tablet fbe784716b3c4293bd4eddf57f6c9048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.044027 2661 raft_consensus.cc:493] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.044124 2661 raft_consensus.cc:515] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.044370 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f5c1eb12b45345aabb7ab3c7a1854ead" } modify_external_catalogs: true
I20260616 19:52:17.044602 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f5c1eb12b45345aabb7ab3c7a1854ead" } modify_external_catalogs: true
I20260616 19:52:17.044668 2661 leader_election.cc:290] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.011504 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 482411d57f24459d8e7ed0eeb573234d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:17.047312 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d825bcf365f424fb99a10afe3e96501 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.027065 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 08db2c1398b946c180d81b88504c1d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:17.049376 1193 ts_tablet_manager.cc:1916] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.054262 763 tablet_service.cc:1558] Processing DeleteTablet for tablet e896d5aa87f14e5593d01085bb6d434f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:11 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.016913 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31db3862f78943519bcd9531c5530048" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:17.055071 1059 raft_consensus.cc:3060] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.051476 2646 raft_consensus.cc:2804] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:17.056531 2646 raft_consensus.cc:493] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:17.056659 2646 raft_consensus.cc:3060] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.037392 1191 tablet_replica.cc:333] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:17.057399 1191 raft_consensus.cc:2243] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.057621 1191 raft_consensus.cc:2272] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.057821 1059 raft_consensus.cc:2468] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:17.058564 752 tablet_service.cc:1558] Processing DeleteTablet for tablet a817b1d4c7b640db8894bc801878caae with delete_type TABLET_DATA_DELETED (replaced by tablet cf23aef677064e43bbba3ffba26f2719) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.058586 1191 ts_tablet_manager.cc:1916] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.058974 2646 raft_consensus.cc:515] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:17.059975 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c74b39e66d344b99f8fc75b855c0520" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:17.060160 1059 raft_consensus.cc:3060] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.062330 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd289d39eaf4471b754dae9433a5474" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:17.062475 1059 raft_consensus.cc:2468] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:17.063004 719 leader_election.cc:304] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:17.063282 2628 raft_consensus.cc:2804] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
W20260616 19:52:17.063373 996 leader_election.cc:343] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.064134 1196 tablet_bootstrap.cc:492] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.064293 1196 ts_tablet_manager.cc:1403] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.153s user 0.012s sys 0.013s
I20260616 19:52:17.019191 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31db3862f78943519bcd9531c5530048" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.064836 1058 raft_consensus.cc:2376] T 31db3862f78943519bcd9531c5530048 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1. Re-sending same reply.
I20260616 19:52:17.065151 1196 raft_consensus.cc:359] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.065330 1196 raft_consensus.cc:385] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.065423 2702 tablet.cc:1724] T 4d3f47e767764032ae5a06e34e2de248 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:17.065608 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c74b39e66d344b99f8fc75b855c0520" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:17.065876 447 consensus_peers.cc:597] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 -> Peer c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219): Couldn't send request to peer c404c91cd2194cf6838fddd212f2f4ae. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:17.066020 718 leader_election.cc:343] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.030828 1029 tablet_service.cc:1511] Processing CreateTablet for tablet ea986e578afb4c838b15ca7be5f2cc0a (DEFAULT_TABLE table=default.Table_2a5f3eb8fe14467f80b2d3222e2f2963 [id=325697368ea746e99d802a27c9bb43a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.066845 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea986e578afb4c838b15ca7be5f2cc0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.069782 754 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.070333 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd289d39eaf4471b754dae9433a5474" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:17.072109 2559 consensus_queue.cc:1048] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.072393 898 tablet_service.cc:1558] Processing DeleteTablet for tablet bcc5116ef5df4140a96f03c003337c68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:17.072544 2646 leader_election.cc:290] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:17.072801 1196 raft_consensus.cc:740] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.072868 898 tablet_service.cc:1558] Processing DeleteTablet for tablet fbe784716b3c4293bd4eddf57f6c9048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:17.073055 1196 consensus_queue.cc:260] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:17.073143 993 leader_election.cc:343] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.073237 993 leader_election.cc:304] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:17.073585 1196 ts_tablet_manager.cc:1434] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260616 19:52:17.073814 2661 raft_consensus.cc:2749] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:17.073871 1196 tablet_bootstrap.cc:492] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.077888 1190 ts_tablet_manager.cc:1929] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.078351 1196 tablet_bootstrap.cc:654] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.078064 1190 log.cc:1199] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/17029c1ba36644e9847200b54bf9094c
I20260616 19:52:17.078987 1190 ts_tablet_manager.cc:1950] T 17029c1ba36644e9847200b54bf9094c P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:17.080363 2743 tablet.cc:1724] T 4d3f47e767764032ae5a06e34e2de248 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:17.081334 1193 ts_tablet_manager.cc:1929] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.029527 2730 tablet.cc:1724] T dbe373c3bb094972b0e17fcb1587987a P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:17.083382 1193 log.cc:1199] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/fb1c2030b3a14c6aafaa961869606f31
I20260616 19:52:17.083576 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1003) took 5370 ms. Trace:
I20260616 19:52:17.083526 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_90fbb44620274eddaf7fb1d1182cda5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:17.083664 1190 rpcz_store.cc:276] 0616 19:52:11.713183 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.770466 (+ 57283us) service_pool.cc:224] Handling call
0616 19:52:16.942084 (+5171618us) ts_tablet_manager.cc:1151] Deleting tablet 17029c1ba36644e9847200b54bf9094c
0616 19:52:16.942097 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:16.991834 (+ 49737us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.077841 (+ 86007us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.083557 (+ 5716us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304,"tablet-delete.queue_time_us":5171424}
I20260616 19:52:17.084110 1193 ts_tablet_manager.cc:1950] T fb1c2030b3a14c6aafaa961869606f31 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:52:17.084100 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90fbb44620274eddaf7fb1d1182cda5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:17.085249 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1115) took 2569 ms. Trace:
I20260616 19:52:17.085733 2661 raft_consensus.cc:493] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.085880 2661 raft_consensus.cc:515] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.086489 2661 leader_election.cc:290] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.087144 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cb7a1acf35403192254bf5cd1170a2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:17.087182 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cb7a1acf35403192254bf5cd1170a2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:17.087674 996 leader_election.cc:343] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:17.087788 993 leader_election.cc:343] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.087909 993 leader_election.cc:304] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:17.088086 1193 rpcz_store.cc:276] 0616 19:52:14.515265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.519245 (+ 3980us) service_pool.cc:224] Handling call
0616 19:52:17.027842 (+2508597us) ts_tablet_manager.cc:1151] Deleting tablet fb1c2030b3a14c6aafaa961869606f31
0616 19:52:17.027853 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.055494 (+ 27641us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.081264 (+ 25770us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.085167 (+ 3903us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2508352}
I20260616 19:52:17.088354 2661 raft_consensus.cc:2749] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:17.090057 1198 tablet_bootstrap.cc:492] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:17.090257 1198 ts_tablet_manager.cc:1403] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.181s user 0.006s sys 0.006s
I20260616 19:52:17.091094 1198 raft_consensus.cc:359] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.091339 1198 raft_consensus.cc:385] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.091444 1198 raft_consensus.cc:740] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.091770 1198 consensus_queue.cc:260] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.092859 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1116) took 2435 ms. Trace:
I20260616 19:52:17.093102 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet fb1c2030b3a14c6aafaa961869606f31 (table default.Table_7cdef69863694f0ba023c214e42394e8 [id=a7f1b3885b764715a88750ea3752dbdb]) successfully deleted
I20260616 19:52:17.094909 2661 raft_consensus.cc:493] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.095026 2661 raft_consensus.cc:515] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.095710 2661 leader_election.cc:290] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.096380 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd5fecc6d444e5fba9103287c09542e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:17.096542 1193 rpcz_store.cc:276] 0616 19:52:14.657169 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.657224 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:17.092696 (+2435472us) ts_tablet_manager.cc:1151] Deleting tablet 76a89e7686aa44df9bb017816d1accb1
0616 19:52:17.092706 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.092809 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2435278}
I20260616 19:52:17.096872 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 17029c1ba36644e9847200b54bf9094c (table default.Table_bfda4071639c49399f2f5bf499be37e9 [id=1449ff28bd8546908359606f7272846f]) successfully deleted
I20260616 19:52:17.097039 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1117) took 2407 ms. Trace:
I20260616 19:52:17.093266 2628 raft_consensus.cc:697] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:17.096645 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd5fecc6d444e5fba9103287c09542e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:17.097203 1193 rpcz_store.cc:276] 0616 19:52:14.689115 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.689181 (+ 66us) service_pool.cc:224] Handling call
0616 19:52:17.096881 (+2407700us) ts_tablet_manager.cc:1151] Deleting tablet e88de49e07a4467d9698d71c321c16f5
0616 19:52:17.096892 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.096981 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2404426}
W20260616 19:52:17.097595 993 leader_election.cc:343] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.097541 2628 consensus_queue.cc:237] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:17.097878 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1118) took 2366 ms. Trace:
I20260616 19:52:17.098327 1193 rpcz_store.cc:276] 0616 19:52:14.731764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.732190 (+ 426us) service_pool.cc:224] Handling call
0616 19:52:17.097734 (+2365544us) ts_tablet_manager.cc:1151] Deleting tablet cd19e83413ad420e97af92ca609757e5
0616 19:52:17.097745 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.097818 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2313924}
W20260616 19:52:17.098664 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 76a89e7686aa44df9bb017816d1accb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76a89e7686aa44df9bb017816d1accb1 already in progress: creating tablet
W20260616 19:52:17.098780 996 leader_election.cc:343] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.098888 996 leader_election.cc:304] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:17.099228 2661 raft_consensus.cc:2749] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:17.100538 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1004) took 5224 ms. Trace:
I20260616 19:52:17.100663 1190 rpcz_store.cc:276] 0616 19:52:11.876556 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.876606 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:17.084130 (+5207524us) ts_tablet_manager.cc:1151] Deleting tablet fd020407d4f8470e99045206ca16c6d2
0616 19:52:17.100410 (+ 16280us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.100518 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5207340}
I20260616 19:52:17.101533 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1005) took 5200 ms. Trace:
I20260616 19:52:17.101655 1190 rpcz_store.cc:276] 0616 19:52:11.901580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.901646 (+ 66us) service_pool.cc:224] Handling call
0616 19:52:17.101425 (+5199779us) ts_tablet_manager.cc:1151] Deleting tablet c37aeb69afa040eeb9db1f8bdc60bb99
0616 19:52:17.101433 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.101518 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5199579}
I20260616 19:52:17.101806 1198 ts_tablet_manager.cc:1434] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260616 19:52:17.102149 1190 tablet_replica.cc:333] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
W20260616 19:52:17.099658 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet e88de49e07a4467d9698d71c321c16f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e88de49e07a4467d9698d71c321c16f5 already in progress: creating tablet
I20260616 19:52:17.102401 1190 raft_consensus.cc:2243] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.102917 1190 raft_consensus.cc:2272] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:17.103262 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 03098d9d34484d5cbdd488264adbd3cf consensus state has no leader
I20260616 19:52:17.103477 1190 ts_tablet_manager.cc:1916] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.104568 1198 tablet_bootstrap.cc:492] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:17.104564 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a555ad9f529943558a5ef6ea5c99851d
I20260616 19:52:17.105619 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet a555ad9f529943558a5ef6ea5c99851d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:17.106295 1192 tablet_bootstrap.cc:492] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.106460 1192 ts_tablet_manager.cc:1403] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.159s user 0.001s sys 0.009s
I20260616 19:52:17.107227 1192 raft_consensus.cc:359] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.107443 1192 raft_consensus.cc:385] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.107517 1192 raft_consensus.cc:740] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.107771 1192 consensus_queue.cc:260] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.108232 1192 ts_tablet_manager.cc:1434] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:17.110016 2662 raft_consensus.cc:493] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.110128 2662 raft_consensus.cc:515] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:17.110706 2662 leader_election.cc:290] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:17.110932 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1119) took 2317 ms. Trace:
I20260616 19:52:17.111073 1193 rpcz_store.cc:276] 0616 19:52:14.793021 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.793077 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:17.110760 (+2317683us) ts_tablet_manager.cc:1151] Deleting tablet 8f67e5add64244629cbe8694223bd00e
0616 19:52:17.110770 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.110872 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2317495}
I20260616 19:52:17.111677 1193 tablet_replica.cc:333] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.111908 1193 raft_consensus.cc:2243] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.112116 2697 tablet.cc:1724] T 4d3f47e767764032ae5a06e34e2de248 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:17.112772 1193 raft_consensus.cc:2272] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.112905 1198 tablet_bootstrap.cc:654] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.113443 1193 ts_tablet_manager.cc:1916] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:17.116415 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet cd19e83413ad420e97af92ca609757e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd19e83413ad420e97af92ca609757e5 already in progress: creating tablet
W20260616 19:52:17.116933 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8f67e5add64244629cbe8694223bd00e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f67e5add64244629cbe8694223bd00e already in progress: creating tablet
I20260616 19:52:17.117619 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7d486a9c69954dc4a9b664d89d2bf28a
I20260616 19:52:17.118005 754 tablet_service.cc:1558] Processing DeleteTablet for tablet a555ad9f529943558a5ef6ea5c99851d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.119647 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d486a9c69954dc4a9b664d89d2bf28a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.119661 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d486a9c69954dc4a9b664d89d2bf28a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:17.122138 860 leader_election.cc:343] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: b718514e4fbd4601afeb021ed35643e6
W20260616 19:52:17.122438 858 leader_election.cc:343] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: b718514e4fbd4601afeb021ed35643e6
I20260616 19:52:17.122573 858 leader_election.cc:304] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
W20260616 19:52:17.123025 858 consensus_peers.cc:597] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4a2855b7dec4244a3fc52bdca7e7eb3. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:17.123209 2662 raft_consensus.cc:2749] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:17.124315 754 tablet_service.cc:1511] Processing CreateTablet for tablet 6662fabcb74841459d542573765b71a5 (DEFAULT_TABLE table=default.Table_f2dbfc9d56f34516a9c5c940d1affa8b [id=953c99af83084c7c89029817f148db28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.124828 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6662fabcb74841459d542573765b71a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.125876 1192 tablet_bootstrap.cc:492] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.127559 1192 tablet_bootstrap.cc:654] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.133498 461 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet dbe373c3bb094972b0e17fcb1587987a (table default.Table_12d44ad1ef7c46e595ac4de96d937d31 [id=fdd0430505e44bbabac45088b8930d0e]). Expected version 1 got 0
I20260616 19:52:17.134388 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d486a9c69954dc4a9b664d89d2bf28a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:17.133705 899 tablet_service.cc:1558] Processing DeleteTablet for tablet a555ad9f529943558a5ef6ea5c99851d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:16 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:17.136433 899 tablet_service.cc:1511] Processing CreateTablet for tablet a43f9a63e3d843c6918880c3472ff82a (DEFAULT_TABLE table=default.Table_8eb987854b2d4a2aa71dc4e1315916f3 [id=f2e62b247db84558b1c62d62065b270c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.138594 1190 ts_tablet_manager.cc:1929] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:17.138768 1190 log.cc:1199] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/e896d5aa87f14e5593d01085bb6d434f
I20260616 19:52:17.139142 1190 ts_tablet_manager.cc:1950] T e896d5aa87f14e5593d01085bb6d434f P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:17.139248 1196 tablet_bootstrap.cc:492] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.139207 2661 raft_consensus.cc:493] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.139425 1196 ts_tablet_manager.cc:1403] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.001s
I20260616 19:52:17.139355 2661 raft_consensus.cc:515] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.139705 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1006) took 5237 ms. Trace:
I20260616 19:52:17.139829 1190 rpcz_store.cc:276] 0616 19:52:11.901972 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.902015 (+ 43us) service_pool.cc:224] Handling call
0616 19:52:17.102103 (+5200088us) ts_tablet_manager.cc:1151] Deleting tablet e896d5aa87f14e5593d01085bb6d434f
0616 19:52:17.102113 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.127796 (+ 25683us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.138542 (+ 10746us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.139690 (+ 1148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5199917}
I20260616 19:52:17.140031 2661 leader_election.cc:290] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.140251 1196 raft_consensus.cc:359] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.140434 1196 raft_consensus.cc:385] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.140416 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1007) took 5238 ms. Trace:
I20260616 19:52:17.140534 1196 raft_consensus.cc:740] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.140530 1190 rpcz_store.cc:276] 0616 19:52:11.902305 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.902344 (+ 39us) service_pool.cc:224] Handling call
0616 19:52:17.140304 (+5237960us) ts_tablet_manager.cc:1151] Deleting tablet a20701ab3a5d43df92c471bd6013ac6c
0616 19:52:17.140313 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.140400 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5237814}
I20260616 19:52:17.140772 1196 consensus_queue.cc:260] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.141063 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1008) took 5231 ms. Trace:
I20260616 19:52:17.141137 1190 rpcz_store.cc:276] 0616 19:52:11.909712 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.909759 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:17.140965 (+5231206us) ts_tablet_manager.cc:1151] Deleting tablet df14405fff32417da8e9069680100dbd
0616 19:52:17.140973 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.141049 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5231043}
I20260616 19:52:17.141338 1196 ts_tablet_manager.cc:1434] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:17.141400 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c48e233d184487b7651e9cb105c2cc" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:17.141692 1196 tablet_bootstrap.cc:492] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:17.141968 996 leader_election.cc:343] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.141747 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c48e233d184487b7651e9cb105c2cc" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:17.143042 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1011) took 5207 ms. Trace:
W20260616 19:52:17.143043 993 leader_election.cc:343] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.143162 993 leader_election.cc:304] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:17.143540 1196 tablet_bootstrap.cc:654] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.143384 1190 rpcz_store.cc:276] 0616 19:52:11.935630 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.935705 (+ 75us) service_pool.cc:224] Handling call
0616 19:52:17.142942 (+5207237us) ts_tablet_manager.cc:1151] Deleting tablet 87ca1b3a712845f9a93653faa0e95291
0616 19:52:17.142951 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.143029 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5207080}
I20260616 19:52:17.143918 2661 raft_consensus.cc:2749] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:17.144075 2661 raft_consensus.cc:493] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.144207 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1010) took 5208 ms. Trace:
I20260616 19:52:17.144188 2661 raft_consensus.cc:515] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.144270 1190 rpcz_store.cc:276] 0616 19:52:11.935474 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.935960 (+ 486us) service_pool.cc:224] Handling call
0616 19:52:17.144092 (+5208132us) ts_tablet_manager.cc:1151] Deleting tablet 5e8c37e4293a4f2fa4f54397686c5dfc
0616 19:52:17.144102 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.144192 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5207978}
I20260616 19:52:17.144788 2661 leader_election.cc:290] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.146279 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48314f8e45d4b198306f0ae6e40def7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:17.146790 993 leader_election.cc:343] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.147715 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43f9a63e3d843c6918880c3472ff82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.149401 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48314f8e45d4b198306f0ae6e40def7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:17.149542 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 6662fabcb74841459d542573765b71a5 (DEFAULT_TABLE table=default.Table_f2dbfc9d56f34516a9c5c940d1affa8b [id=953c99af83084c7c89029817f148db28]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:17.149823 996 leader_election.cc:343] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.149925 996 leader_election.cc:304] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:17.150290 2654 raft_consensus.cc:2749] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:17.151510 461 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 84ce7bf3e0004ffaa2c5e314fa69322c (table default.Table_4f1675b0cae24ecea8b9f4efebb44772 [id=4f2b128cff5248f98e3506bb72a39391]). Expected version 3 got 0
I20260616 19:52:17.152997 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6662fabcb74841459d542573765b71a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.162492 1191 ts_tablet_manager.cc:1929] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.164186 1191 log.cc:1199] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/c239a24dbdc047f9beb2ed7e1492acfe
I20260616 19:52:17.165515 1196 tablet_bootstrap.cc:492] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.165692 1196 ts_tablet_manager.cc:1403] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.001s
I20260616 19:52:17.166687 1196 raft_consensus.cc:359] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.166929 1196 raft_consensus.cc:385] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.167027 1196 raft_consensus.cc:740] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
W20260616 19:52:17.171286 860 consensus_peers.cc:597] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5c82b71969e4cbcb890d16e1cdd5348. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:17.172293 1190 tablet_replica.cc:333] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:17.172591 1190 raft_consensus.cc:2243] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.172817 1190 raft_consensus.cc:2272] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.173504 1190 ts_tablet_manager.cc:1916] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.174564 2628 raft_consensus.cc:493] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.174772 2628 raft_consensus.cc:515] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.175555 2628 leader_election.cc:290] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.176029 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8708321fb0f4c409a66df75da4c6c0e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.176214 1051 raft_consensus.cc:2468] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:17.176609 719 leader_election.cc:304] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
W20260616 19:52:17.162853 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet fd020407d4f8470e99045206ca16c6d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd020407d4f8470e99045206ca16c6d2 already in progress: creating tablet
W20260616 19:52:17.177340 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c37aeb69afa040eeb9db1f8bdc60bb99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c37aeb69afa040eeb9db1f8bdc60bb99 already in progress: creating tablet
I20260616 19:52:17.179177 2628 raft_consensus.cc:2804] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:17.179271 2628 raft_consensus.cc:493] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:17.179352 2628 raft_consensus.cc:3060] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.180037 461 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 76c48e233d184487b7651e9cb105c2cc (table default.Table_8640034462d64b5d879d28e067fe1b14 [id=d24b6a6d28c949b2880a34bfa227c585]). Expected version 2 got 0
I20260616 19:52:17.180723 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8708321fb0f4c409a66df75da4c6c0e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:17.181198 718 leader_election.cc:343] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.181890 2628 raft_consensus.cc:515] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.182469 2628 leader_election.cc:290] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.182888 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8708321fb0f4c409a66df75da4c6c0e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:17.183298 718 leader_election.cc:343] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.183295 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 67ac2e31a1ba40b39145c26a1e4e0884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:17.183601 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8708321fb0f4c409a66df75da4c6c0e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:17.184219 1051 raft_consensus.cc:3060] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.184899 1190 ts_tablet_manager.cc:1929] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:17.185007 1190 log.cc:1199] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/f13d175adfe540b39fd55004a11c9aad
I20260616 19:52:17.185359 1190 ts_tablet_manager.cc:1950] T f13d175adfe540b39fd55004a11c9aad P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:17.185654 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1012) took 5245 ms. Trace:
I20260616 19:52:17.185734 1190 rpcz_store.cc:276] 0616 19:52:11.940662 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.942919 (+ 2257us) service_pool.cc:224] Handling call
0616 19:52:17.158246 (+5215327us) ts_tablet_manager.cc:1151] Deleting tablet f13d175adfe540b39fd55004a11c9aad
0616 19:52:17.172251 (+ 14005us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.178497 (+ 6246us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.184850 (+ 6353us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.185641 (+ 791us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5215169}
I20260616 19:52:17.186074 1190 tablet_replica.cc:333] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:17.186296 1190 raft_consensus.cc:2243] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.186467 1190 raft_consensus.cc:2272] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.187860 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet e896d5aa87f14e5593d01085bb6d434f (table default.Table_8f195aaf0b9c47169f6c04a5e380bd22 [id=a2abe0bca3fa4d35b86a23f91f6973b4]) successfully deleted
I20260616 19:52:17.188453 754 tablet_service.cc:1511] Processing CreateTablet for tablet 6c4d291de79348849078554a968371fa (DEFAULT_TABLE table=default.Table_2ed166bd3a824fa69fffae629bd3570f [id=11ffb381de494b86b8ffe9c2a180b085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.200870 1190 ts_tablet_manager.cc:1916] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.206842 1190 ts_tablet_manager.cc:1929] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:17.189846 1191 ts_tablet_manager.cc:1950] T c239a24dbdc047f9beb2ed7e1492acfe P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:17.209877 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1054) took 4454 ms. Trace:
I20260616 19:52:17.210105 1191 rpcz_store.cc:276] 0616 19:52:12.755886 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.755939 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:17.037348 (+4281409us) ts_tablet_manager.cc:1151] Deleting tablet c239a24dbdc047f9beb2ed7e1492acfe
0616 19:52:17.037358 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.061813 (+ 24455us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.162434 (+100621us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.209842 (+ 47408us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4281203}
I20260616 19:52:17.211438 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1055) took 4313 ms. Trace:
I20260616 19:52:17.211634 1191 rpcz_store.cc:276] 0616 19:52:12.898346 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.898503 (+ 157us) service_pool.cc:224] Handling call
0616 19:52:17.211250 (+4312747us) ts_tablet_manager.cc:1151] Deleting tablet 3624b437ae284916b343c82c07c61e62
0616 19:52:17.211267 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.211412 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4312565}
I20260616 19:52:17.212396 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1056) took 4313 ms. Trace:
I20260616 19:52:17.212611 1191 rpcz_store.cc:276] 0616 19:52:12.898462 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.899146 (+ 684us) service_pool.cc:224] Handling call
0616 19:52:17.212256 (+4313110us) ts_tablet_manager.cc:1151] Deleting tablet f176111bc2a7494da5e17986963a2c5c
0616 19:52:17.212271 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.212376 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4312948}
I20260616 19:52:17.216684 1191 tablet_replica.cc:333] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:17.190580 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fe7bc05510b54924b11d62344defe4a5" } new_table_name: "default.Table_cb44a929206f482bb8beb5fc8eb113d7" modify_external_catalogs: true
I20260616 19:52:17.190910 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_43afc983b9034c56bf7eb1cccf2c7e06" } new_table_name: "default.Table_6206bfba65a54f48a8c98e997e4c21e6" modify_external_catalogs: true
I20260616 19:52:17.207532 2662 raft_consensus.cc:493] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.224484 2662 raft_consensus.cc:515] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:17.191180 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8d5418c55a5b4b00bdf64e1d72483b58" } modify_external_catalogs: true
I20260616 19:52:17.224954 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8d5418c55a5b4b00bdf64e1d72483b58" } modify_external_catalogs: true
I20260616 19:52:17.225157 2662 leader_election.cc:290] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:17.213310 1192 tablet_bootstrap.cc:492] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.225368 1192 ts_tablet_manager.cc:1403] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.100s user 0.006s sys 0.010s
I20260616 19:52:17.191479 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_afc1d67eb0a44d31937f3d2ea557a9f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:17.226141 1192 raft_consensus.cc:359] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.226322 1192 raft_consensus.cc:385] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.226384 1192 raft_consensus.cc:740] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
W20260616 19:52:17.226462 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afc1d67eb0a44d31937f3d2ea557a9f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:17.226570 1192 consensus_queue.cc:260] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:17.226934 858 leader_election.cc:343] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 90205213ba5f49a2931e68839cefb2d2
I20260616 19:52:17.227029 1192 ts_tablet_manager.cc:1434] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:17.227330 1192 tablet_bootstrap.cc:492] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.196791 2545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "85d6b13547f2413c86ee07194ca74704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85d6b13547f2413c86ee07194ca74704" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 35857 } } peers { permanent_uuid: "2b8fb7a8523741a2b7a5e75d8b415be0" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 43055 } } peers { permanent_uuid: "c404c91cd2194cf6838fddd212f2f4ae" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 34219 } } }
I20260616 19:52:17.227418 2559 consensus_queue.cc:1048] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.227579 2545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 [sys.catalog]: This master's current role is: LEADER
I20260616 19:52:17.199800 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_db04f07eeb1544ec9a5b538d6cbd0a44" } modify_external_catalogs: true
I20260616 19:52:17.227892 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_db04f07eeb1544ec9a5b538d6cbd0a44" } modify_external_catalogs: true
W20260616 19:52:17.228524 860 leader_election.cc:343] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 90205213ba5f49a2931e68839cefb2d2
I20260616 19:52:17.228667 860 leader_election.cc:304] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:17.200160 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_edb542c197924a81a6ae1a4a8a16f34a" } modify_external_catalogs: true
I20260616 19:52:17.229179 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_edb542c197924a81a6ae1a4a8a16f34a" } modify_external_catalogs: true
I20260616 19:52:17.229919 2559 raft_consensus.cc:2749] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:17.237519 1192 tablet_bootstrap.cc:654] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.239988 1190 log.cc:1199] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/aa72e00b0a3a423f96bdd7abb6013810
I20260616 19:52:17.240523 1190 ts_tablet_manager.cc:1950] T aa72e00b0a3a423f96bdd7abb6013810 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:17.241194 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1013) took 5283 ms. Trace:
I20260616 19:52:17.248322 2559 consensus_queue.cc:1048] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:17.250844 445 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 62968.1us
W20260616 19:52:17.251119 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a20701ab3a5d43df92c471bd6013ac6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a20701ab3a5d43df92c471bd6013ac6c already in progress: creating tablet
W20260616 19:52:17.251365 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet df14405fff32417da8e9069680100dbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df14405fff32417da8e9069680100dbd already in progress: creating tablet
W20260616 19:52:17.251572 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 87ca1b3a712845f9a93653faa0e95291 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87ca1b3a712845f9a93653faa0e95291 already in progress: creating tablet
W20260616 19:52:17.251782 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 5e8c37e4293a4f2fa4f54397686c5dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e8c37e4293a4f2fa4f54397686c5dfc already in progress: creating tablet
I20260616 19:52:17.251971 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet f13d175adfe540b39fd55004a11c9aad (table default.Table_630c32eab3fb4372a3a7de16f0f7916c [id=f7089c8c9b504f13949fd8db2c11c45c]) successfully deleted
I20260616 19:52:17.252832 899 tablet_service.cc:1511] Processing CreateTablet for tablet 6662fabcb74841459d542573765b71a5 (DEFAULT_TABLE table=default.Table_f2dbfc9d56f34516a9c5c940d1affa8b [id=953c99af83084c7c89029817f148db28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.252959 898 tablet_service.cc:1511] Processing CreateTablet for tablet 6c4d291de79348849078554a968371fa (DEFAULT_TABLE table=default.Table_2ed166bd3a824fa69fffae629bd3570f [id=11ffb381de494b86b8ffe9c2a180b085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.253242 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6662fabcb74841459d542573765b71a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.253470 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4d291de79348849078554a968371fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.254712 893 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb22bec05154cabb7679d577e785b66 (DEFAULT_TABLE table=default.Table_3e1dcfe4518549b894954f78c6d060d2 [id=eeeb8fb2c8344429bf30db969ece63d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.255023 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb22bec05154cabb7679d577e785b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.258190 902 tablet_service.cc:1511] Processing CreateTablet for tablet 2b0144147c014a829e647edf22318940 (DEFAULT_TABLE table=default.Table_6667e28dee3645d7aa4766beddcfa4b6 [id=5759efe75c6c4276a1156a79d0ef9c55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.258503 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0144147c014a829e647edf22318940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.260694 889 tablet_service.cc:1511] Processing CreateTablet for tablet 56b26290785843698daf2398931ed416 (DEFAULT_TABLE table=default.Table_a65d5f0f5a9347a3a06b75a7174ab415 [id=20ea83aae3094fc7b8880b71a7d52cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.261029 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b26290785843698daf2398931ed416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.263936 2662 raft_consensus.cc:493] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.264065 2662 raft_consensus.cc:515] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.264676 2662 leader_election.cc:290] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:17.197147 1193 ts_tablet_manager.cc:1929] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.264864 1193 log.cc:1199] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/e6530753b4184cfe972ae3a43f23d589
I20260616 19:52:17.265070 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4d291de79348849078554a968371fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.265271 1193 ts_tablet_manager.cc:1950] T e6530753b4184cfe972ae3a43f23d589 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:17.266225 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1120) took 2443 ms. Trace:
I20260616 19:52:17.266335 1193 rpcz_store.cc:276] 0616 19:52:14.822458 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.822516 (+ 58us) service_pool.cc:224] Handling call
0616 19:52:17.111587 (+2289071us) ts_tablet_manager.cc:1151] Deleting tablet e6530753b4184cfe972ae3a43f23d589
0616 19:52:17.111596 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.119415 (+ 7819us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.197088 (+ 77673us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.266200 (+ 69112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2288872}
I20260616 19:52:17.266741 1193 tablet_replica.cc:333] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.266969 1193 raft_consensus.cc:2243] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.267140 1193 raft_consensus.cc:2272] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.267798 1193 ts_tablet_manager.cc:1916] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.218497 752 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb22bec05154cabb7679d577e785b66 (DEFAULT_TABLE table=default.Table_3e1dcfe4518549b894954f78c6d060d2 [id=eeeb8fb2c8344429bf30db969ece63d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.219143 763 tablet_service.cc:1511] Processing CreateTablet for tablet 2b0144147c014a829e647edf22318940 (DEFAULT_TABLE table=default.Table_6667e28dee3645d7aa4766beddcfa4b6 [id=5759efe75c6c4276a1156a79d0ef9c55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.220587 757 tablet_service.cc:1511] Processing CreateTablet for tablet 56b26290785843698daf2398931ed416 (DEFAULT_TABLE table=default.Table_a65d5f0f5a9347a3a06b75a7174ab415 [id=20ea83aae3094fc7b8880b71a7d52cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.268870 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb22bec05154cabb7679d577e785b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.268944 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b4c3bd370749b18fb86f7a0aae2c50" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:17.269114 775 raft_consensus.cc:2468] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:17.269556 1192 tablet_bootstrap.cc:492] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.269670 1192 ts_tablet_manager.cc:1403] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.003s
I20260616 19:52:17.270036 860 leader_election.cc:304] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:17.270323 2662 raft_consensus.cc:2804] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:17.270396 2662 raft_consensus.cc:493] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:17.270457 2662 raft_consensus.cc:3060] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.271944 1192 raft_consensus.cc:359] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.272090 1192 raft_consensus.cc:385] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.272131 1192 raft_consensus.cc:740] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.222100 746 tablet_service.cc:1511] Processing CreateTablet for tablet 43e9d7a232f6444dbec3a3954bd47641 (DEFAULT_TABLE table=default.Table_e81c554664ed46b5b0abee87fa9b8e32 [id=edc3db65b0c547d9a1c97c36df298de8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.272326 1192 consensus_queue.cc:260] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.273100 2662 raft_consensus.cc:515] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.273201 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b26290785843698daf2398931ed416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.274451 2662 leader_election.cc:290] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:17.275128 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b4c3bd370749b18fb86f7a0aae2c50" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:17.275315 775 raft_consensus.cc:3060] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.276165 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e9d7a232f6444dbec3a3954bd47641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.277961 775 raft_consensus.cc:2468] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:17.279160 1192 ts_tablet_manager.cc:1434] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260616 19:52:17.279598 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0144147c014a829e647edf22318940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.202596 455 catalog_manager.cc:5696] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:17.210990 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet c239a24dbdc047f9beb2ed7e1492acfe (table default.Table_b9effa349ec04a8989934380e9153218 [id=bb33691603dd4d118134ed79f128e4d9]) successfully deleted
W20260616 19:52:17.282423 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 71467.9us
W20260616 19:52:17.283069 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 3624b437ae284916b343c82c07c61e62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3624b437ae284916b343c82c07c61e62 already in progress: creating tablet
W20260616 19:52:17.283289 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet f176111bc2a7494da5e17986963a2c5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f176111bc2a7494da5e17986963a2c5c already in progress: creating tablet
I20260616 19:52:17.283844 455 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 31db3862f78943519bcd9531c5530048 (table default.Table_8cda9a799036458f9543a8a8aac3ee5a [id=c72157c1e0f943e4af149e7f692209ee]). Expected version 1 got 0
I20260616 19:52:17.284086 860 leader_election.cc:304] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:17.285902 2662 raft_consensus.cc:2804] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:17.286128 1192 tablet_bootstrap.cc:492] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.286304 2662 raft_consensus.cc:697] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:17.286288 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d35aea801f0d481f897236926c33060c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:17.286547 2662 consensus_queue.cc:237] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:17.286860 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d35aea801f0d481f897236926c33060c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:17.288817 1192 tablet_bootstrap.cc:654] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.289633 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet e6530753b4184cfe972ae3a43f23d589 (table default.Table_f05f097bf69a4898afcc750f4aa55d7f [id=99e870e6f821406bb65af1f96f5ad30f]) successfully deleted
I20260616 19:52:17.299932 1193 ts_tablet_manager.cc:1929] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.300145 1193 log.cc:1199] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/c239a24dbdc047f9beb2ed7e1492acfe
I20260616 19:52:17.301069 1193 ts_tablet_manager.cc:1950] T c239a24dbdc047f9beb2ed7e1492acfe P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:17.308193 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1121) took 2356 ms. Trace:
I20260616 19:52:17.308367 1193 rpcz_store.cc:276] 0616 19:52:14.952080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.954039 (+ 1959us) service_pool.cc:224] Handling call
0616 19:52:17.266689 (+2312650us) ts_tablet_manager.cc:1151] Deleting tablet c239a24dbdc047f9beb2ed7e1492acfe
0616 19:52:17.266701 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.292040 (+ 25339us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.299882 (+ 7842us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.308171 (+ 8289us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2312434}
I20260616 19:52:17.308926 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet c239a24dbdc047f9beb2ed7e1492acfe (table default.Table_b9effa349ec04a8989934380e9153218 [id=bb33691603dd4d118134ed79f128e4d9]) successfully deleted
I20260616 19:52:17.262478 1196 consensus_queue.cc:260] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.311780 1190 rpcz_store.cc:276] 0616 19:52:11.958116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:11.959659 (+ 1543us) service_pool.cc:224] Handling call
0616 19:52:17.186001 (+5226342us) ts_tablet_manager.cc:1151] Deleting tablet aa72e00b0a3a423f96bdd7abb6013810
0616 19:52:17.186012 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.203955 (+ 17943us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.206762 (+ 2807us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.241180 (+ 34418us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5226164}
I20260616 19:52:17.314702 1196 ts_tablet_manager.cc:1434] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.149s user 0.015s sys 0.003s
I20260616 19:52:17.315554 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1014) took 5158 ms. Trace:
I20260616 19:52:17.316077 1190 rpcz_store.cc:276] 0616 19:52:12.157076 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.159787 (+ 2711us) service_pool.cc:224] Handling call
0616 19:52:17.315433 (+5155646us) ts_tablet_manager.cc:1151] Deleting tablet cf1ab0a125cf46e9a1afc625297db7af
0616 19:52:17.315444 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.315536 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5155469}
I20260616 19:52:17.316772 1190 tablet_replica.cc:333] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:17.317162 1190 raft_consensus.cc:2243] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.317557 1190 raft_consensus.cc:2272] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.318245 1190 ts_tablet_manager.cc:1916] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.265406 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b4c3bd370749b18fb86f7a0aae2c50" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.320663 1052 raft_consensus.cc:2468] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:17.274151 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b4c3bd370749b18fb86f7a0aae2c50" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:17.320940 1196 tablet_bootstrap.cc:492] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.320998 1058 raft_consensus.cc:3060] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.323558 1191 raft_consensus.cc:2243] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:17.323675 1058 raft_consensus.cc:2468] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:17.323936 1191 raft_consensus.cc:2272] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.324545 1191 ts_tablet_manager.cc:1916] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.274931 1051 raft_consensus.cc:2468] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:17.284977 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 6c4d291de79348849078554a968371fa (DEFAULT_TABLE table=default.Table_2ed166bd3a824fa69fffae629bd3570f [id=11ffb381de494b86b8ffe9c2a180b085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.332001 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4d291de79348849078554a968371fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.322340 1196 tablet_bootstrap.cc:654] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.285112 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb22bec05154cabb7679d577e785b66 (DEFAULT_TABLE table=default.Table_3e1dcfe4518549b894954f78c6d060d2 [id=eeeb8fb2c8344429bf30db969ece63d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.322412 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1122) took 2310 ms. Trace:
I20260616 19:52:17.285112 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 2b0144147c014a829e647edf22318940 (DEFAULT_TABLE table=default.Table_6667e28dee3645d7aa4766beddcfa4b6 [id=5759efe75c6c4276a1156a79d0ef9c55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.333294 1193 rpcz_store.cc:276] 0616 19:52:15.004516 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.004574 (+ 58us) service_pool.cc:224] Handling call
0616 19:52:17.315180 (+2310606us) ts_tablet_manager.cc:1151] Deleting tablet f5c46a428ff44d26a5c49322087cdf7a
0616 19:52:17.315187 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.315289 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2310368}
I20260616 19:52:17.333513 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb22bec05154cabb7679d577e785b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.333600 1193 tablet_replica.cc:333] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.330966 719 leader_election.cc:304] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:17.333771 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0144147c014a829e647edf22318940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.333782 1193 raft_consensus.cc:2243] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.333937 1193 raft_consensus.cc:2272] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.334223 2628 raft_consensus.cc:2804] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:17.334338 2628 raft_consensus.cc:697] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:17.334559 2628 consensus_queue.cc:237] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:17.334715 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f5c46a428ff44d26a5c49322087cdf7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5c46a428ff44d26a5c49322087cdf7a already in progress: creating tablet
I20260616 19:52:17.285320 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 56b26290785843698daf2398931ed416 (DEFAULT_TABLE table=default.Table_a65d5f0f5a9347a3a06b75a7174ab415 [id=20ea83aae3094fc7b8880b71a7d52cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.337679 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b26290785843698daf2398931ed416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.296380 1198 tablet_bootstrap.cc:492] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:17.346422 1198 ts_tablet_manager.cc:1403] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.242s user 0.012s sys 0.028s
W20260616 19:52:17.346880 860 consensus_peers.cc:597] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:17.347162 1198 raft_consensus.cc:359] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.347321 1198 raft_consensus.cc:385] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.347373 1198 raft_consensus.cc:740] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.347582 1198 consensus_queue.cc:260] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.348237 1198 ts_tablet_manager.cc:1434] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:17.348517 1198 tablet_bootstrap.cc:492] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:17.348909 1193 ts_tablet_manager.cc:1916] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.350457 1198 tablet_bootstrap.cc:654] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.355304 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf1b8ec91a3420a8448085f5a8d1e1e (DEFAULT_TABLE table=default.Table_c127220d3313482bafdf2f278d3d815f [id=4731f9a104b24f148d268a0bb24e8cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.355468 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 43e9d7a232f6444dbec3a3954bd47641 (DEFAULT_TABLE table=default.Table_e81c554664ed46b5b0abee87fa9b8e32 [id=edc3db65b0c547d9a1c97c36df298de8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.355551 763 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf1b8ec91a3420a8448085f5a8d1e1e (DEFAULT_TABLE table=default.Table_c127220d3313482bafdf2f278d3d815f [id=4731f9a104b24f148d268a0bb24e8cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.355926 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf1b8ec91a3420a8448085f5a8d1e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.356016 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet aa72e00b0a3a423f96bdd7abb6013810 (table default.Table_4635b5a6e60140b9acd169b569531ffd [id=13855ad4407546ea81ea615a1cdc0438]) successfully deleted
W20260616 19:52:17.356232 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet cf1ab0a125cf46e9a1afc625297db7af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf1ab0a125cf46e9a1afc625297db7af already in progress: creating tablet
I20260616 19:52:17.356904 893 tablet_service.cc:1511] Processing CreateTablet for tablet 43e9d7a232f6444dbec3a3954bd47641 (DEFAULT_TABLE table=default.Table_e81c554664ed46b5b0abee87fa9b8e32 [id=edc3db65b0c547d9a1c97c36df298de8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.357254 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e9d7a232f6444dbec3a3954bd47641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.358947 452 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_12d44ad1ef7c46e595ac4de96d937d31 [id=fdd0430505e44bbabac45088b8930d0e] alter complete (version 1)
I20260616 19:52:17.361172 1192 tablet_bootstrap.cc:492] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.361300 1192 ts_tablet_manager.cc:1403] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.075s user 0.012s sys 0.001s
I20260616 19:52:17.362043 1192 raft_consensus.cc:359] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:17.362188 1192 raft_consensus.cc:385] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.362242 1192 raft_consensus.cc:740] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.362437 1192 consensus_queue.cc:260] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:17.362910 1192 ts_tablet_manager.cc:1434] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260616 19:52:17.363265 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4f5e8729c6149ee92964f08caff6bbf consensus state has no leader
W20260616 19:52:17.363895 860 consensus_peers.cc:597] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6530753b4184cfe972ae3a43f23d589. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:17.365005 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11fae62d87734c369bbb6a6ac95413e9 consensus state has no leader
I20260616 19:52:17.365619 1196 tablet_bootstrap.cc:492] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.365728 1196 ts_tablet_manager.cc:1403] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.001s
I20260616 19:52:17.366307 1196 raft_consensus.cc:359] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.366462 1196 raft_consensus.cc:385] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.366513 1196 raft_consensus.cc:740] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.367190 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9505120dd9f049c19cf2b84cabe021a6
I20260616 19:52:17.368206 1192 tablet_bootstrap.cc:492] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.368309 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 9505120dd9f049c19cf2b84cabe021a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.369592 1192 tablet_bootstrap.cc:654] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.370816 2628 raft_consensus.cc:493] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.370929 2628 raft_consensus.cc:515] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.371856 2662 raft_consensus.cc:493] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.371840 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e277102b8480db44e5ffe88267808" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.371978 2662 raft_consensus.cc:515] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.372033 1051 raft_consensus.cc:2468] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:17.372422 719 leader_election.cc:304] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:17.372704 2745 raft_consensus.cc:2804] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:17.372802 2745 raft_consensus.cc:493] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:17.372881 2745 raft_consensus.cc:3060] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.371871 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e277102b8480db44e5ffe88267808" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:17.373320 922 raft_consensus.cc:2468] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:17.373770 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e277102b8480db44e5ffe88267808" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:17.373822 2662 leader_election.cc:290] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:17.374398 858 consensus_peers.cc:597] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67ac2e31a1ba40b39145c26a1e4e0884. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:17.374902 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5f6a8f2248c34edb80817679ba78faf5" } new_table_name: "default.Table_83fe6e628ced4eddab08b11f3a0c9be7" modify_external_catalogs: true
I20260616 19:52:17.375257 2745 raft_consensus.cc:515] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.375535 784 raft_consensus.cc:2393] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:17.375803 2745 leader_election.cc:290] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.376003 1193 ts_tablet_manager.cc:1929] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.376093 1193 log.cc:1199] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/9d9c89216995430188b1eed4c6b26d1e
I20260616 19:52:17.376268 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e277102b8480db44e5ffe88267808" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:17.376415 922 raft_consensus.cc:3060] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.376406 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8c5e28a5bd6a4912821898da563df270" } new_table_name: "default.Table_2758d8e8b9d74f17bf976b49f830f29c" modify_external_catalogs: true
I20260616 19:52:17.376514 1193 ts_tablet_manager.cc:1950] T 9d9c89216995430188b1eed4c6b26d1e P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:17.376401 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e277102b8480db44e5ffe88267808" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:17.376745 1058 raft_consensus.cc:3060] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.377195 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1123) took 2225 ms. Trace:
I20260616 19:52:17.377264 1193 rpcz_store.cc:276] 0616 19:52:15.151982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.153104 (+ 1122us) service_pool.cc:224] Handling call
0616 19:52:17.333552 (+2180448us) ts_tablet_manager.cc:1151] Deleting tablet 9d9c89216995430188b1eed4c6b26d1e
0616 19:52:17.333561 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.351996 (+ 18435us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.375952 (+ 23956us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.377179 (+ 1227us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2180238}
I20260616 19:52:17.377697 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 9d9c89216995430188b1eed4c6b26d1e (table default.Table_52ebd4cc32a242b6af90514f289aaffd [id=a02891a271e04ca084884abd17c9bee1]) successfully deleted
I20260616 19:52:17.378811 922 raft_consensus.cc:2468] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:17.379094 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_73c81e294f264ad895094c30b52168f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:17.379456 1058 raft_consensus.cc:2468] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:17.379694 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73c81e294f264ad895094c30b52168f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:17.379863 719 leader_election.cc:304] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:17.380095 2745 raft_consensus.cc:2804] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:17.380218 2745 raft_consensus.cc:697] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:17.380897 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf1b8ec91a3420a8448085f5a8d1e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.380954 2662 consensus_queue.cc:1048] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.381351 2745 consensus_queue.cc:237] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.382939 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e9d7a232f6444dbec3a3954bd47641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.387940 2642 consensus_queue.cc:1048] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.389819 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e277102b8480db44e5ffe88267808" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.390085 1051 raft_consensus.cc:2393] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:17.390517 858 leader_election.cc:304] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:17.390981 2662 raft_consensus.cc:2749] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:17.391273 2628 leader_election.cc:290] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.392539 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 9505120dd9f049c19cf2b84cabe021a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:17.393915 1192 tablet_bootstrap.cc:492] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.394047 1192 ts_tablet_manager.cc:1403] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260616 19:52:17.394523 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1131) took 1957 ms. Trace:
I20260616 19:52:17.394733 1192 raft_consensus.cc:359] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.394897 1192 raft_consensus.cc:385] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.395762 1193 rpcz_store.cc:276] 0616 19:52:15.436946 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.440550 (+ 3604us) service_pool.cc:224] Handling call
0616 19:52:17.394376 (+1953826us) ts_tablet_manager.cc:1151] Deleting tablet 0c281b936f2147b9989f03a3e1b6884e
0616 19:52:17.394388 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.394501 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1952004}
I20260616 19:52:17.396603 1192 raft_consensus.cc:740] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.396991 1192 consensus_queue.cc:260] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.397692 1190 ts_tablet_manager.cc:1929] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260616 19:52:17.398113 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0c281b936f2147b9989f03a3e1b6884e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c281b936f2147b9989f03a3e1b6884e already in progress: creating tablet
I20260616 19:52:17.398561 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1154) took 1936 ms. Trace:
I20260616 19:52:17.398900 1193 rpcz_store.cc:276] 0616 19:52:15.462427 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.634859 (+172432us) service_pool.cc:224] Handling call
0616 19:52:17.398446 (+1763587us) ts_tablet_manager.cc:1151] Deleting tablet 0a9e8877705840329d6a063bb5194965
0616 19:52:17.398456 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.398543 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1763411}
W20260616 19:52:17.399947 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 0a9e8877705840329d6a063bb5194965 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a9e8877705840329d6a063bb5194965 already in progress: creating tablet
I20260616 19:52:17.402176 2583 consensus_queue.cc:1048] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.397852 1192 ts_tablet_manager.cc:1434] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260616 19:52:17.412701 1192 tablet_bootstrap.cc:492] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.414050 1192 tablet_bootstrap.cc:654] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.403203 2557 consensus_queue.cc:1048] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.406323 2700 raft_consensus.cc:493] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.415432 2700 raft_consensus.cc:515] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:17.416002 2700 leader_election.cc:290] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:17.416330 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c74b39e66d344b99f8fc75b855c0520" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:17.417019 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c74b39e66d344b99f8fc75b855c0520" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.417276 1058 raft_consensus.cc:2393] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:17.417654 858 leader_election.cc:304] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:17.417734 1196 consensus_queue.cc:260] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.417999 2700 raft_consensus.cc:3060] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:17.418783 445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:43055, user_credentials={real_user=slave}} blocked reactor thread for 61743.6us
I20260616 19:52:17.420286 2700 raft_consensus.cc:2749] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:17.428000 1190 log.cc:1199] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/3b57bceabff64533ae3a49b8afda614d
I20260616 19:52:17.428483 1190 ts_tablet_manager.cc:1950] T 3b57bceabff64533ae3a49b8afda614d P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:17.428447 1196 ts_tablet_manager.cc:1434] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.063s user 0.001s sys 0.001s
I20260616 19:52:17.428788 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1180) took 1364 ms. Trace:
I20260616 19:52:17.428921 1193 rpcz_store.cc:276] 0616 19:52:16.064156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.185910 (+121754us) service_pool.cc:224] Handling call
0616 19:52:17.428645 (+1242735us) ts_tablet_manager.cc:1151] Deleting tablet 170cf5905025434995e7c9cdc802211b
0616 19:52:17.428656 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.428772 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1214179}
I20260616 19:52:17.430051 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1016) took 5267 ms. Trace:
I20260616 19:52:17.431113 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1181) took 1330 ms. Trace:
W20260616 19:52:17.431247 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 170cf5905025434995e7c9cdc802211b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 170cf5905025434995e7c9cdc802211b already in progress: creating tablet
I20260616 19:52:17.431192 1193 rpcz_store.cc:276] 0616 19:52:16.100191 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.186085 (+ 85894us) service_pool.cc:224] Handling call
0616 19:52:17.431006 (+1244921us) ts_tablet_manager.cc:1151] Deleting tablet 5c6add7925294880a5a20eb3d189d1ee
0616 19:52:17.431015 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.431097 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1244782}
I20260616 19:52:17.431473 1193 tablet_replica.cc:333] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.431641 1193 raft_consensus.cc:2243] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:17.431780 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 5c6add7925294880a5a20eb3d189d1ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c6add7925294880a5a20eb3d189d1ee already in progress: creating tablet
I20260616 19:52:17.431808 1193 raft_consensus.cc:2272] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.430891 1190 rpcz_store.cc:276] 0616 19:52:12.162977 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.163038 (+ 61us) service_pool.cc:224] Handling call
0616 19:52:17.316719 (+5153681us) ts_tablet_manager.cc:1151] Deleting tablet 3b57bceabff64533ae3a49b8afda614d
0616 19:52:17.316726 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.371554 (+ 54828us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.397636 (+ 26082us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.430037 (+ 32401us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5153507}
I20260616 19:52:17.432381 1193 ts_tablet_manager.cc:1916] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.433856 1196 tablet_bootstrap.cc:492] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.434368 763 tablet_service.cc:1511] Processing CreateTablet for tablet 778381dbf13942758ec0f20ad60bf81c (DEFAULT_TABLE table=default.Table_c90d49c02db04fe19f8797c4dfa190a3 [id=12b8c335d5a8450cadb6b37f6cfcdc13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.434703 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778381dbf13942758ec0f20ad60bf81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.434897 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 778381dbf13942758ec0f20ad60bf81c (DEFAULT_TABLE table=default.Table_c90d49c02db04fe19f8797c4dfa190a3 [id=12b8c335d5a8450cadb6b37f6cfcdc13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.435247 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778381dbf13942758ec0f20ad60bf81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.435961 752 tablet_service.cc:1511] Processing CreateTablet for tablet 67bb24fb1cbf47529874240f3eee6c14 (DEFAULT_TABLE table=default.Table_fdf8cb959fb04d818c77e3bced7e61b2 [id=f86a72fa840346fd9ecf55d1b79c9abc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.436331 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67bb24fb1cbf47529874240f3eee6c14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.443313 2700 consensus_queue.cc:1048] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.443557 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasknFdngH/build/asan/bin/kudu
/tmp/dist-test-tasknFdngH/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:34219
--webserver_interface=127.0.105.188
--webserver_port=35247
--builtin_ntp_servers=127.0.105.148:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260616 19:52:17.450197 1196 tablet_bootstrap.cc:654] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.451403 893 tablet_service.cc:1558] Processing DeleteTablet for tablet af5e277102b8480db44e5ffe88267808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:17.433372 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1015) took 5270 ms. Trace:
I20260616 19:52:17.455323 1190 rpcz_store.cc:276] 0616 19:52:12.162854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.163246 (+ 392us) service_pool.cc:224] Handling call
0616 19:52:17.433263 (+5270017us) ts_tablet_manager.cc:1151] Deleting tablet adf5010b9025406bb1da70e6875213c6
0616 19:52:17.433273 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.433356 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5269878}
I20260616 19:52:17.455943 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1017) took 5291 ms. Trace:
I20260616 19:52:17.456209 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d825bcf365f424fb99a10afe3e96501 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:17.456252 1190 rpcz_store.cc:276] 0616 19:52:12.164635 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.164683 (+ 48us) service_pool.cc:224] Handling call
0616 19:52:17.455825 (+5291142us) ts_tablet_manager.cc:1151] Deleting tablet 6c9066a57e784356aa27cfcac75c3bd2
0616 19:52:17.455835 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.455928 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5290988}
I20260616 19:52:17.456521 1190 tablet_replica.cc:333] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:17.457187 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 3b57bceabff64533ae3a49b8afda614d (table default.Table_9b86a6539e534ff4a58c2c7ad01e99a0 [id=e29060d6148a4e819d0e9c80cb32956b]) successfully deleted
W20260616 19:52:17.457468 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet adf5010b9025406bb1da70e6875213c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adf5010b9025406bb1da70e6875213c6 already in progress: creating tablet
I20260616 19:52:17.458389 754 tablet_service.cc:1511] Processing CreateTablet for tablet fb0ddbcf398640a6996fc979009662c5 (DEFAULT_TABLE table=default.Table_bd73b82d71a7493299d20a966c252fc7 [id=d6e28d80643a4f7a931f7518fdf57b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.458817 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb0ddbcf398640a6996fc979009662c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.456586 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 9505120dd9f049c19cf2b84cabe021a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:17.459465 1190 raft_consensus.cc:2243] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.459659 1190 raft_consensus.cc:2272] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.460227 1190 ts_tablet_manager.cc:1916] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.461795 2697 tablet.cc:1724] T 84ce7bf3e0004ffaa2c5e314fa69322c P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:17.464144 1192 tablet_bootstrap.cc:492] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.464330 1192 ts_tablet_manager.cc:1403] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.002s
I20260616 19:52:17.465162 1192 raft_consensus.cc:359] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.465481 1192 raft_consensus.cc:385] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.465576 1192 raft_consensus.cc:740] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.465847 1192 consensus_queue.cc:260] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.466431 1192 ts_tablet_manager.cc:1434] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:17.466878 1192 tablet_bootstrap.cc:492] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.462603 2702 tablet.cc:1724] T 84ce7bf3e0004ffaa2c5e314fa69322c P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260616 19:52:17.468243 719 consensus_peers.cc:597] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e896d5aa87f14e5593d01085bb6d434f. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:17.471030 2743 tablet.cc:1724] T 84ce7bf3e0004ffaa2c5e314fa69322c P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:17.471483 2662 consensus_queue.cc:1048] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.472548 1198 tablet_bootstrap.cc:492] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:17.472702 1198 ts_tablet_manager.cc:1403] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.124s user 0.003s sys 0.000s
I20260616 19:52:17.475018 1192 tablet_bootstrap.cc:654] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.475773 1198 raft_consensus.cc:359] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.475978 1198 raft_consensus.cc:385] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.476063 1198 raft_consensus.cc:740] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.476329 1198 consensus_queue.cc:260] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.476941 1198 ts_tablet_manager.cc:1434] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260616 19:52:17.477269 1198 tablet_bootstrap.cc:492] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:52:17.479120 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 6c9066a57e784356aa27cfcac75c3bd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c9066a57e784356aa27cfcac75c3bd2 already in progress: creating tablet
I20260616 19:52:17.479892 893 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf1b8ec91a3420a8448085f5a8d1e1e (DEFAULT_TABLE table=default.Table_c127220d3313482bafdf2f278d3d815f [id=4731f9a104b24f148d268a0bb24e8cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.480090 889 tablet_service.cc:1511] Processing CreateTablet for tablet fb0ddbcf398640a6996fc979009662c5 (DEFAULT_TABLE table=default.Table_bd73b82d71a7493299d20a966c252fc7 [id=d6e28d80643a4f7a931f7518fdf57b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.480611 902 tablet_service.cc:1511] Processing CreateTablet for tablet 778381dbf13942758ec0f20ad60bf81c (DEFAULT_TABLE table=default.Table_c90d49c02db04fe19f8797c4dfa190a3 [id=12b8c335d5a8450cadb6b37f6cfcdc13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.483906 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet cefa4f3eee5b49e6b23405cfd2daabaf
I20260616 19:52:17.484613 456 master_service.cc:960] ReplaceTablet: received request to replace tablet cf1ab0a125cf46e9a1afc625297db7af from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:17.484954 1196 tablet_bootstrap.cc:492] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.485087 1196 ts_tablet_manager.cc:1403] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.051s user 0.000s sys 0.002s
I20260616 19:52:17.485083 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fe2ac7d4df6a48d6a93d40c7eef38c9c
I20260616 19:52:17.485790 1196 raft_consensus.cc:359] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.485975 1196 raft_consensus.cc:385] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.486387 1196 raft_consensus.cc:740] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.486621 1196 consensus_queue.cc:260] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.487157 1196 ts_tablet_manager.cc:1434] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:17.487423 1196 tablet_bootstrap.cc:492] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.488377 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet cefa4f3eee5b49e6b23405cfd2daabaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:17.488564 763 tablet_service.cc:1558] Processing DeleteTablet for tablet fe2ac7d4df6a48d6a93d40c7eef38c9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.489439 2745 raft_consensus.cc:493] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.489193 1192 tablet_bootstrap.cc:492] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.489578 2745 raft_consensus.cc:515] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.490300 2745 leader_election.cc:290] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.490356 1192 ts_tablet_manager.cc:1403] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20260616 19:52:17.490752 752 tablet_service.cc:1558] Processing DeleteTablet for tablet cefa4f3eee5b49e6b23405cfd2daabaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.490939 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40bdb01a15254c329d82f0d40919b880" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:17.491289 922 raft_consensus.cc:2468] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:17.491516 1196 tablet_bootstrap.cc:654] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.491742 718 leader_election.cc:304] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:17.491984 2745 raft_consensus.cc:2804] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:17.492064 2745 raft_consensus.cc:493] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:17.492136 2745 raft_consensus.cc:3060] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.494007 1193 ts_tablet_manager.cc:1929] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.494120 1193 log.cc:1199] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/67ac2e31a1ba40b39145c26a1e4e0884
I20260616 19:52:17.494468 1193 ts_tablet_manager.cc:1950] T 67ac2e31a1ba40b39145c26a1e4e0884 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:17.494974 2745 raft_consensus.cc:515] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.495568 2745 leader_election.cc:290] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.496178 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40bdb01a15254c329d82f0d40919b880" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:17.496323 922 raft_consensus.cc:3060] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.498773 922 raft_consensus.cc:2468] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:17.499168 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet fe2ac7d4df6a48d6a93d40c7eef38c9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:17.499505 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40bdb01a15254c329d82f0d40919b880" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.499677 1058 raft_consensus.cc:2468] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:17.499662 718 leader_election.cc:304] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:17.500810 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40bdb01a15254c329d82f0d40919b880" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:17.500955 1051 raft_consensus.cc:3060] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.502451 2745 raft_consensus.cc:2804] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:17.502688 2745 raft_consensus.cc:697] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:17.503170 2745 consensus_queue.cc:237] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.504343 1192 raft_consensus.cc:359] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.505084 1192 raft_consensus.cc:385] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.505420 1192 raft_consensus.cc:740] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.506559 1192 consensus_queue.cc:260] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.509841 1192 ts_tablet_manager.cc:1434] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.018s user 0.000s sys 0.003s
I20260616 19:52:17.511654 1192 tablet_bootstrap.cc:492] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.512022 1051 raft_consensus.cc:2468] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:17.512149 1031 tablet_service.cc:1511] Processing CreateTablet for tablet fb0ddbcf398640a6996fc979009662c5 (DEFAULT_TABLE table=default.Table_bd73b82d71a7493299d20a966c252fc7 [id=d6e28d80643a4f7a931f7518fdf57b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.513396 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb0ddbcf398640a6996fc979009662c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.513660 1198 tablet_bootstrap.cc:654] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.515228 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1182) took 1409 ms. Trace:
I20260616 19:52:17.515377 1193 rpcz_store.cc:276] 0616 19:52:16.105296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.186227 (+ 80931us) service_pool.cc:224] Handling call
0616 19:52:17.431426 (+1245199us) ts_tablet_manager.cc:1151] Deleting tablet 67ac2e31a1ba40b39145c26a1e4e0884
0616 19:52:17.431436 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.463476 (+ 32040us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.493956 (+ 30480us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.515206 (+ 21250us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1245080}
I20260616 19:52:17.515903 1192 tablet_bootstrap.cc:654] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.516001 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 67ac2e31a1ba40b39145c26a1e4e0884 (table default.Table_a438724efd6349269d52e1958ce629fc [id=979c551af45f4055ac350d0db71fa793]) successfully deleted
I20260616 19:52:17.516498 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1183) took 1320 ms. Trace:
I20260616 19:52:17.516633 1193 rpcz_store.cc:276] 0616 19:52:16.195577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.208063 (+ 12486us) service_pool.cc:224] Handling call
0616 19:52:17.516335 (+1308272us) ts_tablet_manager.cc:1151] Deleting tablet a12cd3744782442f94dc6e76727cca1c
0616 19:52:17.516347 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.516454 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308001}
W20260616 19:52:17.517143 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a12cd3744782442f94dc6e76727cca1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a12cd3744782442f94dc6e76727cca1c already in progress: creating tablet
I20260616 19:52:17.517680 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1184) took 1281 ms. Trace:
I20260616 19:52:17.517840 1193 rpcz_store.cc:276] 0616 19:52:16.236219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.238398 (+ 2179us) service_pool.cc:224] Handling call
0616 19:52:17.517566 (+1279168us) ts_tablet_manager.cc:1151] Deleting tablet 9f1940f3d73d472c9c68a10539848e9d
0616 19:52:17.517577 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.517663 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1278992}
W20260616 19:52:17.518389 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 9f1940f3d73d472c9c68a10539848e9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f1940f3d73d472c9c68a10539848e9d already in progress: creating tablet
I20260616 19:52:17.518829 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1185) took 1273 ms. Trace:
I20260616 19:52:17.519994 1193 rpcz_store.cc:276] 0616 19:52:16.244921 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.247092 (+ 2171us) service_pool.cc:224] Handling call
0616 19:52:17.518712 (+1271620us) ts_tablet_manager.cc:1151] Deleting tablet ba092edcdecf485e96a392b3ea79b01a
0616 19:52:17.518723 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.518810 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1271438}
W20260616 19:52:17.520603 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet ba092edcdecf485e96a392b3ea79b01a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba092edcdecf485e96a392b3ea79b01a already in progress: creating tablet
I20260616 19:52:17.521627 1196 tablet_bootstrap.cc:492] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.521822 1196 ts_tablet_manager.cc:1403] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.001s
I20260616 19:52:17.522718 1196 raft_consensus.cc:359] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.522980 1196 raft_consensus.cc:385] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.523090 1196 raft_consensus.cc:740] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.523432 1196 consensus_queue.cc:260] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.523811 898 tablet_service.cc:1558] Processing DeleteTablet for tablet cefa4f3eee5b49e6b23405cfd2daabaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:17.524646 898 tablet_service.cc:1558] Processing DeleteTablet for tablet fe2ac7d4df6a48d6a93d40c7eef38c9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:17.525434 1196 ts_tablet_manager.cc:1434] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:17.526724 1196 tablet_bootstrap.cc:492] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.528903 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_afc9ed64b03e4d44b67116949d3be7de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:17.527047 1193 tablet_replica.cc:333] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:52:17.529597 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afc9ed64b03e4d44b67116949d3be7de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:17.529822 1193 raft_consensus.cc:2243] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.530009 1193 raft_consensus.cc:2272] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.530623 1193 ts_tablet_manager.cc:1916] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.531350 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8073617fa67c44b28ca01c349241d3eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:17.531853 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8073617fa67c44b28ca01c349241d3eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:17.534478 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_89cbf050adb84a2f85b0c287219d61fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:17.534952 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89cbf050adb84a2f85b0c287219d61fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:17.538100 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 67bb24fb1cbf47529874240f3eee6c14 (DEFAULT_TABLE table=default.Table_fdf8cb959fb04d818c77e3bced7e61b2 [id=f86a72fa840346fd9ecf55d1b79c9abc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.538460 754 tablet_service.cc:1511] Processing CreateTablet for tablet 4cbbc95ca5f24d1381f3d1b18c89a6bf (DEFAULT_TABLE table=default.Table_75c27ca6a3694b52bc0fcca1ab38b143 [id=4893cd3ab3c04161a3d071dd5b91b4d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.538578 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 4cbbc95ca5f24d1381f3d1b18c89a6bf (DEFAULT_TABLE table=default.Table_75c27ca6a3694b52bc0fcca1ab38b143 [id=4893cd3ab3c04161a3d071dd5b91b4d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.538806 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67bb24fb1cbf47529874240f3eee6c14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.538821 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cbbc95ca5f24d1381f3d1b18c89a6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.539085 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cbbc95ca5f24d1381f3d1b18c89a6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.539341 752 tablet_service.cc:1511] Processing CreateTablet for tablet 40dac55e5a2646f8b7b92126861926ff (DEFAULT_TABLE table=default.Table_64c96e45a8124b5ea619d8662ef34ed2 [id=5682cf33fff94019bfc8633594d65f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.539701 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40dac55e5a2646f8b7b92126861926ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.545892 1192 tablet_bootstrap.cc:492] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.546190 1192 ts_tablet_manager.cc:1403] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.035s user 0.013s sys 0.007s
I20260616 19:52:17.547513 1192 raft_consensus.cc:359] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.547871 1192 raft_consensus.cc:385] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.548022 1192 raft_consensus.cc:740] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.548446 1192 consensus_queue.cc:260] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.550437 1192 ts_tablet_manager.cc:1434] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260616 19:52:17.551908 1192 tablet_bootstrap.cc:492] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.552217 1196 tablet_bootstrap.cc:654] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.554982 1192 tablet_bootstrap.cc:654] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.562793 1192 tablet_bootstrap.cc:492] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.563077 1192 ts_tablet_manager.cc:1403] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260616 19:52:17.564600 2700 raft_consensus.cc:493] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.564697 2700 raft_consensus.cc:515] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.565390 2700 leader_election.cc:290] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:17.566141 1193 ts_tablet_manager.cc:1929] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:17.566430 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1e12555be64192860eab59b3aeb562" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.566656 1051 raft_consensus.cc:2468] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:17.567057 858 leader_election.cc:304] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:17.568102 2700 raft_consensus.cc:2804] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:17.568182 2700 raft_consensus.cc:493] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:17.568253 2700 raft_consensus.cc:3060] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.570631 2700 raft_consensus.cc:515] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.567126 1196 tablet_bootstrap.cc:492] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.570971 1196 ts_tablet_manager.cc:1403] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.001s
I20260616 19:52:17.571574 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1e12555be64192860eab59b3aeb562" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:17.571722 784 raft_consensus.cc:3060] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.571656 1196 raft_consensus.cc:359] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.571787 1196 raft_consensus.cc:385] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.571843 1196 raft_consensus.cc:740] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.572115 1196 consensus_queue.cc:260] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.573954 1196 ts_tablet_manager.cc:1434] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260616 19:52:17.574165 784 raft_consensus.cc:2468] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:17.574781 860 leader_election.cc:304] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:17.575026 2662 raft_consensus.cc:2804] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:17.575133 2662 raft_consensus.cc:697] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:17.575349 1196 tablet_bootstrap.cc:492] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.575350 2662 consensus_queue.cc:237] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.576982 1196 tablet_bootstrap.cc:654] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.578027 1193 log.cc:1199] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/4be902fe29bb46a4bf71ee6384e6722a
I20260616 19:52:17.578058 2700 leader_election.cc:290] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:17.578465 1193 ts_tablet_manager.cc:1950] T 4be902fe29bb46a4bf71ee6384e6722a P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:17.578940 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1e12555be64192860eab59b3aeb562" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:17.579628 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]) successfully deleted
I20260616 19:52:17.579716 775 raft_consensus.cc:2376] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1. Re-sending same reply.
W20260616 19:52:17.580555 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 43e9d7a232f6444dbec3a3954bd47641 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43e9d7a232f6444dbec3a3954bd47641 already in progress: creating tablet
I20260616 19:52:17.580612 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1e12555be64192860eab59b3aeb562" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:17.580780 1059 raft_consensus.cc:3060] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:17.581290 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet ad0b7615a5934617be3d8e18a220fa31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad0b7615a5934617be3d8e18a220fa31 already in progress: creating tablet
I20260616 19:52:17.583716 1059 raft_consensus.cc:2468] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
W20260616 19:52:17.583772 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 14a234e4e45f4b68be478bd4fe409225 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14a234e4e45f4b68be478bd4fe409225 already in progress: creating tablet
W20260616 19:52:17.584460 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 7de044cb57e941ab9471ffe3bd7eeccb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7de044cb57e941ab9471ffe3bd7eeccb already in progress: creating tablet
I20260616 19:52:17.564370 1192 raft_consensus.cc:359] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.584899 1192 raft_consensus.cc:385] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260616 19:52:17.585187 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a59409d014404ee6b446c5b405c04bc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a59409d014404ee6b446c5b405c04bc1 already in progress: creating tablet
I20260616 19:52:17.585281 1192 raft_consensus.cc:740] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.585561 1193 tablet_replica.cc:333] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.585799 1193 raft_consensus.cc:2243] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.586018 1193 raft_consensus.cc:2272] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.586083 1192 consensus_queue.cc:260] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.589720 1192 ts_tablet_manager.cc:1434] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260616 19:52:17.590649 1196 tablet_bootstrap.cc:492] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.590828 1196 ts_tablet_manager.cc:1403] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260616 19:52:17.591639 1196 raft_consensus.cc:359] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.591784 1192 tablet_bootstrap.cc:492] T 2141b6c7013648a4b716642ccb4eccd6 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.592069 2745 raft_consensus.cc:493] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.592181 2745 raft_consensus.cc:515] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.592867 2745 leader_election.cc:290] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.591884 1196 raft_consensus.cc:385] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.593497 1196 raft_consensus.cc:740] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.593521 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cb7a1acf35403192254bf5cd1170a2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:17.593807 1196 consensus_queue.cc:260] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.594298 898 tablet_service.cc:1511] Processing CreateTablet for tablet 67bb24fb1cbf47529874240f3eee6c14 (DEFAULT_TABLE table=default.Table_fdf8cb959fb04d818c77e3bced7e61b2 [id=f86a72fa840346fd9ecf55d1b79c9abc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:17.594820 718 leader_election.cc:343] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.594128 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cb7a1acf35403192254bf5cd1170a2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.595638 899 tablet_service.cc:1511] Processing CreateTablet for tablet 4cbbc95ca5f24d1381f3d1b18c89a6bf (DEFAULT_TABLE table=default.Table_75c27ca6a3694b52bc0fcca1ab38b143 [id=4893cd3ab3c04161a3d071dd5b91b4d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.596256 1196 ts_tablet_manager.cc:1434] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260616 19:52:17.596277 1059 raft_consensus.cc:2468] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:17.598178 719 leader_election.cc:304] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:17.598474 2745 raft_consensus.cc:2804] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:17.598553 2745 raft_consensus.cc:493] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:17.598624 2745 raft_consensus.cc:3060] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.599742 1192 tablet_bootstrap.cc:654] T 2141b6c7013648a4b716642ccb4eccd6 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.601263 1193 ts_tablet_manager.cc:1916] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.602919 2745 raft_consensus.cc:515] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.605223 2745 leader_election.cc:290] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.605384 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cb7a1acf35403192254bf5cd1170a2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:17.605891 718 leader_election.cc:343] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.605168 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cb7a1acf35403192254bf5cd1170a2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:17.606158 1059 raft_consensus.cc:3060] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.607187 1196 tablet_bootstrap.cc:492] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.611209 1196 tablet_bootstrap.cc:654] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.616112 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67bb24fb1cbf47529874240f3eee6c14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.616395 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf1b8ec91a3420a8448085f5a8d1e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.616626 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb0ddbcf398640a6996fc979009662c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.616909 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cbbc95ca5f24d1381f3d1b18c89a6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.617090 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778381dbf13942758ec0f20ad60bf81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.627229 1190 ts_tablet_manager.cc:1929] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.627609 1190 log.cc:1199] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/f52b2c5ff6264ffe8d579cb3816fc253
I20260616 19:52:17.628011 1190 ts_tablet_manager.cc:1950] T f52b2c5ff6264ffe8d579cb3816fc253 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:17.628301 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1018) took 5452 ms. Trace:
I20260616 19:52:17.628428 1190 rpcz_store.cc:276] 0616 19:52:12.175949 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.176001 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:17.456449 (+5280448us) ts_tablet_manager.cc:1151] Deleting tablet f52b2c5ff6264ffe8d579cb3816fc253
0616 19:52:17.456457 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.624487 (+168030us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.627161 (+ 2674us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.628290 (+ 1129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5280272}
I20260616 19:52:17.628970 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1020) took 5442 ms. Trace:
I20260616 19:52:17.629096 1190 rpcz_store.cc:276] 0616 19:52:12.186934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.186981 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:17.628868 (+5441887us) ts_tablet_manager.cc:1151] Deleting tablet d55200fc438d407e9930400424b88024
0616 19:52:17.628877 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.628957 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5441712}
I20260616 19:52:17.629503 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1025) took 5260 ms. Trace:
I20260616 19:52:17.629622 1190 rpcz_store.cc:276] 0616 19:52:12.368669 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.368715 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:17.629415 (+5260700us) ts_tablet_manager.cc:1151] Deleting tablet 1b3c170ea2a34e72824dc90f15534745
0616 19:52:17.629422 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.629490 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5260454}
I20260616 19:52:17.629815 1059 raft_consensus.cc:2468] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:17.630012 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1026) took 5260 ms. Trace:
I20260616 19:52:17.630106 1190 rpcz_store.cc:276] 0616 19:52:12.369351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.369394 (+ 43us) service_pool.cc:224] Handling call
0616 19:52:17.629876 (+5260482us) ts_tablet_manager.cc:1151] Deleting tablet 4faa62f03c2a4588a776883dc54d0426
0616 19:52:17.629884 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.629999 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5260277}
I20260616 19:52:17.630285 719 leader_election.cc:304] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:17.630465 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1027) took 5249 ms. Trace:
I20260616 19:52:17.630550 2745 raft_consensus.cc:2804] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:17.630527 1190 rpcz_store.cc:276] 0616 19:52:12.380641 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.380692 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:17.630377 (+5249685us) ts_tablet_manager.cc:1151] Deleting tablet a0313e65e6a3441abcd663110cfcd70d
0616 19:52:17.630386 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.630453 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5249435}
I20260616 19:52:17.630806 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1028) took 5212 ms. Trace:
I20260616 19:52:17.630954 1190 rpcz_store.cc:276] 0616 19:52:12.418329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.423649 (+ 5320us) service_pool.cc:224] Handling call
0616 19:52:17.630723 (+5207074us) ts_tablet_manager.cc:1151] Deleting tablet b65c52ad5b0d48caa5da88c75c60971c
0616 19:52:17.630731 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.630793 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5206841}
I20260616 19:52:17.631279 1190 tablet_replica.cc:333] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:17.631506 1190 raft_consensus.cc:2243] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:17.631737 2745 raft_consensus.cc:697] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:17.632057 1190 raft_consensus.cc:2272] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.631986 2745 consensus_queue.cc:237] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.632623 1190 ts_tablet_manager.cc:1916] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.633059 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 40dac55e5a2646f8b7b92126861926ff (DEFAULT_TABLE table=default.Table_64c96e45a8124b5ea619d8662ef34ed2 [id=5682cf33fff94019bfc8633594d65f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.633494 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40dac55e5a2646f8b7b92126861926ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.641348 1196 tablet_bootstrap.cc:492] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.641541 1196 ts_tablet_manager.cc:1403] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.004s
I20260616 19:52:17.642287 1190 ts_tablet_manager.cc:1929] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.642321 1196 raft_consensus.cc:359] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.642499 1196 raft_consensus.cc:385] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.642554 1196 raft_consensus.cc:740] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.642860 1196 consensus_queue.cc:260] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.643720 1193 ts_tablet_manager.cc:1929] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.644430 1193 log.cc:1199] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/d4a2855b7dec4244a3fc52bdca7e7eb3
I20260616 19:52:17.645045 1193 ts_tablet_manager.cc:1950] T d4a2855b7dec4244a3fc52bdca7e7eb3 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:17.646845 1190 log.cc:1199] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/d5c82b71969e4cbcb890d16e1cdd5348
I20260616 19:52:17.644444 1196 ts_tablet_manager.cc:1434] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260616 19:52:17.649053 1193 tablet_replica.cc:333] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.649277 1193 raft_consensus.cc:2243] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.649510 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet d4a2855b7dec4244a3fc52bdca7e7eb3 (table default.Table_2b005a492d164f608d275c8e23da534a [id=29105635fc2f455a8b53ed105028ac13]) successfully deleted
I20260616 19:52:17.649756 1190 ts_tablet_manager.cc:1950] T d5c82b71969e4cbcb890d16e1cdd5348 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:17.649951 1193 raft_consensus.cc:2272] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.650249 1196 tablet_bootstrap.cc:492] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.651058 1193 ts_tablet_manager.cc:1916] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.651536 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1029) took 5227 ms. Trace:
I20260616 19:52:17.651984 1190 rpcz_store.cc:276] 0616 19:52:12.424565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.424923 (+ 358us) service_pool.cc:224] Handling call
0616 19:52:17.631243 (+5206320us) ts_tablet_manager.cc:1151] Deleting tablet d5c82b71969e4cbcb890d16e1cdd5348
0616 19:52:17.631251 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.636039 (+ 4788us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.642242 (+ 6203us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.651521 (+ 9279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5206109}
I20260616 19:52:17.652539 1196 tablet_bootstrap.cc:654] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.657407 2700 raft_consensus.cc:493] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.657531 2700 raft_consensus.cc:515] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.657456 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1034) took 5100 ms. Trace:
I20260616 19:52:17.657845 1190 rpcz_store.cc:276] 0616 19:52:12.556868 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.557149 (+ 281us) service_pool.cc:224] Handling call
0616 19:52:17.657338 (+5100189us) ts_tablet_manager.cc:1151] Deleting tablet ee10d6f8fd5040aebd9c9592d84534fc
0616 19:52:17.657347 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.657443 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5099986}
I20260616 19:52:17.658191 2700 leader_election.cc:290] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:17.658463 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5587d5aa8584cf49ef3cb113a1b64ca" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:17.658568 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1037) took 5060 ms. Trace:
I20260616 19:52:17.658844 1190 rpcz_store.cc:276] 0616 19:52:12.597913 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.599611 (+ 1698us) service_pool.cc:224] Handling call
0616 19:52:17.658474 (+5058863us) ts_tablet_manager.cc:1151] Deleting tablet 01d862f2ce2e4051bcbc71ba8f24846e
0616 19:52:17.658484 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.658553 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5058285}
W20260616 19:52:17.658958 860 leader_election.cc:343] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.659456 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5587d5aa8584cf49ef3cb113a1b64ca" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.659650 1059 raft_consensus.cc:2468] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:17.659497 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1040) took 4765 ms. Trace:
I20260616 19:52:17.659997 1190 rpcz_store.cc:276] 0616 19:52:12.893596 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.893642 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:17.659398 (+4765756us) ts_tablet_manager.cc:1151] Deleting tablet 3624b437ae284916b343c82c07c61e62
0616 19:52:17.659408 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.659481 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4765537}
I20260616 19:52:17.660234 858 leader_election.cc:304] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:17.660976 2700 raft_consensus.cc:2804] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:17.661046 2700 raft_consensus.cc:493] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:17.661096 2700 raft_consensus.cc:3060] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:17.661053 445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:43055, user_credentials={real_user=slave}} blocked reactor thread for 64990.5us
I20260616 19:52:17.662299 898 tablet_service.cc:1511] Processing CreateTablet for tablet 40dac55e5a2646f8b7b92126861926ff (DEFAULT_TABLE table=default.Table_64c96e45a8124b5ea619d8662ef34ed2 [id=5682cf33fff94019bfc8633594d65f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:17.662948 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40dac55e5a2646f8b7b92126861926ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:17.663437 2700 raft_consensus.cc:515] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.664497 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5587d5aa8584cf49ef3cb113a1b64ca" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:17.665081 860 leader_election.cc:343] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.665939 2700 leader_election.cc:290] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:17.666025 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5587d5aa8584cf49ef3cb113a1b64ca" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:17.666198 1059 raft_consensus.cc:3060] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.666610 1190 tablet_replica.cc:333] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:17.667199 1190 raft_consensus.cc:2243] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.667593 1190 raft_consensus.cc:2272] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.668264 1190 ts_tablet_manager.cc:1916] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.668756 1059 raft_consensus.cc:2468] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:17.669148 858 leader_election.cc:304] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:17.669526 2700 raft_consensus.cc:2804] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:17.669660 2700 raft_consensus.cc:697] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:17.669893 2700 consensus_queue.cc:237] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.673915 1196 tablet_bootstrap.cc:492] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.674062 1196 ts_tablet_manager.cc:1403] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.002s
I20260616 19:52:17.674955 1196 raft_consensus.cc:359] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.675411 1196 raft_consensus.cc:385] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.675480 1196 raft_consensus.cc:740] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.675770 1196 consensus_queue.cc:260] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.677615 1196 ts_tablet_manager.cc:1434] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:17.678994 1196 tablet_bootstrap.cc:492] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.679347 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet f52b2c5ff6264ffe8d579cb3816fc253 (table default.Table_25651fb93ba2434cb75171647df9d2ec [id=3a6c9b0d46764e87832e82eabcdadc7f]) successfully deleted
W20260616 19:52:17.679893 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d55200fc438d407e9930400424b88024 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d55200fc438d407e9930400424b88024 already in progress: creating tablet
W20260616 19:52:17.680450 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 1b3c170ea2a34e72824dc90f15534745 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b3c170ea2a34e72824dc90f15534745 already in progress: creating tablet
W20260616 19:52:17.680979 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 4faa62f03c2a4588a776883dc54d0426 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4faa62f03c2a4588a776883dc54d0426 already in progress: creating tablet
I20260616 19:52:17.681106 1196 tablet_bootstrap.cc:654] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.682925 1198 tablet_bootstrap.cc:492] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:17.683123 1198 ts_tablet_manager.cc:1403] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.206s user 0.004s sys 0.000s
I20260616 19:52:17.683974 1198 raft_consensus.cc:359] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.684211 1198 raft_consensus.cc:385] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.684316 1198 raft_consensus.cc:740] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.684615 1198 consensus_queue.cc:260] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.685240 1198 ts_tablet_manager.cc:1434] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:17.685555 1198 tablet_bootstrap.cc:492] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:17.687119 1198 tablet_bootstrap.cc:654] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.690109 1193 ts_tablet_manager.cc:1929] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.690212 1193 log.cc:1199] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/2e1696a3c9f24001a4aaf99725f73f62
I20260616 19:52:17.690531 1193 ts_tablet_manager.cc:1950] T 2e1696a3c9f24001a4aaf99725f73f62 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:17.691498 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 2e1696a3c9f24001a4aaf99725f73f62 (table default.Table_186eb03ebeeb4351b7cd0feeaebd1ef3 [id=9f49b3a822224b5082a631394c44a5b2]) successfully deleted
W20260616 19:52:17.693267 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a0313e65e6a3441abcd663110cfcd70d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0313e65e6a3441abcd663110cfcd70d already in progress: creating tablet
W20260616 19:52:17.693849 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet b65c52ad5b0d48caa5da88c75c60971c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b65c52ad5b0d48caa5da88c75c60971c already in progress: creating tablet
I20260616 19:52:17.694594 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet d5c82b71969e4cbcb890d16e1cdd5348 (table default.Table_ece3f5e58baa45dfb295c03ab6a85f01 [id=d5fe1c6faa0d446ca84e71bbdfb4018d]) successfully deleted
W20260616 19:52:17.695034 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet ee10d6f8fd5040aebd9c9592d84534fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee10d6f8fd5040aebd9c9592d84534fc already in progress: creating tablet
I20260616 19:52:17.695268 922 raft_consensus.cc:3060] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:17.695686 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 01d862f2ce2e4051bcbc71ba8f24846e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01d862f2ce2e4051bcbc71ba8f24846e already in progress: creating tablet
W20260616 19:52:17.696274 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 3624b437ae284916b343c82c07c61e62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3624b437ae284916b343c82c07c61e62 already in progress: creating tablet
I20260616 19:52:17.697707 1193 tablet_replica.cc:333] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.697888 1193 raft_consensus.cc:2243] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:17.698189 1193 raft_consensus.cc:2272] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.698660 2745 raft_consensus.cc:493] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.698827 2745 raft_consensus.cc:515] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.699290 455 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_2ae975bcbcb5466c99f5c77eb216d950 [id=af4aada43ecf46b8bacf0d9d1388e92e] alter complete (version 2)
I20260616 19:52:17.699594 2745 leader_election.cc:290] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.700086 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f2d259a31c4f4eaeceaba57fb978b2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.700287 1059 raft_consensus.cc:2468] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:17.700654 1193 ts_tablet_manager.cc:1916] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.700770 719 leader_election.cc:304] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:17.700914 2745 consensus_queue.cc:1048] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.701040 2642 raft_consensus.cc:2804] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:17.701115 2642 raft_consensus.cc:493] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:17.701188 2642 raft_consensus.cc:3060] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.703188 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f2d259a31c4f4eaeceaba57fb978b2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:17.703344 922 raft_consensus.cc:2468] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:17.703722 2642 raft_consensus.cc:515] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.704069 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.704262 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f1e12555be64192860eab59b3aeb562 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.704322 2642 leader_election.cc:290] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.704416 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c74b39e66d344b99f8fc75b855c0520 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:17.704941 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet efd5fecc6d444e5fba9103287c09542e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:17.706478 1190 ts_tablet_manager.cc:1929] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.706727 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f2d259a31c4f4eaeceaba57fb978b2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:17.706925 1059 raft_consensus.cc:3060] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.707154 1190 log.cc:1199] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/bbf73c4c1133405bb46df19c0559ab92
I20260616 19:52:17.708324 1190 ts_tablet_manager.cc:1950] T bbf73c4c1133405bb46df19c0559ab92 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:17.709685 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1042) took 4803 ms. Trace:
I20260616 19:52:17.709996 1059 raft_consensus.cc:2468] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:17.710493 719 leader_election.cc:304] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:17.710536 1190 rpcz_store.cc:276] 0616 19:52:12.905996 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.906044 (+ 48us) service_pool.cc:224] Handling call
0616 19:52:17.666553 (+4760509us) ts_tablet_manager.cc:1151] Deleting tablet bbf73c4c1133405bb46df19c0559ab92
0616 19:52:17.666565 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.683243 (+ 16678us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.706407 (+ 23164us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.709670 (+ 3263us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4760273}
I20260616 19:52:17.710923 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1041) took 4817 ms. Trace:
I20260616 19:52:17.711820 2642 raft_consensus.cc:2804] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
W20260616 19:52:17.711674 860 consensus_peers.cc:597] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c239a24dbdc047f9beb2ed7e1492acfe. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:17.712010 2642 raft_consensus.cc:697] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:17.712177 1190 rpcz_store.cc:276] 0616 19:52:12.893678 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.943486 (+ 49808us) service_pool.cc:224] Handling call
0616 19:52:17.710801 (+4767315us) ts_tablet_manager.cc:1151] Deleting tablet f176111bc2a7494da5e17986963a2c5c
0616 19:52:17.710810 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.710906 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4767139}
I20260616 19:52:17.712301 2642 consensus_queue.cc:237] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.713182 1190 tablet_replica.cc:333] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:17.713821 1190 raft_consensus.cc:2243] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:17.713197 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f2d259a31c4f4eaeceaba57fb978b2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:17.714570 922 raft_consensus.cc:3060] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.717736 922 raft_consensus.cc:2468] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:17.718361 1190 pending_rounds.cc:70] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:52:17.719058 1190 pending_rounds.cc:77] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595527106752512 op_type: NO_OP noop_request { }
I20260616 19:52:17.719393 1190 raft_consensus.cc:2889] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:17.719758 1190 raft_consensus.cc:2272] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.720520 1190 ts_tablet_manager.cc:1916] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.722842 1193 ts_tablet_manager.cc:1929] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.723158 1193 log.cc:1199] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/647b1abeb3c14b11b9a5c62b67e83cf8
I20260616 19:52:17.723707 1193 ts_tablet_manager.cc:1950] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:17.725219 1193 tablet_replica.cc:333] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.725389 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 647b1abeb3c14b11b9a5c62b67e83cf8 (table default.Table_120e5c908fe348a7ab3ff54504e841ec [id=508154cdccf0482b890ef231e6fac070]) successfully deleted
I20260616 19:52:17.726225 1198 tablet_bootstrap.cc:492] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:17.726835 1198 ts_tablet_manager.cc:1403] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.003s
I20260616 19:52:17.727497 1196 tablet_bootstrap.cc:492] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.727478 1193 raft_consensus.cc:2243] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:17.727867 1196 ts_tablet_manager.cc:1403] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.049s user 0.008s sys 0.000s
I20260616 19:52:17.728713 1193 pending_rounds.cc:70] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:17.729091 1198 raft_consensus.cc:359] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.728910 1193 pending_rounds.cc:77] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595543267352576 op_type: NO_OP noop_request { }
I20260616 19:52:17.729430 1193 raft_consensus.cc:2889] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:17.729641 1198 raft_consensus.cc:385] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.729822 1198 raft_consensus.cc:740] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.729717 1193 raft_consensus.cc:2272] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.729889 1196 raft_consensus.cc:359] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.730278 1196 raft_consensus.cc:385] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.730356 1196 raft_consensus.cc:740] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.730500 1198 consensus_queue.cc:260] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.730962 1196 consensus_queue.cc:260] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.732123 1193 ts_tablet_manager.cc:1916] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.732820 1198 ts_tablet_manager.cc:1434] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260616 19:52:17.733239 1196 ts_tablet_manager.cc:1434] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:52:17.733875 1198 tablet_bootstrap.cc:492] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:17.738215 1198 tablet_bootstrap.cc:654] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.747109 1196 tablet_bootstrap.cc:492] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.748997 1196 tablet_bootstrap.cc:654] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.755846 2642 consensus_queue.cc:1048] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260616 19:52:17.757803 1193 ts_tablet_manager.cc:1929] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.758198 1193 log.cc:1199] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/802d30c340494490896c8da33d110708
I20260616 19:52:17.759694 1196 tablet_bootstrap.cc:492] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.759874 1196 ts_tablet_manager.cc:1403] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260616 19:52:17.760891 1196 raft_consensus.cc:359] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.761140 1196 raft_consensus.cc:385] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.761261 1196 raft_consensus.cc:740] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.761608 1196 consensus_queue.cc:260] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.762566 1196 ts_tablet_manager.cc:1434] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:17.763008 1196 tablet_bootstrap.cc:492] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.764389 1193 ts_tablet_manager.cc:1950] T 802d30c340494490896c8da33d110708 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:17.764945 1198 tablet_bootstrap.cc:492] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:17.765671 1198 ts_tablet_manager.cc:1403] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260616 19:52:17.767256 2700 consensus_queue.cc:1048] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.768784 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 802d30c340494490896c8da33d110708 (table default.Table_368e4b7684c64cdcb5a8ac4665e649d2 [id=cb3eb4838e8a48108a44c7940a73765e]) successfully deleted
W20260616 19:52:17.770186 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8a718fefe07141119b7ef7edcbf61123 because the tablet was not found. No further retry: Not found: Tablet not found: 8a718fefe07141119b7ef7edcbf61123
I20260616 19:52:17.770437 1193 tablet_replica.cc:333] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.771623 1193 raft_consensus.cc:2243] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:17.772368 858 consensus_peers.cc:597] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c239a24dbdc047f9beb2ed7e1492acfe. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:17.771090 1198 raft_consensus.cc:359] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.772225 1196 tablet_bootstrap.cc:654] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.772671 1193 raft_consensus.cc:2272] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.772939 1198 raft_consensus.cc:385] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.773592 1198 raft_consensus.cc:740] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.775305 1193 ts_tablet_manager.cc:1916] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.775705 1198 consensus_queue.cc:260] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.782847 2745 consensus_queue.cc:1048] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.784770 2661 raft_consensus.cc:493] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.784950 2661 raft_consensus.cc:515] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.785676 2661 leader_election.cc:290] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.786742 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f96ef25396a4092bc475f4aab269bc7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:17.786732 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f96ef25396a4092bc475f4aab269bc7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:17.787297 993 leader_election.cc:343] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:17.787467 996 leader_election.cc:343] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.787578 993 leader_election.cc:304] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:17.788218 2661 raft_consensus.cc:2749] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:17.791226 718 consensus_peers.cc:597] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e896d5aa87f14e5593d01085bb6d434f. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:17.780133 1191 ts_tablet_manager.cc:1929] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.793072 1196 tablet_bootstrap.cc:492] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.793673 1196 ts_tablet_manager.cc:1403] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.002s
I20260616 19:52:17.794986 2557 raft_consensus.cc:493] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.795122 2557 raft_consensus.cc:515] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:17.795780 2557 leader_election.cc:290] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:17.796933 860 leader_election.cc:343] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 102f322eb98f4224acb8637f8c29ac19
W20260616 19:52:17.797060 858 leader_election.cc:343] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 102f322eb98f4224acb8637f8c29ac19
I20260616 19:52:17.797196 858 leader_election.cc:304] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:17.798650 2662 raft_consensus.cc:2749] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:17.798673 1198 ts_tablet_manager.cc:1434] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.016s user 0.002s sys 0.001s
I20260616 19:52:17.799016 2662 consensus_queue.cc:1048] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.798302 1196 raft_consensus.cc:359] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.799331 1196 raft_consensus.cc:385] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.799853 1196 raft_consensus.cc:740] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.800457 2557 consensus_queue.cc:1048] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.801386 1198 tablet_bootstrap.cc:492] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:17.802068 1196 consensus_queue.cc:260] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:17.804190 860 consensus_peers.cc:597] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6939d108a7948bb9e56311a34d95486. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:17.804601 2557 consensus_queue.cc:1048] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.821184 2642 consensus_queue.cc:1048] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.821731 1191 log.cc:1199] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/bbf73c4c1133405bb46df19c0559ab92
I20260616 19:52:17.821772 1196 ts_tablet_manager.cc:1434] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.028s user 0.001s sys 0.002s
I20260616 19:52:17.823450 1191 ts_tablet_manager.cc:1950] T bbf73c4c1133405bb46df19c0559ab92 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:17.823467 1196 tablet_bootstrap.cc:492] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.827307 1193 ts_tablet_manager.cc:1929] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:17.827911 1193 log.cc:1199] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/afc58b2bda2a43f18f157469b591854b
I20260616 19:52:17.830597 1193 ts_tablet_manager.cc:1950] T afc58b2bda2a43f18f157469b591854b P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:52:17.833110 445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:43055, user_credentials={real_user=slave}} blocked reactor thread for 136066us
I20260616 19:52:17.835441 1196 tablet_bootstrap.cc:654] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.836305 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet afc58b2bda2a43f18f157469b591854b (table default.Table_24447e65692d452a82a5ef91bdc6ab4f [id=9c655609a0ef47a2b4fb050ad8dab9d7]) successfully deleted
I20260616 19:52:17.837188 1193 tablet_replica.cc:333] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.838397 1193 raft_consensus.cc:2243] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.839176 1193 raft_consensus.cc:2272] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.842363 1193 ts_tablet_manager.cc:1916] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.845383 1198 tablet_bootstrap.cc:654] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.848835 1196 tablet_bootstrap.cc:492] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.849428 1196 ts_tablet_manager.cc:1403] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.005s
I20260616 19:52:17.851018 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 40bdb01a15254c329d82f0d40919b880 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:17.851504 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 43b4c3bd370749b18fb86f7a0aae2c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:17.853242 2661 raft_consensus.cc:493] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.853374 2661 raft_consensus.cc:515] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.853073 1196 raft_consensus.cc:359] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.853735 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet bbf73c4c1133405bb46df19c0559ab92 (table default.Table_77c7656d4f3a49f1ac1ef9398f720934 [id=3875e9f7e8ef471cb793134e7bc06a32]) successfully deleted
I20260616 19:52:17.853720 1196 raft_consensus.cc:385] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.853948 2661 leader_election.cc:290] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.854076 1196 raft_consensus.cc:740] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
W20260616 19:52:17.854174 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet f176111bc2a7494da5e17986963a2c5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f176111bc2a7494da5e17986963a2c5c already in progress: creating tablet
I20260616 19:52:17.854710 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f1e12555be64192860eab59b3aeb562 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:08 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:17.854795 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1203a4e952a42369d5c03ff4a4c59ec" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:17.855310 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1203a4e952a42369d5c03ff4a4c59ec" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:17.855989 996 leader_election.cc:343] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:17.856233 993 leader_election.cc:343] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:17.856365 993 leader_election.cc:304] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:17.856623 2661 raft_consensus.cc:2749] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:17.860535 860 consensus_peers.cc:597] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67ac2e31a1ba40b39145c26a1e4e0884. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:17.861321 1190 ts_tablet_manager.cc:1929] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.861500 1190 log.cc:1199] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/1c35e4c8e9304e798c9031469877b70e
I20260616 19:52:17.861683 1192 tablet_bootstrap.cc:492] T 2141b6c7013648a4b716642ccb4eccd6 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.861802 1192 ts_tablet_manager.cc:1403] T 2141b6c7013648a4b716642ccb4eccd6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.270s user 0.022s sys 0.036s
I20260616 19:52:17.862049 1190 ts_tablet_manager.cc:1950] T 1c35e4c8e9304e798c9031469877b70e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:17.862458 1192 raft_consensus.cc:359] T 2141b6c7013648a4b716642ccb4eccd6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.862618 1192 raft_consensus.cc:385] T 2141b6c7013648a4b716642ccb4eccd6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.862533 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1039) took 4969 ms. Trace:
I20260616 19:52:17.862751 1190 rpcz_store.cc:276] 0616 19:52:12.893513 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.945890 (+ 52377us) service_pool.cc:224] Handling call
0616 19:52:17.713139 (+4767249us) ts_tablet_manager.cc:1151] Deleting tablet 1c35e4c8e9304e798c9031469877b70e
0616 19:52:17.713147 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.858389 (+145242us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.861276 (+ 2887us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.862374 (+ 1098us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4767076}
I20260616 19:52:17.863207 1190 tablet_replica.cc:333] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:17.863458 1190 raft_consensus.cc:2243] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.863781 1190 raft_consensus.cc:2272] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.864338 1190 ts_tablet_manager.cc:1916] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.862664 1192 raft_consensus.cc:740] T 2141b6c7013648a4b716642ccb4eccd6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.864668 1192 consensus_queue.cc:260] T 2141b6c7013648a4b716642ccb4eccd6 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.865108 1192 ts_tablet_manager.cc:1434] T 2141b6c7013648a4b716642ccb4eccd6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:17.865371 1192 tablet_bootstrap.cc:492] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.866940 1192 tablet_bootstrap.cc:654] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.855002 1196 consensus_queue.cc:260] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.868145 1196 ts_tablet_manager.cc:1434] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260616 19:52:17.868796 1196 tablet_bootstrap.cc:492] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.871011 1196 tablet_bootstrap.cc:654] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.873440 1193 ts_tablet_manager.cc:1929] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:17.861308 881 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:48628 (request call id 231) took 1096 ms. Trace:
I20260616 19:52:17.875308 881 rpcz_store.cc:276] 0616 19:52:16.764572 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.764622 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:16.931203 (+166581us) spinlock_profiling.cc:243] Waited 95.6 ms on lock 0x616000182254. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7cf5ef8c0 00007fb7d34a0f1f 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138 0000000000aa681c
0616 19:52:16.948254 (+ 17051us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x6160001c2154. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7cf5ef8c0 00007fb7d34a0f1f 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138 0000000000aa681c
0616 19:52:17.174414 (+226160us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x616000182854. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7cf5ef8c0 00007fb7d34a0f1f 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138 0000000000aa681c
0616 19:52:17.861287 (+686873us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760169728}
I20260616 19:52:17.879396 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 1c35e4c8e9304e798c9031469877b70e (table default.Table_940a8144c5014fc9b2fcb74257f85d89 [id=7278ea7c992e450d840d9174df3f1ca0]) successfully deleted
I20260616 19:52:17.880303 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d9475c4c32a248de8a4ce51252e648aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:17.880903 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9475c4c32a248de8a4ce51252e648aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:17.881228 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9052d7e3461c48ea86abbc7e466a6610"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:17.881625 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9052d7e3461c48ea86abbc7e466a6610 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:17.882081 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d9b6ea5cbcd347058c16f26573990825" } new_table_name: "default.Table_52c372106d354fba9e90c5be75714312" modify_external_catalogs: true
I20260616 19:52:17.882354 2679 raft_consensus.cc:493] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.882511 2679 raft_consensus.cc:515] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.883147 2679 leader_election.cc:290] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:17.888342 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8708321fb0f4c409a66df75da4c6c0e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.888593 1059 raft_consensus.cc:2393] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:17.877346 2642 consensus_queue.cc:1048] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.883740 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8708321fb0f4c409a66df75da4c6c0e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:17.889442 860 leader_election.cc:304] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:17.889690 2679 raft_consensus.cc:3060] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.890233 1193 log.cc:1199] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/269c1dea941c481fb6fd2e4d59c877c0
I20260616 19:52:17.890853 1193 ts_tablet_manager.cc:1950] T 269c1dea941c481fb6fd2e4d59c877c0 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:17.892309 2679 raft_consensus.cc:2749] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:17.893919 1192 tablet_bootstrap.cc:492] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.894052 1192 ts_tablet_manager.cc:1403] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260616 19:52:17.894743 1192 raft_consensus.cc:359] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.894886 1192 raft_consensus.cc:385] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.894935 1192 raft_consensus.cc:740] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.895102 1192 consensus_queue.cc:260] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.895578 1192 ts_tablet_manager.cc:1434] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260616 19:52:17.895848 1192 tablet_bootstrap.cc:492] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.897890 1196 tablet_bootstrap.cc:492] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:17.898013 1196 ts_tablet_manager.cc:1403] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.002s
I20260616 19:52:17.898697 1196 raft_consensus.cc:359] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.898856 1196 raft_consensus.cc:385] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.898911 1196 raft_consensus.cc:740] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.899175 1196 consensus_queue.cc:260] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.902103 1198 tablet_bootstrap.cc:492] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:17.902734 1198 ts_tablet_manager.cc:1403] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.102s user 0.004s sys 0.000s
I20260616 19:52:17.903683 1198 raft_consensus.cc:359] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.904798 1198 raft_consensus.cc:385] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.904989 1198 raft_consensus.cc:740] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.905411 1198 consensus_queue.cc:260] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.906482 1198 ts_tablet_manager.cc:1434] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260616 19:52:17.910364 2745 consensus_queue.cc:1048] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.916196 1196 ts_tablet_manager.cc:1434] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260616 19:52:17.920166 883 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:48628 (request call id 229) took 1156 ms. Trace:
I20260616 19:52:17.924669 1198 tablet_bootstrap.cc:492] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:17.929219 1198 tablet_bootstrap.cc:654] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.922469 1192 tablet_bootstrap.cc:654] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.930735 883 rpcz_store.cc:276] 0616 19:52:16.763387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.763440 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:16.980289 (+216849us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x616000143254. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7cf5ef8c0 00007fb7d34a0f1f 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138 0000000000aa681c
0616 19:52:17.920135 (+939846us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140755200}
I20260616 19:52:17.940346 1198 tablet_bootstrap.cc:492] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:17.942715 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1057) took 5036 ms. Trace:
I20260616 19:52:17.945430 1198 ts_tablet_manager.cc:1403] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260616 19:52:17.946334 1198 raft_consensus.cc:359] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.954845 1192 tablet_bootstrap.cc:492] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.954986 1192 ts_tablet_manager.cc:1403] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.011s
I20260616 19:52:17.955531 1198 raft_consensus.cc:385] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.955742 1192 raft_consensus.cc:359] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.955916 1192 raft_consensus.cc:385] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.955974 1192 raft_consensus.cc:740] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.955770 1198 raft_consensus.cc:740] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.956219 1192 consensus_queue.cc:260] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.956704 1192 ts_tablet_manager.cc:1434] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:17.957055 1192 tablet_bootstrap.cc:492] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.958122 1198 consensus_queue.cc:260] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.958737 1192 tablet_bootstrap.cc:654] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.959342 1198 ts_tablet_manager.cc:1434] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260616 19:52:17.960012 1198 tablet_bootstrap.cc:492] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:17.961983 1198 tablet_bootstrap.cc:654] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.964787 1192 tablet_bootstrap.cc:492] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:17.964922 1192 ts_tablet_manager.cc:1403] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260616 19:52:17.965596 1192 raft_consensus.cc:359] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.965770 1192 raft_consensus.cc:385] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.965849 1192 raft_consensus.cc:740] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.966075 1192 consensus_queue.cc:260] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.945329 1191 rpcz_store.cc:276] 0616 19:52:12.906303 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.906373 (+ 70us) service_pool.cc:224] Handling call
0616 19:52:17.216627 (+4310254us) ts_tablet_manager.cc:1151] Deleting tablet bbf73c4c1133405bb46df19c0559ab92
0616 19:52:17.216637 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.327808 (+111171us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.779883 (+452075us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.942647 (+162764us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4308487}
I20260616 19:52:17.966593 1192 ts_tablet_manager.cc:1434] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:17.966867 1192 tablet_bootstrap.cc:492] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:17.967123 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet bbf73c4c1133405bb46df19c0559ab92 (table default.Table_77c7656d4f3a49f1ac1ef9398f720934 [id=3875e9f7e8ef471cb793134e7bc06a32]) successfully deleted
I20260616 19:52:17.967597 1191 tablet_replica.cc:333] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:17.968479 1192 tablet_bootstrap.cc:654] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.968519 1191 raft_consensus.cc:2243] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.976174 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1210) took 1002 ms. Trace:
I20260616 19:52:17.976305 1193 rpcz_store.cc:276] 0616 19:52:16.973660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.981183 (+ 7523us) service_pool.cc:224] Handling call
0616 19:52:17.837047 (+855864us) ts_tablet_manager.cc:1151] Deleting tablet 269c1dea941c481fb6fd2e4d59c877c0
0616 19:52:17.837057 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.863319 (+ 26262us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.873393 (+ 10074us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:17.976136 (+102743us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":855597}
I20260616 19:52:17.976649 1193 tablet_replica.cc:333] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.976809 1193 raft_consensus.cc:2243] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:17.976923 1193 raft_consensus.cc:2272] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:17.977444 1193 ts_tablet_manager.cc:1916] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:17.981030 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 269c1dea941c481fb6fd2e4d59c877c0 (table default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb [id=2c7a8a72acf5496eaebb585c459112fb]) successfully deleted
I20260616 19:52:17.981257 1196 tablet_bootstrap.cc:492] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:17.977264 1198 tablet_bootstrap.cc:492] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:17.981823 1198 ts_tablet_manager.cc:1403] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260616 19:52:17.982873 1196 tablet_bootstrap.cc:654] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:17.983245 1193 ts_tablet_manager.cc:1929] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:17.983412 1198 raft_consensus.cc:359] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.983560 1198 raft_consensus.cc:385] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:17.983873 1193 log.cc:1199] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/43b4c3bd370749b18fb86f7a0aae2c50
I20260616 19:52:17.983932 2745 raft_consensus.cc:493] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:17.984061 2745 raft_consensus.cc:515] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.984385 1193 ts_tablet_manager.cc:1950] T 43b4c3bd370749b18fb86f7a0aae2c50 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:17.984721 2745 leader_election.cc:290] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:17.985306 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141b6c7013648a4b716642ccb4eccd6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:17.985409 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141b6c7013648a4b716642ccb4eccd6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:17.985517 921 raft_consensus.cc:2468] T 2141b6c7013648a4b716642ccb4eccd6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:17.985574 1052 raft_consensus.cc:2468] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:17.985926 719 leader_election.cc:304] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:17.986238 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 43b4c3bd370749b18fb86f7a0aae2c50 (table default.Table_7ad7ef9c768d41edaa47c8cd68466731 [id=217c0ab9c81b4dae8666abc02dfeb60b]) successfully deleted
I20260616 19:52:17.986833 1193 tablet_replica.cc:333] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:17.987089 2745 raft_consensus.cc:2804] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:17.987169 2745 raft_consensus.cc:493] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:17.987229 2745 raft_consensus.cc:3060] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.983603 1198 raft_consensus.cc:740] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:17.987537 1198 consensus_queue.cc:260] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.989153 1198 ts_tablet_manager.cc:1434] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260616 19:52:17.989624 2745 raft_consensus.cc:515] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.993201 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141b6c7013648a4b716642ccb4eccd6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:17.993387 921 raft_consensus.cc:3060] T 2141b6c7013648a4b716642ccb4eccd6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:17.996411 921 raft_consensus.cc:2468] T 2141b6c7013648a4b716642ccb4eccd6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:17.997591 718 leader_election.cc:304] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:17.997898 2642 raft_consensus.cc:2804] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:17.998011 2642 raft_consensus.cc:697] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:17.998302 2642 consensus_queue.cc:237] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:17.999377 2745 leader_election.cc:290] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.005275 1193 raft_consensus.cc:2243] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:18.005878 1193 raft_consensus.cc:2272] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.007507 2745 consensus_queue.cc:1048] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:17.996923 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141b6c7013648a4b716642ccb4eccd6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:18.008368 1052 raft_consensus.cc:3060] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.008445 1193 ts_tablet_manager.cc:1916] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.011128 1052 raft_consensus.cc:2468] T 2141b6c7013648a4b716642ccb4eccd6 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.013499 1198 tablet_bootstrap.cc:492] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:18.018070 1198 tablet_bootstrap.cc:654] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.018611 1192 tablet_bootstrap.cc:492] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:18.018805 1192 ts_tablet_manager.cc:1403] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.052s user 0.009s sys 0.000s
I20260616 19:52:18.020223 1192 raft_consensus.cc:359] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.020452 1192 raft_consensus.cc:385] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.020568 1192 raft_consensus.cc:740] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.021149 1192 consensus_queue.cc:260] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.021785 1192 ts_tablet_manager.cc:1434] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260616 19:52:18.022075 1192 tablet_bootstrap.cc:492] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:18.024216 1192 tablet_bootstrap.cc:654] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.028417 1198 tablet_bootstrap.cc:492] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:18.028878 1193 ts_tablet_manager.cc:1929] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260616 19:52:18.028918 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet e90ea4190d3a42ac8082cd6869588490 (table default.Table_1b25ad7f911d4a3ea20352ebc3dd6236 [id=cffd115a37db4c9185cf6561e200bf19], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e90ea4190d3a42ac8082cd6869588490 consensus state has no leader
I20260616 19:52:18.029086 1193 log.cc:1199] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/bcc5116ef5df4140a96f03c003337c68
I20260616 19:52:18.029888 1193 ts_tablet_manager.cc:1950] T bcc5116ef5df4140a96f03c003337c68 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:18.030200 2642 consensus_queue.cc:1048] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.031302 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet bcc5116ef5df4140a96f03c003337c68 (table default.Table_60ba0f6f88634456a3d4afc9f759c4a7 [id=9c7b653f62ef4b74946cc87069f8df6e]) successfully deleted
I20260616 19:52:18.031706 1193 tablet_replica.cc:333] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:18.032177 1193 raft_consensus.cc:2243] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:18.032799 1193 raft_consensus.cc:2272] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.033157 1198 ts_tablet_manager.cc:1403] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.001s
I20260616 19:52:18.035059 1193 ts_tablet_manager.cc:1916] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.037397 2642 raft_consensus.cc:493] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.037585 2642 raft_consensus.cc:515] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.039048 2642 leader_election.cc:290] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.039295 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48314f8e45d4b198306f0ae6e40def7" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.039543 922 raft_consensus.cc:2468] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:18.040088 718 leader_election.cc:304] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:18.040627 2642 raft_consensus.cc:2804] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.040751 2642 raft_consensus.cc:493] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.040858 2642 raft_consensus.cc:3060] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.039330 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48314f8e45d4b198306f0ae6e40def7" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.041216 1052 raft_consensus.cc:2468] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:18.037178 1198 raft_consensus.cc:359] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.042196 1198 raft_consensus.cc:385] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.043480 2642 raft_consensus.cc:515] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.043691 1198 raft_consensus.cc:740] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.044106 2642 leader_election.cc:290] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.044435 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48314f8e45d4b198306f0ae6e40def7" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:18.044632 1052 raft_consensus.cc:3060] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.044658 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48314f8e45d4b198306f0ae6e40def7" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:18.044865 922 raft_consensus.cc:3060] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.047545 1052 raft_consensus.cc:2468] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.048033 719 leader_election.cc:304] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:18.048223 922 raft_consensus.cc:2468] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.048504 2642 raft_consensus.cc:2804] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.048861 2642 raft_consensus.cc:697] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:18.049088 2642 consensus_queue.cc:237] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.052608 1198 consensus_queue.cc:260] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.053192 1198 ts_tablet_manager.cc:1434] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260616 19:52:18.053488 1198 tablet_bootstrap.cc:492] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:18.055399 1198 tablet_bootstrap.cc:654] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.055955 2662 raft_consensus.cc:493] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.056119 2662 raft_consensus.cc:515] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.056710 2662 leader_election.cc:290] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:18.057500 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95c684f5fe54f7dad6300efb0c18780" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.057703 775 raft_consensus.cc:2468] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:18.058296 860 leader_election.cc:304] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:18.058723 2662 raft_consensus.cc:2804] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.058851 2662 raft_consensus.cc:493] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.058964 2662 raft_consensus.cc:3060] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.062283 2662 raft_consensus.cc:515] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.063905 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95c684f5fe54f7dad6300efb0c18780" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:18.064092 775 raft_consensus.cc:3060] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.065416 1190 ts_tablet_manager.cc:1929] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:18.065528 1190 log.cc:1199] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/b718514e4fbd4601afeb021ed35643e6
I20260616 19:52:18.065820 1190 ts_tablet_manager.cc:1950] T b718514e4fbd4601afeb021ed35643e6 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:18.066107 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1044) took 5102 ms. Trace:
I20260616 19:52:18.066184 1190 rpcz_store.cc:276] 0616 19:52:12.963566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.969874 (+ 6308us) service_pool.cc:224] Handling call
0616 19:52:17.863144 (+4893270us) ts_tablet_manager.cc:1151] Deleting tablet b718514e4fbd4601afeb021ed35643e6
0616 19:52:17.863153 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:17.867434 (+ 4281us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.065350 (+197916us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.066077 (+ 727us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4893090}
I20260616 19:52:18.066617 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet b718514e4fbd4601afeb021ed35643e6 (table default.Table_9eedef731fd84c70a73a66128d239708 [id=b4da8c337e114065ad1498aa33588d55]) successfully deleted
I20260616 19:52:18.057621 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95c684f5fe54f7dad6300efb0c18780" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.067193 1052 raft_consensus.cc:2468] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:18.067265 775 raft_consensus.cc:2468] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:18.068240 860 leader_election.cc:304] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:18.068622 2679 raft_consensus.cc:2804] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.068783 2679 raft_consensus.cc:697] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:18.069087 2679 consensus_queue.cc:237] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.070922 2628 raft_consensus.cc:493] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.071051 2628 raft_consensus.cc:515] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:18.072268 860 consensus_peers.cc:597] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e1696a3c9f24001a4aaf99725f73f62. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:18.072415 2662 leader_election.cc:290] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:18.072517 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272838af35d840faa7b11217456533c2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.072713 2628 leader_election.cc:290] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:18.072981 719 leader_election.cc:343] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.073086 1192 tablet_bootstrap.cc:492] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:18.073261 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95c684f5fe54f7dad6300efb0c18780" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:18.073311 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272838af35d840faa7b11217456533c2" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.073421 1052 raft_consensus.cc:3060] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.073688 1192 ts_tablet_manager.cc:1403] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.004s
I20260616 19:52:18.074440 1192 raft_consensus.cc:359] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.074586 1192 raft_consensus.cc:385] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.074644 1192 raft_consensus.cc:740] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.074865 1192 consensus_queue.cc:260] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.075945 1052 raft_consensus.cc:2468] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:18.077140 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1045) took 5096 ms. Trace:
I20260616 19:52:18.077225 1190 rpcz_store.cc:276] 0616 19:52:12.980607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.981389 (+ 782us) service_pool.cc:224] Handling call
0616 19:52:18.077015 (+5095626us) ts_tablet_manager.cc:1151] Deleting tablet c5047956478f488dbb4734bbaa138c00
0616 19:52:18.077024 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.077105 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5093945}
I20260616 19:52:18.077500 1190 tablet_replica.cc:333] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:18.077579 1192 ts_tablet_manager.cc:1434] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260616 19:52:18.077680 1190 raft_consensus.cc:2243] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:18.078006 1190 raft_consensus.cc:2272] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.078424 2661 raft_consensus.cc:493] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.078536 2661 raft_consensus.cc:515] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.078765 1190 ts_tablet_manager.cc:1916] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.079005 2661 leader_election.cc:290] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.079283 1192 tablet_bootstrap.cc:492] T 272838af35d840faa7b11217456533c2 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:52:18.080241 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c5047956478f488dbb4734bbaa138c00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5047956478f488dbb4734bbaa138c00 already in progress: creating tablet
I20260616 19:52:18.080282 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189a715da140a6833801681bbd5ef4" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.080384 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189a715da140a6833801681bbd5ef4" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:18.080722 996 leader_election.cc:343] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:18.081210 993 leader_election.cc:343] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.081305 993 leader_election.cc:304] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:18.081760 718 leader_election.cc:343] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.081853 718 leader_election.cc:304] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.082233 2661 raft_consensus.cc:2749] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:18.082486 2662 consensus_queue.cc:1048] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.083163 2628 raft_consensus.cc:2749] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:17.971783 1191 raft_consensus.cc:2272] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.084702 1191 ts_tablet_manager.cc:1916] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.086023 922 raft_consensus.cc:3060] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.089732 2642 consensus_queue.cc:1048] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.093247 880 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:48628 (request call id 230) took 1329 ms. Trace:
I20260616 19:52:18.093366 880 rpcz_store.cc:276] 0616 19:52:16.763557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.763600 (+ 43us) service_pool.cc:224] Handling call
0616 19:52:16.939892 (+176292us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x61800008508c. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7d0b7c4be 00007fb7d097690c 00007fb7d34a0d28 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138
0616 19:52:16.975730 (+ 35838us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x618000081c8c. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7d0b7c4be 00007fb7d097690c 00007fb7d34a0d28 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138
0616 19:52:17.203260 (+227530us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x6180000f348c. stack: 00007fb7c35ec086 00007fb7c35ebe40 00007fb7c25a53ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fb7d0b7c4be 00007fb7d097690c 00007fb7d34a0d28 00007fb7cd8c2c36 00007fb7cd8c2965 00007fb7ca68488e 00007fb7ca68376e 00007fb7ca6899a8 00007fb7ca68a30f 00007fb7ca68a138
0616 19:52:18.093206 (+889946us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388082176}
I20260616 19:52:18.093600 1198 tablet_bootstrap.cc:492] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:18.093758 1198 ts_tablet_manager.cc:1403] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.003s
I20260616 19:52:18.094435 1196 tablet_bootstrap.cc:492] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:18.094568 1196 ts_tablet_manager.cc:1403] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.113s user 0.030s sys 0.026s
I20260616 19:52:18.094601 1198 raft_consensus.cc:359] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.094867 1198 raft_consensus.cc:385] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.094990 1198 raft_consensus.cc:740] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.095221 1198 consensus_queue.cc:260] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.095312 1196 raft_consensus.cc:359] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.095463 1196 raft_consensus.cc:385] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.095528 1196 raft_consensus.cc:740] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.095729 1196 consensus_queue.cc:260] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.096190 1196 ts_tablet_manager.cc:1434] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:18.096190 1198 ts_tablet_manager.cc:1434] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:52:18.096514 1198 tablet_bootstrap.cc:492] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:18.098038 1196 tablet_bootstrap.cc:492] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:18.099686 1196 tablet_bootstrap.cc:654] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.104584 1198 tablet_bootstrap.cc:654] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:18.107750 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2c87488f7b84af595c4e509f6ecd9d7 consensus state has no leader
I20260616 19:52:18.116763 1192 tablet_bootstrap.cc:654] T 272838af35d840faa7b11217456533c2 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.118959 458 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf (table default.Table_ab8c15658e304438854ef13e1ce2274b [id=b7d5c502d76f428683cb0830f0819011]). Expected version 2 got 0
I20260616 19:52:18.127518 2628 raft_consensus.cc:493] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.127846 2628 raft_consensus.cc:515] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.129146 2628 leader_election.cc:290] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.129215 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_03f32450daa54bdeb536825ee2bec211" } modify_external_catalogs: true
I20260616 19:52:18.129449 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_03f32450daa54bdeb536825ee2bec211" } modify_external_catalogs: true
W20260616 19:52:18.130376 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5462af2002f9406b85ee20660e001a95 consensus state has no leader
I20260616 19:52:18.131191 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e68e2c6caff4ac38aa52b8b29f5ace6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.131168 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f2243cb23a37411591f0cd2ef5a5ed61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:18.131412 921 raft_consensus.cc:2468] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:18.131667 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e68e2c6caff4ac38aa52b8b29f5ace6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.131877 1059 raft_consensus.cc:2468] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
W20260616 19:52:18.131912 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2243cb23a37411591f0cd2ef5a5ed61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.131904 718 leader_election.cc:304] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:18.132225 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ca1174d132374ac18b552a80f5b61d87" } modify_external_catalogs: true
I20260616 19:52:18.132318 2628 raft_consensus.cc:2804] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.132385 2628 raft_consensus.cc:493] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.132340 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ca1174d132374ac18b552a80f5b61d87" } modify_external_catalogs: true
I20260616 19:52:18.132441 2628 raft_consensus.cc:3060] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.133833 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0acb0d2fafc04473871b8f4c15e6bfac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.134378 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0acb0d2fafc04473871b8f4c15e6bfac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.135257 2628 raft_consensus.cc:515] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.136227 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e68e2c6caff4ac38aa52b8b29f5ace6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:18.136381 1059 raft_consensus.cc:3060] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.136476 2628 leader_election.cc:290] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.139323 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c17ad23bee294c7ebb5f3a56c3993605" } new_table_name: "default.Table_48b28e7db53c426695b8938921f3a837" modify_external_catalogs: true
I20260616 19:52:18.139428 1059 raft_consensus.cc:2468] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.139945 719 leader_election.cc:304] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:18.141302 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e68e2c6caff4ac38aa52b8b29f5ace6" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:18.141485 921 raft_consensus.cc:3060] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.141316 2628 raft_consensus.cc:2804] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.141636 2661 raft_consensus.cc:493] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.141749 2628 raft_consensus.cc:697] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:18.141758 2661 raft_consensus.cc:515] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.142035 2628 consensus_queue.cc:237] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.142287 2661 leader_election.cc:290] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.142844 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc9d2ca8a644f69e0bc3e9ccecc3cf" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:18.143867 860 consensus_peers.cc:597] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4a2855b7dec4244a3fc52bdca7e7eb3. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:18.144191 996 leader_election.cc:343] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.145653 461 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet b8b01b42ffba4c68a0c3c238551d658b
I20260616 19:52:18.146145 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3f91f4dd18b54a2e88100598a7741ae3" } modify_external_catalogs: true
I20260616 19:52:18.146374 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3f91f4dd18b54a2e88100598a7741ae3" } modify_external_catalogs: true
I20260616 19:52:18.148857 1198 tablet_bootstrap.cc:492] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:18.149070 1198 ts_tablet_manager.cc:1403] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.001s
W20260616 19:52:18.149326 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33a6a46041464e93811b0c573db19f43 consensus state has no leader
I20260616 19:52:18.149458 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bfbf1a44762849e783649a69e17c311d" } new_table_name: "default.Table_1d7511f9de4347e38759761c12ea3af2" modify_external_catalogs: true
I20260616 19:52:18.149978 1198 raft_consensus.cc:359] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.150125 1198 raft_consensus.cc:385] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.150170 1198 raft_consensus.cc:740] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.150099 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c2b3654ba2644023ac6959fa72488070"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:18.150381 1198 consensus_queue.cc:260] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:18.150955 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2b3654ba2644023ac6959fa72488070 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.151332 1198 ts_tablet_manager.cc:1434] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:18.151603 1198 tablet_bootstrap.cc:492] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:18.153399 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c63ea4e62e3e433b86b05b9a80a2fd49" } modify_external_catalogs: true
I20260616 19:52:18.153596 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c63ea4e62e3e433b86b05b9a80a2fd49" } modify_external_catalogs: true
I20260616 19:52:18.153913 1198 tablet_bootstrap.cc:654] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:18.157061 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cce749336e6146dda490587b01e071f0 consensus state has no leader
I20260616 19:52:18.157799 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_88f278e7debf4f848f8569bea8b9b8f7" } modify_external_catalogs: true
I20260616 19:52:18.157953 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_88f278e7debf4f848f8569bea8b9b8f7" } modify_external_catalogs: true
I20260616 19:52:18.158210 2628 raft_consensus.cc:493] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.158347 2628 raft_consensus.cc:515] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.159230 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08db2c1398b946c180d81b88504c1d9c" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.159272 2628 leader_election.cc:290] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.159404 1059 raft_consensus.cc:2468] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:18.160089 719 leader_election.cc:304] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:18.160336 1196 tablet_bootstrap.cc:492] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:18.160480 1196 ts_tablet_manager.cc:1403] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.000s
I20260616 19:52:18.160920 2628 raft_consensus.cc:2804] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.161032 2628 raft_consensus.cc:493] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.161149 2628 raft_consensus.cc:3060] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.161216 1196 raft_consensus.cc:359] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.161382 1196 raft_consensus.cc:385] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.161451 1196 raft_consensus.cc:740] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.161649 1196 consensus_queue.cc:260] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.162765 2811 raft_consensus.cc:493] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.163111 2811 raft_consensus.cc:515] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.164350 2628 raft_consensus.cc:515] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.164554 2811 leader_election.cc:290] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.164778 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482411d57f24459d8e7ed0eeb573234d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.164971 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 4819496da1bc4421b1641b8441546879
I20260616 19:52:18.164995 1059 raft_consensus.cc:2468] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:18.165434 719 leader_election.cc:304] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:18.165618 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 4819496da1bc4421b1641b8441546879 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.165781 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08db2c1398b946c180d81b88504c1d9c" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:18.165943 1059 raft_consensus.cc:3060] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.168172 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 33a6a46041464e93811b0c573db19f43 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:18.169163 1059 raft_consensus.cc:2468] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.169759 719 leader_election.cc:304] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:18.169972 2642 raft_consensus.cc:2804] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.170044 2642 raft_consensus.cc:493] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.170105 2642 raft_consensus.cc:3060] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.170245 2811 raft_consensus.cc:2804] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
W20260616 19:52:18.170249 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f858ecd77984b1c9f729e201b099e66 consensus state has no leader
I20260616 19:52:18.170354 2811 raft_consensus.cc:697] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:18.170639 2811 consensus_queue.cc:237] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.170995 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 8e8ee572626a42909f31874a55b5cbb6 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:18.171684 2628 leader_election.cc:290] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.172510 2642 raft_consensus.cc:515] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.172962 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 4819496da1bc4421b1641b8441546879 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.173020 2642 leader_election.cc:290] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.174052 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 1a95eafa064b4b95b5281915ea5bd9f7 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:18.174710 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482411d57f24459d8e7ed0eeb573234d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:18.174901 1059 raft_consensus.cc:3060] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.175453 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 892ec2013b9f4c9292bf745e2aeae4ed
I20260616 19:52:18.176088 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 892ec2013b9f4c9292bf745e2aeae4ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.177325 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 892ec2013b9f4c9292bf745e2aeae4ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.177661 1059 raft_consensus.cc:2468] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.178063 719 leader_election.cc:304] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:18.178378 2745 raft_consensus.cc:2804] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.178501 2745 raft_consensus.cc:697] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:18.178723 2745 consensus_queue.cc:237] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.182521 1191 ts_tablet_manager.cc:1929] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:18.182698 1191 log.cc:1199] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/647b1abeb3c14b11b9a5c62b67e83cf8
I20260616 19:52:18.183146 1191 ts_tablet_manager.cc:1950] T 647b1abeb3c14b11b9a5c62b67e83cf8 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:18.146277 1192 tablet_bootstrap.cc:492] T 272838af35d840faa7b11217456533c2 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:18.172111 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08db2c1398b946c180d81b88504c1d9c" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:18.183689 1192 ts_tablet_manager.cc:1403] T 272838af35d840faa7b11217456533c2 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.104s user 0.003s sys 0.000s
I20260616 19:52:18.183892 1190 ts_tablet_manager.cc:1929] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260616 19:52:18.184080 718 leader_election.cc:343] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.184582 1196 ts_tablet_manager.cc:1434] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260616 19:52:18.185746 1196 tablet_bootstrap.cc:492] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:18.186925 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8e8ee572626a42909f31874a55b5cbb6
I20260616 19:52:18.187585 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e8ee572626a42909f31874a55b5cbb6 with delete_type TABLET_DATA_DELETED (replaced by tablet ddbb87afa67742dc8dbfd84a2e344811) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.188273 1196 tablet_bootstrap.cc:654] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.188666 460 catalog_manager.cc:6784] ReplaceTablet: tablet 8e8ee572626a42909f31874a55b5cbb6 deleted and replaced by tablet ddbb87afa67742dc8dbfd84a2e344811
I20260616 19:52:18.164520 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482411d57f24459d8e7ed0eeb573234d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.188978 1190 log.cc:1199] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/731556662b62419dae76149b22469ebd
I20260616 19:52:18.168738 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 4819496da1bc4421b1641b8441546879 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:18.173578 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482411d57f24459d8e7ed0eeb573234d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:18.176788 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 892ec2013b9f4c9292bf745e2aeae4ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:18.145136 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc9d2ca8a644f69e0bc3e9ccecc3cf" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.189355 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e8ee572626a42909f31874a55b5cbb6 with delete_type TABLET_DATA_DELETED (replaced by tablet ddbb87afa67742dc8dbfd84a2e344811) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:18.189373 718 leader_election.cc:343] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.159736 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08db2c1398b946c180d81b88504c1d9c" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:18.189848 718 leader_election.cc:343] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:18.189851 993 leader_election.cc:343] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.189955 993 leader_election.cc:304] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.190025 2628 consensus_queue.cc:1048] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:18.190126 718 leader_election.cc:343] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.190310 2661 raft_consensus.cc:2749] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:18.143947 921 raft_consensus.cc:2468] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.185050 1192 raft_consensus.cc:359] T 272838af35d840faa7b11217456533c2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.187815 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e8ee572626a42909f31874a55b5cbb6 with delete_type TABLET_DATA_DELETED (replaced by tablet ddbb87afa67742dc8dbfd84a2e344811) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:18.194504 1192 raft_consensus.cc:385] T 272838af35d840faa7b11217456533c2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.194595 1192 raft_consensus.cc:740] T 272838af35d840faa7b11217456533c2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.194898 1192 consensus_queue.cc:260] T 272838af35d840faa7b11217456533c2 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.195722 1192 ts_tablet_manager.cc:1434] T 272838af35d840faa7b11217456533c2 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260616 19:52:18.195994 1192 tablet_bootstrap.cc:492] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:18.197472 1192 tablet_bootstrap.cc:654] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.201175 1190 ts_tablet_manager.cc:1950] T 731556662b62419dae76149b22469ebd P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:18.202143 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1046) took 5119 ms. Trace:
I20260616 19:52:18.205667 2661 raft_consensus.cc:493] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.205790 2661 raft_consensus.cc:515] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.206312 2661 leader_election.cc:290] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.213604 1198 tablet_bootstrap.cc:492] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:18.213855 1198 ts_tablet_manager.cc:1403] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.000s
I20260616 19:52:18.214622 1198 raft_consensus.cc:359] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.215226 2628 consensus_queue.cc:1048] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.216538 1198 raft_consensus.cc:385] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.216662 1198 raft_consensus.cc:740] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.216967 1198 consensus_queue.cc:260] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.218317 1198 ts_tablet_manager.cc:1434] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260616 19:52:18.200783 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1058) took 5225 ms. Trace:
I20260616 19:52:18.220072 1198 tablet_bootstrap.cc:492] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:18.221992 1198 tablet_bootstrap.cc:654] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:18.205283 860 consensus_peers.cc:597] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43b4c3bd370749b18fb86f7a0aae2c50. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:18.223071 1190 rpcz_store.cc:276] 0616 19:52:13.082419 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.082474 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:18.077439 (+4994965us) ts_tablet_manager.cc:1151] Deleting tablet 731556662b62419dae76149b22469ebd
0616 19:52:18.077447 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.081745 (+ 4298us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.183834 (+102089us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.202127 (+ 18293us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4994772}
I20260616 19:52:18.224658 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 731556662b62419dae76149b22469ebd (table default.Table_465ef4c1c4044473a6e721ae45cbd7a1 [id=c49098557d4b4b0d9a720713127e4b53]) successfully deleted
I20260616 19:52:18.221216 1192 tablet_bootstrap.cc:492] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:18.225471 1192 ts_tablet_manager.cc:1403] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260616 19:52:18.219995 1191 rpcz_store.cc:276] 0616 19:52:12.975049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.975097 (+ 48us) service_pool.cc:224] Handling call
0616 19:52:17.967378 (+4992281us) ts_tablet_manager.cc:1151] Deleting tablet 647b1abeb3c14b11b9a5c62b67e83cf8
0616 19:52:17.967450 (+ 72us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.088124 (+120674us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.125064 (+ 36940us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.200759 (+ 75695us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4991758}
I20260616 19:52:18.230417 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 647b1abeb3c14b11b9a5c62b67e83cf8 (table default.Table_120e5c908fe348a7ab3ff54504e841ec [id=508154cdccf0482b890ef231e6fac070]) successfully deleted
I20260616 19:52:18.230960 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1059) took 5251 ms. Trace:
I20260616 19:52:18.231052 1192 raft_consensus.cc:359] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.231258 1192 raft_consensus.cc:385] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.231313 1192 raft_consensus.cc:740] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.231500 1192 consensus_queue.cc:260] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.231993 1192 ts_tablet_manager.cc:1434] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.006s user 0.000s sys 0.000s
I20260616 19:52:18.233081 1191 rpcz_store.cc:276] 0616 19:52:12.979577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.979626 (+ 49us) service_pool.cc:224] Handling call
0616 19:52:18.230830 (+5251204us) ts_tablet_manager.cc:1151] Deleting tablet c5047956478f488dbb4734bbaa138c00
0616 19:52:18.230840 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.230942 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5251038}
W20260616 19:52:18.233948 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c5047956478f488dbb4734bbaa138c00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5047956478f488dbb4734bbaa138c00 already in progress: creating tablet
I20260616 19:52:18.234403 1191 tablet_replica.cc:333] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:18.234539 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bc7409e31043bd9f47d3628278a2fa" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.234802 1190 tablet_replica.cc:333] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:18.234965 1190 raft_consensus.cc:2243] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:18.235100 1190 raft_consensus.cc:2272] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.235615 1190 ts_tablet_manager.cc:1916] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.237535 1192 tablet_bootstrap.cc:492] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:18.238888 1192 tablet_bootstrap.cc:654] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:18.237104 993 leader_election.cc:343] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.241044 1191 raft_consensus.cc:2243] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:18.242013 1191 raft_consensus.cc:2272] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.246850 1191 ts_tablet_manager.cc:1916] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.251124 2628 consensus_queue.cc:1048] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.257349 2628 raft_consensus.cc:493] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.264840 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bc7409e31043bd9f47d3628278a2fa" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.265053 775 raft_consensus.cc:2468] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:18.265309 1198 tablet_bootstrap.cc:492] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:18.265242 2628 raft_consensus.cc:515] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.265444 1198 ts_tablet_manager.cc:1403] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.047s user 0.009s sys 0.005s
I20260616 19:52:18.265816 2628 leader_election.cc:290] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.266186 1198 raft_consensus.cc:359] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.266433 1198 raft_consensus.cc:385] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.266543 1198 raft_consensus.cc:740] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.266614 1196 tablet_bootstrap.cc:492] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:18.266738 1196 ts_tablet_manager.cc:1403] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.081s user 0.005s sys 0.001s
I20260616 19:52:18.266551 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5587d5aa8584cf49ef3cb113a1b64ca" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.266889 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5587d5aa8584cf49ef3cb113a1b64ca" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.267095 1052 raft_consensus.cc:2393] T b5587d5aa8584cf49ef3cb113a1b64ca P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
I20260616 19:52:18.267462 1196 raft_consensus.cc:359] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.267520 719 leader_election.cc:304] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.267616 1196 raft_consensus.cc:385] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.267659 1196 raft_consensus.cc:740] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.267813 1196 consensus_queue.cc:260] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.268126 996 leader_election.cc:304] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.268172 1198 consensus_queue.cc:260] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.268532 2661 raft_consensus.cc:2804] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.268622 2661 raft_consensus.cc:493] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.268700 2661 raft_consensus.cc:3060] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.271147 2661 raft_consensus.cc:515] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.271654 2661 leader_election.cc:290] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.273077 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bc7409e31043bd9f47d3628278a2fa" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:18.273319 775 raft_consensus.cc:3060] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.273850 2745 raft_consensus.cc:3060] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.275918 775 raft_consensus.cc:2468] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:18.275987 2745 raft_consensus.cc:2749] T b5587d5aa8584cf49ef3cb113a1b64ca P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:18.276096 1190 ts_tablet_manager.cc:1929] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:18.276213 1190 log.cc:1199] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/102f322eb98f4224acb8637f8c29ac19
I20260616 19:52:18.277289 1196 ts_tablet_manager.cc:1434] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260616 19:52:18.277645 1196 tablet_bootstrap.cc:492] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:18.279632 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 3b57bceabff64533ae3a49b8afda614d from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:18.281287 1196 tablet_bootstrap.cc:654] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.281594 1192 tablet_bootstrap.cc:492] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:18.281738 1192 ts_tablet_manager.cc:1403] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.001s
I20260616 19:52:18.282420 1192 raft_consensus.cc:359] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.282483 996 leader_election.cc:304] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:18.282586 1192 raft_consensus.cc:385] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.282639 1192 raft_consensus.cc:740] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.282828 1192 consensus_queue.cc:260] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.283016 2661 raft_consensus.cc:2804] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.283115 2661 raft_consensus.cc:697] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:18.283365 2661 consensus_queue.cc:237] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.285969 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bc7409e31043bd9f47d3628278a2fa" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:18.286444 993 leader_election.cc:343] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.287226 2662 raft_consensus.cc:493] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.287339 2662 raft_consensus.cc:515] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.287868 2662 leader_election.cc:290] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:18.288437 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f96ef25396a4092bc475f4aab269bc7" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.288717 775 raft_consensus.cc:2468] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:18.288846 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f96ef25396a4092bc475f4aab269bc7" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.289060 1059 raft_consensus.cc:2468] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:18.289124 860 leader_election.cc:304] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:18.289371 2662 raft_consensus.cc:2804] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.289440 2662 raft_consensus.cc:493] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.289498 2662 raft_consensus.cc:3060] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.290426 1192 ts_tablet_manager.cc:1434] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260616 19:52:18.291088 1192 tablet_bootstrap.cc:492] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:18.291944 2662 raft_consensus.cc:515] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.293577 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f96ef25396a4092bc475f4aab269bc7" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:18.293738 781 raft_consensus.cc:3060] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.293660 2662 leader_election.cc:290] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:18.294054 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f96ef25396a4092bc475f4aab269bc7" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:18.294203 1059 raft_consensus.cc:3060] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.296754 1059 raft_consensus.cc:2468] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:18.296993 781 raft_consensus.cc:2468] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:18.297142 858 leader_election.cc:304] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:18.297421 2662 raft_consensus.cc:2804] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.297533 2662 raft_consensus.cc:697] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:18.297739 2662 consensus_queue.cc:237] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.298739 2628 consensus_queue.cc:1048] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.305102 2628 raft_consensus.cc:493] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.305249 2628 raft_consensus.cc:515] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.305878 2628 leader_election.cc:290] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.306444 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7b177800174706a985c11e5876b9d3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.306586 921 raft_consensus.cc:2468] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:18.308323 718 leader_election.cc:304] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:18.308774 2628 raft_consensus.cc:2804] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.308847 2628 raft_consensus.cc:493] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.308902 2628 raft_consensus.cc:3060] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.309589 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0e8a5c6334524a4e97813b34c6ead7e3" } new_table_name: "default.Table_47355a21f56c4a0eaab896baa5cceba6" modify_external_catalogs: true
I20260616 19:52:18.311283 2628 raft_consensus.cc:515] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.313506 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7b177800174706a985c11e5876b9d3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:18.313674 921 raft_consensus.cc:3060] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.316381 921 raft_consensus.cc:2468] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.318178 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_76b685a41bec414b8aa31150f92839aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:18.318516 718 leader_election.cc:304] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
W20260616 19:52:18.318701 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76b685a41bec414b8aa31150f92839aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:18.319278 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66d1f74bd23d48af8028bc3499d2c79d consensus state has no leader
I20260616 19:52:18.319298 2811 raft_consensus.cc:2804] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.319429 2811 raft_consensus.cc:697] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:18.319662 2811 consensus_queue.cc:237] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.321348 2628 leader_election.cc:290] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.323381 1192 tablet_bootstrap.cc:654] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.327255 1192 tablet_bootstrap.cc:492] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:18.327399 1192 ts_tablet_manager.cc:1403] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.002s
I20260616 19:52:18.328148 1192 raft_consensus.cc:359] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.328336 1192 raft_consensus.cc:385] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.328403 1192 raft_consensus.cc:740] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.328373 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_91f3b18de4544e1f955b7e68395c0c61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:18.328624 1192 consensus_queue.cc:260] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:18.329032 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91f3b18de4544e1f955b7e68395c0c61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.329170 1192 ts_tablet_manager.cc:1434] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:52:18.329487 1192 tablet_bootstrap.cc:492] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:18.329772 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1a5924d3b655450a8804a5a77cd2181a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.330175 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a5924d3b655450a8804a5a77cd2181a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.331175 1190 ts_tablet_manager.cc:1950] T 102f322eb98f4224acb8637f8c29ac19 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:18.331962 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1047) took 5188 ms. Trace:
I20260616 19:52:18.332041 1190 rpcz_store.cc:276] 0616 19:52:13.143623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.143678 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:18.225007 (+5081329us) ts_tablet_manager.cc:1151] Deleting tablet 102f322eb98f4224acb8637f8c29ac19
0616 19:52:18.232075 (+ 7068us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.272987 (+ 40912us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.276046 (+ 3059us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.331943 (+ 55897us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5081126}
I20260616 19:52:18.332235 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6ae99f784fee4c47b163e188e692ead7" } new_table_name: "default.Table_746d1671de2240a4968157d24c25b72f" modify_external_catalogs: true
I20260616 19:52:18.333076 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 102f322eb98f4224acb8637f8c29ac19 (table default.Table_9e4be7ef0c8d47f18765df6682984b16 [id=451f7d9acb9e4ec889906998eebae58f]) successfully deleted
I20260616 19:52:18.333962 2853 raft_consensus.cc:493] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.334079 2853 raft_consensus.cc:515] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.335186 2853 leader_election.cc:290] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.335280 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc22cdaecf2c46b5b69e5dc4f8eb04fd" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:18.335778 993 leader_election.cc:343] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.336526 1191 ts_tablet_manager.cc:1929] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:18.337592 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bc56a536b4ae4a45a371edc40efa390e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.338064 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc56a536b4ae4a45a371edc40efa390e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.337014 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7b177800174706a985c11e5876b9d3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.339002 1059 raft_consensus.cc:2468] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:18.339241 1191 log.cc:1199] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/ba0d3e7da3c74f5ea5dc4aac80a01c82
I20260616 19:52:18.339609 1191 ts_tablet_manager.cc:1950] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:18.340492 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7b177800174706a985c11e5876b9d3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:18.340670 1059 raft_consensus.cc:3060] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.343082 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc22cdaecf2c46b5b69e5dc4f8eb04fd" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:18.343158 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b82dd2c060dc45a781831dde1f67184a consensus state has no leader
I20260616 19:52:18.343498 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_75dfd23bdd1e4538975aeae054d02379"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.344070 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75dfd23bdd1e4538975aeae054d02379 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:18.344403 996 leader_election.cc:343] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.344568 996 leader_election.cc:304] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.345479 2661 raft_consensus.cc:2749] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:18.345458 1059 raft_consensus.cc:2468] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.345832 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6452f8aede464c779152e21149033fd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.346318 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6452f8aede464c779152e21149033fd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.351524 1196 tablet_bootstrap.cc:492] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:18.351665 1196 ts_tablet_manager.cc:1403] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.001s
I20260616 19:52:18.352128 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1060) took 5365 ms. Trace:
I20260616 19:52:18.352244 1191 rpcz_store.cc:276] 0616 19:52:12.986772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:12.986957 (+ 185us) service_pool.cc:224] Handling call
0616 19:52:18.234359 (+5247402us) ts_tablet_manager.cc:1151] Deleting tablet ba0d3e7da3c74f5ea5dc4aac80a01c82
0616 19:52:18.234369 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.273883 (+ 39514us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.336450 (+ 62567us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.352106 (+ 15656us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5247232}
I20260616 19:52:18.352631 1191 tablet_replica.cc:333] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:18.352319 1196 raft_consensus.cc:359] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.352684 1198 ts_tablet_manager.cc:1434] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.087s user 0.010s sys 0.014s
I20260616 19:52:18.352707 1196 raft_consensus.cc:385] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.352634 1190 tablet_replica.cc:333] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:18.352766 1196 raft_consensus.cc:740] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.352831 1191 raft_consensus.cc:2243] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:18.352998 1196 consensus_queue.cc:260] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.352957 1190 raft_consensus.cc:2243] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:18.353452 1196 ts_tablet_manager.cc:1434] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:18.353500 1190 raft_consensus.cc:2272] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.354038 1190 ts_tablet_manager.cc:1916] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.354200 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 (table default.Table_08419ba303bb445eac997664503a70a7 [id=2f996fd8aa154e608653b56bc8d01990]) successfully deleted
I20260616 19:52:18.352988 1191 raft_consensus.cc:2272] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.355001 1198 tablet_bootstrap.cc:492] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:18.355382 1196 tablet_bootstrap.cc:492] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:18.355692 1191 ts_tablet_manager.cc:1916] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.357033 1196 tablet_bootstrap.cc:654] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.357085 2745 consensus_queue.cc:1048] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.357340 1198 tablet_bootstrap.cc:654] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.359030 2850 raft_consensus.cc:493] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.359267 2850 raft_consensus.cc:515] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.359902 1193 ts_tablet_manager.cc:1929] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:18.360013 1193 log.cc:1199] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/c7f724dc23024a7297cfb8689f199600
I20260616 19:52:18.360522 2850 leader_election.cc:290] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.360555 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272838af35d840faa7b11217456533c2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.360728 781 raft_consensus.cc:2468] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:18.360948 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272838af35d840faa7b11217456533c2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.361181 922 raft_consensus.cc:2468] T 272838af35d840faa7b11217456533c2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:18.361166 996 leader_election.cc:304] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:18.361400 2850 raft_consensus.cc:2804] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.361617 1193 ts_tablet_manager.cc:1950] T c7f724dc23024a7297cfb8689f199600 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:18.361724 2850 raft_consensus.cc:493] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.361847 2850 raft_consensus.cc:3060] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.362564 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1219) took 1321 ms. Trace:
I20260616 19:52:18.364488 1193 rpcz_store.cc:276] 0616 19:52:17.041128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.042683 (+ 1555us) service_pool.cc:224] Handling call
0616 19:52:18.031656 (+988973us) ts_tablet_manager.cc:1151] Deleting tablet c7f724dc23024a7297cfb8689f199600
0616 19:52:18.031665 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.315004 (+283339us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.359746 (+ 44742us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.362548 (+ 2802us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":988844}
I20260616 19:52:18.364936 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet c7f724dc23024a7297cfb8689f199600 (table default.Table_7cdef69863694f0ba023c214e42394e8 [id=a7f1b3885b764715a88750ea3752dbdb]) successfully deleted
I20260616 19:52:18.365326 1193 tablet_replica.cc:333] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:18.366004 1193 raft_consensus.cc:2243] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:18.366292 2661 raft_consensus.cc:493] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.366374 1193 raft_consensus.cc:2272] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.366513 2661 raft_consensus.cc:515] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.367650 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d05c86bca9343a2bc8c5709e1c49647" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.367456 2850 raft_consensus.cc:515] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:18.368192 993 leader_election.cc:343] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.368417 2661 leader_election.cc:290] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.369326 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d05c86bca9343a2bc8c5709e1c49647" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.369475 781 raft_consensus.cc:2468] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:18.369519 1192 tablet_bootstrap.cc:654] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.369876 996 leader_election.cc:304] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.370148 2661 raft_consensus.cc:2804] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.370253 2661 raft_consensus.cc:493] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.370357 2661 raft_consensus.cc:3060] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.372895 1191 ts_tablet_manager.cc:1929] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:18.373010 1191 log.cc:1199] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/269c1dea941c481fb6fd2e4d59c877c0
I20260616 19:52:18.373363 2661 raft_consensus.cc:515] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.373600 1191 ts_tablet_manager.cc:1950] T 269c1dea941c481fb6fd2e4d59c877c0 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:18.374361 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1061) took 5331 ms. Trace:
I20260616 19:52:18.374573 1191 rpcz_store.cc:276] 0616 19:52:13.042804 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.042857 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:18.352585 (+5309728us) ts_tablet_manager.cc:1151] Deleting tablet 269c1dea941c481fb6fd2e4d59c877c0
0616 19:52:18.352595 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.367306 (+ 14711us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.372839 (+ 5533us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.374341 (+ 1502us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5307833}
I20260616 19:52:18.374884 1191 tablet_replica.cc:333] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:18.375074 1191 raft_consensus.cc:2243] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:18.375265 1191 raft_consensus.cc:2272] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.375480 2661 leader_election.cc:290] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.375501 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d05c86bca9343a2bc8c5709e1c49647" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:18.375993 993 leader_election.cc:343] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.376302 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d05c86bca9343a2bc8c5709e1c49647" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:18.376495 781 raft_consensus.cc:3060] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.376959 1193 ts_tablet_manager.cc:1916] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.377070 1191 ts_tablet_manager.cc:1916] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.378916 781 raft_consensus.cc:2468] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:18.380192 996 leader_election.cc:304] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.382426 2661 raft_consensus.cc:2804] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.382583 2661 raft_consensus.cc:697] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:18.382833 2661 consensus_queue.cc:237] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.386610 1198 tablet_bootstrap.cc:492] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:18.386737 1198 ts_tablet_manager.cc:1403] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.002s
I20260616 19:52:18.387795 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272838af35d840faa7b11217456533c2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:18.387976 922 raft_consensus.cc:3060] T 272838af35d840faa7b11217456533c2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.390484 922 raft_consensus.cc:2468] T 272838af35d840faa7b11217456533c2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:18.391183 993 leader_election.cc:304] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:18.391824 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272838af35d840faa7b11217456533c2" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:18.392020 781 raft_consensus.cc:3060] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.394822 1198 raft_consensus.cc:359] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.395054 1198 raft_consensus.cc:385] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.395141 1198 raft_consensus.cc:740] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.395555 781 raft_consensus.cc:2468] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:18.395503 1198 consensus_queue.cc:260] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.395999 1198 ts_tablet_manager.cc:1434] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260616 19:52:18.396319 1198 tablet_bootstrap.cc:492] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:52:18.397083 860 consensus_peers.cc:597] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 269c1dea941c481fb6fd2e4d59c877c0. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:18.397490 2661 raft_consensus.cc:2804] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.398767 2850 leader_election.cc:290] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.402972 2661 raft_consensus.cc:697] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:18.403399 2661 consensus_queue.cc:237] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.399029 1198 tablet_bootstrap.cc:654] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.406823 1192 tablet_bootstrap.cc:492] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:18.406970 1192 ts_tablet_manager.cc:1403] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.078s user 0.000s sys 0.002s
I20260616 19:52:18.407755 1192 raft_consensus.cc:359] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.407948 1192 raft_consensus.cc:385] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.408017 1192 raft_consensus.cc:740] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.408245 1192 consensus_queue.cc:260] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.408619 2864 raft_consensus.cc:493] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.409940 2864 raft_consensus.cc:515] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.409825 1198 tablet_bootstrap.cc:492] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:18.411105 1198 ts_tablet_manager.cc:1403] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260616 19:52:18.412072 1198 raft_consensus.cc:359] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.412326 1198 raft_consensus.cc:385] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.412446 1198 raft_consensus.cc:740] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.412791 1198 consensus_queue.cc:260] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.413591 1198 ts_tablet_manager.cc:1434] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:18.414304 1198 tablet_bootstrap.cc:492] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:18.415860 1192 ts_tablet_manager.cc:1434] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260616 19:52:18.416320 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b75452879004490ca0a5e9a28ddf4b80" } new_table_name: "default.Table_0cf44b9cc2a84e65b3b8882587c44781" modify_external_catalogs: true
I20260616 19:52:18.416437 2679 raft_consensus.cc:493] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.416620 2679 raft_consensus.cc:515] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.417259 2679 leader_election.cc:290] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:18.417886 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9eed87a7b66e4e379a000d4b0b594e69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:18.418995 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_31d718b4876e45f4b7366b0b32d66680" } modify_external_catalogs: true
I20260616 19:52:18.419134 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_31d718b4876e45f4b7366b0b32d66680" } modify_external_catalogs: true
I20260616 19:52:18.419178 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cb7a1acf35403192254bf5cd1170a2" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.419409 1059 raft_consensus.cc:2393] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:18.421136 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd52351082274a4aa12cac468d9a512d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.421586 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd52351082274a4aa12cac468d9a512d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:18.422289 993 leader_election.cc:343] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.424293 1198 tablet_bootstrap.cc:654] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.424430 2864 leader_election.cc:290] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:18.439742 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43f2f5f0d53a4098bef75a9006c81e80 consensus state has no leader
I20260616 19:52:18.440191 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4d803ac85364461abea82543951e59e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:18.441921 1192 tablet_bootstrap.cc:492] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:18.417572 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0cb7a1acf35403192254bf5cd1170a2" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.457769 2662 consensus_queue.cc:1048] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:18.459040 996 leader_election.cc:343] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.459168 996 leader_election.cc:304] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.459610 2850 raft_consensus.cc:2749] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:18.459306 1192 tablet_bootstrap.cc:654] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.460700 860 leader_election.cc:304] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:18.461283 2679 raft_consensus.cc:3060] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.462714 1190 ts_tablet_manager.cc:1929] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:18.462963 1190 log.cc:1199] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/f1a09d62e68148349b337c5075763672
I20260616 19:52:18.463745 2679 raft_consensus.cc:2749] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:18.463956 1190 ts_tablet_manager.cc:1950] T f1a09d62e68148349b337c5075763672 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:18.464704 2864 raft_consensus.cc:493] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.464726 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1048) took 5278 ms. Trace:
I20260616 19:52:18.464825 2864 raft_consensus.cc:515] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.465472 2864 leader_election.cc:290] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.465955 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cd1ad6e8744d33a2845e9f3dda4a7b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.466331 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cd1ad6e8744d33a2845e9f3dda4a7b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:18.466465 996 leader_election.cc:343] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:18.466733 993 leader_election.cc:343] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.466835 993 leader_election.cc:304] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.464879 1190 rpcz_store.cc:276] 0616 19:52:13.186304 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.186353 (+ 49us) service_pool.cc:224] Handling call
0616 19:52:18.352589 (+5166236us) ts_tablet_manager.cc:1151] Deleting tablet f1a09d62e68148349b337c5075763672
0616 19:52:18.352598 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.357338 (+ 4740us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.462622 (+105284us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.464672 (+ 2050us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5161390}
I20260616 19:52:18.467226 2864 raft_consensus.cc:2749] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:18.467329 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet f1a09d62e68148349b337c5075763672 (table default.Table_9a89b6471d8c42e594c15f43327d9572 [id=e2e41de8962e4ce081aa7c1ac71f8064]) successfully deleted
I20260616 19:52:18.467994 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1049) took 5188 ms. Trace:
I20260616 19:52:18.473650 1198 tablet_bootstrap.cc:492] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:18.474475 1198 ts_tablet_manager.cc:1403] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.060s user 0.004s sys 0.000s
I20260616 19:52:18.376138 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 269c1dea941c481fb6fd2e4d59c877c0 (table default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb [id=2c7a8a72acf5496eaebb585c459112fb]) successfully deleted
W20260616 19:52:18.475953 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d803ac85364461abea82543951e59e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:18.475999 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 99867.5us
W20260616 19:52:18.476106 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9eed87a7b66e4e379a000d4b0b594e69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:18.477917 858 consensus_peers.cc:597] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba0d3e7da3c74f5ea5dc4aac80a01c82. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:18.478659 1198 raft_consensus.cc:359] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.478865 1198 raft_consensus.cc:385] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.478950 1198 raft_consensus.cc:740] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.479158 1198 consensus_queue.cc:260] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.479754 1198 ts_tablet_manager.cc:1434] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:52:18.480079 1198 tablet_bootstrap.cc:492] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:18.482172 1198 tablet_bootstrap.cc:654] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.483713 1196 tablet_bootstrap.cc:492] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:18.485778 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4977207a3a3e4366a30e0cffb72a5682" } new_table_name: "default.Table_3e256435589541629fa556b1569d4b73" modify_external_catalogs: true
I20260616 19:52:18.486189 1196 ts_tablet_manager.cc:1403] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.131s user 0.017s sys 0.018s
I20260616 19:52:18.487155 1196 raft_consensus.cc:359] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.487432 1196 raft_consensus.cc:385] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.487569 1196 raft_consensus.cc:740] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.487860 1196 consensus_queue.cc:260] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.491438 1196 ts_tablet_manager.cc:1434] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260616 19:52:18.492025 1196 tablet_bootstrap.cc:492] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:18.492483 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_47c7c784919540a4bda1aaf9cb6e3ab2" } modify_external_catalogs: true
I20260616 19:52:18.492539 2864 raft_consensus.cc:493] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.492660 2864 raft_consensus.cc:515] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.492771 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_47c7c784919540a4bda1aaf9cb6e3ab2" } modify_external_catalogs: true
I20260616 19:52:18.493248 2864 leader_election.cc:290] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.494349 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a95eafa064b4b95b5281915ea5bd9f7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:18.494783 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6b8fdd3a52974113af28706dd8b74d4e consensus state has no leader
I20260616 19:52:18.495205 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5436b0719642405e902210bdd7310a37" } new_table_name: "default.Table_facdaa8cecb9489da27d797b13153169" modify_external_catalogs: true
W20260616 19:52:18.495416 993 leader_election.cc:343] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.496522 2557 consensus_queue.cc:1048] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.494177 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a95eafa064b4b95b5281915ea5bd9f7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.494576 2811 consensus_queue.cc:1048] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.500267 1196 tablet_bootstrap.cc:654] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:18.500600 996 leader_election.cc:343] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.500725 996 leader_election.cc:304] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.500970 2864 raft_consensus.cc:2749] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:18.502552 2745 consensus_queue.cc:1048] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:18.504349 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 90643052a7f34442a8f43a2c58f3b7d3 consensus state has no leader
I20260616 19:52:18.505548 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e2c4a551aeaa41c4be9c40d9b5232686"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.506237 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2c4a551aeaa41c4be9c40d9b5232686 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.519013 1191 ts_tablet_manager.cc:1929] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:18.519208 1191 log.cc:1199] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/e6f309caaa9042f99432a61fd2ebb089
I20260616 19:52:18.519627 1191 ts_tablet_manager.cc:1950] T e6f309caaa9042f99432a61fd2ebb089 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:18.521780 1193 ts_tablet_manager.cc:1929] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:18.521950 1193 log.cc:1199] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/af5e277102b8480db44e5ffe88267808
I20260616 19:52:18.523862 2845 consensus_queue.cc:1048] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.526980 2845 consensus_queue.cc:1048] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.534829 1192 tablet_bootstrap.cc:492] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:18.534978 1192 ts_tablet_manager.cc:1403] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.093s user 0.002s sys 0.002s
I20260616 19:52:18.535660 1192 raft_consensus.cc:359] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.535861 1192 raft_consensus.cc:385] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.535916 1192 raft_consensus.cc:740] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.536106 1192 consensus_queue.cc:260] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.536957 1192 ts_tablet_manager.cc:1434] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260616 19:52:18.537207 1192 tablet_bootstrap.cc:492] T 5fd289d39eaf4471b754dae9433a5474 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:18.539568 1192 tablet_bootstrap.cc:654] T 5fd289d39eaf4471b754dae9433a5474 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.468218 1190 rpcz_store.cc:276] 0616 19:52:13.279427 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.279485 (+ 58us) service_pool.cc:224] Handling call
0616 19:52:18.467709 (+5188224us) ts_tablet_manager.cc:1151] Deleting tablet 09b2bf2ff1004853a39522a0b0608290
0616 19:52:18.467720 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.467976 (+ 256us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5187916}
W20260616 19:52:18.540203 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 09b2bf2ff1004853a39522a0b0608290 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09b2bf2ff1004853a39522a0b0608290 already in progress: creating tablet
I20260616 19:52:18.540643 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1050) took 5255 ms. Trace:
I20260616 19:52:18.540732 1190 rpcz_store.cc:276] 0616 19:52:13.285612 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.285848 (+ 236us) service_pool.cc:224] Handling call
0616 19:52:18.540526 (+5254678us) ts_tablet_manager.cc:1151] Deleting tablet 0dc52e26f5554d789addb5923a612070
0616 19:52:18.540537 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.540627 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5254480}
W20260616 19:52:18.541115 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 0dc52e26f5554d789addb5923a612070 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dc52e26f5554d789addb5923a612070 already in progress: creating tablet
I20260616 19:52:18.541438 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1051) took 5246 ms. Trace:
I20260616 19:52:18.541522 1190 rpcz_store.cc:276] 0616 19:52:13.294883 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.294943 (+ 60us) service_pool.cc:224] Handling call
0616 19:52:18.541341 (+5246398us) ts_tablet_manager.cc:1151] Deleting tablet 20b9e3626794464aa823724bee0a1682
0616 19:52:18.541351 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.541423 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5246213}
W20260616 19:52:18.541891 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 20b9e3626794464aa823724bee0a1682 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20b9e3626794464aa823724bee0a1682 already in progress: creating tablet
I20260616 19:52:18.542140 1190 tablet_replica.cc:333] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:18.542332 1190 raft_consensus.cc:2243] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:18.542544 1190 pending_rounds.cc:70] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e: Trying to abort 1 pending ops.
I20260616 19:52:18.542589 1190 pending_rounds.cc:77] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595548869804032 op_type: NO_OP noop_request { }
I20260616 19:52:18.542675 1190 raft_consensus.cc:2889] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:18.542747 1190 raft_consensus.cc:2272] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.544452 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_798762eab3ea49818ee909f8b3207b1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.544999 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_798762eab3ea49818ee909f8b3207b1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.549626 1196 tablet_bootstrap.cc:492] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:18.549772 1196 ts_tablet_manager.cc:1403] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.000s
I20260616 19:52:18.550549 1196 raft_consensus.cc:359] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.550714 1196 raft_consensus.cc:385] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.550782 1196 raft_consensus.cc:740] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.550999 1196 consensus_queue.cc:260] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.551399 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2cf157e2fe134e2c80976c8deaf8deba" } modify_external_catalogs: true
I20260616 19:52:18.552335 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2cf157e2fe134e2c80976c8deaf8deba" } modify_external_catalogs: true
I20260616 19:52:18.552964 1193 ts_tablet_manager.cc:1950] T af5e277102b8480db44e5ffe88267808 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:18.553689 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1220) took 1511 ms. Trace:
I20260616 19:52:18.553776 1193 rpcz_store.cc:276] 0616 19:52:17.041802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.042836 (+ 1034us) service_pool.cc:224] Handling call
0616 19:52:18.365285 (+1322449us) ts_tablet_manager.cc:1151] Deleting tablet af5e277102b8480db44e5ffe88267808
0616 19:52:18.365294 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.473158 (+107864us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.521727 (+ 48569us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.553669 (+ 31942us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1322336}
I20260616 19:52:18.554203 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet af5e277102b8480db44e5ffe88267808 (table default.Table_d19f51d7b61e47dea882c1fd07d9a122 [id=00510df65be542a98fec0f25a07d1542]) successfully deleted
I20260616 19:52:18.556213 2700 raft_consensus.cc:493] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.556327 2700 raft_consensus.cc:515] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.557041 2700 leader_election.cc:290] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:18.557816 1190 ts_tablet_manager.cc:1916] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.530951 1198 tablet_bootstrap.cc:492] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:18.558046 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b362fa598a54632880faa42a9224ffd" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.558182 1198 ts_tablet_manager.cc:1403] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.078s user 0.006s sys 0.002s
I20260616 19:52:18.558195 775 raft_consensus.cc:2468] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:18.558715 860 leader_election.cc:304] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:18.558802 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1062) took 5317 ms. Trace:
I20260616 19:52:18.558960 2700 raft_consensus.cc:2804] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.559032 2700 raft_consensus.cc:493] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.558966 1198 raft_consensus.cc:359] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.559089 2700 raft_consensus.cc:3060] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.559120 1198 raft_consensus.cc:385] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.559170 1198 raft_consensus.cc:740] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.559377 1198 consensus_queue.cc:260] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.560392 1192 tablet_bootstrap.cc:492] T 5fd289d39eaf4471b754dae9433a5474 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:18.560631 1198 ts_tablet_manager.cc:1434] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:18.560650 1192 ts_tablet_manager.cc:1403] T 5fd289d39eaf4471b754dae9433a5474 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260616 19:52:18.560889 1198 tablet_bootstrap.cc:492] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:18.561614 2700 raft_consensus.cc:515] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.561643 1192 raft_consensus.cc:359] T 5fd289d39eaf4471b754dae9433a5474 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.561815 1192 raft_consensus.cc:385] T 5fd289d39eaf4471b754dae9433a5474 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.561865 1192 raft_consensus.cc:740] T 5fd289d39eaf4471b754dae9433a5474 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.562048 1192 consensus_queue.cc:260] T 5fd289d39eaf4471b754dae9433a5474 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.562517 1192 ts_tablet_manager.cc:1434] T 5fd289d39eaf4471b754dae9433a5474 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:18.562851 1192 tablet_bootstrap.cc:492] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:18.563057 1198 tablet_bootstrap.cc:654] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.562986 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b362fa598a54632880faa42a9224ffd" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
W20260616 19:52:18.563506 858 leader_election.cc:343] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.563649 2700 leader_election.cc:290] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:18.564499 1193 tablet_replica.cc:333] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:18.564695 1193 raft_consensus.cc:2243] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:18.564949 1198 tablet_bootstrap.cc:492] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:18.564940 1193 raft_consensus.cc:2272] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.565459 1196 ts_tablet_manager.cc:1434] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260616 19:52:18.565896 1198 ts_tablet_manager.cc:1403] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20260616 19:52:18.565423 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b362fa598a54632880faa42a9224ffd" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:18.566124 775 raft_consensus.cc:3060] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.566473 1196 tablet_bootstrap.cc:492] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:18.558887 1191 rpcz_store.cc:276] 0616 19:52:13.241615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.241696 (+ 81us) service_pool.cc:224] Handling call
0616 19:52:18.374836 (+5133140us) ts_tablet_manager.cc:1151] Deleting tablet e6f309caaa9042f99432a61fd2ebb089
0616 19:52:18.374846 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.456303 (+ 81457us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.518952 (+ 62649us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.558784 (+ 39832us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5132957}
I20260616 19:52:18.569475 1198 raft_consensus.cc:359] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.569533 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet e6f309caaa9042f99432a61fd2ebb089 (table default.Table_148c23f911c0426e857f5f3cd973d63e [id=fa08d08f5e8a4f9d8616afb37792fbeb]) successfully deleted
I20260616 19:52:18.569959 775 raft_consensus.cc:2468] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:18.570387 860 leader_election.cc:304] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
I20260616 19:52:18.570762 2700 raft_consensus.cc:2804] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.571090 2700 raft_consensus.cc:697] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:18.571370 2700 consensus_queue.cc:237] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.572806 1196 tablet_bootstrap.cc:654] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.574546 1198 raft_consensus.cc:385] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.574764 1198 raft_consensus.cc:740] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.575179 1198 consensus_queue.cc:260] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.569216 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1063) took 5290 ms. Trace:
I20260616 19:52:18.575924 1191 rpcz_store.cc:276] 0616 19:52:13.278525 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.278663 (+ 138us) service_pool.cc:224] Handling call
0616 19:52:18.569094 (+5290431us) ts_tablet_manager.cc:1151] Deleting tablet 09b2bf2ff1004853a39522a0b0608290
0616 19:52:18.569102 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.569202 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5290215}
W20260616 19:52:18.576365 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 09b2bf2ff1004853a39522a0b0608290 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09b2bf2ff1004853a39522a0b0608290 already in progress: creating tablet
I20260616 19:52:18.569751 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b362fa598a54632880faa42a9224ffd" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.577131 1198 ts_tablet_manager.cc:1434] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
W20260616 19:52:18.577172 858 leader_election.cc:343] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.578275 1198 tablet_bootstrap.cc:492] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:18.577740 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1064) took 5292 ms. Trace:
I20260616 19:52:18.580032 1191 rpcz_store.cc:276] 0616 19:52:13.285779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.286085 (+ 306us) service_pool.cc:224] Handling call
0616 19:52:18.577632 (+5291547us) ts_tablet_manager.cc:1151] Deleting tablet 0dc52e26f5554d789addb5923a612070
0616 19:52:18.577641 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.577726 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5291395}
W20260616 19:52:18.580433 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0dc52e26f5554d789addb5923a612070 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dc52e26f5554d789addb5923a612070 already in progress: creating tablet
I20260616 19:52:18.580724 1191 tablet_replica.cc:333] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:18.581043 1191 raft_consensus.cc:2243] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:18.581259 1191 raft_consensus.cc:2272] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.581447 1193 ts_tablet_manager.cc:1916] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.581934 1191 ts_tablet_manager.cc:1916] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.588238 452 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet a95c684f5fe54f7dad6300efb0c18780 (table default.Table_57baa761ff0f4e189d6b46fada3d0d9f [id=02d0cb31737b4289988e982dd24ae298]). Expected version 1 got 0
I20260616 19:52:18.589854 452 catalog_manager.cc:5696] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:18.590629 452 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 41f2d259a31c4f4eaeceaba57fb978b2 (table default.Table_7ffffaef50044d8ba89e6df198946113 [id=d49c093f51b04c2fa1b1f5daadd802cf]). Expected version 3 got 0
I20260616 19:52:18.591070 452 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet b5587d5aa8584cf49ef3cb113a1b64ca (table default.Table_0f374c454bc04298ba16dc14edb7bc9e [id=1105333647e747a39fc06efbcc95fa0d]). Expected version 1 got 0
I20260616 19:52:18.591228 452 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 2141b6c7013648a4b716642ccb4eccd6 (table default.Table_5047c84664124989b931ee92afc5b463 [id=bc83d5c728054794b2c3cc0f9b90e202]). Expected version 1 got 0
I20260616 19:52:18.592687 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 51983531f0f5423aa5f4bb3435cd5a7e
I20260616 19:52:18.593552 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 51983531f0f5423aa5f4bb3435cd5a7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:18.594014 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 51983531f0f5423aa5f4bb3435cd5a7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.594542 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1a95eafa064b4b95b5281915ea5bd9f7
I20260616 19:52:18.594615 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 51983531f0f5423aa5f4bb3435cd5a7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:51610
W20260616 19:52:18.595441 860 consensus_peers.cc:597] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4be902fe29bb46a4bf71ee6384e6722a. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:18.595629 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a95eafa064b4b95b5281915ea5bd9f7 with delete_type TABLET_DATA_DELETED (replaced by tablet f1ce8c8fcf5b4546ab90c4dacd78118f) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.595901 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a95eafa064b4b95b5281915ea5bd9f7 with delete_type TABLET_DATA_DELETED (replaced by tablet f1ce8c8fcf5b4546ab90c4dacd78118f) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:18.595942 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 33a6a46041464e93811b0c573db19f43
I20260616 19:52:18.596381 456 catalog_manager.cc:6784] ReplaceTablet: tablet 33a6a46041464e93811b0c573db19f43 deleted and replaced by tablet 9f9f9b7d86984ee6b75f8cd4b87ca3b9
I20260616 19:52:18.596486 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a95eafa064b4b95b5281915ea5bd9f7 with delete_type TABLET_DATA_DELETED (replaced by tablet f1ce8c8fcf5b4546ab90c4dacd78118f) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.596836 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a6a46041464e93811b0c573db19f43 with delete_type TABLET_DATA_DELETED (replaced by tablet 9f9f9b7d86984ee6b75f8cd4b87ca3b9) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:18.599010 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a6a46041464e93811b0c573db19f43 with delete_type TABLET_DATA_DELETED (replaced by tablet 9f9f9b7d86984ee6b75f8cd4b87ca3b9) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.599107 1196 tablet_bootstrap.cc:492] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:18.599210 1196 ts_tablet_manager.cc:1403] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260616 19:52:18.599499 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a6a46041464e93811b0c573db19f43 with delete_type TABLET_DATA_DELETED (replaced by tablet 9f9f9b7d86984ee6b75f8cd4b87ca3b9) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.599769 457 catalog_manager.cc:6784] ReplaceTablet: tablet 1a95eafa064b4b95b5281915ea5bd9f7 deleted and replaced by tablet f1ce8c8fcf5b4546ab90c4dacd78118f
I20260616 19:52:18.599900 1196 raft_consensus.cc:359] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.600061 1196 raft_consensus.cc:385] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.600119 1196 raft_consensus.cc:740] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.601168 1198 tablet_bootstrap.cc:654] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.608965 1196 consensus_queue.cc:260] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.609952 1192 tablet_bootstrap.cc:654] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.610600 2662 consensus_queue.cc:1048] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.615417 1190 ts_tablet_manager.cc:1929] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:18.615540 1190 log.cc:1199] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/3f96ef25396a4092bc475f4aab269bc7
I20260616 19:52:18.615873 1193 ts_tablet_manager.cc:1929] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:18.615955 1190 ts_tablet_manager.cc:1950] T 3f96ef25396a4092bc475f4aab269bc7 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:18.616166 1196 ts_tablet_manager.cc:1434] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260616 19:52:18.616272 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1052) took 5303 ms. Trace:
I20260616 19:52:18.616509 1196 tablet_bootstrap.cc:492] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:18.618088 1196 tablet_bootstrap.cc:654] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.616371 1190 rpcz_store.cc:276] 0616 19:52:13.312984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.313037 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:18.542100 (+5229063us) ts_tablet_manager.cc:1151] Deleting tablet 3f96ef25396a4092bc475f4aab269bc7
0616 19:52:18.542109 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.607509 (+ 65400us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.615352 (+ 7843us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.616257 (+ 905us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5228855}
I20260616 19:52:18.619680 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1053) took 5289 ms. Trace:
I20260616 19:52:18.619788 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 3f96ef25396a4092bc475f4aab269bc7 (table default.Table_8f2f5974ba694802a093f7c3adbacd48 [id=85bdc981552e4f50a725c53285275af3]) successfully deleted
I20260616 19:52:18.619769 1190 rpcz_store.cc:276] 0616 19:52:13.330423 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.331266 (+ 843us) service_pool.cc:224] Handling call
0616 19:52:18.619567 (+5288301us) ts_tablet_manager.cc:1151] Deleting tablet 8b4d4c8b67aa44f68a974f7ca7090dd4
0616 19:52:18.619576 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.619666 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5288116}
I20260616 19:52:18.620023 1190 tablet_replica.cc:333] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:18.620204 1190 raft_consensus.cc:2243] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:18.620254 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 8b4d4c8b67aa44f68a974f7ca7090dd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b4d4c8b67aa44f68a974f7ca7090dd4 already in progress: creating tablet
I20260616 19:52:18.620354 1190 raft_consensus.cc:2272] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.621081 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_06e2b90b7d114fdaa63c3075528179ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.621701 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06e2b90b7d114fdaa63c3075528179ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.622884 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_14591625550c4aa5a5a46a183fb22a3f" } new_table_name: "default.Table_c035e26c7baf4a53b91d95a05cbceeed" modify_external_catalogs: true
I20260616 19:52:18.624058 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9b7db1fbbdd5489e808bdf3476b6090e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.624521 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b7db1fbbdd5489e808bdf3476b6090e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.625777 1198 tablet_bootstrap.cc:492] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:18.625908 1198 ts_tablet_manager.cc:1403] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.001s
I20260616 19:52:18.626483 1190 ts_tablet_manager.cc:1916] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.626629 1198 raft_consensus.cc:359] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.626786 1198 raft_consensus.cc:385] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.626839 1198 raft_consensus.cc:740] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.627030 1198 consensus_queue.cc:260] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.627543 1198 ts_tablet_manager.cc:1434] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:18.629909 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 574927dc3a804b059e71630c133dcbea
I20260616 19:52:18.630586 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1711b70016334d1e9cd9e043a4cd1625" } new_table_name: "default.Table_4d937ed6c0714153993ea132f1eb2b3c" modify_external_catalogs: true
I20260616 19:52:18.631805 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 574927dc3a804b059e71630c133dcbea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.632711 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 574927dc3a804b059e71630c133dcbea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:18.633172 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 574927dc3a804b059e71630c133dcbea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.639155 1196 tablet_bootstrap.cc:492] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:18.639300 1196 ts_tablet_manager.cc:1403] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260616 19:52:18.641702 763 tablet_service.cc:1511] Processing CreateTablet for tablet f428de72bfe840cba50eedc054072fbf (DEFAULT_TABLE table=default.Table_afc1d67eb0a44d31937f3d2ea557a9f5 [id=1e3186a0453241729d1f0044b67b2758]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.642077 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f428de72bfe840cba50eedc054072fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.642462 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 290d1bf172f949089e013d24ec64435d
I20260616 19:52:18.642853 454 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet f1ce8c8fcf5b4546ab90c4dacd78118f
I20260616 19:52:18.642954 461 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:41696 (request call id 1518) took 1072 ms. Trace:
I20260616 19:52:18.643016 461 rpcz_store.cc:276] 0616 19:52:17.570188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.146035 (+575847us) service_pool.cc:224] Handling call
0616 19:52:18.146653 (+ 618us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0616 19:52:18.146802 (+ 149us) catalog_manager.cc:2840] Modifying in-memory table state
0616 19:52:18.146859 (+ 57us) catalog_manager.cc:2849] Locking tablets
0616 19:52:18.588809 (+441950us) catalog_manager.cc:2863] Removing table and tablets from system table
0616 19:52:18.642320 (+ 53511us) catalog_manager.cc:2881] Removing table from by-name map
0616 19:52:18.642394 (+ 74us) catalog_manager.cc:2897] Committing in-memory state
0616 19:52:18.642432 (+ 38us) catalog_manager.cc:2901] Aborting table tasks
0616 19:52:18.642944 (+ 512us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:18.622204 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:18.622300 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:18.622305 (+ 5us) write_op.cc:435] Acquired schema lock
0616 19:52:18.622307 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:18.622391 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:18.622400 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:18.622405 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:18.622482 (+ 77us) tablet.cc:701] Row locks acquired
0616 19:52:18.622485 (+ 3us) write_op.cc:260] PREPARE: finished
0616 19:52:18.622510 (+ 25us) write_op.cc:270] Start()
0616 19:52:18.622533 (+ 23us) write_op.cc:276] Timestamp: P: 1781639538622452 usec, L: 0
0616 19:52:18.622537 (+ 4us) op_driver.cc:348] REPLICATION: starting
0616 19:52:18.622665 (+ 128us) log.cc:844] Serialized 762 byte log entry
0616 19:52:18.640210 (+ 17545us) op_driver.cc:464] REPLICATION: finished
0616 19:52:18.640571 (+ 361us) write_op.cc:301] APPLY: starting
0616 19:52:18.640585 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:18.640631 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:18.640656 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:18.640735 (+ 79us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:18.640769 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0616 19:52:18.640776 (+ 7us) write_op.cc:312] APPLY: finished
0616 19:52:18.640851 (+ 75us) log.cc:844] Serialized 29 byte log entry
0616 19:52:18.640916 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:18.640951 (+ 35us) write_op.cc:454] Released schema lock
0616 19:52:18.640957 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:18.641030 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:18.641036 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":308,"apply.run_cpu_time_us":449,"apply.run_wall_time_us":449,"num_ops":2,"prepare.queue_time_us":32563,"prepare.run_cpu_time_us":538,"prepare.run_wall_time_us":594,"raft.queue_time_us":38,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":17644}]]}
I20260616 19:52:18.643639 461 master_service.cc:960] ReplaceTablet: received request to replace tablet ce0963f38738468eb1518deadb3f119d from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:18.640056 1196 raft_consensus.cc:359] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.644392 1196 raft_consensus.cc:385] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.644451 1196 raft_consensus.cc:740] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.644685 1196 consensus_queue.cc:260] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.645293 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 290d1bf172f949089e013d24ec64435d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.645593 2864 raft_consensus.cc:493] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.645716 2864 raft_consensus.cc:515] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.646432 2864 leader_election.cc:290] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.646652 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 41f2d259a31c4f4eaeceaba57fb978b2 (table default.Table_7ffffaef50044d8ba89e6df198946113 [id=d49c093f51b04c2fa1b1f5daadd802cf]). Expected version 3 got 0
I20260616 19:52:18.647074 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet a95c684f5fe54f7dad6300efb0c18780 (table default.Table_57baa761ff0f4e189d6b46fada3d0d9f [id=02d0cb31737b4289988e982dd24ae298]). Expected version 1 got 0
I20260616 19:52:18.647225 459 catalog_manager.cc:5696] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } }
I20260616 19:52:18.647534 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet b5587d5aa8584cf49ef3cb113a1b64ca (table default.Table_0f374c454bc04298ba16dc14edb7bc9e [id=1105333647e747a39fc06efbcc95fa0d]). Expected version 1 got 0
I20260616 19:52:18.647749 458 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_4f1675b0cae24ecea8b9f4efebb44772 [id=4f2b128cff5248f98e3506bb72a39391] alter complete (version 3)
I20260616 19:52:18.648952 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 290d1bf172f949089e013d24ec64435d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.649720 1031 tablet_service.cc:1511] Processing CreateTablet for tablet f428de72bfe840cba50eedc054072fbf (DEFAULT_TABLE table=default.Table_afc1d67eb0a44d31937f3d2ea557a9f5 [id=1e3186a0453241729d1f0044b67b2758]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:18.649881 458 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:38239 (request call id 213) took 770 ms (client timeout 1000 ms). Trace:
I20260616 19:52:18.650087 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f428de72bfe840cba50eedc054072fbf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:18.649952 458 rpcz_store.cc:269] 0616 19:52:17.879225 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.114727 (+235502us) service_pool.cc:224] Handling call
0616 19:52:18.649864 (+535137us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:18.196152 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:18.196274 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:18.196279 (+ 5us) write_op.cc:435] Acquired schema lock
0616 19:52:18.196282 (+ 3us) tablet.cc:662] Decoding operations
0616 19:52:18.196373 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:18.196384 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:18.196389 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0616 19:52:18.196444 (+ 55us) tablet.cc:701] Row locks acquired
0616 19:52:18.196446 (+ 2us) write_op.cc:260] PREPARE: finished
0616 19:52:18.196508 (+ 62us) write_op.cc:270] Start()
0616 19:52:18.196538 (+ 30us) write_op.cc:276] Timestamp: P: 1781639538196441 usec, L: 0
0616 19:52:18.196542 (+ 4us) op_driver.cc:348] REPLICATION: starting
0616 19:52:18.196700 (+ 158us) log.cc:844] Serialized 356 byte log entry
0616 19:52:18.203397 (+ 6697us) op_driver.cc:464] REPLICATION: finished
0616 19:52:18.204454 (+ 1057us) write_op.cc:301] APPLY: starting
0616 19:52:18.204488 (+ 34us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:18.204524 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:18.204550 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:18.204599 (+ 49us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:18.204629 (+ 30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0616 19:52:18.204635 (+ 6us) write_op.cc:312] APPLY: finished
0616 19:52:18.204704 (+ 69us) log.cc:844] Serialized 23 byte log entry
0616 19:52:18.204763 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:18.204784 (+ 21us) write_op.cc:454] Released schema lock
0616 19:52:18.204792 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":1001,"apply.run_cpu_time_us":410,"apply.run_wall_time_us":410,"mutex_wait_us":21,"num_ops":1,"prepare.queue_time_us":101,"prepare.run_cpu_time_us":674,"prepare.run_wall_time_us":690,"raft.queue_time_us":94,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":257,"replication_time_us":6809,"spinlock_wait_cycles":1792}]]}
I20260616 19:52:18.650764 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a8708321fb0f4c409a66df75da4c6c0e
I20260616 19:52:18.651485 2845 raft_consensus.cc:493] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.651592 2845 raft_consensus.cc:515] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.652100 2845 leader_election.cc:290] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.652616 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 290d1bf172f949089e013d24ec64435d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:18.655247 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd5fecc6d444e5fba9103287c09542e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.655573 889 tablet_service.cc:1558] Processing DeleteTablet for tablet a8708321fb0f4c409a66df75da4c6c0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:18.655714 1191 ts_tablet_manager.cc:1929] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:18.655828 1191 log.cc:1199] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/a817b1d4c7b640db8894bc801878caae
I20260616 19:52:18.655951 898 tablet_service.cc:1511] Processing CreateTablet for tablet ad5dd770f49b42c5ba362c26d615d35b (DEFAULT_TABLE table=default.Table_1dfa3e8f31e44cca9b69c60f7bba81d4 [id=8ec151c465df4ac88d39ae8d1f7760c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.656206 1191 ts_tablet_manager.cc:1950] T a817b1d4c7b640db8894bc801878caae P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:18.656718 902 tablet_service.cc:1511] Processing CreateTablet for tablet f428de72bfe840cba50eedc054072fbf (DEFAULT_TABLE table=default.Table_afc1d67eb0a44d31937f3d2ea557a9f5 [id=1e3186a0453241729d1f0044b67b2758]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.657223 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.657562 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet e6f309caaa9042f99432a61fd2ebb089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.657671 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 61189a715da140a6833801681bbd5ef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.657871 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet a8708321fb0f4c409a66df75da4c6c0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.658013 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d05c86bca9343a2bc8c5709e1c49647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.658016 1025 tablet_service.cc:1511] Processing CreateTablet for tablet ad5dd770f49b42c5ba362c26d615d35b (DEFAULT_TABLE table=default.Table_1dfa3e8f31e44cca9b69c60f7bba81d4 [id=8ec151c465df4ac88d39ae8d1f7760c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.658213 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29df38f273494a079bdc76a915d43dab" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:18.658560 452 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:50389 (request call id 202) took 779 ms (client timeout 1000 ms). Trace:
W20260616 19:52:18.658643 452 rpcz_store.cc:269] 0616 19:52:17.879318 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.128185 (+248867us) service_pool.cc:224] Handling call
0616 19:52:18.658540 (+530355us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:18.622822 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:18.622904 (+ 82us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:18.622909 (+ 5us) write_op.cc:435] Acquired schema lock
0616 19:52:18.622911 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:18.622978 (+ 67us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:18.622985 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:18.622990 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0616 19:52:18.623030 (+ 40us) tablet.cc:701] Row locks acquired
0616 19:52:18.623033 (+ 3us) write_op.cc:260] PREPARE: finished
0616 19:52:18.623055 (+ 22us) write_op.cc:270] Start()
0616 19:52:18.623077 (+ 22us) write_op.cc:276] Timestamp: P: 1781639538622999 usec, L: 0
0616 19:52:18.623080 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:18.623197 (+ 117us) log.cc:844] Serialized 533 byte log entry
0616 19:52:18.640279 (+ 17082us) op_driver.cc:464] REPLICATION: finished
0616 19:52:18.641109 (+ 830us) write_op.cc:301] APPLY: starting
0616 19:52:18.641119 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:18.641146 (+ 27us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:18.641165 (+ 19us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:18.641200 (+ 35us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:18.641224 (+ 24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0616 19:52:18.641231 (+ 7us) write_op.cc:312] APPLY: finished
0616 19:52:18.641280 (+ 49us) log.cc:844] Serialized 23 byte log entry
0616 19:52:18.641336 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:18.641348 (+ 12us) write_op.cc:454] Released schema lock
0616 19:52:18.641353 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:18.641416 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:18.641420 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":794,"apply.run_cpu_time_us":301,"apply.run_wall_time_us":302,"num_ops":1,"prepare.queue_time_us":30790,"prepare.run_cpu_time_us":459,"prepare.run_wall_time_us":513,"raft.queue_time_us":47,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":17183}]]}
I20260616 19:52:18.663151 1196 ts_tablet_manager.cc:1434] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.024s user 0.000s sys 0.002s
I20260616 19:52:18.663456 1196 tablet_bootstrap.cc:492] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:18.665462 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 7d722dca415c47ec96dfd18060b94e0e (DEFAULT_TABLE table=default.Table_a632f56f49de487f99b7e68978a6ae78 [id=28f03dd243ee4e9998b36298c6c0167f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.665625 1198 tablet_bootstrap.cc:492] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:52:18.665761 718 leader_election.cc:343] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.667245 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_47efe8b561e24ce78082f339ba9db1e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.667764 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47efe8b561e24ce78082f339ba9db1e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.668779 889 tablet_service.cc:1511] Processing CreateTablet for tablet 7d722dca415c47ec96dfd18060b94e0e (DEFAULT_TABLE table=default.Table_a632f56f49de487f99b7e68978a6ae78 [id=28f03dd243ee4e9998b36298c6c0167f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.669268 1196 tablet_bootstrap.cc:654] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.669348 1198 tablet_bootstrap.cc:654] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:18.669550 996 leader_election.cc:343] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.669800 754 tablet_service.cc:1558] Processing DeleteTablet for tablet a8708321fb0f4c409a66df75da4c6c0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.669956 746 tablet_service.cc:1558] Processing DeleteTablet for tablet c48314f8e45d4b198306f0ae6e40def7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.670163 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 272838af35d840faa7b11217456533c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.670245 752 tablet_service.cc:1511] Processing CreateTablet for tablet ad5dd770f49b42c5ba362c26d615d35b (DEFAULT_TABLE table=default.Table_1dfa3e8f31e44cca9b69c60f7bba81d4 [id=8ec151c465df4ac88d39ae8d1f7760c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.670315 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.670315 746 tablet_service.cc:1558] Processing DeleteTablet for tablet a0cb7a1acf35403192254bf5cd1170a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.670524 757 tablet_service.cc:1558] Processing DeleteTablet for tablet af5e277102b8480db44e5ffe88267808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.670622 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5dd770f49b42c5ba362c26d615d35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.670644 746 tablet_service.cc:1558] Processing DeleteTablet for tablet c7f724dc23024a7297cfb8689f199600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.670665 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 269c1dea941c481fb6fd2e4d59c877c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b0f5388a73143569012ed714e53a8be) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.670454 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9106e27b54a6450aa0c0366fbda74e48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:18.670812 757 tablet_service.cc:1558] Processing DeleteTablet for tablet bcc5116ef5df4140a96f03c003337c68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:18.671118 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9106e27b54a6450aa0c0366fbda74e48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.672130 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 90bc7409e31043bd9f47d3628278a2fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.672510 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d727712bd5c04c0eb3f30732551a823d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.672956 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d727712bd5c04c0eb3f30732551a823d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.670248 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a7b177800174706a985c11e5876b9d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:18.673496 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 482411d57f24459d8e7ed0eeb573234d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:18.674605 860 consensus_peers.cc:597] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bcc5116ef5df4140a96f03c003337c68. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:18.675292 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3f18e61382a947d5aa635d3c83068f35 consensus state has no leader
I20260616 19:52:18.676399 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_44fee7679648424894edbdd8abdd1d22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.676859 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44fee7679648424894edbdd8abdd1d22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.677227 754 tablet_service.cc:1511] Processing CreateTablet for tablet 7d722dca415c47ec96dfd18060b94e0e (DEFAULT_TABLE table=default.Table_a632f56f49de487f99b7e68978a6ae78 [id=28f03dd243ee4e9998b36298c6c0167f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.677567 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d722dca415c47ec96dfd18060b94e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.678390 2864 raft_consensus.cc:493] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.678511 2864 raft_consensus.cc:515] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.679122 2864 leader_election.cc:290] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.680676 747 tablet_service.cc:1511] Processing CreateTablet for tablet daf73abc88864295949f07cfd93fcad8 (DEFAULT_TABLE table=default.Table_c71dd033f51a440cbf2753ecd22014bf [id=ba2647a8213c42eeadda51ec1c471999]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.680977 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf73abc88864295949f07cfd93fcad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.682096 1192 tablet_bootstrap.cc:492] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:18.682227 1192 ts_tablet_manager.cc:1403] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.119s user 0.000s sys 0.014s
I20260616 19:52:18.685165 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db750fc9641f492494fdb167de86f6df" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.685225 1029 tablet_service.cc:1511] Processing CreateTablet for tablet daf73abc88864295949f07cfd93fcad8 (DEFAULT_TABLE table=default.Table_c71dd033f51a440cbf2753ecd22014bf [id=ba2647a8213c42eeadda51ec1c471999]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.685333 781 raft_consensus.cc:2468] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:18.687256 996 leader_election.cc:304] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:18.687273 1192 raft_consensus.cc:359] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.687477 2850 raft_consensus.cc:493] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.687575 2850 raft_consensus.cc:515] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.687425 1192 raft_consensus.cc:385] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.687944 1192 raft_consensus.cc:740] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.688138 2850 leader_election.cc:290] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.688139 1192 consensus_queue.cc:260] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.688267 2850 raft_consensus.cc:2804] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.688337 2850 raft_consensus.cc:493] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.688400 2850 raft_consensus.cc:3060] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.688619 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db750fc9641f492494fdb167de86f6df" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.688712 1192 ts_tablet_manager.cc:1434] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
W20260616 19:52:18.690209 993 leader_election.cc:343] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.691594 2850 raft_consensus.cc:515] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.691735 2559 consensus_queue.cc:1048] T b5587d5aa8584cf49ef3cb113a1b64ca P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.692142 2850 leader_election.cc:290] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:18.692520 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f252ea7261ea42869e25245c7ee78c05 consensus state has no leader
I20260616 19:52:18.692978 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc0c02ef58d4e429855e5bbaa4752ad" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:18.693917 993 leader_election.cc:343] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.694136 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db750fc9641f492494fdb167de86f6df" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:18.694339 1190 ts_tablet_manager.cc:1929] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260616 19:52:18.694536 993 leader_election.cc:343] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.695619 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_dfb699d5dba24e07a034ab8ed349ebd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.696383 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfb699d5dba24e07a034ab8ed349ebd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.699869 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:06 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:18.700011 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c74b39e66d344b99f8fc75b855c0520 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:18.700039 895 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a09d62e68148349b337c5075763672 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:18.700058 899 tablet_service.cc:1511] Processing CreateTablet for tablet daf73abc88864295949f07cfd93fcad8 (DEFAULT_TABLE table=default.Table_c71dd033f51a440cbf2753ecd22014bf [id=ba2647a8213c42eeadda51ec1c471999]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.696920 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ab8c15658e304438854ef13e1ce2274b" } new_table_name: "default.Table_44aec49c206e4527939d533088c54ba6" modify_external_catalogs: true
I20260616 19:52:18.700315 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9af38c47677c428f82e0a880edef1e6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.700839 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9af38c47677c428f82e0a880edef1e6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.702165 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc0c02ef58d4e429855e5bbaa4752ad" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.702670 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db750fc9641f492494fdb167de86f6df" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:18.702816 775 raft_consensus.cc:3060] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.704023 1190 log.cc:1199] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/fb1c2030b3a14c6aafaa961869606f31
I20260616 19:52:18.704428 1190 ts_tablet_manager.cc:1950] T fb1c2030b3a14c6aafaa961869606f31 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:18.705216 775 raft_consensus.cc:2468] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
W20260616 19:52:18.706387 996 leader_election.cc:343] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.706506 996 leader_election.cc:304] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.706892 996 leader_election.cc:304] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.707520 2864 raft_consensus.cc:2749] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:18.707665 2864 raft_consensus.cc:2804] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.707775 2864 raft_consensus.cc:697] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:18.708021 2864 consensus_queue.cc:237] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.710727 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0dae2e2b86304f1e918ba87baa81fc0e" } new_table_name: "default.Table_2b2f2de9fe7447699e405ceb2f661744" modify_external_catalogs: true
I20260616 19:52:18.714334 1192 tablet_bootstrap.cc:492] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:18.716557 1196 tablet_bootstrap.cc:492] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:18.716778 1196 ts_tablet_manager.cc:1403] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.000s
I20260616 19:52:18.717597 1196 raft_consensus.cc:359] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.717820 1196 raft_consensus.cc:385] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.717921 1196 raft_consensus.cc:740] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.718243 1196 consensus_queue.cc:260] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.719002 1196 ts_tablet_manager.cc:1434] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:18.719331 1196 tablet_bootstrap.cc:492] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:18.717011 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a632f56f49de487f99b7e68978a6ae78" } new_table_name: "default.Table_de5e568c6f58476d90896df557d2579f" modify_external_catalogs: true
I20260616 19:52:18.717222 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29df38f273494a079bdc76a915d43dab" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.721388 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd5fecc6d444e5fba9103287c09542e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.721565 1051 raft_consensus.cc:2468] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:18.724545 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5dd770f49b42c5ba362c26d615d35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.725008 719 leader_election.cc:304] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.725414 2845 raft_consensus.cc:2804] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.725458 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1065) took 5432 ms. Trace:
I20260616 19:52:18.725492 2845 raft_consensus.cc:493] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.725570 2845 raft_consensus.cc:3060] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.725531 1191 rpcz_store.cc:276] 0616 19:52:13.292716 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.292766 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:18.580294 (+5287528us) ts_tablet_manager.cc:1151] Deleting tablet a817b1d4c7b640db8894bc801878caae
0616 19:52:18.580685 (+ 391us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.599307 (+ 18622us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.655632 (+ 56325us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.725441 (+ 69809us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5287338}
I20260616 19:52:18.725991 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1066) took 5432 ms. Trace:
I20260616 19:52:18.726055 1191 rpcz_store.cc:276] 0616 19:52:13.293975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.294024 (+ 49us) service_pool.cc:224] Handling call
0616 19:52:18.725889 (+5431865us) ts_tablet_manager.cc:1151] Deleting tablet 20b9e3626794464aa823724bee0a1682
0616 19:52:18.725898 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.725979 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5431717}
I20260616 19:52:18.726624 1191 tablet_replica.cc:333] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:18.726958 1191 raft_consensus.cc:2243] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:18.727203 1191 raft_consensus.cc:2272] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.725927 922 raft_consensus.cc:2468] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:18.728091 1191 ts_tablet_manager.cc:1916] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.728127 2845 raft_consensus.cc:515] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.728863 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d722dca415c47ec96dfd18060b94e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.729135 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf73abc88864295949f07cfd93fcad8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:18.699558 459 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:35519 (request call id 186) took 943 ms (client timeout 1000 ms). Trace:
I20260616 19:52:18.699873 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 31db3862f78943519bcd9531c5530048 (table default.Table_8cda9a799036458f9543a8a8aac3ee5a [id=c72157c1e0f943e4af149e7f692209ee]). Expected version 1 got 0
I20260616 19:52:18.729524 461 catalog_manager.cc:5696] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:18.730365 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 2141b6c7013648a4b716642ccb4eccd6 (table default.Table_5047c84664124989b931ee92afc5b463 [id=bc83d5c728054794b2c3cc0f9b90e202]). Expected version 1 got 0
I20260616 19:52:18.730551 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf (table default.Table_ab8c15658e304438854ef13e1ce2274b [id=b7d5c502d76f428683cb0830f0819011]). Expected version 2 got 0
W20260616 19:52:18.731117 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf consensus state has no leader
I20260616 19:52:18.734719 993 leader_election.cc:304] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:18.736976 2845 leader_election.cc:290] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.737597 763 tablet_service.cc:1511] Processing CreateTablet for tablet 055e7171abba41a091c2ceb7dbd40851 (DEFAULT_TABLE table=default.Table_37e7ca7c1f6e44c08dc9ad75b1b4325e [id=43d01cdcfc5a48bb866889f49cf73241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.737850 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd5fecc6d444e5fba9103287c09542e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:18.738027 1059 raft_consensus.cc:3060] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.738288 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055e7171abba41a091c2ceb7dbd40851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.741364 2850 raft_consensus.cc:2804] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.741509 2850 raft_consensus.cc:493] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.741554 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1055) took 5337 ms. Trace:
I20260616 19:52:18.741677 2850 raft_consensus.cc:3060] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.741642 1190 rpcz_store.cc:276] 0616 19:52:13.404449 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.412532 (+ 8083us) service_pool.cc:224] Handling call
0616 19:52:18.619977 (+5207445us) ts_tablet_manager.cc:1151] Deleting tablet fb1c2030b3a14c6aafaa961869606f31
0616 19:52:18.619987 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.639267 (+ 19280us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.694265 (+ 54998us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.741535 (+ 47270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5628,"tablet-delete.queue_time_us":5207246}
I20260616 19:52:18.742111 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1058) took 5310 ms. Trace:
I20260616 19:52:18.742192 1190 rpcz_store.cc:276] 0616 19:52:13.431128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.431177 (+ 49us) service_pool.cc:224] Handling call
0616 19:52:18.741990 (+5310813us) ts_tablet_manager.cc:1151] Deleting tablet fae2f430cf904db09b2f18a37d3d9f7f
0616 19:52:18.742002 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.742094 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5310651}
I20260616 19:52:18.742497 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1057) took 5311 ms. Trace:
I20260616 19:52:18.742568 1190 rpcz_store.cc:276] 0616 19:52:13.431016 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.431534 (+ 518us) service_pool.cc:224] Handling call
0616 19:52:18.742408 (+5310874us) ts_tablet_manager.cc:1151] Deleting tablet c3d71d78c92f45f1a6c0af3589026b10
0616 19:52:18.742416 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.742484 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5310685}
I20260616 19:52:18.742815 1190 tablet_replica.cc:333] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:18.743006 1190 raft_consensus.cc:2243] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:18.743312 1190 raft_consensus.cc:2272] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.743986 1190 ts_tablet_manager.cc:1916] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.744689 2850 raft_consensus.cc:515] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.746279 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4fd1d944e4b54432979c16a8d23c9ee9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.746884 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4fd1d944e4b54432979c16a8d23c9ee9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.748155 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29df38f273494a079bdc76a915d43dab" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:18.748310 921 raft_consensus.cc:3060] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.750244 1059 raft_consensus.cc:2468] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.750819 921 raft_consensus.cc:2468] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:18.751348 719 leader_election.cc:304] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:18.751785 993 leader_election.cc:304] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:18.752010 2661 raft_consensus.cc:2804] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.752126 2661 raft_consensus.cc:697] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:18.752381 2661 consensus_queue.cc:237] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.753001 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet fb1c2030b3a14c6aafaa961869606f31 (table default.Table_7cdef69863694f0ba023c214e42394e8 [id=a7f1b3885b764715a88750ea3752dbdb]) successfully deleted
I20260616 19:52:18.753401 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29df38f273494a079bdc76a915d43dab" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:18.754106 996 leader_election.cc:343] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.754710 2845 raft_consensus.cc:2804] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.754938 2845 raft_consensus.cc:697] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:18.755160 2845 consensus_queue.cc:237] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.759106 2662 raft_consensus.cc:493] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.759236 2662 raft_consensus.cc:515] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.759805 2662 leader_election.cc:290] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:18.760824 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08db2c1398b946c180d81b88504c1d9c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:18.761646 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08db2c1398b946c180d81b88504c1d9c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.752873 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2dfdcf510b5c4e15abed203ee19760df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.762334 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet fae2f430cf904db09b2f18a37d3d9f7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fae2f430cf904db09b2f18a37d3d9f7f already in progress: creating tablet
W20260616 19:52:18.762535 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet c3d71d78c92f45f1a6c0af3589026b10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3d71d78c92f45f1a6c0af3589026b10 already in progress: creating tablet
W20260616 19:52:18.762609 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2dfdcf510b5c4e15abed203ee19760df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.763381 1059 raft_consensus.cc:2393] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:18.764122 858 leader_election.cc:304] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:18.764596 2700 raft_consensus.cc:3060] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.764974 895 tablet_service.cc:1511] Processing CreateTablet for tablet 055e7171abba41a091c2ceb7dbd40851 (DEFAULT_TABLE table=default.Table_37e7ca7c1f6e44c08dc9ad75b1b4325e [id=43d01cdcfc5a48bb866889f49cf73241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.728873 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet a817b1d4c7b640db8894bc801878caae (table default.Table_516f90bc9f17467796c1a387794b5568 [id=f212bb8d2d614707bc55ef08138d29d3]) successfully deleted
W20260616 19:52:18.765636 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 20b9e3626794464aa823724bee0a1682 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20b9e3626794464aa823724bee0a1682 already in progress: creating tablet
W20260616 19:52:18.729197 459 rpcz_store.cc:269] 0616 19:52:17.756575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.108003 (+351428us) service_pool.cc:224] Handling call
0616 19:52:18.699543 (+591540us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:18.678421 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:18.678507 (+ 86us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:18.678512 (+ 5us) write_op.cc:435] Acquired schema lock
0616 19:52:18.678514 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:18.678593 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:18.678602 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:18.678606 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0616 19:52:18.678654 (+ 48us) tablet.cc:701] Row locks acquired
0616 19:52:18.678657 (+ 3us) write_op.cc:260] PREPARE: finished
0616 19:52:18.678690 (+ 33us) write_op.cc:270] Start()
0616 19:52:18.678728 (+ 38us) write_op.cc:276] Timestamp: P: 1781639538678624 usec, L: 0
0616 19:52:18.678731 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:18.678867 (+ 136us) log.cc:844] Serialized 533 byte log entry
0616 19:52:18.690347 (+ 11480us) op_driver.cc:464] REPLICATION: finished
0616 19:52:18.690896 (+ 549us) write_op.cc:301] APPLY: starting
0616 19:52:18.690919 (+ 23us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:18.690947 (+ 28us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:18.690970 (+ 23us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:18.691009 (+ 39us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:18.691039 (+ 30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0616 19:52:18.691047 (+ 8us) write_op.cc:312] APPLY: finished
0616 19:52:18.691100 (+ 53us) log.cc:844] Serialized 23 byte log entry
0616 19:52:18.691151 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:18.691163 (+ 12us) write_op.cc:454] Released schema lock
0616 19:52:18.691168 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:18.691232 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:18.691236 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":511,"apply.run_cpu_time_us":329,"apply.run_wall_time_us":328,"num_ops":1,"prepare.queue_time_us":30210,"prepare.run_cpu_time_us":535,"prepare.run_wall_time_us":586,"raft.queue_time_us":33,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":11591}]]}
I20260616 19:52:18.767236 2700 raft_consensus.cc:2749] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:18.767737 763 tablet_service.cc:1511] Processing CreateTablet for tablet 0066e17de51949ed8085235d1b6994b9 (DEFAULT_TABLE table=default.Table_9fb65cbb56c14cbcac8456f350edf882 [id=dae6fcdad9464e668c83d9a6b8f79e72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.768509 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0066e17de51949ed8085235d1b6994b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.769901 2745 consensus_queue.cc:1048] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.771293 2745 raft_consensus.cc:493] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.771421 2745 raft_consensus.cc:515] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.772028 2745 leader_election.cc:290] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.773654 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1203a4e952a42369d5c03ff4a4c59ec" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:18.774410 718 leader_election.cc:343] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.771163 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 055e7171abba41a091c2ceb7dbd40851 (DEFAULT_TABLE table=default.Table_37e7ca7c1f6e44c08dc9ad75b1b4325e [id=43d01cdcfc5a48bb866889f49cf73241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.615978 1193 log.cc:1199] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/40bdb01a15254c329d82f0d40919b880
I20260616 19:52:18.781500 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5dd770f49b42c5ba362c26d615d35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.781733 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055e7171abba41a091c2ceb7dbd40851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.781853 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1203a4e952a42369d5c03ff4a4c59ec" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.781956 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf73abc88864295949f07cfd93fcad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.782064 1052 raft_consensus.cc:2468] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:18.782505 719 leader_election.cc:304] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.782939 2745 raft_consensus.cc:2804] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.783020 2745 raft_consensus.cc:493] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.783095 2745 raft_consensus.cc:3060] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.785789 2745 raft_consensus.cc:515] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.787209 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1203a4e952a42369d5c03ff4a4c59ec" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:18.788686 718 leader_election.cc:343] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.789055 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f428de72bfe840cba50eedc054072fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.790597 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055e7171abba41a091c2ceb7dbd40851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.791487 1192 tablet_bootstrap.cc:654] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.792585 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d722dca415c47ec96dfd18060b94e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.794938 2745 leader_election.cc:290] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.795053 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_51e7fb35630c4bcab85c4b278daacf2c" } modify_external_catalogs: true
I20260616 19:52:18.795259 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_51e7fb35630c4bcab85c4b278daacf2c" } modify_external_catalogs: true
I20260616 19:52:18.795361 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1203a4e952a42369d5c03ff4a4c59ec" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:18.795564 1052 raft_consensus.cc:3060] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.798204 1052 raft_consensus.cc:2468] T c1203a4e952a42369d5c03ff4a4c59ec P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.799543 719 leader_election.cc:304] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.800154 2843 raft_consensus.cc:2804] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.800315 2843 raft_consensus.cc:697] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:18.800840 2843 consensus_queue.cc:237] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.803404 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 0066e17de51949ed8085235d1b6994b9 (DEFAULT_TABLE table=default.Table_9fb65cbb56c14cbcac8456f350edf882 [id=dae6fcdad9464e668c83d9a6b8f79e72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.803824 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0066e17de51949ed8085235d1b6994b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.805150 2642 consensus_queue.cc:1048] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.814461 899 tablet_service.cc:1511] Processing CreateTablet for tablet 0066e17de51949ed8085235d1b6994b9 (DEFAULT_TABLE table=default.Table_9fb65cbb56c14cbcac8456f350edf882 [id=dae6fcdad9464e668c83d9a6b8f79e72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.814838 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0066e17de51949ed8085235d1b6994b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.822827 747 tablet_service.cc:1511] Processing CreateTablet for tablet 55579278138d41f981f964f0e750a2ce (DEFAULT_TABLE table=default.Table_ba342fba19324583bf4aabd1e4d2cf78 [id=044ae6b9f65547eeae07e176a951584c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.823326 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55579278138d41f981f964f0e750a2ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.826344 1191 ts_tablet_manager.cc:1929] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:18.826481 1191 log.cc:1199] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/3f96ef25396a4092bc475f4aab269bc7
I20260616 19:52:18.828260 1198 tablet_bootstrap.cc:492] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:18.828761 1198 ts_tablet_manager.cc:1403] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.163s user 0.002s sys 0.002s
I20260616 19:52:18.829150 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 55579278138d41f981f964f0e750a2ce (DEFAULT_TABLE table=default.Table_ba342fba19324583bf4aabd1e4d2cf78 [id=044ae6b9f65547eeae07e176a951584c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.829511 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55579278138d41f981f964f0e750a2ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.829692 1198 raft_consensus.cc:359] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.829893 1198 raft_consensus.cc:385] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.829969 1198 raft_consensus.cc:740] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.830155 1190 ts_tablet_manager.cc:1929] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:18.830255 1190 log.cc:1199] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/c6939d108a7948bb9e56311a34d95486
I20260616 19:52:18.830241 1198 consensus_queue.cc:260] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.830470 2853 raft_consensus.cc:493] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.830602 1190 ts_tablet_manager.cc:1950] T c6939d108a7948bb9e56311a34d95486 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:18.830596 2853 raft_consensus.cc:515] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.830899 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1061) took 5323 ms. Trace:
I20260616 19:52:18.830997 1190 rpcz_store.cc:276] 0616 19:52:13.507018 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.507068 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:18.742776 (+5235708us) ts_tablet_manager.cc:1151] Deleting tablet c6939d108a7948bb9e56311a34d95486
0616 19:52:18.742783 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.788267 (+ 45484us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.830107 (+ 41840us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.830883 (+ 776us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5227225}
I20260616 19:52:18.831171 2853 leader_election.cc:290] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.831552 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet c6939d108a7948bb9e56311a34d95486 (table default.Table_8dbc007d3ffb483d8f4ca4fefdde8a2b [id=794886751c914a4b9a139e477021e487]) successfully deleted
I20260616 19:52:18.832281 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c08452aeec471f8480a489620cca28" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:18.832958 993 leader_election.cc:343] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.833086 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ef97cbfc987249e68055ac2866180927" } modify_external_catalogs: true
I20260616 19:52:18.833232 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ef97cbfc987249e68055ac2866180927" } modify_external_catalogs: true
I20260616 19:52:18.833299 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c08452aeec471f8480a489620cca28" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:18.833817 996 leader_election.cc:343] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.833950 996 leader_election.cc:304] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:18.833977 1198 ts_tablet_manager.cc:1434] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:52:18.834281 1198 tablet_bootstrap.cc:492] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:18.835142 2853 raft_consensus.cc:2749] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:18.835882 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd5fecc6d444e5fba9103287c09542e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:18.838953 718 leader_election.cc:343] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:18.841571 1193 ts_tablet_manager.cc:1950] T 40bdb01a15254c329d82f0d40919b880 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:18.842144 763 tablet_service.cc:1511] Processing CreateTablet for tablet 430b810fd7dd4d0bae046834c8c42b99 (DEFAULT_TABLE table=default.Table_9b4c9fb1e2f641f28cbd42c2c093a835 [id=060ebad8281e43c69d96c4f67e86287c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.842450 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1223) took 1799 ms. Trace:
I20260616 19:52:18.842538 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430b810fd7dd4d0bae046834c8c42b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.842666 1193 rpcz_store.cc:276] 0616 19:52:17.043359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.043416 (+ 57us) service_pool.cc:224] Handling call
0616 19:52:18.564426 (+1521010us) ts_tablet_manager.cc:1151] Deleting tablet 40bdb01a15254c329d82f0d40919b880
0616 19:52:18.564437 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.613142 (+ 48705us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.615824 (+ 2682us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.842406 (+226582us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1520861}
I20260616 19:52:18.843137 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 40bdb01a15254c329d82f0d40919b880 (table default.Table_d2ddb45a3fbb446689cb737dcb4fbc12 [id=ccddc1e63f194e539a50d511f05eff8a]) successfully deleted
I20260616 19:52:18.843259 1193 tablet_replica.cc:333] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:18.843467 1193 raft_consensus.cc:2243] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:18.843650 1193 raft_consensus.cc:2272] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.844452 752 tablet_service.cc:1511] Processing CreateTablet for tablet b57d6f12255e43ea9c35aedd388913e0 (DEFAULT_TABLE table=default.Table_54440d81ff5a4fa59cde855e84964b07 [id=a0e1c937560640a087e727ca05e90f02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.844910 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57d6f12255e43ea9c35aedd388913e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.844954 895 tablet_service.cc:1511] Processing CreateTablet for tablet b57d6f12255e43ea9c35aedd388913e0 (DEFAULT_TABLE table=default.Table_54440d81ff5a4fa59cde855e84964b07 [id=a0e1c937560640a087e727ca05e90f02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.845613 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57d6f12255e43ea9c35aedd388913e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.845801 754 tablet_service.cc:1511] Processing CreateTablet for tablet 625dd9e7170b47cf9ac7449ff5a0b7c9 (DEFAULT_TABLE table=default.Table_8956120045dd4a45a8b94f46fe2d8ad9 [id=01a3c660e9034237849f2273cf65ec50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.846149 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625dd9e7170b47cf9ac7449ff5a0b7c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.849017 761 tablet_service.cc:1511] Processing CreateTablet for tablet 26f0d194150d48c09620dd1a1d09a983 (DEFAULT_TABLE table=default.Table_56b9e6315f83488bb248451987d21c53 [id=fe58be338c514a0b8be5780e91d18916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.849080 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7ab5f3b543474247a8968a200f848284 (DEFAULT_TABLE table=default.Table_1fac960c4cde449a9b6ab1d68cde9d22 [id=33a8c6b46f0b449180d538c5ea42c0e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.849380 765 tablet_service.cc:1511] Processing CreateTablet for tablet 9de9e78efdc14106aac7a9e411f12c10 (DEFAULT_TABLE table=default.Table_90fbb44620274eddaf7fb1d1182cda5f [id=abee4002468e429e94803e9bdcec248a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.849579 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f0d194150d48c09620dd1a1d09a983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.849790 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de9e78efdc14106aac7a9e411f12c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.849853 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 625dd9e7170b47cf9ac7449ff5a0b7c9 (DEFAULT_TABLE table=default.Table_8956120045dd4a45a8b94f46fe2d8ad9 [id=01a3c660e9034237849f2273cf65ec50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.850134 1027 tablet_service.cc:1511] Processing CreateTablet for tablet b57d6f12255e43ea9c35aedd388913e0 (DEFAULT_TABLE table=default.Table_54440d81ff5a4fa59cde855e84964b07 [id=a0e1c937560640a087e727ca05e90f02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.850292 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625dd9e7170b47cf9ac7449ff5a0b7c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.850263 1038 tablet_service.cc:1511] Processing CreateTablet for tablet d8f48eaed58f4b63bc955540fd22cf02 (DEFAULT_TABLE table=default.Table_80f6064bd3104b6699561f5e6cda71ea [id=24945804be7e40dfb20aa6d3cbad6a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.850459 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57d6f12255e43ea9c35aedd388913e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.850878 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f48eaed58f4b63bc955540fd22cf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.849380 746 tablet_service.cc:1511] Processing CreateTablet for tablet dd89b2889495472f8ce332ef2bc18eb4 (DEFAULT_TABLE table=default.Table_a05dd0b3957b4fb1954090bc8cefe859 [id=ef3543c5dd9949cf96e748441cc18657]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.852871 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd89b2889495472f8ce332ef2bc18eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.856699 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 7ab5f3b543474247a8968a200f848284 (DEFAULT_TABLE table=default.Table_1fac960c4cde449a9b6ab1d68cde9d22 [id=33a8c6b46f0b449180d538c5ea42c0e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.857095 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ab5f3b543474247a8968a200f848284. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:18.857323 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f3d75c36cf545de96d9f1722c60fea6 consensus state has no leader
I20260616 19:52:18.858654 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 9de9e78efdc14106aac7a9e411f12c10 (DEFAULT_TABLE table=default.Table_90fbb44620274eddaf7fb1d1182cda5f [id=abee4002468e429e94803e9bdcec248a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.858985 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de9e78efdc14106aac7a9e411f12c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.860813 1023 tablet_service.cc:1511] Processing CreateTablet for tablet dd89b2889495472f8ce332ef2bc18eb4 (DEFAULT_TABLE table=default.Table_a05dd0b3957b4fb1954090bc8cefe859 [id=ef3543c5dd9949cf96e748441cc18657]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.861166 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd89b2889495472f8ce332ef2bc18eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.864981 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ab5f3b543474247a8968a200f848284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.865197 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 26f0d194150d48c09620dd1a1d09a983 (DEFAULT_TABLE table=default.Table_56b9e6315f83488bb248451987d21c53 [id=fe58be338c514a0b8be5780e91d18916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.865268 1191 ts_tablet_manager.cc:1950] T 3f96ef25396a4092bc475f4aab269bc7 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:18.865648 747 tablet_service.cc:1511] Processing CreateTablet for tablet d8f48eaed58f4b63bc955540fd22cf02 (DEFAULT_TABLE table=default.Table_80f6064bd3104b6699561f5e6cda71ea [id=24945804be7e40dfb20aa6d3cbad6a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.865716 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 430b810fd7dd4d0bae046834c8c42b99 (DEFAULT_TABLE table=default.Table_9b4c9fb1e2f641f28cbd42c2c093a835 [id=060ebad8281e43c69d96c4f67e86287c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.866045 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f48eaed58f4b63bc955540fd22cf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.870945 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430b810fd7dd4d0bae046834c8c42b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.872077 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f0d194150d48c09620dd1a1d09a983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.877707 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1067) took 5568 ms. Trace:
I20260616 19:52:18.877830 1191 rpcz_store.cc:276] 0616 19:52:13.309493 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.309546 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:18.726419 (+5416873us) ts_tablet_manager.cc:1151] Deleting tablet 3f96ef25396a4092bc475f4aab269bc7
0616 19:52:18.726426 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.823563 (+ 97137us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.826220 (+ 2657us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.877662 (+ 51442us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5416699}
I20260616 19:52:18.878556 893 tablet_service.cc:1511] Processing CreateTablet for tablet 26f0d194150d48c09620dd1a1d09a983 (DEFAULT_TABLE table=default.Table_56b9e6315f83488bb248451987d21c53 [id=fe58be338c514a0b8be5780e91d18916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.878928 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f0d194150d48c09620dd1a1d09a983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.881579 896 tablet_service.cc:1511] Processing CreateTablet for tablet 7ab5f3b543474247a8968a200f848284 (DEFAULT_TABLE table=default.Table_1fac960c4cde449a9b6ab1d68cde9d22 [id=33a8c6b46f0b449180d538c5ea42c0e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.881922 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ab5f3b543474247a8968a200f848284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.882661 2850 leader_election.cc:290] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.884796 886 tablet_service.cc:1511] Processing CreateTablet for tablet dd89b2889495472f8ce332ef2bc18eb4 (DEFAULT_TABLE table=default.Table_a05dd0b3957b4fb1954090bc8cefe859 [id=ef3543c5dd9949cf96e748441cc18657]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.885162 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd89b2889495472f8ce332ef2bc18eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.885432 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 3f96ef25396a4092bc475f4aab269bc7 (table default.Table_8f2f5974ba694802a093f7c3adbacd48 [id=85bdc981552e4f50a725c53285275af3]) successfully deleted
I20260616 19:52:18.885771 895 tablet_service.cc:1511] Processing CreateTablet for tablet 625dd9e7170b47cf9ac7449ff5a0b7c9 (DEFAULT_TABLE table=default.Table_8956120045dd4a45a8b94f46fe2d8ad9 [id=01a3c660e9034237849f2273cf65ec50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.886037 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625dd9e7170b47cf9ac7449ff5a0b7c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.891369 2642 raft_consensus.cc:493] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:18.891520 2642 raft_consensus.cc:515] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.892138 2642 leader_election.cc:290] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.878214 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1068) took 5549 ms. Trace:
I20260616 19:52:18.892628 1191 rpcz_store.cc:276] 0616 19:52:13.328752 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.328807 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:18.878086 (+5549279us) ts_tablet_manager.cc:1151] Deleting tablet 8b4d4c8b67aa44f68a974f7ca7090dd4
0616 19:52:18.878094 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.878182 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5549099}
I20260616 19:52:18.893080 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_46b4bfa888f24ed891dbe0678898e6c9" } modify_external_catalogs: true
I20260616 19:52:18.893236 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_46b4bfa888f24ed891dbe0678898e6c9" } modify_external_catalogs: true
I20260616 19:52:18.894416 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd289d39eaf4471b754dae9433a5474" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:18.894663 922 raft_consensus.cc:2468] T 5fd289d39eaf4471b754dae9433a5474 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:18.894783 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1070) took 5464 ms. Trace:
I20260616 19:52:18.894867 1191 rpcz_store.cc:276] 0616 19:52:13.429975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.430146 (+ 171us) service_pool.cc:224] Handling call
0616 19:52:18.894664 (+5464518us) ts_tablet_manager.cc:1151] Deleting tablet c3d71d78c92f45f1a6c0af3589026b10
0616 19:52:18.894674 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.894767 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5464249}
I20260616 19:52:18.895138 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1071) took 5464 ms. Trace:
I20260616 19:52:18.895188 1191 rpcz_store.cc:276] 0616 19:52:13.430416 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.439066 (+ 8650us) service_pool.cc:224] Handling call
0616 19:52:18.895062 (+5455996us) ts_tablet_manager.cc:1151] Deleting tablet fae2f430cf904db09b2f18a37d3d9f7f
0616 19:52:18.895069 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.895128 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5455825}
I20260616 19:52:18.895211 718 leader_election.cc:304] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:18.895398 1191 tablet_replica.cc:333] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:18.895476 2642 raft_consensus.cc:2804] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:18.895555 1191 raft_consensus.cc:2243] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:18.895570 2642 raft_consensus.cc:493] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:18.895643 2642 raft_consensus.cc:3060] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.895702 1191 raft_consensus.cc:2272] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.896183 1191 ts_tablet_manager.cc:1916] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.898217 2642 raft_consensus.cc:515] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.898811 2642 leader_election.cc:290] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:18.900821 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd289d39eaf4471b754dae9433a5474" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:18.901043 922 raft_consensus.cc:3060] T 5fd289d39eaf4471b754dae9433a5474 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:18.902595 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8b4d4c8b67aa44f68a974f7ca7090dd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b4d4c8b67aa44f68a974f7ca7090dd4 already in progress: creating tablet
W20260616 19:52:18.902793 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet c3d71d78c92f45f1a6c0af3589026b10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3d71d78c92f45f1a6c0af3589026b10 already in progress: creating tablet
W20260616 19:52:18.902966 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet fae2f430cf904db09b2f18a37d3d9f7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fae2f430cf904db09b2f18a37d3d9f7f already in progress: creating tablet
I20260616 19:52:18.904348 922 raft_consensus.cc:2468] T 5fd289d39eaf4471b754dae9433a5474 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.904637 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd289d39eaf4471b754dae9433a5474" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:18.904803 1051 raft_consensus.cc:3060] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.904785 718 leader_election.cc:304] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:18.905032 2745 raft_consensus.cc:2804] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:18.905167 2745 raft_consensus.cc:697] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:18.905416 2745 consensus_queue.cc:237] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:18.907214 1051 raft_consensus.cc:2468] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:18.907866 2628 consensus_queue.cc:1048] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.913590 1196 tablet_bootstrap.cc:700] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767: Time spent opening tablet: real 0.193s user 0.000s sys 0.000s
I20260616 19:52:18.913947 1196 tablet_bootstrap.cc:654] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.919117 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd289d39eaf4471b754dae9433a5474" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:18.919281 1052 raft_consensus.cc:2376] T 5fd289d39eaf4471b754dae9433a5474 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1. Re-sending same reply.
I20260616 19:52:18.922004 1198 tablet_bootstrap.cc:654] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.924618 902 tablet_service.cc:1511] Processing CreateTablet for tablet 430b810fd7dd4d0bae046834c8c42b99 (DEFAULT_TABLE table=default.Table_9b4c9fb1e2f641f28cbd42c2c093a835 [id=060ebad8281e43c69d96c4f67e86287c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.925011 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430b810fd7dd4d0bae046834c8c42b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.925201 1192 tablet_bootstrap.cc:492] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:18.925338 1192 ts_tablet_manager.cc:1403] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.211s user 0.004s sys 0.024s
I20260616 19:52:18.925962 1192 raft_consensus.cc:359] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.926149 1192 raft_consensus.cc:385] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:18.926236 1192 raft_consensus.cc:740] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:18.926460 1192 consensus_queue.cc:260] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:18.927080 1192 ts_tablet_manager.cc:1434] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:18.927413 1192 tablet_bootstrap.cc:492] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:18.928844 889 tablet_service.cc:1511] Processing CreateTablet for tablet d8f48eaed58f4b63bc955540fd22cf02 (DEFAULT_TABLE table=default.Table_80f6064bd3104b6699561f5e6cda71ea [id=24945804be7e40dfb20aa6d3cbad6a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.929175 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f48eaed58f4b63bc955540fd22cf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.929551 898 tablet_service.cc:1511] Processing CreateTablet for tablet 55579278138d41f981f964f0e750a2ce (DEFAULT_TABLE table=default.Table_ba342fba19324583bf4aabd1e4d2cf78 [id=044ae6b9f65547eeae07e176a951584c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.929806 1192 tablet_bootstrap.cc:654] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:18.930015 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55579278138d41f981f964f0e750a2ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.931571 1191 ts_tablet_manager.cc:1929] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:18.931679 1191 log.cc:1199] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/1d825bcf365f424fb99a10afe3e96501
I20260616 19:52:18.934993 1191 ts_tablet_manager.cc:1950] T 1d825bcf365f424fb99a10afe3e96501 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:18.935504 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8f2f5974ba694802a093f7c3adbacd48" } modify_external_catalogs: true
I20260616 19:52:18.935688 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8f2f5974ba694802a093f7c3adbacd48" } modify_external_catalogs: true
I20260616 19:52:18.935760 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1075) took 5403 ms. Trace:
I20260616 19:52:18.935843 1191 rpcz_store.cc:276] 0616 19:52:13.532310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.544368 (+ 12058us) service_pool.cc:224] Handling call
0616 19:52:18.895358 (+5350990us) ts_tablet_manager.cc:1151] Deleting tablet 1d825bcf365f424fb99a10afe3e96501
0616 19:52:18.895367 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.914376 (+ 19009us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.931519 (+ 17143us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.935739 (+ 4220us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5343422}
I20260616 19:52:18.936141 1191 tablet_replica.cc:333] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:18.936355 1191 raft_consensus.cc:2243] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:18.937626 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 1d825bcf365f424fb99a10afe3e96501 (table default.Table_b6f1fb47223d447fb0c0eed0f8b52102 [id=d3197da9180e47e18f4e1573504ae8c7]) successfully deleted
I20260616 19:52:18.937976 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8dfce4bb3f8d42fba854b68e675edf41" } modify_external_catalogs: true
I20260616 19:52:18.938104 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8dfce4bb3f8d42fba854b68e675edf41" } modify_external_catalogs: true
I20260616 19:52:18.941567 2642 consensus_queue.cc:1048] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.936699 1191 raft_consensus.cc:2272] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.942363 1191 ts_tablet_manager.cc:1916] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:18.943617 719 consensus_peers.cc:597] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d825bcf365f424fb99a10afe3e96501. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:18.945289 919 raft_consensus.cc:3060] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:18.950237 2811 consensus_queue.cc:1048] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:18.953691 1190 tablet_replica.cc:333] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:18.953954 1190 raft_consensus.cc:2243] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:18.954362 1190 raft_consensus.cc:2272] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.955016 1190 ts_tablet_manager.cc:1916] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.844427 1193 ts_tablet_manager.cc:1916] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:18.960618 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3d98401012fb44179d92d887233d208f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:18.961364 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d98401012fb44179d92d887233d208f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:18.966480 1191 ts_tablet_manager.cc:1929] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:18.966586 1191 log.cc:1199] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/7dc92bc15da14504a1ff5feda5aff7cf
I20260616 19:52:18.966954 1191 ts_tablet_manager.cc:1950] T 7dc92bc15da14504a1ff5feda5aff7cf P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:18.967710 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1083) took 5376 ms. Trace:
I20260616 19:52:18.967789 1191 rpcz_store.cc:276] 0616 19:52:13.591075 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.591125 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:18.936095 (+5344970us) ts_tablet_manager.cc:1151] Deleting tablet 7dc92bc15da14504a1ff5feda5aff7cf
0616 19:52:18.936106 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.953647 (+ 17541us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.966410 (+ 12763us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:18.967692 (+ 1282us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5344765}
I20260616 19:52:18.968209 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 7dc92bc15da14504a1ff5feda5aff7cf (table default.Table_6955250583bf4c3cbff20316dfa5d1a7 [id=8c7791625cfd4d39ad0dff83be1c7089]) successfully deleted
W20260616 19:52:18.971251 860 consensus_peers.cc:597] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f724dc23024a7297cfb8689f199600. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:18.973052 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 31db3862f78943519bcd9531c5530048 (table default.Table_8cda9a799036458f9543a8a8aac3ee5a [id=c72157c1e0f943e4af149e7f692209ee]). Expected version 1 got 0
I20260616 19:52:18.973222 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet b5587d5aa8584cf49ef3cb113a1b64ca (table default.Table_0f374c454bc04298ba16dc14edb7bc9e [id=1105333647e747a39fc06efbcc95fa0d]). Expected version 1 got 0
I20260616 19:52:18.973347 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 8b7e2d8c25b8464b94ca386566abc2cc (table default.Table_9c19749d8e8a4eaeaa2294ca29ea85dc [id=a12694adb1ba4cfabe42db00e13b002b]). Expected version 1 got 0
I20260616 19:52:18.973608 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet e85e2861c41f402d88cafe64a6871429 (table default.Table_66d56024dca749dfb6300ffa4cb0dec9 [id=02a85fe82ed24f6b949c0ded2d9a7d5e]). Expected version 1 got 0
I20260616 19:52:18.973706 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 61132c1c9cd24b7d923f1d65ad04c340 (table default.Table_9eb13a45afad449a9bf9b25a0f5d4d1d [id=e8db7417fd294af4b160a434625e9fd0]). Expected version 2 got 0
I20260616 19:52:18.973819 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet dd52351082274a4aa12cac468d9a512d (table default.Table_3bee557dbc924f6b982089749d9abe7b [id=ae7663c7da4444f1a6ef328ba7bd3494]). Expected version 2 got 0
I20260616 19:52:18.973917 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 29df38f273494a079bdc76a915d43dab (table default.Table_bfda4071639c49399f2f5bf499be37e9 [id=1449ff28bd8546908359606f7272846f]). Expected version 2 got 0
I20260616 19:52:18.974279 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1084) took 5371 ms. Trace:
I20260616 19:52:18.974354 1191 rpcz_store.cc:276] 0616 19:52:13.603322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.603394 (+ 72us) service_pool.cc:224] Handling call
0616 19:52:18.968080 (+5364686us) ts_tablet_manager.cc:1151] Deleting tablet d1e3778611a24397a1a776be2cc76284
0616 19:52:18.968090 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.974261 (+ 6171us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5364472}
W20260616 19:52:18.974741 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet d1e3778611a24397a1a776be2cc76284 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1e3778611a24397a1a776be2cc76284 already in progress: creating tablet
I20260616 19:52:18.975201 899 tablet_service.cc:1511] Processing CreateTablet for tablet 9de9e78efdc14106aac7a9e411f12c10 (DEFAULT_TABLE table=default.Table_90fbb44620274eddaf7fb1d1182cda5f [id=abee4002468e429e94803e9bdcec248a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.979918 763 tablet_service.cc:1511] Processing CreateTablet for tablet 92e3849e91824e17b4b196f367da9127 (DEFAULT_TABLE table=default.Table_d5b58242e0e1482bb075c36a0a36d598 [id=bf771d96432842e18c16e15bca462be6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.980346 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e3849e91824e17b4b196f367da9127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.980458 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de9e78efdc14106aac7a9e411f12c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.980873 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 352ca272888f4dd2ab1a8127bb8c2b6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.981352 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 90bc7409e31043bd9f47d3628278a2fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.981724 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc0c02ef58d4e429855e5bbaa4752ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.982266 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 272838af35d840faa7b11217456533c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.982460 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.982741 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet db750fc9641f492494fdb167de86f6df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.984592 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc92bc15da14504a1ff5feda5aff7cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.985484 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:18.986837 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1082) took 5398 ms. Trace:
I20260616 19:52:18.986929 1191 rpcz_store.cc:276] 0616 19:52:13.587889 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.604944 (+ 17055us) service_pool.cc:224] Handling call
0616 19:52:18.974605 (+5369661us) ts_tablet_manager.cc:1151] Deleting tablet 3d44aed473e44e2eaa0d166f164c9309
0616 19:52:18.974613 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.986823 (+ 12210us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5369490}
I20260616 19:52:18.987309 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1086) took 5376 ms. Trace:
W20260616 19:52:18.987437 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 3d44aed473e44e2eaa0d166f164c9309 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d44aed473e44e2eaa0d166f164c9309 already in progress: creating tablet
I20260616 19:52:18.988410 1191 rpcz_store.cc:276] 0616 19:52:13.610780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.622458 (+ 11678us) service_pool.cc:224] Handling call
0616 19:52:18.987151 (+5364693us) ts_tablet_manager.cc:1151] Deleting tablet 1d9d5b9b81694258accdb0d18ae094de
0616 19:52:18.987160 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.987297 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5364420}
W20260616 19:52:18.988833 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 1d9d5b9b81694258accdb0d18ae094de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d9d5b9b81694258accdb0d18ae094de already in progress: creating tablet
I20260616 19:52:18.989084 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1085) took 5383 ms. Trace:
I20260616 19:52:18.989164 1191 rpcz_store.cc:276] 0616 19:52:13.606067 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.622786 (+ 16719us) service_pool.cc:224] Handling call
0616 19:52:18.988979 (+5366193us) ts_tablet_manager.cc:1151] Deleting tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c
0616 19:52:18.988989 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.989068 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5366046}
I20260616 19:52:18.989418 1191 tablet_replica.cc:333] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:18.989496 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c already in progress: creating tablet
I20260616 19:52:18.989588 1191 raft_consensus.cc:2243] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:18.989740 1191 raft_consensus.cc:2272] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:18.990271 1191 ts_tablet_manager.cc:1916] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:18.990270 858 consensus_peers.cc:597] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 269c1dea941c481fb6fd2e4d59c877c0. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:18.991051 895 tablet_service.cc:1511] Processing CreateTablet for tablet 92e3849e91824e17b4b196f367da9127 (DEFAULT_TABLE table=default.Table_d5b58242e0e1482bb075c36a0a36d598 [id=bf771d96432842e18c16e15bca462be6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.991138 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 92e3849e91824e17b4b196f367da9127 (DEFAULT_TABLE table=default.Table_d5b58242e0e1482bb075c36a0a36d598 [id=bf771d96432842e18c16e15bca462be6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.991431 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e3849e91824e17b4b196f367da9127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.991536 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e3849e91824e17b4b196f367da9127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.996780 763 tablet_service.cc:1511] Processing CreateTablet for tablet ad92442af7634adea61b112d04409cb1 (DEFAULT_TABLE table=default.Table_6335468b43594dd68c34567f2d697b0a [id=7527506529b0431a960623027ad29170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.997152 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad92442af7634adea61b112d04409cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:18.997699 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ad92442af7634adea61b112d04409cb1 (DEFAULT_TABLE table=default.Table_6335468b43594dd68c34567f2d697b0a [id=7527506529b0431a960623027ad29170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:18.998080 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad92442af7634adea61b112d04409cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.000813 2700 raft_consensus.cc:493] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.000953 2700 raft_consensus.cc:515] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.002008 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d05c86bca9343a2bc8c5709e1c49647" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:19.002534 2700 leader_election.cc:290] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:19.003053 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d722dca415c47ec96dfd18060b94e0e consensus state has no leader
I20260616 19:52:19.003332 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d05c86bca9343a2bc8c5709e1c49647" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.003579 781 raft_consensus.cc:2393] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
I20260616 19:52:19.005985 860 leader_election.cc:304] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:19.007009 2700 raft_consensus.cc:3060] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.009615 2700 raft_consensus.cc:2749] T 2d05c86bca9343a2bc8c5709e1c49647 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.012908 2843 consensus_queue.cc:1048] T 2141b6c7013648a4b716642ccb4eccd6 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.016114 1198 tablet_bootstrap.cc:492] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:19.016327 2679 raft_consensus.cc:493] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:19.016500 2679 raft_consensus.cc:515] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } }
I20260616 19:52:19.016481 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_58889a74cc6b4c8f835ac834eda1583e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:19.017077 2679 leader_election.cc:290] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:19.017118 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58889a74cc6b4c8f835ac834eda1583e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:19.019202 860 leader_election.cc:343] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 8a718fefe07141119b7ef7edcbf61123
I20260616 19:52:19.020062 2679 consensus_queue.cc:1048] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.022768 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 7d4d05b550f645e3a4b156bd79a58456
I20260616 19:52:19.024121 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d4d05b550f645e3a4b156bd79a58456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:19.024955 858 leader_election.cc:343] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 8a718fefe07141119b7ef7edcbf61123
I20260616 19:52:19.025101 858 leader_election.cc:304] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:19.025493 2679 raft_consensus.cc:2749] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:19.026829 1192 tablet_bootstrap.cc:492] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:19.026822 1196 tablet_bootstrap.cc:492] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:19.026993 1196 ts_tablet_manager.cc:1403] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.308s user 0.002s sys 0.002s
I20260616 19:52:19.026995 1192 ts_tablet_manager.cc:1403] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.100s user 0.010s sys 0.006s
I20260616 19:52:19.027292 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d4d05b550f645e3a4b156bd79a58456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.027346 1198 ts_tablet_manager.cc:1403] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.193s user 0.001s sys 0.005s
I20260616 19:52:19.027930 1196 raft_consensus.cc:359] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:19.027940 1192 raft_consensus.cc:359] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.028162 1192 raft_consensus.cc:385] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.028247 1192 raft_consensus.cc:740] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.028271 1196 raft_consensus.cc:385] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.028507 1196 raft_consensus.cc:740] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.028483 1192 consensus_queue.cc:260] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.029011 1192 ts_tablet_manager.cc:1434] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260616 19:52:19.029188 719 consensus_peers.cc:597] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:19.029311 1192 tablet_bootstrap.cc:492] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:19.031032 1192 tablet_bootstrap.cc:654] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.031648 1198 raft_consensus.cc:359] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:19.032509 1198 raft_consensus.cc:385] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.033267 1198 raft_consensus.cc:740] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
W20260616 19:52:19.034087 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet f252ea7261ea42869e25245c7ee78c05 (table default.Table_4d937ed6c0714153993ea132f1eb2b3c [id=5e7b87ea6e424b179eaee22711702ee3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f252ea7261ea42869e25245c7ee78c05 consensus state has no leader
I20260616 19:52:19.019006 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c08452aeec471f8480a489620cca28 with delete_type TABLET_DATA_DELETED (replaced by tablet 12944efb54824dc4960db5d09c1a1684) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:19.018819 2661 raft_consensus.cc:493] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.034960 2661 raft_consensus.cc:515] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.035637 1196 consensus_queue.cc:260] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:19.035933 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e2861c41f402d88cafe64a6871429" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:19.036311 1196 ts_tablet_manager.cc:1434] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260616 19:52:19.036311 1191 ts_tablet_manager.cc:1929] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260616 19:52:19.036401 993 leader_election.cc:343] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.036803 1196 tablet_bootstrap.cc:492] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:19.036859 1198 consensus_queue.cc:260] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:19.037626 2661 leader_election.cc:290] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.037731 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_05ada076635d40b6998e1b4787ac3d9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:19.038331 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05ada076635d40b6998e1b4787ac3d9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:19.039024 1198 ts_tablet_manager.cc:1434] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260616 19:52:19.040573 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e2861c41f402d88cafe64a6871429" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.040853 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_be897d5410d941d6b1866917c3340089" } new_table_name: "default.Table_a250188be6474253b5eed8851d652aa7" modify_external_catalogs: true
W20260616 19:52:19.041411 996 leader_election.cc:343] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.041524 996 leader_election.cc:304] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:19.036414 1191 log.cc:1199] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/fbe784716b3c4293bd4eddf57f6c9048
I20260616 19:52:19.042021 2661 raft_consensus.cc:2749] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.042510 1198 tablet_bootstrap.cc:492] T 335f7411fda84fada762345010a4339c P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:19.042121 1191 ts_tablet_manager.cc:1950] T fbe784716b3c4293bd4eddf57f6c9048 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:19.043906 2745 consensus_queue.cc:1048] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.045033 1198 tablet_bootstrap.cc:654] T 335f7411fda84fada762345010a4339c P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.049226 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 29712de1da8b47098aad2b962390f790
I20260616 19:52:19.053503 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 29712de1da8b47098aad2b962390f790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.057400 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 29712de1da8b47098aad2b962390f790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:19.057868 2843 raft_consensus.cc:493] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.058015 2843 raft_consensus.cc:515] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.058583 2843 leader_election.cc:290] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.059059 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e2fb7eef7b82491ab920e5278f9b2abf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:19.059214 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 29712de1da8b47098aad2b962390f790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:19.059674 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2fb7eef7b82491ab920e5278f9b2abf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:19.059978 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d4d05b550f645e3a4b156bd79a58456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:19.060401 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1088) took 5347 ms. Trace:
I20260616 19:52:19.060509 1191 rpcz_store.cc:276] 0616 19:52:13.713264 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.722023 (+ 8759us) service_pool.cc:224] Handling call
0616 19:52:18.989378 (+5267355us) ts_tablet_manager.cc:1151] Deleting tablet fbe784716b3c4293bd4eddf57f6c9048
0616 19:52:18.989386 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.016508 (+ 27122us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.036247 (+ 19739us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.060384 (+ 24137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5267062}
I20260616 19:52:19.060710 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc9d2ca8a644f69e0bc3e9ccecc3cf" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:19.060827 1191 tablet_replica.cc:333] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:19.060896 1052 raft_consensus.cc:2468] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:19.061009 1191 raft_consensus.cc:2243] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.061136 1191 raft_consensus.cc:2272] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.061615 1191 ts_tablet_manager.cc:1916] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.063975 2662 consensus_queue.cc:1048] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.066659 895 tablet_service.cc:1511] Processing CreateTablet for tablet f7a2ef76c45e42e7a01d3b6a571340d6 (DEFAULT_TABLE table=default.Table_2d4da3ce99c746bf9df636a9abb9831d [id=9f488965316f47349a401eea6f860fb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.067282 747 tablet_service.cc:1511] Processing CreateTablet for tablet f7a2ef76c45e42e7a01d3b6a571340d6 (DEFAULT_TABLE table=default.Table_2d4da3ce99c746bf9df636a9abb9831d [id=9f488965316f47349a401eea6f860fb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.067778 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a2ef76c45e42e7a01d3b6a571340d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.069212 898 tablet_service.cc:1511] Processing CreateTablet for tablet ad92442af7634adea61b112d04409cb1 (DEFAULT_TABLE table=default.Table_6335468b43594dd68c34567f2d697b0a [id=7527506529b0431a960623027ad29170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.070361 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet fbe784716b3c4293bd4eddf57f6c9048 (table default.Table_dc19f0ab5b6c47ea854f9d8bfdf6f905 [id=16e9ecefa14243e9988253004dcd756b]) successfully deleted
I20260616 19:52:19.070436 1192 tablet_bootstrap.cc:492] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:19.070565 1192 ts_tablet_manager.cc:1403] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.002s
I20260616 19:52:19.070528 719 leader_election.cc:304] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:19.070955 2628 raft_consensus.cc:2804] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:19.071044 2628 raft_consensus.cc:493] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:19.071131 2628 raft_consensus.cc:3060] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.071218 1192 raft_consensus.cc:359] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.071412 1192 raft_consensus.cc:385] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.071489 1192 raft_consensus.cc:740] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.073822 2628 raft_consensus.cc:515] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.075541 763 tablet_service.cc:1511] Processing CreateTablet for tablet fbf9ad5680074ee0ac4948f82a8bd4a5 (DEFAULT_TABLE table=default.Table_1936994c9dc74e62b39778da2355b418 [id=92b7c44eefd745358f2439ac97450216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.075965 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf9ad5680074ee0ac4948f82a8bd4a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.080598 757 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa385ea6cda48a0b7b33ca458972339 (DEFAULT_TABLE table=default.Table_c974894ab3f54d5d899d7affcfe26f57 [id=fd3b99ed495b4375ae2158ebbb50c394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.080847 886 tablet_service.cc:1511] Processing CreateTablet for tablet fbf9ad5680074ee0ac4948f82a8bd4a5 (DEFAULT_TABLE table=default.Table_1936994c9dc74e62b39778da2355b418 [id=92b7c44eefd745358f2439ac97450216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.080924 2628 leader_election.cc:290] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.080965 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa385ea6cda48a0b7b33ca458972339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.081354 896 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa385ea6cda48a0b7b33ca458972339 (DEFAULT_TABLE table=default.Table_c974894ab3f54d5d899d7affcfe26f57 [id=fd3b99ed495b4375ae2158ebbb50c394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.086906 2661 raft_consensus.cc:493] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.087122 2661 raft_consensus.cc:515] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.087728 2661 leader_election.cc:290] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:19.088260 447 consensus_peers.cc:597] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 -> Peer c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219): Couldn't send request to peer c404c91cd2194cf6838fddd212f2f4ae. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260616 19:52:19.091275 1192 consensus_queue.cc:260] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.092414 1192 ts_tablet_manager.cc:1434] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260616 19:52:19.100982 893 tablet_service.cc:1511] Processing CreateTablet for tablet d7cb00d193774b679027abd23689d112 (DEFAULT_TABLE table=default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.101637 757 tablet_service.cc:1511] Processing CreateTablet for tablet d7cb00d193774b679027abd23689d112 (DEFAULT_TABLE table=default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.102144 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7cb00d193774b679027abd23689d112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.103057 1193 ts_tablet_manager.cc:1929] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.103201 1193 log.cc:1199] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/e6f309caaa9042f99432a61fd2ebb089
I20260616 19:52:19.103643 1193 ts_tablet_manager.cc:1950] T e6f309caaa9042f99432a61fd2ebb089 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:19.104363 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1222) took 2061 ms. Trace:
I20260616 19:52:19.104714 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 29df38f273494a079bdc76a915d43dab (table default.Table_bfda4071639c49399f2f5bf499be37e9 [id=1449ff28bd8546908359606f7272846f]). Expected version 2 got 0
I20260616 19:52:19.105037 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 41f2d259a31c4f4eaeceaba57fb978b2 (table default.Table_7ffffaef50044d8ba89e6df198946113 [id=d49c093f51b04c2fa1b1f5daadd802cf]). Expected version 3 got 0
I20260616 19:52:19.105201 1191 ts_tablet_manager.cc:1929] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.105463 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet b5587d5aa8584cf49ef3cb113a1b64ca (table default.Table_0f374c454bc04298ba16dc14edb7bc9e [id=1105333647e747a39fc06efbcc95fa0d]). Expected version 1 got 0
I20260616 19:52:19.105604 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 2141b6c7013648a4b716642ccb4eccd6 (table default.Table_5047c84664124989b931ee92afc5b463 [id=bc83d5c728054794b2c3cc0f9b90e202]). Expected version 1 got 0
I20260616 19:52:19.105772 459 catalog_manager.cc:5696] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } }
I20260616 19:52:19.106101 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet a95c684f5fe54f7dad6300efb0c18780 (table default.Table_57baa761ff0f4e189d6b46fada3d0d9f [id=02d0cb31737b4289988e982dd24ae298]). Expected version 1 got 0
I20260616 19:52:19.106385 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 31db3862f78943519bcd9531c5530048 (table default.Table_8cda9a799036458f9543a8a8aac3ee5a [id=c72157c1e0f943e4af149e7f692209ee]). Expected version 1 got 0
I20260616 19:52:19.108882 2661 raft_consensus.cc:493] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.109081 2661 raft_consensus.cc:515] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.109777 1190 ts_tablet_manager.cc:1929] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.109926 1190 log.cc:1199] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/2e316e44693d473dad901eeb95299988
I20260616 19:52:19.110617 1190 ts_tablet_manager.cc:1950] T 2e316e44693d473dad901eeb95299988 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:19.112847 901 tablet_service.cc:1511] Processing CreateTablet for tablet 67d27fe2ecaf4579978e357b4cdce90f (DEFAULT_TABLE table=default.Table_cd1b270f52fc41b38b26559fc9f49692 [id=8d015054855148569e24b89db22d1145]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.112872 763 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3d75c36cf545de96d9f1722c60fea6 (DEFAULT_TABLE table=default.Table_2b2f2de9fe7447699e405ceb2f661744 [id=6dc0653643394fb79d433af1e37b5bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.113286 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3d75c36cf545de96d9f1722c60fea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.113807 892 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3d75c36cf545de96d9f1722c60fea6 (DEFAULT_TABLE table=default.Table_2b2f2de9fe7447699e405ceb2f661744 [id=6dc0653643394fb79d433af1e37b5bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.114212 747 tablet_service.cc:1511] Processing CreateTablet for tablet 67d27fe2ecaf4579978e357b4cdce90f (DEFAULT_TABLE table=default.Table_cd1b270f52fc41b38b26559fc9f49692 [id=8d015054855148569e24b89db22d1145]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.114547 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d27fe2ecaf4579978e357b4cdce90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.118295 2864 raft_consensus.cc:493] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.119362 1196 tablet_bootstrap.cc:654] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.119385 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc9d2ca8a644f69e0bc3e9ccecc3cf" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:19.119989 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc9d2ca8a644f69e0bc3e9ccecc3cf" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:19.120153 718 leader_election.cc:343] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.120656 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7e2d8c25b8464b94ca386566abc2cc" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:19.120710 2745 consensus_queue.cc:1048] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:19.120956 718 leader_election.cc:343] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.121060 2745 consensus_queue.cc:1048] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.121474 2745 consensus_queue.cc:1048] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:19.121520 993 leader_election.cc:343] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.126312 1031 tablet_service.cc:1511] Processing CreateTablet for tablet f7a2ef76c45e42e7a01d3b6a571340d6 (DEFAULT_TABLE table=default.Table_2d4da3ce99c746bf9df636a9abb9831d [id=9f488965316f47349a401eea6f860fb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.126787 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a2ef76c45e42e7a01d3b6a571340d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.128069 1191 log.cc:1199] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/bcc5116ef5df4140a96f03c003337c68
I20260616 19:52:19.128674 1191 ts_tablet_manager.cc:1950] T bcc5116ef5df4140a96f03c003337c68 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:19.129384 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1089) took 5381 ms. Trace:
I20260616 19:52:19.129474 1191 rpcz_store.cc:276] 0616 19:52:13.747584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.747866 (+ 282us) service_pool.cc:224] Handling call
0616 19:52:19.060780 (+5312914us) ts_tablet_manager.cc:1151] Deleting tablet bcc5116ef5df4140a96f03c003337c68
0616 19:52:19.060791 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.095720 (+ 34929us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.105150 (+ 9430us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.129359 (+ 24209us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5312628}
I20260616 19:52:19.129900 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc9d2ca8a644f69e0bc3e9ccecc3cf" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:19.130172 1058 raft_consensus.cc:3060] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.130306 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1091) took 5282 ms. Trace:
I20260616 19:52:19.130383 1191 rpcz_store.cc:276] 0616 19:52:13.848064 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.848113 (+ 49us) service_pool.cc:224] Handling call
0616 19:52:19.130176 (+5282063us) ts_tablet_manager.cc:1151] Deleting tablet a6565379687e4ddfb471b513939775be
0616 19:52:19.130186 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.130290 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5281904}
I20260616 19:52:19.130708 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1094) took 5171 ms. Trace:
I20260616 19:52:19.130772 1191 rpcz_store.cc:276] 0616 19:52:13.959541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.963921 (+ 4380us) service_pool.cc:224] Handling call
0616 19:52:19.130596 (+5166675us) ts_tablet_manager.cc:1151] Deleting tablet 1d5efc4005fa447091cbc9aa28ac3922
0616 19:52:19.130615 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.130694 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4480,"tablet-delete.queue_time_us":5166488}
I20260616 19:52:19.131059 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1095) took 5166 ms. Trace:
I20260616 19:52:19.131131 1191 rpcz_store.cc:276] 0616 19:52:13.964442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.964519 (+ 77us) service_pool.cc:224] Handling call
0616 19:52:19.130965 (+5166446us) ts_tablet_manager.cc:1151] Deleting tablet 296dd76b85b244769d9e4c51163a4e4a
0616 19:52:19.130973 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.131046 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5166258}
I20260616 19:52:19.131281 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7e2d8c25b8464b94ca386566abc2cc" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.131426 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1097) took 5152 ms. Trace:
I20260616 19:52:19.131491 1191 rpcz_store.cc:276] 0616 19:52:13.978955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.979101 (+ 146us) service_pool.cc:224] Handling call
0616 19:52:19.131317 (+5152216us) ts_tablet_manager.cc:1151] Deleting tablet 265a37409d8e4b1bb8ea20e3970b5f69
0616 19:52:19.131326 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.131413 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5152013}
I20260616 19:52:19.131752 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1098) took 5138 ms. Trace:
I20260616 19:52:19.131821 1191 rpcz_store.cc:276] 0616 19:52:13.993781 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.993828 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:19.131661 (+5137833us) ts_tablet_manager.cc:1151] Deleting tablet 96bf58d365a54c24b5131416d95d2b6a
0616 19:52:19.131669 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.131740 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5137609}
I20260616 19:52:19.132171 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1102) took 5093 ms. Trace:
I20260616 19:52:19.132301 1191 rpcz_store.cc:276] 0616 19:52:14.039212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.039275 (+ 63us) service_pool.cc:224] Handling call
0616 19:52:19.132006 (+5092731us) ts_tablet_manager.cc:1151] Deleting tablet ce0963f38738468eb1518deadb3f119d
0616 19:52:19.132015 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.132154 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5092334}
I20260616 19:52:19.132555 1191 tablet_replica.cc:333] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:19.132743 1191 raft_consensus.cc:2243] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.132906 1191 raft_consensus.cc:2272] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.133431 2843 consensus_queue.cc:1048] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.133589 1191 ts_tablet_manager.cc:1916] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.134824 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet bcc5116ef5df4140a96f03c003337c68 (table default.Table_60ba0f6f88634456a3d4afc9f759c4a7 [id=9c7b653f62ef4b74946cc87069f8df6e]) successfully deleted
I20260616 19:52:19.135135 2642 consensus_queue.cc:1048] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:19.136622 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a6565379687e4ddfb471b513939775be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6565379687e4ddfb471b513939775be already in progress: creating tablet
I20260616 19:52:19.137666 1025 tablet_service.cc:1511] Processing CreateTablet for tablet fbf9ad5680074ee0ac4948f82a8bd4a5 (DEFAULT_TABLE table=default.Table_1936994c9dc74e62b39778da2355b418 [id=92b7c44eefd745358f2439ac97450216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.138046 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf9ad5680074ee0ac4948f82a8bd4a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.138823 2845 consensus_queue.cc:1048] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.143803 1029 tablet_service.cc:1511] Processing CreateTablet for tablet d7cb00d193774b679027abd23689d112 (DEFAULT_TABLE table=default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.144635 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 67d27fe2ecaf4579978e357b4cdce90f (DEFAULT_TABLE table=default.Table_cd1b270f52fc41b38b26559fc9f49692 [id=8d015054855148569e24b89db22d1145]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:19.145324 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 1d5efc4005fa447091cbc9aa28ac3922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d5efc4005fa447091cbc9aa28ac3922 already in progress: creating tablet
W20260616 19:52:19.145567 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 296dd76b85b244769d9e4c51163a4e4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 296dd76b85b244769d9e4c51163a4e4a already in progress: creating tablet
W20260616 19:52:19.145743 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 265a37409d8e4b1bb8ea20e3970b5f69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 265a37409d8e4b1bb8ea20e3970b5f69 already in progress: creating tablet
W20260616 19:52:19.145901 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 96bf58d365a54c24b5131416d95d2b6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96bf58d365a54c24b5131416d95d2b6a already in progress: creating tablet
W20260616 19:52:19.146077 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ce0963f38738468eb1518deadb3f119d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce0963f38738468eb1518deadb3f119d already in progress: creating tablet
I20260616 19:52:19.147627 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3d75c36cf545de96d9f1722c60fea6 (DEFAULT_TABLE table=default.Table_2b2f2de9fe7447699e405ceb2f661744 [id=6dc0653643394fb79d433af1e37b5bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.147671 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa385ea6cda48a0b7b33ca458972339 (DEFAULT_TABLE table=default.Table_c974894ab3f54d5d899d7affcfe26f57 [id=fd3b99ed495b4375ae2158ebbb50c394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:19.147603 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7cb00d193774b679027abd23689d112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.148794 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3d75c36cf545de96d9f1722c60fea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.148926 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d27fe2ecaf4579978e357b4cdce90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.150207 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa385ea6cda48a0b7b33ca458972339. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:19.155704 996 leader_election.cc:343] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.156931 996 leader_election.cc:304] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:19.157274 2850 raft_consensus.cc:2749] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.157939 2850 consensus_queue.cc:1048] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.176091 2661 leader_election.cc:290] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.118443 2864 raft_consensus.cc:515] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.176708 2864 leader_election.cc:290] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.178221 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352ca272888f4dd2ab1a8127bb8c2b6e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:19.179183 993 leader_election.cc:343] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.183401 1058 raft_consensus.cc:2468] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:19.187546 858 consensus_peers.cc:597] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:19.189672 1191 ts_tablet_manager.cc:1929] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.189777 1191 log.cc:1199] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/43b4c3bd370749b18fb86f7a0aae2c50
I20260616 19:52:19.190102 1191 ts_tablet_manager.cc:1950] T 43b4c3bd370749b18fb86f7a0aae2c50 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:19.190778 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1101) took 5168 ms. Trace:
I20260616 19:52:19.190860 1191 rpcz_store.cc:276] 0616 19:52:14.021865 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.100523 (+ 78658us) service_pool.cc:224] Handling call
0616 19:52:19.132517 (+5031994us) ts_tablet_manager.cc:1151] Deleting tablet 43b4c3bd370749b18fb86f7a0aae2c50
0616 19:52:19.132526 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.186140 (+ 53614us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.189630 (+ 3490us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.190762 (+ 1132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5031817}
I20260616 19:52:19.191149 1191 tablet_replica.cc:333] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:19.191334 1191 raft_consensus.cc:2243] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.191462 1191 raft_consensus.cc:2272] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.191923 1191 ts_tablet_manager.cc:1916] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.198812 1191 ts_tablet_manager.cc:1929] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.198904 1191 log.cc:1199] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/c7f724dc23024a7297cfb8689f199600
I20260616 19:52:19.199242 1191 ts_tablet_manager.cc:1950] T c7f724dc23024a7297cfb8689f199600 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:19.199882 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1107) took 5030 ms. Trace:
I20260616 19:52:19.199972 1191 rpcz_store.cc:276] 0616 19:52:14.168924 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.168967 (+ 43us) service_pool.cc:224] Handling call
0616 19:52:19.191103 (+5022136us) ts_tablet_manager.cc:1151] Deleting tablet c7f724dc23024a7297cfb8689f199600
0616 19:52:19.191111 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.196357 (+ 5246us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.198770 (+ 2413us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.199866 (+ 1096us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5021965}
I20260616 19:52:19.200356 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1110) took 4976 ms. Trace:
I20260616 19:52:19.201508 2661 raft_consensus.cc:493] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.201628 2661 raft_consensus.cc:515] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:19.202101 2661 leader_election.cc:290] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.202836 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b362fa598a54632880faa42a9224ffd" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:19.203848 1196 tablet_bootstrap.cc:492] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:19.203989 1196 ts_tablet_manager.cc:1403] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.167s user 0.004s sys 0.005s
I20260616 19:52:19.204821 1196 raft_consensus.cc:359] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.205010 1196 raft_consensus.cc:385] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.205067 1196 raft_consensus.cc:740] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.205300 1196 consensus_queue.cc:260] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.200433 1191 rpcz_store.cc:276] 0616 19:52:14.223786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.224193 (+ 407us) service_pool.cc:224] Handling call
0616 19:52:19.200227 (+4976034us) ts_tablet_manager.cc:1151] Deleting tablet 150af2d5b0614adc8ae7a2bdac076a87
0616 19:52:19.200236 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.200339 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4975705}
I20260616 19:52:19.206070 1191 tablet_replica.cc:333] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:19.206292 1191 raft_consensus.cc:2243] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.206435 1191 raft_consensus.cc:2272] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.209059 1191 ts_tablet_manager.cc:1916] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.211764 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a2ef76c45e42e7a01d3b6a571340d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.221532 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda5bcb16cf4b48bc1ca87d0a3a48d7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:19.223330 993 leader_election.cc:343] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.223482 1191 ts_tablet_manager.cc:1929] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.223574 1191 log.cc:1199] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/40bdb01a15254c329d82f0d40919b880
I20260616 19:52:19.224611 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda5bcb16cf4b48bc1ca87d0a3a48d7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.224737 1193 rpcz_store.cc:276] 0616 19:52:17.042727 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.043593 (+ 866us) service_pool.cc:224] Handling call
0616 19:52:18.843192 (+1799599us) ts_tablet_manager.cc:1151] Deleting tablet e6f309caaa9042f99432a61fd2ebb089
0616 19:52:18.843201 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:18.958679 (+115478us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.102981 (+144302us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.104298 (+ 1317us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1799457}
I20260616 19:52:19.223850 1198 tablet_bootstrap.cc:492] T 335f7411fda84fada762345010a4339c P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:19.225561 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf9ad5680074ee0ac4948f82a8bd4a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.225714 1198 ts_tablet_manager.cc:1403] T 335f7411fda84fada762345010a4339c P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.186s user 0.004s sys 0.007s
I20260616 19:52:19.225785 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352ca272888f4dd2ab1a8127bb8c2b6e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.226476 1198 raft_consensus.cc:359] T 335f7411fda84fada762345010a4339c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.227128 719 leader_election.cc:304] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:19.227555 2845 raft_consensus.cc:2804] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:19.227666 2845 raft_consensus.cc:697] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:19.227890 2845 consensus_queue.cc:237] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.228677 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa385ea6cda48a0b7b33ca458972339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.229866 1198 raft_consensus.cc:385] T 335f7411fda84fada762345010a4339c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.230005 1198 raft_consensus.cc:740] T 335f7411fda84fada762345010a4339c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.224987 1191 ts_tablet_manager.cc:1950] T 40bdb01a15254c329d82f0d40919b880 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:19.232678 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7cb00d193774b679027abd23689d112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.232656 1198 consensus_queue.cc:260] T 335f7411fda84fada762345010a4339c P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.233078 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1114) took 4932 ms. Trace:
I20260616 19:52:19.233162 1191 rpcz_store.cc:276] 0616 19:52:14.301087 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.301431 (+ 344us) service_pool.cc:224] Handling call
0616 19:52:19.206026 (+4904595us) ts_tablet_manager.cc:1151] Deleting tablet 40bdb01a15254c329d82f0d40919b880
0616 19:52:19.206036 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.220229 (+ 14193us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.223440 (+ 3211us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.233060 (+ 9620us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4904415}
I20260616 19:52:19.233520 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1115) took 4932 ms. Trace:
I20260616 19:52:19.233597 1191 rpcz_store.cc:276] 0616 19:52:14.301235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.302116 (+ 881us) service_pool.cc:224] Handling call
0616 19:52:19.233420 (+4931304us) ts_tablet_manager.cc:1151] Deleting tablet bd7b91e00d6c4f70b0eda75fe83d617e
0616 19:52:19.233428 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.233506 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4931163}
I20260616 19:52:19.233903 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1119) took 4853 ms. Trace:
I20260616 19:52:19.233974 1191 rpcz_store.cc:276] 0616 19:52:14.379995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.380084 (+ 89us) service_pool.cc:224] Handling call
0616 19:52:19.233797 (+4853713us) ts_tablet_manager.cc:1151] Deleting tablet 70e1f138c3154dfbb93aca7bed67719d
0616 19:52:19.233806 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.233889 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4853555}
I20260616 19:52:19.234421 1191 tablet_replica.cc:333] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:19.235728 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b362fa598a54632880faa42a9224ffd" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.235925 775 raft_consensus.cc:2393] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61c874fef3684d10a272a9c7f280e0e2 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
I20260616 19:52:19.236778 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3d75c36cf545de96d9f1722c60fea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.240398 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d27fe2ecaf4579978e357b4cdce90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.240515 1192 tablet_bootstrap.cc:492] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:19.242187 1192 tablet_bootstrap.cc:654] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.243398 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad92442af7634adea61b112d04409cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:19.244887 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 43b4c3bd370749b18fb86f7a0aae2c50 (table default.Table_7ad7ef9c768d41edaa47c8cd68466731 [id=217c0ab9c81b4dae8666abc02dfeb60b]) successfully deleted
I20260616 19:52:19.245193 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet c7f724dc23024a7297cfb8689f199600 (table default.Table_7cdef69863694f0ba023c214e42394e8 [id=a7f1b3885b764715a88750ea3752dbdb]) successfully deleted
W20260616 19:52:19.245376 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 150af2d5b0614adc8ae7a2bdac076a87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 150af2d5b0614adc8ae7a2bdac076a87 already in progress: creating tablet
I20260616 19:52:19.248267 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 40bdb01a15254c329d82f0d40919b880 (table default.Table_d2ddb45a3fbb446689cb737dcb4fbc12 [id=ccddc1e63f194e539a50d511f05eff8a]) successfully deleted
W20260616 19:52:19.248454 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet bd7b91e00d6c4f70b0eda75fe83d617e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd7b91e00d6c4f70b0eda75fe83d617e already in progress: creating tablet
W20260616 19:52:19.248636 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 70e1f138c3154dfbb93aca7bed67719d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70e1f138c3154dfbb93aca7bed67719d already in progress: creating tablet
I20260616 19:52:19.248914 1196 ts_tablet_manager.cc:1434] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.045s user 0.000s sys 0.002s
I20260616 19:52:19.249202 1196 tablet_bootstrap.cc:492] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:19.249312 2843 consensus_queue.cc:1048] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:19.251251 719 consensus_peers.cc:597] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a817b1d4c7b640db8894bc801878caae. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:19.252884 1191 raft_consensus.cc:2243] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.253057 1191 raft_consensus.cc:2272] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.253445 1198 ts_tablet_manager.cc:1434] T 335f7411fda84fada762345010a4339c P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260616 19:52:19.253780 1198 tablet_bootstrap.cc:492] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:19.253851 1191 ts_tablet_manager.cc:1916] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.255437 1198 tablet_bootstrap.cc:654] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.256676 1192 tablet_bootstrap.cc:492] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:19.256800 1192 ts_tablet_manager.cc:1403] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20260616 19:52:19.257421 1192 raft_consensus.cc:359] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.257583 1192 raft_consensus.cc:385] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.257637 1192 raft_consensus.cc:740] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.258167 1193 tablet_replica.cc:333] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:19.258822 1192 consensus_queue.cc:260] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.259298 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1068) took 5682 ms. Trace:
I20260616 19:52:19.259461 1190 rpcz_store.cc:276] 0616 19:52:13.576708 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.576764 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:18.953624 (+5376860us) ts_tablet_manager.cc:1151] Deleting tablet 2e316e44693d473dad901eeb95299988
0616 19:52:18.953637 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.015449 (+ 61812us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.109721 (+ 94272us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.259248 (+149527us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5376653}
I20260616 19:52:19.260061 1190 tablet_replica.cc:333] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:19.260192 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 2e316e44693d473dad901eeb95299988 (table default.Table_032fed7521604405ba49b2f399e0f628 [id=5aaccdcce80844bbb73b04f81bde9373]) successfully deleted
I20260616 19:52:19.260514 1190 raft_consensus.cc:2243] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.260753 1192 ts_tablet_manager.cc:1434] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260616 19:52:19.260901 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet e6f309caaa9042f99432a61fd2ebb089 (table default.Table_148c23f911c0426e857f5f3cd973d63e [id=fa08d08f5e8a4f9d8616afb37792fbeb]) successfully deleted
I20260616 19:52:19.261088 1190 raft_consensus.cc:2272] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.261996 1192 tablet_bootstrap.cc:492] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:19.262023 1190 ts_tablet_manager.cc:1916] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.258853 1193 raft_consensus.cc:2243] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:19.263530 1193 raft_consensus.cc:2272] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.275609 1196 tablet_bootstrap.cc:654] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.276444 1192 tablet_bootstrap.cc:654] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.271656 1193 ts_tablet_manager.cc:1916] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.262914 1191 ts_tablet_manager.cc:1929] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260616 19:52:19.268162 996 leader_election.cc:343] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.286697 996 leader_election.cc:304] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:19.287150 2679 raft_consensus.cc:493] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.287307 2679 raft_consensus.cc:515] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:19.287412 2661 raft_consensus.cc:2749] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.287936 2679 leader_election.cc:290] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:19.286515 1191 log.cc:1199] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/af5e277102b8480db44e5ffe88267808
I20260616 19:52:19.288707 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db750fc9641f492494fdb167de86f6df" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:19.288872 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db750fc9641f492494fdb167de86f6df" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.289095 781 raft_consensus.cc:2393] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
I20260616 19:52:19.289671 1191 ts_tablet_manager.cc:1950] T af5e277102b8480db44e5ffe88267808 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:19.290372 860 leader_election.cc:304] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:19.290880 2679 raft_consensus.cc:3060] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.291865 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1121) took 4796 ms. Trace:
I20260616 19:52:19.292172 1191 rpcz_store.cc:276] 0616 19:52:14.495719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.495770 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:19.234380 (+4738610us) ts_tablet_manager.cc:1151] Deleting tablet af5e277102b8480db44e5ffe88267808
0616 19:52:19.234390 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.259540 (+ 25150us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.262862 (+ 3322us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.291799 (+ 28937us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18239,"tablet-delete.queue_time_us":4738438}
I20260616 19:52:19.293306 1191 tablet_replica.cc:333] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:19.293897 2679 raft_consensus.cc:2749] T db750fc9641f492494fdb167de86f6df P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.293902 1191 raft_consensus.cc:2243] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.294324 1191 raft_consensus.cc:2272] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.296123 1196 tablet_bootstrap.cc:492] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:19.296268 1196 ts_tablet_manager.cc:1403] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.003s
I20260616 19:52:19.297029 1196 raft_consensus.cc:359] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.297201 1196 raft_consensus.cc:385] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.297256 1196 raft_consensus.cc:740] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.297437 1196 consensus_queue.cc:260] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.298069 1196 ts_tablet_manager.cc:1434] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:19.298372 1196 tablet_bootstrap.cc:492] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:19.298380 1191 ts_tablet_manager.cc:1916] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:19.301215 996 leader_election.cc:343] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.301621 996 leader_election.cc:304] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:19.302314 2661 raft_consensus.cc:2749] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.303908 2661 consensus_queue.cc:1048] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.304917 996 leader_election.cc:304] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:19.305512 2661 raft_consensus.cc:3060] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.307487 1193 ts_tablet_manager.cc:1929] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.307586 1193 log.cc:1199] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/fbe784716b3c4293bd4eddf57f6c9048
I20260616 19:52:19.308503 2661 raft_consensus.cc:2749] T 0b362fa598a54632880faa42a9224ffd P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.313657 2679 raft_consensus.cc:493] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.313833 2679 raft_consensus.cc:515] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.314862 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335f7411fda84fada762345010a4339c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.314930 2679 leader_election.cc:290] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:19.315037 781 raft_consensus.cc:2468] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:19.315651 1193 ts_tablet_manager.cc:1950] T fbe784716b3c4293bd4eddf57f6c9048 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:19.315709 860 leader_election.cc:304] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:19.315975 1196 tablet_bootstrap.cc:654] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.316699 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335f7411fda84fada762345010a4339c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:19.316871 1054 raft_consensus.cc:2468] T 335f7411fda84fada762345010a4339c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:19.316995 2700 raft_consensus.cc:2804] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:19.317065 2700 raft_consensus.cc:493] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:19.317135 2700 raft_consensus.cc:3060] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.319656 2700 raft_consensus.cc:515] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.320269 2700 leader_election.cc:290] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:19.320818 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335f7411fda84fada762345010a4339c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:19.320969 1054 raft_consensus.cc:3060] T 335f7411fda84fada762345010a4339c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.320958 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335f7411fda84fada762345010a4339c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:19.321133 781 raft_consensus.cc:3060] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.321599 1198 tablet_bootstrap.cc:492] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:19.321703 1198 ts_tablet_manager.cc:1403] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.002s
I20260616 19:52:19.322450 1198 raft_consensus.cc:359] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.322752 1198 raft_consensus.cc:385] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.322907 1198 raft_consensus.cc:740] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.323266 1198 consensus_queue.cc:260] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.323698 2864 raft_consensus.cc:493] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.323865 2864 raft_consensus.cc:515] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.324075 781 raft_consensus.cc:2468] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:19.324172 1198 ts_tablet_manager.cc:1434] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:19.324406 2864 leader_election.cc:290] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.324522 860 leader_election.cc:304] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:19.324643 1198 tablet_bootstrap.cc:492] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:19.327003 1054 raft_consensus.cc:2468] T 335f7411fda84fada762345010a4339c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:19.327122 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 272838af35d840faa7b11217456533c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.327382 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61132c1c9cd24b7d923f1d65ad04c340" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:19.327983 993 leader_election.cc:343] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.333289 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b362fa598a54632880faa42a9224ffd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.334777 1198 tablet_bootstrap.cc:654] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.338707 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1224) took 2294 ms. Trace:
I20260616 19:52:19.338833 1193 rpcz_store.cc:276] 0616 19:52:17.043806 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.043853 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:19.258084 (+2214231us) ts_tablet_manager.cc:1151] Deleting tablet fbe784716b3c4293bd4eddf57f6c9048
0616 19:52:19.258094 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.283835 (+ 25741us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.307426 (+ 23591us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.338672 (+ 31246us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2214080}
I20260616 19:52:19.339304 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet fbe784716b3c4293bd4eddf57f6c9048 (table default.Table_dc19f0ab5b6c47ea854f9d8bfdf6f905 [id=16e9ecefa14243e9988253004dcd756b]) successfully deleted
I20260616 19:52:19.344726 1193 tablet_replica.cc:333] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:19.345191 1193 raft_consensus.cc:2243] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:19.345927 1193 raft_consensus.cc:2272] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.347023 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 90bc7409e31043bd9f47d3628278a2fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.347059 1193 ts_tablet_manager.cc:1916] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.347908 1192 tablet_bootstrap.cc:492] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:19.347956 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 482411d57f24459d8e7ed0eeb573234d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.348073 1192 ts_tablet_manager.cc:1403] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.086s user 0.007s sys 0.001s
I20260616 19:52:19.348656 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d05c86bca9343a2bc8c5709e1c49647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.348845 1192 raft_consensus.cc:359] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.349033 1192 raft_consensus.cc:385] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.349092 1192 raft_consensus.cc:740] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.349288 1192 consensus_queue.cc:260] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.349341 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.350250 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e316e44693d473dad901eeb95299988 with delete_type TABLET_DATA_DELETED (replaced by tablet 93c940bd14a040ddba5ea058e732bf0c) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.350858 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 08db2c1398b946c180d81b88504c1d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.351867 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a7b177800174706a985c11e5876b9d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.352742 901 tablet_service.cc:1558] Processing DeleteTablet for tablet c48314f8e45d4b198306f0ae6e40def7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.353559 901 tablet_service.cc:1558] Processing DeleteTablet for tablet c6939d108a7948bb9e56311a34d95486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.354360 901 tablet_service.cc:1558] Processing DeleteTablet for tablet a0cb7a1acf35403192254bf5cd1170a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.361485 1192 ts_tablet_manager.cc:1434] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260616 19:52:19.363565 1192 tablet_bootstrap.cc:492] T c1203a4e952a42369d5c03ff4a4c59ec P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:19.364180 2937 raft_consensus.cc:2804] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:19.367892 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet af5e277102b8480db44e5ffe88267808 (table default.Table_d19f51d7b61e47dea882c1fd07d9a122 [id=00510df65be542a98fec0f25a07d1542]) successfully deleted
I20260616 19:52:19.377389 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61132c1c9cd24b7d923f1d65ad04c340" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.388188 1192 tablet_bootstrap.cc:654] T c1203a4e952a42369d5c03ff4a4c59ec P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.398720 2843 raft_consensus.cc:493] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.398922 2843 raft_consensus.cc:515] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
W20260616 19:52:19.399497 858 consensus_peers.cc:597] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:19.399601 2843 leader_election.cc:290] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:19.402173 2937 raft_consensus.cc:697] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
W20260616 19:52:19.406724 858 consensus_peers.cc:597] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6f309caaa9042f99432a61fd2ebb089. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:19.413009 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29df38f273494a079bdc76a915d43dab" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:19.413255 918 raft_consensus.cc:2393] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7245e7dab0ec474a876537be514c8767 in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
I20260616 19:52:19.414608 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29df38f273494a079bdc76a915d43dab" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:19.420994 2938 raft_consensus.cc:493] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.405853 2937 consensus_queue.cc:237] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.423058 1190 ts_tablet_manager.cc:1929] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:19.424916 1196 tablet_bootstrap.cc:492] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:19.425069 1196 ts_tablet_manager.cc:1403] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.127s user 0.005s sys 0.003s
I20260616 19:52:19.424661 1190 log.cc:1199] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/7dc92bc15da14504a1ff5feda5aff7cf
I20260616 19:52:19.423359 2938 raft_consensus.cc:515] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.425868 1196 raft_consensus.cc:359] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.426023 1196 raft_consensus.cc:385] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.426080 1196 raft_consensus.cc:740] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.426294 1196 consensus_queue.cc:260] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.426805 1196 ts_tablet_manager.cc:1434] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:19.427084 1196 tablet_bootstrap.cc:492] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:19.429169 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 964384a661834a6e9ffaa4724a0ee3be
W20260616 19:52:19.429306 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d69db202af9e4d4f86a9d8d40e9fe3af consensus state has no leader
I20260616 19:52:19.430039 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a063d8f3960c4fc68928fce3710aeefd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:19.430583 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a063d8f3960c4fc68928fce3710aeefd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:19.430780 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bfda4071639c49399f2f5bf499be37e9" } new_table_name: "default.Table_c2ce6e69bb9245d8846dc2de654d9ba8" modify_external_catalogs: true
I20260616 19:52:19.430903 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 964384a661834a6e9ffaa4724a0ee3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.432291 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 964384a661834a6e9ffaa4724a0ee3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.434206 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet a95c684f5fe54f7dad6300efb0c18780 (table default.Table_57baa761ff0f4e189d6b46fada3d0d9f [id=02d0cb31737b4289988e982dd24ae298]). Expected version 1 got 0
I20260616 19:52:19.434573 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 2141b6c7013648a4b716642ccb4eccd6 (table default.Table_5047c84664124989b931ee92afc5b463 [id=bc83d5c728054794b2c3cc0f9b90e202]). Expected version 1 got 0
I20260616 19:52:19.435022 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf (table default.Table_44aec49c206e4527939d533088c54ba6 [id=b7d5c502d76f428683cb0830f0819011]). Expected version 3 got 0
I20260616 19:52:19.434594 1190 ts_tablet_manager.cc:1950] T 7dc92bc15da14504a1ff5feda5aff7cf P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:19.435421 460 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 41f2d259a31c4f4eaeceaba57fb978b2 (table default.Table_7ffffaef50044d8ba89e6df198946113 [id=d49c093f51b04c2fa1b1f5daadd802cf]). Expected version 3 got 0
I20260616 19:52:19.437861 1196 tablet_bootstrap.cc:654] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.438655 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1070) took 5846 ms. Trace:
I20260616 19:52:19.439376 1190 rpcz_store.cc:276] 0616 19:52:13.591748 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.597762 (+ 6014us) service_pool.cc:224] Handling call
0616 19:52:19.259986 (+5662224us) ts_tablet_manager.cc:1151] Deleting tablet 7dc92bc15da14504a1ff5feda5aff7cf
0616 19:52:19.259995 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.372898 (+112903us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.422242 (+ 49344us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.438406 (+ 16164us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5662057}
I20260616 19:52:19.443462 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 7dc92bc15da14504a1ff5feda5aff7cf (table default.Table_6955250583bf4c3cbff20316dfa5d1a7 [id=8c7791625cfd4d39ad0dff83be1c7089]) successfully deleted
I20260616 19:52:19.444420 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 78cef79e6b324df7943e6f499516c5d9
I20260616 19:52:19.445047 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6454fb2cae974195b380fd6b2ae1ec44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:19.445122 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9ae3d5cd3dc546c0b88e9142d5803827"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:19.445797 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ae3d5cd3dc546c0b88e9142d5803827 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:19.445966 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29df38f273494a079bdc76a915d43dab consensus state has no leader
W20260616 19:52:19.446084 461 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:50389 (request call id 203) took 782 ms (client timeout 1000 ms). Trace:
I20260616 19:52:19.446300 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2a8f3a4767fb47a0908c8e8d410500a9" } new_table_name: "default.Table_d878e2d0b4c74f0bba00f978e0b08cd7" modify_external_catalogs: true
W20260616 19:52:19.445799 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6454fb2cae974195b380fd6b2ae1ec44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:19.447384 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 78cef79e6b324df7943e6f499516c5d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.447607 747 tablet_service.cc:1558] Processing DeleteTablet for tablet efd5fecc6d444e5fba9103287c09542e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.447866 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b362fa598a54632880faa42a9224ffd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.448022 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f96ef25396a4092bc475f4aab269bc7 with delete_type TABLET_DATA_DELETED (replaced by tablet 78cef79e6b324df7943e6f499516c5d9) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.448124 763 tablet_service.cc:1558] Processing DeleteTablet for tablet db750fc9641f492494fdb167de86f6df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.448204 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d05c86bca9343a2bc8c5709e1c49647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.448308 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 08db2c1398b946c180d81b88504c1d9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.448446 761 tablet_service.cc:1558] Processing DeleteTablet for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.448132 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 40bdb01a15254c329d82f0d40919b880 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:19.446173 461 rpcz_store.cc:269] 0616 19:52:18.664002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.667418 (+ 3416us) service_pool.cc:224] Handling call
0616 19:52:19.446066 (+778648us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:18.963032 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:18.963130 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:18.963134 (+ 4us) write_op.cc:435] Acquired schema lock
0616 19:52:18.963136 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:18.963228 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:18.963253 (+ 25us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:18.963258 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0616 19:52:18.963319 (+ 61us) tablet.cc:701] Row locks acquired
0616 19:52:18.963321 (+ 2us) write_op.cc:260] PREPARE: finished
0616 19:52:18.963353 (+ 32us) write_op.cc:270] Start()
0616 19:52:18.963385 (+ 32us) write_op.cc:276] Timestamp: P: 1781639538963310 usec, L: 0
0616 19:52:18.963388 (+ 3us) op_driver.cc:348] REPLICATION: starting
0616 19:52:18.963557 (+ 169us) log.cc:844] Serialized 533 byte log entry
0616 19:52:18.966706 (+ 3149us) op_driver.cc:464] REPLICATION: finished
0616 19:52:18.966955 (+ 249us) write_op.cc:301] APPLY: starting
0616 19:52:18.966972 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:18.967014 (+ 42us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:18.967045 (+ 31us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:18.967109 (+ 64us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:18.967150 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0616 19:52:18.967161 (+ 11us) write_op.cc:312] APPLY: finished
0616 19:52:18.967265 (+ 104us) log.cc:844] Serialized 23 byte log entry
0616 19:52:18.967328 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:18.967348 (+ 20us) write_op.cc:454] Released schema lock
0616 19:52:18.967356 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:18.998756 (+ 31400us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:18.998763 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":193,"apply.run_cpu_time_us":465,"apply.run_wall_time_us":465,"num_ops":1,"prepare.queue_time_us":198332,"prepare.run_cpu_time_us":690,"prepare.run_wall_time_us":35712,"raft.queue_time_us":85,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":877,"replication_time_us":3284}]]}
I20260616 19:52:19.449074 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4d803ac85364461abea82543951e59e2" } new_table_name: "default.Table_ddaf7a16b2a64e1187acd63181b8ec90" modify_external_catalogs: true
I20260616 19:52:19.449152 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_22869952175a4723a7ea94a9237354d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:19.449537 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22869952175a4723a7ea94a9237354d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:19.450042 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9b0f947c2cb64fbd89900c3decc44c56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:19.450395 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b0f947c2cb64fbd89900c3decc44c56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:19.452324 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_1a8cf36c967745d685873eaa02896d04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:19.452678 2938 leader_election.cc:290] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:19.452836 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a8cf36c967745d685873eaa02896d04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:19.453985 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc9d2ca8a644f69e0bc3e9ccecc3cf" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:19.454275 1054 raft_consensus.cc:2393] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:19.456579 2937 raft_consensus.cc:493] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.456640 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc9d2ca8a644f69e0bc3e9ccecc3cf" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.456750 2937 raft_consensus.cc:515] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.457330 2937 leader_election.cc:290] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:19.457592 860 leader_election.cc:304] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:19.457793 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bc7409e31043bd9f47d3628278a2fa" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:19.458258 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bc7409e31043bd9f47d3628278a2fa" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.459959 860 leader_election.cc:304] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:19.461035 719 leader_election.cc:304] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:19.461485 2843 raft_consensus.cc:3060] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.464201 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 78cef79e6b324df7943e6f499516c5d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.464294 2843 raft_consensus.cc:2749] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.464511 893 tablet_service.cc:1558] Processing DeleteTablet for tablet db750fc9641f492494fdb167de86f6df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:07 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.464788 896 tablet_service.cc:1558] Processing DeleteTablet for tablet efd5fecc6d444e5fba9103287c09542e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.465129 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 335f7411fda84fada762345010a4339c with delete_type TABLET_DATA_DELETED (replaced by tablet 2171eb55560f44dd91ad52e0b5b49408) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.467171 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2d3af2b449be4a3e86c6f58dfda03e6d" } new_table_name: "default.Table_ae7722a848474c1abb434442bd4a59a5" modify_external_catalogs: true
I20260616 19:52:19.472612 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 17d5740c8bc14441a4f5d7c509791679
I20260616 19:52:19.473373 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 17d5740c8bc14441a4f5d7c509791679 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.474009 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1a7673e0f4cd433792d8ef02de3304ac" } modify_external_catalogs: true
I20260616 19:52:19.474155 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1a7673e0f4cd433792d8ef02de3304ac" } modify_external_catalogs: true
I20260616 19:52:19.475523 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 17d5740c8bc14441a4f5d7c509791679 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.475708 2938 raft_consensus.cc:3060] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.477147 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 964384a661834a6e9ffaa4724a0ee3be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:19.478886 2661 consensus_queue.cc:1048] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.480136 2662 raft_consensus.cc:2749] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.481458 2843 raft_consensus.cc:493] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.481670 2843 raft_consensus.cc:515] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.482424 892 tablet_service.cc:1558] Processing DeleteTablet for tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.482844 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc22cdaecf2c46b5b69e5dc4f8eb04fd" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:19.482991 2843 leader_election.cc:290] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.483022 923 raft_consensus.cc:2468] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:19.483443 718 leader_election.cc:304] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:19.483788 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_52ed654c2a7e47f588674617cd3a57a0" } modify_external_catalogs: true
I20260616 19:52:19.483884 2843 raft_consensus.cc:2804] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:19.483960 2843 raft_consensus.cc:493] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:19.484091 2843 raft_consensus.cc:3060] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.484081 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_52ed654c2a7e47f588674617cd3a57a0" } modify_external_catalogs: true
I20260616 19:52:19.486299 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1069) took 5894 ms. Trace:
I20260616 19:52:19.486389 1190 rpcz_store.cc:276] 0616 19:52:13.591620 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.598398 (+ 6778us) service_pool.cc:224] Handling call
0616 19:52:19.486176 (+5887778us) ts_tablet_manager.cc:1151] Deleting tablet 3d44aed473e44e2eaa0d166f164c9309
0616 19:52:19.486186 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.486283 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5887494}
W20260616 19:52:19.486752 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 3d44aed473e44e2eaa0d166f164c9309 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d44aed473e44e2eaa0d166f164c9309 already in progress: creating tablet
I20260616 19:52:19.488265 923 raft_consensus.cc:3060] T 90bc7409e31043bd9f47d3628278a2fa P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.490850 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 2141b6c7013648a4b716642ccb4eccd6 (table default.Table_5047c84664124989b931ee92afc5b463 [id=bc83d5c728054794b2c3cc0f9b90e202]). Expected version 1 got 0
I20260616 19:52:19.491101 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 29df38f273494a079bdc76a915d43dab (table default.Table_c2ce6e69bb9245d8846dc2de654d9ba8 [id=1449ff28bd8546908359606f7272846f]). Expected version 3 got 0
I20260616 19:52:19.491220 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 61132c1c9cd24b7d923f1d65ad04c340 (table default.Table_9eb13a45afad449a9bf9b25a0f5d4d1d [id=e8db7417fd294af4b160a434625e9fd0]). Expected version 2 got 0
I20260616 19:52:19.491389 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet b5587d5aa8584cf49ef3cb113a1b64ca (table default.Table_0f374c454bc04298ba16dc14edb7bc9e [id=1105333647e747a39fc06efbcc95fa0d]). Expected version 1 got 0
I20260616 19:52:19.491592 460 catalog_manager.cc:5696] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:19.491822 2661 consensus_queue.cc:1048] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.492066 460 catalog_manager.cc:5696] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:19.492394 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf (table default.Table_44aec49c206e4527939d533088c54ba6 [id=b7d5c502d76f428683cb0830f0819011]). Expected version 3 got 0
I20260616 19:52:19.496668 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1071) took 5898 ms. Trace:
I20260616 19:52:19.496757 1190 rpcz_store.cc:276] 0616 19:52:13.598204 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.598624 (+ 420us) service_pool.cc:224] Handling call
0616 19:52:19.496559 (+5897935us) ts_tablet_manager.cc:1151] Deleting tablet d1e3778611a24397a1a776be2cc76284
0616 19:52:19.496568 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.496653 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5897803}
I20260616 19:52:19.499075 2938 raft_consensus.cc:2749] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.499404 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1072) took 5893 ms. Trace:
I20260616 19:52:19.499469 1190 rpcz_store.cc:276] 0616 19:52:13.605974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.606026 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:19.499307 (+5893281us) ts_tablet_manager.cc:1151] Deleting tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c
0616 19:52:19.499316 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.499392 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5893118}
I20260616 19:52:19.499890 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1073) took 5889 ms. Trace:
I20260616 19:52:19.499961 1190 rpcz_store.cc:276] 0616 19:52:13.610845 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.610901 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:19.499806 (+5888905us) ts_tablet_manager.cc:1151] Deleting tablet 1d9d5b9b81694258accdb0d18ae094de
0616 19:52:19.499813 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.499878 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5888746}
I20260616 19:52:19.501232 2661 consensus_queue.cc:1048] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:19.497128 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet d1e3778611a24397a1a776be2cc76284 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1e3778611a24397a1a776be2cc76284 already in progress: creating tablet
W20260616 19:52:19.503515 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c already in progress: creating tablet
W20260616 19:52:19.503765 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 1d9d5b9b81694258accdb0d18ae094de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d9d5b9b81694258accdb0d18ae094de already in progress: creating tablet
I20260616 19:52:19.504213 460 catalog_manager.cc:5696] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:19.504675 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1075) took 5652 ms. Trace:
I20260616 19:52:19.504752 1190 rpcz_store.cc:276] 0616 19:52:13.852386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.853431 (+ 1045us) service_pool.cc:224] Handling call
0616 19:52:19.504571 (+5651140us) ts_tablet_manager.cc:1151] Deleting tablet a6565379687e4ddfb471b513939775be
0616 19:52:19.504581 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.504660 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5650968}
I20260616 19:52:19.504920 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 31db3862f78943519bcd9531c5530048 (table default.Table_8cda9a799036458f9543a8a8aac3ee5a [id=c72157c1e0f943e4af149e7f692209ee]). Expected version 1 got 0
W20260616 19:52:19.505112 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a6565379687e4ddfb471b513939775be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6565379687e4ddfb471b513939775be already in progress: creating tablet
I20260616 19:52:19.505205 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet dd52351082274a4aa12cac468d9a512d (table default.Table_3bee557dbc924f6b982089749d9abe7b [id=ae7663c7da4444f1a6ef328ba7bd3494]). Expected version 2 got 0
I20260616 19:52:19.505367 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 76c48e233d184487b7651e9cb105c2cc (table default.Table_8640034462d64b5d879d28e067fe1b14 [id=d24b6a6d28c949b2880a34bfa227c585]). Expected version 2 got 0
I20260616 19:52:19.505501 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1079) took 5547 ms. Trace:
I20260616 19:52:19.505569 1190 rpcz_store.cc:276] 0616 19:52:13.957923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.959937 (+ 2014us) service_pool.cc:224] Handling call
0616 19:52:19.505406 (+5545469us) ts_tablet_manager.cc:1151] Deleting tablet 1d5efc4005fa447091cbc9aa28ac3922
0616 19:52:19.505415 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.505487 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5545229}
I20260616 19:52:19.506124 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1080) took 5543 ms. Trace:
I20260616 19:52:19.506307 1190 rpcz_store.cc:276] 0616 19:52:13.962672 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.962731 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:19.506043 (+5543312us) ts_tablet_manager.cc:1151] Deleting tablet 296dd76b85b244769d9e4c51163a4e4a
0616 19:52:19.506052 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.506112 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5543144}
I20260616 19:52:19.506677 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1081) took 5527 ms. Trace:
I20260616 19:52:19.506737 1190 rpcz_store.cc:276] 0616 19:52:13.978826 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.978890 (+ 64us) service_pool.cc:224] Handling call
0616 19:52:19.506597 (+5527707us) ts_tablet_manager.cc:1151] Deleting tablet 265a37409d8e4b1bb8ea20e3970b5f69
0616 19:52:19.506605 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.506665 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5527526}
I20260616 19:52:19.507819 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1082) took 5514 ms. Trace:
I20260616 19:52:19.507880 1190 rpcz_store.cc:276] 0616 19:52:13.993436 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:13.993825 (+ 389us) service_pool.cc:224] Handling call
0616 19:52:19.507740 (+5513915us) ts_tablet_manager.cc:1151] Deleting tablet 96bf58d365a54c24b5131416d95d2b6a
0616 19:52:19.507746 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.507805 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5513738}
I20260616 19:52:19.508237 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1085) took 5469 ms. Trace:
I20260616 19:52:19.508296 1190 rpcz_store.cc:276] 0616 19:52:14.039058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.039452 (+ 394us) service_pool.cc:224] Handling call
0616 19:52:19.508146 (+5468694us) ts_tablet_manager.cc:1151] Deleting tablet ce0963f38738468eb1518deadb3f119d
0616 19:52:19.508154 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.508225 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5468486}
I20260616 19:52:19.508651 1190 tablet_replica.cc:333] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:19.508960 1196 tablet_bootstrap.cc:492] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:19.509101 1196 ts_tablet_manager.cc:1403] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.082s user 0.008s sys 0.002s
I20260616 19:52:19.509810 1196 raft_consensus.cc:359] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.509948 1196 raft_consensus.cc:385] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.509986 1196 raft_consensus.cc:740] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.510154 1196 consensus_queue.cc:260] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.510468 1196 ts_tablet_manager.cc:1434] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260616 19:52:19.510728 1196 tablet_bootstrap.cc:492] T 8b7e2d8c25b8464b94ca386566abc2cc P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:19.510913 1190 raft_consensus.cc:2243] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.511044 1190 raft_consensus.cc:2272] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:19.505915 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 1d5efc4005fa447091cbc9aa28ac3922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d5efc4005fa447091cbc9aa28ac3922 already in progress: creating tablet
W20260616 19:52:19.511296 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 296dd76b85b244769d9e4c51163a4e4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 296dd76b85b244769d9e4c51163a4e4a already in progress: creating tablet
W20260616 19:52:19.511479 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 265a37409d8e4b1bb8ea20e3970b5f69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 265a37409d8e4b1bb8ea20e3970b5f69 already in progress: creating tablet
I20260616 19:52:19.511575 1190 ts_tablet_manager.cc:1916] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:19.511647 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 96bf58d365a54c24b5131416d95d2b6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96bf58d365a54c24b5131416d95d2b6a already in progress: creating tablet
W20260616 19:52:19.511821 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet ce0963f38738468eb1518deadb3f119d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce0963f38738468eb1518deadb3f119d already in progress: creating tablet
I20260616 19:52:19.512094 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet a95c684f5fe54f7dad6300efb0c18780 (table default.Table_57baa761ff0f4e189d6b46fada3d0d9f [id=02d0cb31737b4289988e982dd24ae298]). Expected version 1 got 0
I20260616 19:52:19.512364 1196 tablet_bootstrap.cc:654] T 8b7e2d8c25b8464b94ca386566abc2cc P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.512326 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 41f2d259a31c4f4eaeceaba57fb978b2 (table default.Table_7ffffaef50044d8ba89e6df198946113 [id=d49c093f51b04c2fa1b1f5daadd802cf]). Expected version 3 got 0
I20260616 19:52:19.520141 2843 raft_consensus.cc:515] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.523264 2843 leader_election.cc:290] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.523373 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc22cdaecf2c46b5b69e5dc4f8eb04fd" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:19.523532 917 raft_consensus.cc:3060] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.526470 917 raft_consensus.cc:2468] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:19.526894 718 leader_election.cc:304] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:19.527218 2843 raft_consensus.cc:2804] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:19.527873 2843 raft_consensus.cc:697] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:19.528112 2843 consensus_queue.cc:237] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.541401 1198 tablet_bootstrap.cc:492] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:19.541590 1198 ts_tablet_manager.cc:1403] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.217s user 0.010s sys 0.025s
I20260616 19:52:19.542286 1192 tablet_bootstrap.cc:492] T c1203a4e952a42369d5c03ff4a4c59ec P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:19.542405 1192 ts_tablet_manager.cc:1403] T c1203a4e952a42369d5c03ff4a4c59ec P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.179s user 0.006s sys 0.006s
I20260616 19:52:19.543073 1192 raft_consensus.cc:359] T c1203a4e952a42369d5c03ff4a4c59ec P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.543236 1192 raft_consensus.cc:385] T c1203a4e952a42369d5c03ff4a4c59ec P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.543289 1192 raft_consensus.cc:740] T c1203a4e952a42369d5c03ff4a4c59ec P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.543460 1192 consensus_queue.cc:260] T c1203a4e952a42369d5c03ff4a4c59ec P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.543910 1192 ts_tablet_manager.cc:1434] T c1203a4e952a42369d5c03ff4a4c59ec P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260616 19:52:19.544147 1192 tablet_bootstrap.cc:492] T 76c48e233d184487b7651e9cb105c2cc P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:19.545449 1192 tablet_bootstrap.cc:654] T 76c48e233d184487b7651e9cb105c2cc P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.547230 1198 raft_consensus.cc:359] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.547461 1198 raft_consensus.cc:385] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.547551 1198 raft_consensus.cc:740] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.547781 1198 consensus_queue.cc:260] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.548259 1198 ts_tablet_manager.cc:1434] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260616 19:52:19.549256 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac675d72e0614ebaaf6b477e22691dc4 consensus state has no leader
I20260616 19:52:19.550158 458 master_service.cc:960] ReplaceTablet: received request to replace tablet 7de044cb57e941ab9471ffe3bd7eeccb from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:19.551403 1198 tablet_bootstrap.cc:492] T 8c19c2e43a944893b86982bee1eb2f30 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:19.553319 1198 tablet_bootstrap.cc:654] T 8c19c2e43a944893b86982bee1eb2f30 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.556700 1196 tablet_bootstrap.cc:492] T 8b7e2d8c25b8464b94ca386566abc2cc P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:19.556903 1196 ts_tablet_manager.cc:1403] T 8b7e2d8c25b8464b94ca386566abc2cc P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.046s user 0.011s sys 0.000s
I20260616 19:52:19.557643 1196 raft_consensus.cc:359] T 8b7e2d8c25b8464b94ca386566abc2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.557876 1196 raft_consensus.cc:385] T 8b7e2d8c25b8464b94ca386566abc2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.557986 1196 raft_consensus.cc:740] T 8b7e2d8c25b8464b94ca386566abc2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.558276 1196 consensus_queue.cc:260] T 8b7e2d8c25b8464b94ca386566abc2cc P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.558836 1196 ts_tablet_manager.cc:1434] T 8b7e2d8c25b8464b94ca386566abc2cc P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:19.561734 1196 tablet_bootstrap.cc:492] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:19.563356 1196 tablet_bootstrap.cc:654] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.566979 2937 raft_consensus.cc:493] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.567174 2937 raft_consensus.cc:515] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.567652 1192 tablet_bootstrap.cc:492] T 76c48e233d184487b7651e9cb105c2cc P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:19.567770 1192 ts_tablet_manager.cc:1403] T 76c48e233d184487b7651e9cb105c2cc P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260616 19:52:19.568358 1192 raft_consensus.cc:359] T 76c48e233d184487b7651e9cb105c2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.568526 1192 raft_consensus.cc:385] T 76c48e233d184487b7651e9cb105c2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.568583 1192 raft_consensus.cc:740] T 76c48e233d184487b7651e9cb105c2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.568686 2937 leader_election.cc:290] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:19.568806 1192 consensus_queue.cc:260] T 76c48e233d184487b7651e9cb105c2cc P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.569360 1192 ts_tablet_manager.cc:1434] T 76c48e233d184487b7651e9cb105c2cc P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:19.568244 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd5fecc6d444e5fba9103287c09542e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.569602 1192 tablet_bootstrap.cc:492] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:19.570914 1192 tablet_bootstrap.cc:654] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.560375 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 78cef79e6b324df7943e6f499516c5d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:19.573033 2937 consensus_queue.cc:1048] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.560648 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 17d5740c8bc14441a4f5d7c509791679 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:19.578475 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd5fecc6d444e5fba9103287c09542e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:19.578816 1054 raft_consensus.cc:2393] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:19.579324 858 leader_election.cc:304] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:19.579646 2937 raft_consensus.cc:3060] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:19.561030 996 leader_election.cc:343] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.580103 996 leader_election.cc:304] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:19.580554 2864 raft_consensus.cc:2749] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.582193 2937 raft_consensus.cc:2749] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.581466 1192 tablet_bootstrap.cc:492] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:19.585119 1192 ts_tablet_manager.cc:1403] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.003s
I20260616 19:52:19.585805 1192 raft_consensus.cc:359] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.585973 1192 raft_consensus.cc:385] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.586030 1192 raft_consensus.cc:740] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.588622 1192 consensus_queue.cc:260] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.589816 1192 ts_tablet_manager.cc:1434] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:52:19.590108 1192 tablet_bootstrap.cc:492] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:19.598603 1192 tablet_bootstrap.cc:654] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.600167 2662 consensus_queue.cc:1048] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.608505 1196 tablet_bootstrap.cc:492] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:19.608688 1196 ts_tablet_manager.cc:1403] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.000s
I20260616 19:52:19.609464 1196 raft_consensus.cc:359] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.609664 1196 raft_consensus.cc:385] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.609766 1196 raft_consensus.cc:740] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.609994 1196 consensus_queue.cc:260] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.610827 1196 ts_tablet_manager.cc:1434] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:19.611331 1196 tablet_bootstrap.cc:492] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:19.613049 1196 tablet_bootstrap.cc:654] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.630700 2937 raft_consensus.cc:493] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.630903 2937 raft_consensus.cc:515] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.631682 2937 leader_election.cc:290] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:19.632025 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cfe9357976fa469aa84822173ab350d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:19.632339 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda5bcb16cf4b48bc1ca87d0a3a48d7" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:19.632650 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfe9357976fa469aa84822173ab350d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:19.633033 860 leader_election.cc:343] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:19.640841 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 79808.7us
I20260616 19:52:19.658440 1190 ts_tablet_manager.cc:1929] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:19.658574 1190 log.cc:1199] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/90205213ba5f49a2931e68839cefb2d2
I20260616 19:52:19.658872 1190 ts_tablet_manager.cc:1950] T 90205213ba5f49a2931e68839cefb2d2 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:19.659180 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1087) took 5599 ms. Trace:
I20260616 19:52:19.659335 1190 rpcz_store.cc:276] 0616 19:52:14.059260 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.064654 (+ 5394us) service_pool.cc:224] Handling call
0616 19:52:19.508612 (+5443958us) ts_tablet_manager.cc:1151] Deleting tablet 90205213ba5f49a2931e68839cefb2d2
0616 19:52:19.508620 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.654114 (+145494us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.658383 (+ 4269us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.659167 (+ 784us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2093,"tablet-delete.queue_time_us":5443748}
I20260616 19:52:19.659832 1190 tablet_replica.cc:333] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:19.660076 1190 raft_consensus.cc:2243] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.660261 1190 raft_consensus.cc:2272] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.661098 1190 ts_tablet_manager.cc:1916] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.661092 2959 raft_consensus.cc:493] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.661295 2959 raft_consensus.cc:515] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.661981 2959 leader_election.cc:290] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:19.664191 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 48801.3us
I20260616 19:52:19.665148 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6dc34b00414a0d94b01f579994eb4c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:19.665164 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda5bcb16cf4b48bc1ca87d0a3a48d7" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:19.665333 1052 raft_consensus.cc:2468] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
W20260616 19:52:19.667212 993 leader_election.cc:343] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.667568 858 leader_election.cc:304] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:19.667798 2937 raft_consensus.cc:2804] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:19.667874 2937 raft_consensus.cc:493] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:19.667946 2937 raft_consensus.cc:3060] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.670496 2937 raft_consensus.cc:515] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:19.670601 445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:43055, user_credentials={real_user=slave}} blocked reactor thread for 121727us
I20260616 19:52:19.670884 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 90205213ba5f49a2931e68839cefb2d2 (table default.Table_3fde6faf0f8549f69328d3129ad9f367 [id=e43abc84d7e146e591d10768c8f146e1]) successfully deleted
I20260616 19:52:19.671729 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda5bcb16cf4b48bc1ca87d0a3a48d7" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:19.673240 860 leader_election.cc:343] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.673435 2937 leader_election.cc:290] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
W20260616 19:52:19.677378 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f64cb61035034692b89c0673a1d73a63 has no consensus state
I20260616 19:52:19.677459 1191 ts_tablet_manager.cc:1929] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.677573 1191 log.cc:1199] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/2f1e12555be64192860eab59b3aeb562
I20260616 19:52:19.677675 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c7617de287ff4770bb063b7ee633a61a" } new_table_name: "default.Table_385331b90796460d860c4dca1d37ebdf" modify_external_catalogs: true
I20260616 19:52:19.677944 1191 ts_tablet_manager.cc:1950] T 2f1e12555be64192860eab59b3aeb562 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:19.678418 2864 raft_consensus.cc:493] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.678645 2864 raft_consensus.cc:515] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.679628 2864 leader_election.cc:290] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.681192 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda5bcb16cf4b48bc1ca87d0a3a48d7" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:19.681305 1198 tablet_bootstrap.cc:492] T 8c19c2e43a944893b86982bee1eb2f30 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:19.681377 1052 raft_consensus.cc:3060] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.681412 1198 ts_tablet_manager.cc:1403] T 8c19c2e43a944893b86982bee1eb2f30 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.130s user 0.006s sys 0.012s
I20260616 19:52:19.682157 1198 raft_consensus.cc:359] T 8c19c2e43a944893b86982bee1eb2f30 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.682278 1198 raft_consensus.cc:385] T 8c19c2e43a944893b86982bee1eb2f30 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.682318 1198 raft_consensus.cc:740] T 8c19c2e43a944893b86982bee1eb2f30 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.682477 1198 consensus_queue.cc:260] T 8c19c2e43a944893b86982bee1eb2f30 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.682886 1198 ts_tablet_manager.cc:1434] T 8c19c2e43a944893b86982bee1eb2f30 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260616 19:52:19.683127 1198 tablet_bootstrap.cc:492] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:19.683825 1052 raft_consensus.cc:2468] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:19.686033 2843 raft_consensus.cc:493] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.686192 2843 raft_consensus.cc:515] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.686792 2843 leader_election.cc:290] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.687355 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03e6a2614564eeeb8ec382b16f0ece1" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:19.687731 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd52351082274a4aa12cac468d9a512d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:19.688220 718 leader_election.cc:343] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.688927 1198 tablet_bootstrap.cc:654] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:19.689468 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b404671bc58045538f2c27b3d2c01478 consensus state has no leader
I20260616 19:52:19.690033 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f851c41915c44cdea7cd46da2ad886ea
I20260616 19:52:19.689477 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1d98a5dc581f4594a832f6390837cd57
I20260616 19:52:19.692345 892 tablet_service.cc:1558] Processing DeleteTablet for tablet f851c41915c44cdea7cd46da2ad886ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:19 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.692530 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d98a5dc581f4594a832f6390837cd57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:19 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.694836 858 leader_election.cc:304] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:19.695472 2937 raft_consensus.cc:2804] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:19.695454 754 tablet_service.cc:1558] Processing DeleteTablet for tablet f851c41915c44cdea7cd46da2ad886ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:19 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.695596 2937 raft_consensus.cc:697] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:19.695828 2937 consensus_queue.cc:237] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.695914 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d98a5dc581f4594a832f6390837cd57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:19 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.703244 1198 tablet_bootstrap.cc:492] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:19.704615 1198 ts_tablet_manager.cc:1403] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260616 19:52:19.705585 1198 raft_consensus.cc:359] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.705789 1198 raft_consensus.cc:385] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.705850 1198 raft_consensus.cc:740] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.706091 1198 consensus_queue.cc:260] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.707490 1198 ts_tablet_manager.cc:1434] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:19.708189 918 raft_consensus.cc:3060] T c1203a4e952a42369d5c03ff4a4c59ec P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.708508 1198 tablet_bootstrap.cc:492] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:19.710026 1198 tablet_bootstrap.cc:654] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:19.711180 993 leader_election.cc:343] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.711849 2843 consensus_queue.cc:1048] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.714598 1193 ts_tablet_manager.cc:1929] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.714705 1193 log.cc:1199] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/1d825bcf365f424fb99a10afe3e96501
I20260616 19:52:19.715497 1193 ts_tablet_manager.cc:1950] T 1d825bcf365f424fb99a10afe3e96501 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:19.716452 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1215) took 2677 ms. Trace:
I20260616 19:52:19.716562 1193 rpcz_store.cc:276] 0616 19:52:17.039129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.047248 (+ 8119us) service_pool.cc:224] Handling call
0616 19:52:19.344597 (+2297349us) ts_tablet_manager.cc:1151] Deleting tablet 1d825bcf365f424fb99a10afe3e96501
0616 19:52:19.344636 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.536015 (+191379us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.714537 (+178522us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.716430 (+ 1893us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2297163}
I20260616 19:52:19.717026 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 1d825bcf365f424fb99a10afe3e96501 (table default.Table_b6f1fb47223d447fb0c0eed0f8b52102 [id=d3197da9180e47e18f4e1573504ae8c7]) successfully deleted
I20260616 19:52:19.717121 1193 tablet_replica.cc:333] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:19.717283 1193 raft_consensus.cc:2243] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:19.717530 1193 pending_rounds.cc:70] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767: Trying to abort 1 pending ops.
I20260616 19:52:19.717581 1193 pending_rounds.cc:77] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297595542208987136 op_type: NO_OP noop_request { }
I20260616 19:52:19.717666 1193 raft_consensus.cc:2889] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260616 19:52:19.717746 1193 raft_consensus.cc:2272] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.718233 1193 ts_tablet_manager.cc:1916] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.720256 1192 tablet_bootstrap.cc:492] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:19.720456 1192 ts_tablet_manager.cc:1403] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.130s user 0.008s sys 0.008s
I20260616 19:52:19.721676 1192 raft_consensus.cc:359] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.721900 1192 raft_consensus.cc:385] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.721973 1192 raft_consensus.cc:740] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.722215 1192 consensus_queue.cc:260] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.722728 1192 ts_tablet_manager.cc:1434] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:19.722996 1192 tablet_bootstrap.cc:492] T 61132c1c9cd24b7d923f1d65ad04c340 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:19.724418 1192 tablet_bootstrap.cc:654] T 61132c1c9cd24b7d923f1d65ad04c340 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:19.726974 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 85779.5us
I20260616 19:52:19.729668 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6dc34b00414a0d94b01f579994eb4c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.730729 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03e6a2614564eeeb8ec382b16f0ece1" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.730895 2959 consensus_queue.cc:1048] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.732293 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc22cdaecf2c46b5b69e5dc4f8eb04fd" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:19.732762 1052 raft_consensus.cc:2468] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:19.735004 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc22cdaecf2c46b5b69e5dc4f8eb04fd" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:19.735180 1052 raft_consensus.cc:3060] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.737030 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1122) took 5224 ms. Trace:
I20260616 19:52:19.737126 1191 rpcz_store.cc:276] 0616 19:52:14.512834 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.513087 (+ 253us) service_pool.cc:224] Handling call
0616 19:52:19.293168 (+4780081us) ts_tablet_manager.cc:1151] Deleting tablet 2f1e12555be64192860eab59b3aeb562
0616 19:52:19.293183 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.549761 (+256578us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.677394 (+127633us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.737006 (+ 59612us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4779770}
I20260616 19:52:19.737475 1191 tablet_replica.cc:333] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:19.737684 1191 raft_consensus.cc:2243] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.737816 1191 raft_consensus.cc:2272] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.738353 1191 ts_tablet_manager.cc:1916] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.739781 1052 raft_consensus.cc:2468] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:19.742805 2959 consensus_queue.cc:1048] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.756872 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd52351082274a4aa12cac468d9a512d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:19.757090 1052 raft_consensus.cc:2468] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:19.765720 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet f851c41915c44cdea7cd46da2ad886ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:19 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:19.765899 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d98a5dc581f4594a832f6390837cd57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:19 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:19.767916 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 2f1e12555be64192860eab59b3aeb562 (table default.Table_3f1ead1791b844acbe29bd0f9c9e6488 [id=91826dbfc6aa417cba9e7f3cc5fb8dba]) successfully deleted
I20260616 19:52:19.770881 2959 consensus_queue.cc:1048] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.771809 2959 consensus_queue.cc:1048] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:19.772895 996 leader_election.cc:343] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.773088 996 leader_election.cc:304] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:19.767748 2843 consensus_queue.cc:1048] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260616 19:52:19.773411 2960 raft_consensus.cc:2749] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.770229 2745 consensus_queue.cc:1048] T c1203a4e952a42369d5c03ff4a4c59ec P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260616 19:52:19.773782 996 leader_election.cc:343] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.773912 996 leader_election.cc:304] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:19.760679 1193 ts_tablet_manager.cc:1929] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.774175 1193 log.cc:1199] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/e896d5aa87f14e5593d01085bb6d434f
I20260616 19:52:19.774273 2960 raft_consensus.cc:2749] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:19.770411 719 leader_election.cc:304] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:19.776542 2745 raft_consensus.cc:2804] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:19.776613 2745 raft_consensus.cc:493] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:19.776677 2745 raft_consensus.cc:3060] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.779052 2745 raft_consensus.cc:515] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.779609 2745 leader_election.cc:290] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.780732 2845 consensus_queue.cc:1048] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.781582 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd52351082274a4aa12cac468d9a512d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:19.781987 718 leader_election.cc:343] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.774756 1193 ts_tablet_manager.cc:1950] T e896d5aa87f14e5593d01085bb6d434f P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:19.783677 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1216) took 2744 ms. Trace:
I20260616 19:52:19.787806 1193 rpcz_store.cc:276] 0616 19:52:17.039624 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.054157 (+ 14533us) service_pool.cc:224] Handling call
0616 19:52:19.717076 (+2662919us) ts_tablet_manager.cc:1151] Deleting tablet e896d5aa87f14e5593d01085bb6d434f
0616 19:52:19.717085 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.751570 (+ 34485us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.760618 (+ 9048us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.783660 (+ 23042us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2662699}
I20260616 19:52:19.788985 1193 tablet_replica.cc:333] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:19.788992 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet e896d5aa87f14e5593d01085bb6d434f (table default.Table_8f195aaf0b9c47169f6c04a5e380bd22 [id=a2abe0bca3fa4d35b86a23f91f6973b4]) successfully deleted
I20260616 19:52:19.789781 1193 raft_consensus.cc:2243] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:19.790481 1192 tablet_bootstrap.cc:492] T 61132c1c9cd24b7d923f1d65ad04c340 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:19.791287 1198 tablet_bootstrap.cc:492] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:19.791456 1198 ts_tablet_manager.cc:1403] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.083s user 0.007s sys 0.004s
I20260616 19:52:19.794412 1193 raft_consensus.cc:2272] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.795442 1193 ts_tablet_manager.cc:1916] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.795428 2959 consensus_queue.cc:1048] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.796371 1192 ts_tablet_manager.cc:1403] T 61132c1c9cd24b7d923f1d65ad04c340 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.073s user 0.004s sys 0.007s
I20260616 19:52:19.795810 1198 raft_consensus.cc:359] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.797417 1198 raft_consensus.cc:385] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.798142 1192 raft_consensus.cc:359] T 61132c1c9cd24b7d923f1d65ad04c340 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.798668 1198 raft_consensus.cc:740] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.796099 1196 tablet_bootstrap.cc:492] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:19.798935 1196 ts_tablet_manager.cc:1403] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.188s user 0.016s sys 0.029s
I20260616 19:52:19.800132 1196 raft_consensus.cc:359] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.800349 1196 raft_consensus.cc:385] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.800483 1196 raft_consensus.cc:740] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.800833 1196 consensus_queue.cc:260] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.801610 1196 ts_tablet_manager.cc:1434] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:19.801923 1196 tablet_bootstrap.cc:492] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:19.803421 1196 tablet_bootstrap.cc:654] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:19.797583 757 consensus_meta.cc:287] T d7cb00d193774b679027abd23689d112 P 7245e7dab0ec474a876537be514c8767: Time spent flushing consensus metadata: real 0.691s user 0.022s sys 0.000s
I20260616 19:52:19.804682 1198 consensus_queue.cc:260] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.806221 1192 raft_consensus.cc:385] T 61132c1c9cd24b7d923f1d65ad04c340 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.806335 1192 raft_consensus.cc:740] T 61132c1c9cd24b7d923f1d65ad04c340 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.806574 1192 consensus_queue.cc:260] T 61132c1c9cd24b7d923f1d65ad04c340 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.807045 1198 ts_tablet_manager.cc:1434] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260616 19:52:19.807559 1198 tablet_bootstrap.cc:492] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:19.807608 2845 consensus_queue.cc:1048] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:19.809067 1192 ts_tablet_manager.cc:1434] T 61132c1c9cd24b7d923f1d65ad04c340 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260616 19:52:19.809372 1192 tablet_bootstrap.cc:492] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:19.810774 1192 tablet_bootstrap.cc:654] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.812336 1198 tablet_bootstrap.cc:654] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.812875 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd52351082274a4aa12cac468d9a512d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:19.813073 1054 raft_consensus.cc:3060] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.816097 1054 raft_consensus.cc:2468] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:19.834690 1193 ts_tablet_manager.cc:1929] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.843905 455 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 76c48e233d184487b7651e9cb105c2cc (table default.Table_8640034462d64b5d879d28e067fe1b14 [id=d24b6a6d28c949b2880a34bfa227c585]). Expected version 2 got 0
I20260616 19:52:19.844003 1191 ts_tablet_manager.cc:1929] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.844130 1191 log.cc:1199] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/0d8b9d6b95a74dbe97461b4bc9984fe3
I20260616 19:52:19.850622 898 tablet_service.cc:1558] Processing DeleteTablet for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:19.854029 1193 log.cc:1199] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/a817b1d4c7b640db8894bc801878caae
I20260616 19:52:19.854395 1193 ts_tablet_manager.cc:1950] T a817b1d4c7b640db8894bc801878caae P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:19.855077 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1217) took 2814 ms. Trace:
I20260616 19:52:19.855147 1193 rpcz_store.cc:276] 0616 19:52:17.040122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.058480 (+ 18358us) service_pool.cc:224] Handling call
0616 19:52:19.788938 (+2730458us) ts_tablet_manager.cc:1151] Deleting tablet a817b1d4c7b640db8894bc801878caae
0616 19:52:19.788947 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.803152 (+ 14205us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.834625 (+ 31473us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.855056 (+ 20431us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2730266}
I20260616 19:52:19.846060 1196 tablet_bootstrap.cc:492] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:19.852685 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 335f7411fda84fada762345010a4339c with delete_type TABLET_DATA_DELETED (replaced by tablet 2171eb55560f44dd91ad52e0b5b49408) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.853025 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d825bcf365f424fb99a10afe3e96501 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:19.855675 1196 ts_tablet_manager.cc:1403] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.004s
I20260616 19:52:19.856859 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet a817b1d4c7b640db8894bc801878caae (table default.Table_516f90bc9f17467796c1a387794b5568 [id=f212bb8d2d614707bc55ef08138d29d3]) successfully deleted
I20260616 19:52:19.856417 1196 raft_consensus.cc:359] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.859326 1196 raft_consensus.cc:385] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.859390 1196 raft_consensus.cc:740] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.859578 1196 consensus_queue.cc:260] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.861475 1193 tablet_replica.cc:333] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:19.861688 1193 raft_consensus.cc:2243] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.861845 1193 raft_consensus.cc:2272] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.862366 1193 ts_tablet_manager.cc:1916] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.863380 719 leader_election.cc:304] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:19.864333 2642 raft_consensus.cc:2804] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:19.864446 2642 raft_consensus.cc:697] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:19.864657 2642 consensus_queue.cc:237] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.872795 1198 tablet_bootstrap.cc:492] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:19.875125 1196 ts_tablet_manager.cc:1434] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260616 19:52:19.875509 1191 ts_tablet_manager.cc:1950] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:19.875533 1198 ts_tablet_manager.cc:1403] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.065s user 0.003s sys 0.000s
I20260616 19:52:19.876992 1198 raft_consensus.cc:359] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.877898 1198 raft_consensus.cc:385] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.878036 1198 raft_consensus.cc:740] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.878371 1198 consensus_queue.cc:260] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.880264 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1123) took 5272 ms. Trace:
I20260616 19:52:19.880345 2845 raft_consensus.cc:493] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.880374 1191 rpcz_store.cc:276] 0616 19:52:14.607310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.624206 (+ 16896us) service_pool.cc:224] Handling call
0616 19:52:19.737423 (+5113217us) ts_tablet_manager.cc:1151] Deleting tablet 0d8b9d6b95a74dbe97461b4bc9984fe3
0616 19:52:19.737435 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.840445 (+103010us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.843933 (+ 3488us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.880220 (+ 36287us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5112945}
I20260616 19:52:19.880519 2845 raft_consensus.cc:515] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.880817 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1124) took 5224 ms. Trace:
I20260616 19:52:19.880935 1191 rpcz_store.cc:276] 0616 19:52:14.656558 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.657689 (+ 1131us) service_pool.cc:224] Handling call
0616 19:52:19.880670 (+5222981us) ts_tablet_manager.cc:1151] Deleting tablet 76a89e7686aa44df9bb017816d1accb1
0616 19:52:19.880682 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.880782 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5222738}
I20260616 19:52:19.881187 2845 leader_election.cc:290] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.881259 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1125) took 5191 ms. Trace:
I20260616 19:52:19.881366 1191 rpcz_store.cc:276] 0616 19:52:14.690068 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.692639 (+ 2571us) service_pool.cc:224] Handling call
0616 19:52:19.881144 (+5188505us) ts_tablet_manager.cc:1151] Deleting tablet e88de49e07a4467d9698d71c321c16f5
0616 19:52:19.881152 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.881225 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5188306}
I20260616 19:52:19.881688 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1126) took 5150 ms. Trace:
I20260616 19:52:19.881796 1191 rpcz_store.cc:276] 0616 19:52:14.731685 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.733140 (+ 1455us) service_pool.cc:224] Handling call
0616 19:52:19.881571 (+5148431us) ts_tablet_manager.cc:1151] Deleting tablet cd19e83413ad420e97af92ca609757e5
0616 19:52:19.881579 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.881649 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5148239}
I20260616 19:52:19.882117 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1127) took 5088 ms. Trace:
I20260616 19:52:19.882226 1191 rpcz_store.cc:276] 0616 19:52:14.793865 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.793914 (+ 49us) service_pool.cc:224] Handling call
0616 19:52:19.881997 (+5088083us) ts_tablet_manager.cc:1151] Deleting tablet 8f67e5add64244629cbe8694223bd00e
0616 19:52:19.882007 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.882087 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5087931}
I20260616 19:52:19.882383 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61132c1c9cd24b7d923f1d65ad04c340" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:19.882526 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1128) took 4876 ms. Trace:
I20260616 19:52:19.882553 918 raft_consensus.cc:2468] T 61132c1c9cd24b7d923f1d65ad04c340 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:19.882622 1191 rpcz_store.cc:276] 0616 19:52:15.005573 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.005633 (+ 60us) service_pool.cc:224] Handling call
0616 19:52:19.882422 (+4876789us) ts_tablet_manager.cc:1151] Deleting tablet f5c46a428ff44d26a5c49322087cdf7a
0616 19:52:19.882430 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.882495 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4876602}
I20260616 19:52:19.882952 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1129) took 4457 ms. Trace:
I20260616 19:52:19.883054 718 leader_election.cc:304] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:19.883050 1191 rpcz_store.cc:276] 0616 19:52:15.425613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.426220 (+ 607us) service_pool.cc:224] Handling call
0616 19:52:19.882822 (+4456602us) ts_tablet_manager.cc:1151] Deleting tablet 8a718fefe07141119b7ef7edcbf61123
0616 19:52:19.882832 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.882918 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4456411}
I20260616 19:52:19.883301 1191 tablet_replica.cc:333] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:19.883530 1191 raft_consensus.cc:2243] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.883630 2845 raft_consensus.cc:2804] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:19.883697 2845 raft_consensus.cc:493] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:19.883697 1191 raft_consensus.cc:2272] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.883759 2845 raft_consensus.cc:3060] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.884270 1191 ts_tablet_manager.cc:1916] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.886504 2845 raft_consensus.cc:515] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.887013 2845 leader_election.cc:290] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.888410 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61132c1c9cd24b7d923f1d65ad04c340" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:19.888581 918 raft_consensus.cc:3060] T 61132c1c9cd24b7d923f1d65ad04c340 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:19.889868 860 consensus_peers.cc:597] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6f309caaa9042f99432a61fd2ebb089. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:19.879017 1198 ts_tablet_manager.cc:1434] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260616 19:52:19.890759 1198 tablet_bootstrap.cc:492] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:19.895216 918 raft_consensus.cc:2468] T 61132c1c9cd24b7d923f1d65ad04c340 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:19.900252 718 leader_election.cc:304] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:19.901536 1198 tablet_bootstrap.cc:654] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.902328 2642 raft_consensus.cc:2804] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:19.902442 2642 raft_consensus.cc:697] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:19.902663 2642 consensus_queue.cc:237] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.904680 881 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:48628 (request call id 239) took 1002 ms. Trace:
I20260616 19:52:19.904771 881 rpcz_store.cc:276] 0616 19:52:18.902361 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.902417 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:19.904657 (+1002240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260616 19:52:19.907333 2937 raft_consensus.cc:493] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:19.907457 2937 raft_consensus.cc:515] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.907984 2937 leader_election.cc:290] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:19.908931 918 raft_consensus.cc:1275] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Refusing update from remote peer 7245e7dab0ec474a876537be514c8767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:52:19.909685 2985 consensus_queue.cc:1048] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:19.912948 860 leader_election.cc:343] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 647b1abeb3c14b11b9a5c62b67e83cf8
I20260616 19:52:19.917346 1196 tablet_bootstrap.cc:492] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:19.919553 1196 tablet_bootstrap.cc:654] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:19.922746 858 leader_election.cc:343] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 647b1abeb3c14b11b9a5c62b67e83cf8
I20260616 19:52:19.923462 1190 ts_tablet_manager.cc:1929] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.923475 858 leader_election.cc:304] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:19.924883 2937 raft_consensus.cc:2749] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:19.926400 1190 log.cc:1199] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/8a718fefe07141119b7ef7edcbf61123
I20260616 19:52:19.927815 1190 ts_tablet_manager.cc:1950] T 8a718fefe07141119b7ef7edcbf61123 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:19.930148 1198 tablet_bootstrap.cc:492] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:19.930341 1198 ts_tablet_manager.cc:1403] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260616 19:52:19.935472 1192 tablet_bootstrap.cc:492] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:19.935781 1192 ts_tablet_manager.cc:1403] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.126s user 0.003s sys 0.003s
I20260616 19:52:19.936930 1192 raft_consensus.cc:359] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.937316 1192 raft_consensus.cc:385] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.937440 1192 raft_consensus.cc:740] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.937721 1192 consensus_queue.cc:260] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.938412 1192 ts_tablet_manager.cc:1434] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:19.938898 1192 tablet_bootstrap.cc:492] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:19.939255 1191 ts_tablet_manager.cc:1929] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.939966 1191 log.cc:1199] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/5c74b39e66d344b99f8fc75b855c0520
I20260616 19:52:19.940387 1191 ts_tablet_manager.cc:1950] T 5c74b39e66d344b99f8fc75b855c0520 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:19.940990 1198 raft_consensus.cc:359] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.941636 1192 tablet_bootstrap.cc:654] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.942041 1196 tablet_bootstrap.cc:492] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:19.941182 1198 raft_consensus.cc:385] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.942253 1198 raft_consensus.cc:740] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.942510 1198 consensus_queue.cc:260] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.942919 1196 ts_tablet_manager.cc:1403] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.000s
I20260616 19:52:19.943526 1198 ts_tablet_manager.cc:1434] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260616 19:52:19.944831 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_4caa0f5a7db1472db6b0c1f053454557" } new_table_name: "default.Table_fb9ee5a7f0ff47f28e6c1c408b7cf236" modify_external_catalogs: true
I20260616 19:52:19.945626 1198 tablet_bootstrap.cc:492] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:19.946309 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8345aacaa215426e86af44475fc967ee" } modify_external_catalogs: true
I20260616 19:52:19.946442 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8345aacaa215426e86af44475fc967ee" } modify_external_catalogs: true
I20260616 19:52:19.946913 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0da36efbb8ce483d944db33901a29766"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:19.947402 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0da36efbb8ce483d944db33901a29766 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:19.948212 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f7d0ca5e4788407381cd7ad2a4ed9561"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:19.948901 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7d0ca5e4788407381cd7ad2a4ed9561 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:19.952080 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bc56a536b4ae4a45a371edc40efa390e" } modify_external_catalogs: true
I20260616 19:52:19.952234 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bc56a536b4ae4a45a371edc40efa390e" } modify_external_catalogs: true
I20260616 19:52:19.952736 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5d6fdacece394c618e52a026584d5018"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:19.953439 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d6fdacece394c618e52a026584d5018 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:19.953533 2991 tablet.cc:1724] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:19.955633 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c8e40b7e46144c01b81b302e91eee634"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:19.956061 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8e40b7e46144c01b81b302e91eee634 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:19.957743 2745 raft_consensus.cc:493] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.957871 2745 raft_consensus.cc:515] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.959277 1193 ts_tablet_manager.cc:1929] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:19.959267 2679 raft_consensus.cc:493] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.959481 2679 raft_consensus.cc:515] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.959568 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c48e233d184487b7651e9cb105c2cc" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:19.959736 921 raft_consensus.cc:2468] T 76c48e233d184487b7651e9cb105c2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:19.960134 2679 leader_election.cc:290] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:19.960136 718 leader_election.cc:304] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:19.961450 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7e2d8c25b8464b94ca386566abc2cc" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:19.961648 1052 raft_consensus.cc:2468] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:19.962182 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7e2d8c25b8464b94ca386566abc2cc" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:19.962338 775 raft_consensus.cc:2468] T 8b7e2d8c25b8464b94ca386566abc2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:19.962347 858 leader_election.cc:304] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:19.962625 2985 raft_consensus.cc:2804] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:19.962703 2985 raft_consensus.cc:493] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:19.962765 2985 raft_consensus.cc:3060] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.962759 2662 raft_consensus.cc:2804] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:19.962854 2662 raft_consensus.cc:493] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:19.962941 2662 raft_consensus.cc:3060] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.944430 1196 raft_consensus.cc:359] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.964615 1196 raft_consensus.cc:385] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.964668 1196 raft_consensus.cc:740] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.964883 1196 consensus_queue.cc:260] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.965183 2985 raft_consensus.cc:515] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.965364 1196 ts_tablet_manager.cc:1434] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.022s user 0.001s sys 0.000s
I20260616 19:52:19.965588 1196 tablet_bootstrap.cc:492] T e85e2861c41f402d88cafe64a6871429 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:19.965879 2985 leader_election.cc:290] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.965844 2662 raft_consensus.cc:515] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.960248 2745 leader_election.cc:290] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.966065 1193 log.cc:1199] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/ba0d3e7da3c74f5ea5dc4aac80a01c82
I20260616 19:52:19.966130 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c48e233d184487b7651e9cb105c2cc" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:19.966306 921 raft_consensus.cc:3060] T 76c48e233d184487b7651e9cb105c2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.966450 1193 ts_tablet_manager.cc:1950] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:19.966473 2662 leader_election.cc:290] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:19.967320 1196 tablet_bootstrap.cc:654] T e85e2861c41f402d88cafe64a6871429 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.968035 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7e2d8c25b8464b94ca386566abc2cc" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:19.941215 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1130) took 4515 ms. Trace:
I20260616 19:52:19.968232 1052 raft_consensus.cc:3060] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.968328 1191 rpcz_store.cc:276] 0616 19:52:15.425737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.426460 (+ 723us) service_pool.cc:224] Handling call
0616 19:52:19.883241 (+4456781us) ts_tablet_manager.cc:1151] Deleting tablet 5c74b39e66d344b99f8fc75b855c0520
0616 19:52:19.883249 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.918424 (+ 35175us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.938619 (+ 20195us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.941148 (+ 2529us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4456665}
I20260616 19:52:19.968842 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1138) took 4520 ms. Trace:
I20260616 19:52:19.968930 1191 rpcz_store.cc:276] 0616 19:52:15.447923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.447976 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:19.968665 (+4520689us) ts_tablet_manager.cc:1151] Deleting tablet 0c281b936f2147b9989f03a3e1b6884e
0616 19:52:19.968675 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.968780 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4520497}
I20260616 19:52:19.969173 921 raft_consensus.cc:2468] T 76c48e233d184487b7651e9cb105c2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:19.969282 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1161) took 4503 ms. Trace:
I20260616 19:52:19.969369 1191 rpcz_store.cc:276] 0616 19:52:15.465947 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.234299 (+768352us) service_pool.cc:224] Handling call
0616 19:52:19.969122 (+3734823us) ts_tablet_manager.cc:1151] Deleting tablet 0a9e8877705840329d6a063bb5194965
0616 19:52:19.969130 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.969225 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3734632}
I20260616 19:52:19.969699 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1187) took 3740 ms. Trace:
I20260616 19:52:19.969792 1191 rpcz_store.cc:276] 0616 19:52:16.228940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.432693 (+203753us) service_pool.cc:224] Handling call
0616 19:52:19.969550 (+3536857us) ts_tablet_manager.cc:1151] Deleting tablet 170cf5905025434995e7c9cdc802211b
0616 19:52:19.969558 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.969643 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3536706}
I20260616 19:52:19.970103 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1188) took 3736 ms. Trace:
I20260616 19:52:19.970196 1191 rpcz_store.cc:276] 0616 19:52:16.233400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.432861 (+199461us) service_pool.cc:224] Handling call
0616 19:52:19.969968 (+3537107us) ts_tablet_manager.cc:1151] Deleting tablet 5c6add7925294880a5a20eb3d189d1ee
0616 19:52:19.969975 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.970047 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3536844}
I20260616 19:52:19.970594 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1189) took 3736 ms. Trace:
I20260616 19:52:19.970675 1191 rpcz_store.cc:276] 0616 19:52:16.233799 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.433137 (+199338us) service_pool.cc:224] Handling call
0616 19:52:19.970461 (+3537324us) ts_tablet_manager.cc:1151] Deleting tablet a12cd3744782442f94dc6e76727cca1c
0616 19:52:19.970472 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.970543 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3537178}
I20260616 19:52:19.970988 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1190) took 3737 ms. Trace:
I20260616 19:52:19.971082 1191 rpcz_store.cc:276] 0616 19:52:16.233877 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.433295 (+199418us) service_pool.cc:224] Handling call
0616 19:52:19.970856 (+3537561us) ts_tablet_manager.cc:1151] Deleting tablet 9f1940f3d73d472c9c68a10539848e9d
0616 19:52:19.970864 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.970935 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3537245}
I20260616 19:52:19.971426 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1191) took 3702 ms. Trace:
I20260616 19:52:19.971510 1191 rpcz_store.cc:276] 0616 19:52:16.268908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.433636 (+164728us) service_pool.cc:224] Handling call
0616 19:52:19.971294 (+3537658us) ts_tablet_manager.cc:1151] Deleting tablet ba092edcdecf485e96a392b3ea79b01a
0616 19:52:19.971302 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.971380 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3537439}
I20260616 19:52:19.972276 2960 raft_consensus.cc:493] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:19.972399 2960 raft_consensus.cc:515] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.973168 2960 leader_election.cc:290] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:19.974040 718 leader_election.cc:304] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:19.974499 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7e2d8c25b8464b94ca386566abc2cc" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:19.974684 775 raft_consensus.cc:3060] T 8b7e2d8c25b8464b94ca386566abc2cc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:19.974726 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab8282287434bf8b7e37f008a1b0166" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:19.975183 993 leader_election.cc:343] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:19.971093 1052 raft_consensus.cc:2468] T 8b7e2d8c25b8464b94ca386566abc2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:19.977134 858 leader_election.cc:304] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:19.977332 775 raft_consensus.cc:2468] T 8b7e2d8c25b8464b94ca386566abc2cc P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:19.978051 2662 raft_consensus.cc:2804] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:19.978212 2662 raft_consensus.cc:697] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:19.978453 2662 consensus_queue.cc:237] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:19.979483 858 consensus_peers.cc:597] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f724dc23024a7297cfb8689f199600. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:19.980032 1198 tablet_bootstrap.cc:654] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:19.980544 2985 raft_consensus.cc:2804] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:19.980774 2985 raft_consensus.cc:697] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:19.981066 2985 consensus_queue.cc:237] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.984807 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1214) took 2946 ms. Trace:
I20260616 19:52:19.986265 1193 rpcz_store.cc:276] 0616 19:52:17.038567 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.069686 (+ 31119us) service_pool.cc:224] Handling call
0616 19:52:19.861425 (+2791739us) ts_tablet_manager.cc:1151] Deleting tablet ba0d3e7da3c74f5ea5dc4aac80a01c82
0616 19:52:19.861437 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.865751 (+ 4314us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.959211 (+ 93460us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.984697 (+ 25486us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2791515}
I20260616 19:52:19.987915 1198 tablet_bootstrap.cc:492] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:19.988044 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 (table default.Table_08419ba303bb445eac997664503a70a7 [id=2f996fd8aa154e608653b56bc8d01990]) successfully deleted
I20260616 19:52:19.988104 1198 ts_tablet_manager.cc:1403] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260616 19:52:19.988246 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1225) took 2872 ms. Trace:
I20260616 19:52:19.988317 1193 rpcz_store.cc:276] 0616 19:52:17.116102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.117910 (+ 1808us) service_pool.cc:224] Handling call
0616 19:52:19.987860 (+2869950us) ts_tablet_manager.cc:1151] Deleting tablet a555ad9f529943558a5ef6ea5c99851d
0616 19:52:19.987869 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.988229 (+ 360us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2869651}
W20260616 19:52:19.989128 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 126749us
I20260616 19:52:19.989923 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1226) took 2870 ms. Trace:
W20260616 19:52:19.990165 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet a555ad9f529943558a5ef6ea5c99851d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a555ad9f529943558a5ef6ea5c99851d already in progress: creating tablet
I20260616 19:52:19.991430 1193 rpcz_store.cc:276] 0616 19:52:17.119503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.119550 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:19.989826 (+2870276us) ts_tablet_manager.cc:1151] Deleting tablet 7d486a9c69954dc4a9b664d89d2bf28a
0616 19:52:19.989835 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.989908 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2869975}
I20260616 19:52:19.991988 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1234) took 2623 ms. Trace:
W20260616 19:52:19.992033 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 7d486a9c69954dc4a9b664d89d2bf28a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d486a9c69954dc4a9b664d89d2bf28a already in progress: creating tablet
I20260616 19:52:19.993211 1193 rpcz_store.cc:276] 0616 19:52:17.368217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.368267 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:19.991895 (+2623628us) ts_tablet_manager.cc:1151] Deleting tablet 9505120dd9f049c19cf2b84cabe021a6
0616 19:52:19.991903 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.991975 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2623477}
I20260616 19:52:19.993322 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1088) took 5933 ms. Trace:
I20260616 19:52:19.993439 1190 rpcz_store.cc:276] 0616 19:52:14.059372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.064907 (+ 5535us) service_pool.cc:224] Handling call
0616 19:52:19.659772 (+5594865us) ts_tablet_manager.cc:1151] Deleting tablet 8a718fefe07141119b7ef7edcbf61123
0616 19:52:19.659785 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:19.807220 (+147435us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.923313 (+116093us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:19.993285 (+ 69972us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5594720}
I20260616 19:52:19.993835 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 8a718fefe07141119b7ef7edcbf61123 (table default.Table_db902752da5f4f3ab65c0b21c57d34a9 [id=347e25a5fa42418fa9952ed1e6bf9c03]) successfully deleted
I20260616 19:52:19.993935 1193 tablet_replica.cc:333] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:52:19.994091 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 9505120dd9f049c19cf2b84cabe021a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9505120dd9f049c19cf2b84cabe021a6 already in progress: creating tablet
I20260616 19:52:19.994113 1193 raft_consensus.cc:2243] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.994344 1193 raft_consensus.cc:2272] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.994390 1190 tablet_replica.cc:333] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:19.994592 1190 raft_consensus.cc:2243] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:19.994901 1190 raft_consensus.cc:2272] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:19.995642 1190 ts_tablet_manager.cc:1916] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.997205 1193 ts_tablet_manager.cc:1916] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:19.997256 1191 tablet_replica.cc:333] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:19.997486 1191 raft_consensus.cc:2243] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:19.997692 1191 raft_consensus.cc:2272] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:19.997848 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d8082b99233417a97046d2d1d3ef552 consensus state has no leader
W20260616 19:52:19.998703 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59dbf72f58d74c269eed40e480d869ec consensus state has no leader
I20260616 19:52:19.999238 1198 raft_consensus.cc:359] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:19.999495 1198 raft_consensus.cc:385] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:19.999560 1198 raft_consensus.cc:740] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:19.998672 1196 tablet_bootstrap.cc:492] T e85e2861c41f402d88cafe64a6871429 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:19.999838 1196 ts_tablet_manager.cc:1403] T e85e2861c41f402d88cafe64a6871429 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.000s
I20260616 19:52:20.000402 1191 ts_tablet_manager.cc:1916] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:20.000376 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_95c15a9d564140b6a153f6acf270f21e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.001087 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95c15a9d564140b6a153f6acf270f21e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.001304 1196 raft_consensus.cc:359] T e85e2861c41f402d88cafe64a6871429 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.001456 1196 raft_consensus.cc:385] T e85e2861c41f402d88cafe64a6871429 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.001502 1196 raft_consensus.cc:740] T e85e2861c41f402d88cafe64a6871429 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.001698 1196 consensus_queue.cc:260] T e85e2861c41f402d88cafe64a6871429 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.002146 1196 ts_tablet_manager.cc:1434] T e85e2861c41f402d88cafe64a6871429 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:20.002807 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_11d98749e6df433ab4df38f2991dbf08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.003399 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11d98749e6df433ab4df38f2991dbf08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.009773 2962 raft_consensus.cc:493] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.010051 2962 raft_consensus.cc:515] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.004990 1198 consensus_queue.cc:260] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.011790 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eb61046c954a36a036b24e9e16b5c4" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:20.012627 993 leader_election.cc:343] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.012917 2962 leader_election.cc:290] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:20.015723 858 consensus_peers.cc:597] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bcc5116ef5df4140a96f03c003337c68. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:20.016851 1198 ts_tablet_manager.cc:1434] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.029s user 0.003s sys 0.000s
I20260616 19:52:20.020581 1198 tablet_bootstrap.cc:492] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:20.021808 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61132c1c9cd24b7d923f1d65ad04c340" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:20.022027 1052 raft_consensus.cc:2468] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:20.022081 1196 tablet_bootstrap.cc:492] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:20.022665 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61132c1c9cd24b7d923f1d65ad04c340" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:20.022879 1052 raft_consensus.cc:3060] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.023942 1196 tablet_bootstrap.cc:654] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.026358 1198 tablet_bootstrap.cc:654] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.026573 1052 raft_consensus.cc:2468] T 61132c1c9cd24b7d923f1d65ad04c340 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:20.029392 1193 ts_tablet_manager.cc:1929] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:20.032119 1191 ts_tablet_manager.cc:1929] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.037736 1196 tablet_bootstrap.cc:492] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:20.039824 1196 ts_tablet_manager.cc:1403] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.004s
I20260616 19:52:20.041464 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 04f54a486d4b46248ef9eb7d9c67606a from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:20.043798 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c48e233d184487b7651e9cb105c2cc" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:20.043955 1060 raft_consensus.cc:3060] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.044303 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 (table default.Table_d82de7981eb34e10866c36d2414328af [id=a4744c9d6db148a095891784f8e9bab6]) successfully deleted
I20260616 19:52:20.044834 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c48e233d184487b7651e9cb105c2cc" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:52:20.044865 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 76a89e7686aa44df9bb017816d1accb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76a89e7686aa44df9bb017816d1accb1 already in progress: creating tablet
W20260616 19:52:20.045248 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet e88de49e07a4467d9698d71c321c16f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e88de49e07a4467d9698d71c321c16f5 already in progress: creating tablet
W20260616 19:52:20.045644 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet cd19e83413ad420e97af92ca609757e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd19e83413ad420e97af92ca609757e5 already in progress: creating tablet
W20260616 19:52:20.046046 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8f67e5add64244629cbe8694223bd00e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f67e5add64244629cbe8694223bd00e already in progress: creating tablet
I20260616 19:52:20.046394 1060 raft_consensus.cc:2468] T 76c48e233d184487b7651e9cb105c2cc P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:20.046602 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet f5c46a428ff44d26a5c49322087cdf7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5c46a428ff44d26a5c49322087cdf7a already in progress: creating tablet
W20260616 19:52:20.046936 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8a718fefe07141119b7ef7edcbf61123 because the tablet was not found. No further retry: Not found: Tablet not found: 8a718fefe07141119b7ef7edcbf61123
I20260616 19:52:20.047411 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 5c74b39e66d344b99f8fc75b855c0520 (table default.Table_7af2cb04d4654ceabe58936f5a687406 [id=7f7faf7145fd4ea5babd783d76d44821]) successfully deleted
W20260616 19:52:20.047730 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0c281b936f2147b9989f03a3e1b6884e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c281b936f2147b9989f03a3e1b6884e already in progress: creating tablet
I20260616 19:52:20.032248 1191 log.cc:1199] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/1a7b177800174706a985c11e5876b9d3
W20260616 19:52:20.048060 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 0a9e8877705840329d6a063bb5194965 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a9e8877705840329d6a063bb5194965 already in progress: creating tablet
I20260616 19:52:20.048323 1191 ts_tablet_manager.cc:1950] T 1a7b177800174706a985c11e5876b9d3 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:20.048781 1052 raft_consensus.cc:1275] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Refusing update from remote peer 7245e7dab0ec474a876537be514c8767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:52:20.049010 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1194) took 3470 ms. Trace:
I20260616 19:52:20.049098 1191 rpcz_store.cc:276] 0616 19:52:16.578470 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.578518 (+ 48us) service_pool.cc:224] Handling call
0616 19:52:19.971691 (+3393173us) ts_tablet_manager.cc:1151] Deleting tablet 1a7b177800174706a985c11e5876b9d3
0616 19:52:19.971699 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.009385 (+ 37686us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.032032 (+ 22647us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.048993 (+ 16961us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3392986}
I20260616 19:52:20.049377 1191 tablet_replica.cc:333] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
W20260616 19:52:20.049469 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 7f3d75c36cf545de96d9f1722c60fea6 (table default.Table_2b2f2de9fe7447699e405ceb2f661744 [id=6dc0653643394fb79d433af1e37b5bb0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7f3d75c36cf545de96d9f1722c60fea6 consensus state has no leader
I20260616 19:52:20.049541 1191 raft_consensus.cc:2243] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:20.049664 1191 raft_consensus.cc:2272] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.051358 1198 tablet_bootstrap.cc:492] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:20.052073 1198 ts_tablet_manager.cc:1403] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20260616 19:52:20.053035 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b4b107ff33584b268f159abfa80497ee" } modify_external_catalogs: true
I20260616 19:52:20.053011 1198 raft_consensus.cc:359] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.053164 1198 raft_consensus.cc:385] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.053186 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b4b107ff33584b268f159abfa80497ee" } modify_external_catalogs: true
I20260616 19:52:20.053229 1198 raft_consensus.cc:740] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.054503 1198 consensus_queue.cc:260] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.054993 1196 raft_consensus.cc:359] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.055143 1196 raft_consensus.cc:385] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.055183 1196 raft_consensus.cc:740] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.055516 1198 ts_tablet_manager.cc:1434] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260616 19:52:20.055398 1196 consensus_queue.cc:260] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.056725 1196 ts_tablet_manager.cc:1434] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260616 19:52:20.057003 1196 tablet_bootstrap.cc:492] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:20.058812 1196 tablet_bootstrap.cc:654] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.059666 1193 log.cc:1199] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/fe2ac7d4df6a48d6a93d40c7eef38c9c
I20260616 19:52:20.060042 1193 ts_tablet_manager.cc:1950] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:20.060796 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1239) took 2572 ms. Trace:
I20260616 19:52:20.064725 1191 ts_tablet_manager.cc:1916] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:20.065099 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2db86dd551a14e588331c28f7ad6e0d4" } new_table_name: "default.Table_40d99059ac2c478ea36daedbe05d6f91" modify_external_catalogs: true
I20260616 19:52:20.064626 2985 consensus_queue.cc:1048] T 5fd289d39eaf4471b754dae9433a5474 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:20.070621 1193 rpcz_store.cc:276] 0616 19:52:17.488420 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.488518 (+ 98us) service_pool.cc:224] Handling call
0616 19:52:19.993891 (+2505373us) ts_tablet_manager.cc:1151] Deleting tablet fe2ac7d4df6a48d6a93d40c7eef38c9c
0616 19:52:19.993900 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.010086 (+ 16186us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.029334 (+ 19248us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.060776 (+ 31442us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2505217}
I20260616 19:52:20.068403 1196 tablet_bootstrap.cc:492] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:20.072126 1196 ts_tablet_manager.cc:1403] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.002s
I20260616 19:52:20.072866 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet fe2ac7d4df6a48d6a93d40c7eef38c9c (table default.Table_edb542c197924a81a6ae1a4a8a16f34a [id=1e3bc78bafc8405c8e57142c8236aef3]) successfully deleted
I20260616 19:52:20.072439 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1238) took 2584 ms. Trace:
I20260616 19:52:20.073477 1193 rpcz_store.cc:276] 0616 19:52:17.488263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.490705 (+ 2442us) service_pool.cc:224] Handling call
0616 19:52:20.072315 (+2581610us) ts_tablet_manager.cc:1151] Deleting tablet cefa4f3eee5b49e6b23405cfd2daabaf
0616 19:52:20.072325 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.072424 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2581443}
W20260616 19:52:20.075455 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet cefa4f3eee5b49e6b23405cfd2daabaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cefa4f3eee5b49e6b23405cfd2daabaf already in progress: creating tablet
I20260616 19:52:20.075924 1193 tablet_replica.cc:333] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:20.076126 1193 raft_consensus.cc:2243] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:20.076404 1193 raft_consensus.cc:2272] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.076969 1193 ts_tablet_manager.cc:1916] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:20.078738 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4413cec10d7c4ff2904219f7bd57c03e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:20.073177 1196 raft_consensus.cc:359] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.080891 1196 raft_consensus.cc:385] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.080945 1196 raft_consensus.cc:740] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.080243 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 2141b6c7013648a4b716642ccb4eccd6 (table default.Table_5047c84664124989b931ee92afc5b463 [id=bc83d5c728054794b2c3cc0f9b90e202]). Expected version 1 got 0
I20260616 19:52:20.082664 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 41f2d259a31c4f4eaeceaba57fb978b2 (table default.Table_7ffffaef50044d8ba89e6df198946113 [id=d49c093f51b04c2fa1b1f5daadd802cf]). Expected version 3 got 0
I20260616 19:52:20.082892 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet b5587d5aa8584cf49ef3cb113a1b64ca (table default.Table_0f374c454bc04298ba16dc14edb7bc9e [id=1105333647e747a39fc06efbcc95fa0d]). Expected version 1 got 0
I20260616 19:52:20.083164 459 catalog_manager.cc:5696] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131). New cstate: current_term: 1 leader_uuid: "61c874fef3684d10a272a9c7f280e0e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: HEALTHY } } }
I20260616 19:52:20.083635 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 29df38f273494a079bdc76a915d43dab (table default.Table_c2ce6e69bb9245d8846dc2de654d9ba8 [id=1449ff28bd8546908359606f7272846f]). Expected version 3 got 0
I20260616 19:52:20.083732 1196 consensus_queue.cc:260] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:20.084815 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4413cec10d7c4ff2904219f7bd57c03e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.086963 1196 ts_tablet_manager.cc:1434] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260616 19:52:20.087234 1196 tablet_bootstrap.cc:492] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:20.089928 1191 ts_tablet_manager.cc:1929] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.090050 1191 log.cc:1199] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/5e68e2c6caff4ac38aa52b8b29f5ace6
I20260616 19:52:20.090440 1191 ts_tablet_manager.cc:1950] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:20.093448 2985 raft_consensus.cc:493] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.093575 2985 raft_consensus.cc:515] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.094166 2985 leader_election.cc:290] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.094866 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cd1ad6e8744d33a2845e9f3dda4a7b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:20.095398 718 leader_election.cc:343] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.097322 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9951d4dcafd64f8180125bb0c25c67ef
W20260616 19:52:20.097707 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7e3944f0ece4450823521e689224485 consensus state has no leader
I20260616 19:52:20.098047 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0f25c7f0e55b413b8979e51adc294a9e" } new_table_name: "default.Table_ddfa1ca06b184996ae29343458c8402f" modify_external_catalogs: true
I20260616 19:52:20.098656 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 9951d4dcafd64f8180125bb0c25c67ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:19 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:20.100970 898 tablet_service.cc:1511] Processing CreateTablet for tablet 07077d9ecfae448a8a522b95e7dc33b0 (DEFAULT_TABLE table=default.Table_2dfdcf510b5c4e15abed203ee19760df [id=10972e091ba342e4ba2c7c4694e3340b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.101416 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07077d9ecfae448a8a522b95e7dc33b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.101483 1196 tablet_bootstrap.cc:654] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.104002 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cca35e086f1b4097b41fbaa853cc2473" } new_table_name: "default.Table_e315f9f792144241a82574dbc54e880f" modify_external_catalogs: true
I20260616 19:52:20.107472 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 9951d4dcafd64f8180125bb0c25c67ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:19 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.107638 757 tablet_service.cc:1511] Processing CreateTablet for tablet 07077d9ecfae448a8a522b95e7dc33b0 (DEFAULT_TABLE table=default.Table_2dfdcf510b5c4e15abed203ee19760df [id=10972e091ba342e4ba2c7c4694e3340b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.109270 892 tablet_service.cc:1511] Processing CreateTablet for tablet 9d99ea46b28447cab5bfe4b8c5fdbbe3 (DEFAULT_TABLE table=default.Table_dfb699d5dba24e07a034ab8ed349ebd3 [id=4993e41a918c48758dd95902e2a45b32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.109733 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d99ea46b28447cab5bfe4b8c5fdbbe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.109807 2992 tablet.cc:1724] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:20.113830 754 tablet_service.cc:1511] Processing CreateTablet for tablet 9d99ea46b28447cab5bfe4b8c5fdbbe3 (DEFAULT_TABLE table=default.Table_dfb699d5dba24e07a034ab8ed349ebd3 [id=4993e41a918c48758dd95902e2a45b32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.117549 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab8282287434bf8b7e37f008a1b0166" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:20.118392 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eb61046c954a36a036b24e9e16b5c4" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:20.119447 719 consensus_peers.cc:597] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c74b39e66d344b99f8fc75b855c0520. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:20.119707 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 170cf5905025434995e7c9cdc802211b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 170cf5905025434995e7c9cdc802211b already in progress: creating tablet
W20260616 19:52:20.119937 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 5c6add7925294880a5a20eb3d189d1ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c6add7925294880a5a20eb3d189d1ee already in progress: creating tablet
W20260616 19:52:20.119983 996 leader_election.cc:343] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.120097 996 leader_election.cc:304] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:20.120123 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a12cd3744782442f94dc6e76727cca1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a12cd3744782442f94dc6e76727cca1c already in progress: creating tablet
W20260616 19:52:20.120311 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 9f1940f3d73d472c9c68a10539848e9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f1940f3d73d472c9c68a10539848e9d already in progress: creating tablet
I20260616 19:52:20.120323 2960 raft_consensus.cc:2749] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:20.120528 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ba092edcdecf485e96a392b3ea79b01a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba092edcdecf485e96a392b3ea79b01a already in progress: creating tablet
I20260616 19:52:20.122275 1198 tablet_bootstrap.cc:492] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:20.122922 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1193) took 3544 ms. Trace:
I20260616 19:52:20.123008 1191 rpcz_store.cc:276] 0616 19:52:16.578346 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.579287 (+ 941us) service_pool.cc:224] Handling call
0616 19:52:20.049339 (+3470052us) ts_tablet_manager.cc:1151] Deleting tablet 5e68e2c6caff4ac38aa52b8b29f5ace6
0616 19:52:20.049348 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.067673 (+ 18325us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.089866 (+ 22193us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.122898 (+ 33032us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3469889}
I20260616 19:52:20.123417 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1203) took 3473 ms. Trace:
I20260616 19:52:20.123486 1191 rpcz_store.cc:276] 0616 19:52:16.649813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.651635 (+ 1822us) service_pool.cc:224] Handling call
0616 19:52:20.123293 (+3471658us) ts_tablet_manager.cc:1151] Deleting tablet 14a234e4e45f4b68be478bd4fe409225
0616 19:52:20.123305 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.123401 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3471347}
I20260616 19:52:20.123766 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1201) took 3474 ms. Trace:
I20260616 19:52:20.123824 1191 rpcz_store.cc:276] 0616 19:52:16.649569 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.652018 (+ 2449us) service_pool.cc:224] Handling call
0616 19:52:20.123678 (+3471660us) ts_tablet_manager.cc:1151] Deleting tablet 43e9d7a232f6444dbec3a3954bd47641
0616 19:52:20.123688 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.123753 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3471445}
I20260616 19:52:20.123905 1198 tablet_bootstrap.cc:654] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.124048 1191 tablet_replica.cc:333] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:20.124266 1191 raft_consensus.cc:2243] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:20.124434 1191 raft_consensus.cc:2272] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.128882 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d06a8b4004d040c09bc18117494a401c
I20260616 19:52:20.128830 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_f54d915ba23e4f42becad23e4e9951cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.129416 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f54d915ba23e4f42becad23e4e9951cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.129493 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c72cfa1b4cd747f78d9abb8b2595745b" } modify_external_catalogs: true
I20260616 19:52:20.129628 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_c72cfa1b4cd747f78d9abb8b2595745b" } modify_external_catalogs: true
I20260616 19:52:20.131186 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07077d9ecfae448a8a522b95e7dc33b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.131449 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d99ea46b28447cab5bfe4b8c5fdbbe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.132136 892 tablet_service.cc:1558] Processing DeleteTablet for tablet d06a8b4004d040c09bc18117494a401c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:19 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:20.132373 459 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:38239 (request call id 215) took 1075 ms (client timeout 1000 ms). Trace:
W20260616 19:52:20.132448 459 rpcz_store.cc:269] 0616 19:52:19.057312 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.357085 (+299773us) service_pool.cc:224] Handling call
0616 19:52:20.132354 (+775269us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:20.093424 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:20.093547 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:20.093554 (+ 7us) write_op.cc:435] Acquired schema lock
0616 19:52:20.093558 (+ 4us) tablet.cc:662] Decoding operations
0616 19:52:20.093658 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:20.093670 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:20.093677 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0616 19:52:20.093755 (+ 78us) tablet.cc:701] Row locks acquired
0616 19:52:20.093759 (+ 4us) write_op.cc:260] PREPARE: finished
0616 19:52:20.093794 (+ 35us) write_op.cc:270] Start()
0616 19:52:20.093847 (+ 53us) write_op.cc:276] Timestamp: P: 1781639540093743 usec, L: 0
0616 19:52:20.093853 (+ 6us) op_driver.cc:348] REPLICATION: starting
0616 19:52:20.094034 (+ 181us) log.cc:844] Serialized 533 byte log entry
0616 19:52:20.127085 (+ 33051us) op_driver.cc:464] REPLICATION: finished
0616 19:52:20.127349 (+ 264us) write_op.cc:301] APPLY: starting
0616 19:52:20.127367 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:20.127421 (+ 54us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:20.127450 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:20.127510 (+ 60us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:20.127544 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0616 19:52:20.127552 (+ 8us) write_op.cc:312] APPLY: finished
0616 19:52:20.127632 (+ 80us) log.cc:844] Serialized 23 byte log entry
0616 19:52:20.127694 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:20.127710 (+ 16us) write_op.cc:454] Released schema lock
0616 19:52:20.127716 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:20.127797 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:20.127804 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":208,"apply.run_cpu_time_us":435,"apply.run_wall_time_us":434,"num_ops":1,"prepare.queue_time_us":9164,"prepare.run_cpu_time_us":719,"prepare.run_wall_time_us":786,"raft.queue_time_us":43,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":33193}]]}
I20260616 19:52:20.133708 458 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 8b7e2d8c25b8464b94ca386566abc2cc (table default.Table_9c19749d8e8a4eaeaa2294ca29ea85dc [id=a12694adb1ba4cfabe42db00e13b002b]). Expected version 1 got 0
I20260616 19:52:20.136077 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_43642798648b4083bc3e6132accafbb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.136606 858 consensus_peers.cc:597] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:20.137006 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6ff69aa268bc43f99b003e8db11d759c" } modify_external_catalogs: true
I20260616 19:52:20.137151 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6ff69aa268bc43f99b003e8db11d759c" } modify_external_catalogs: true
I20260616 19:52:20.137184 1191 ts_tablet_manager.cc:1916] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:20.137773 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c19c2e43a944893b86982bee1eb2f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.138634 761 tablet_service.cc:1558] Processing DeleteTablet for tablet d06a8b4004d040c09bc18117494a401c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:19 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.138805 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.138933 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc0c02ef58d4e429855e5bbaa4752ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.146634 457 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 29df38f273494a079bdc76a915d43dab (table default.Table_c2ce6e69bb9245d8846dc2de654d9ba8 [id=1449ff28bd8546908359606f7272846f]). Expected version 3 got 0
I20260616 19:52:20.147430 1193 ts_tablet_manager.cc:1929] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.147723 457 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 61132c1c9cd24b7d923f1d65ad04c340 (table default.Table_9eb13a45afad449a9bf9b25a0f5d4d1d [id=e8db7417fd294af4b160a434625e9fd0]). Expected version 2 got 0
I20260616 19:52:20.148088 457 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet b5587d5aa8584cf49ef3cb113a1b64ca (table default.Table_0f374c454bc04298ba16dc14edb7bc9e [id=1105333647e747a39fc06efbcc95fa0d]). Expected version 1 got 0
I20260616 19:52:20.148645 457 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet a95c684f5fe54f7dad6300efb0c18780 (table default.Table_57baa761ff0f4e189d6b46fada3d0d9f [id=02d0cb31737b4289988e982dd24ae298]). Expected version 1 got 0
I20260616 19:52:20.151362 892 tablet_service.cc:1511] Processing CreateTablet for tablet 43dbb249d43d4c68b4ba831f2903e74a (DEFAULT_TABLE table=default.Table_47efe8b561e24ce78082f339ba9db1e2 [id=13b4f75609c74a0ea12b0c2f2fca13a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.151795 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43dbb249d43d4c68b4ba831f2903e74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.152751 886 tablet_service.cc:1511] Processing CreateTablet for tablet f64cb61035034692b89c0673a1d73a63 (DEFAULT_TABLE table=default.Table_ddaf7a16b2a64e1187acd63181b8ec90 [id=7fdc48c322d44db4ac46c11b0acd79b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.153308 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64cb61035034692b89c0673a1d73a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.156764 896 tablet_service.cc:1511] Processing CreateTablet for tablet d06a8b4004d040c09bc18117494a401c (DEFAULT_TABLE table=default.Table_bc56a536b4ae4a45a371edc40efa390e [id=3512dcba0f354383a64477658592b7b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.157266 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06a8b4004d040c09bc18117494a401c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.147478 754 tablet_service.cc:1511] Processing CreateTablet for tablet 43dbb249d43d4c68b4ba831f2903e74a (DEFAULT_TABLE table=default.Table_47efe8b561e24ce78082f339ba9db1e2 [id=13b4f75609c74a0ea12b0c2f2fca13a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.159083 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43dbb249d43d4c68b4ba831f2903e74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.160560 1196 tablet_bootstrap.cc:492] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:20.160729 1196 ts_tablet_manager.cc:1403] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.001s
I20260616 19:52:20.161485 1196 raft_consensus.cc:359] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.161708 1196 raft_consensus.cc:385] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.161818 1196 raft_consensus.cc:740] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.155458 746 tablet_service.cc:1511] Processing CreateTablet for tablet d06a8b4004d040c09bc18117494a401c (DEFAULT_TABLE table=default.Table_bc56a536b4ae4a45a371edc40efa390e [id=3512dcba0f354383a64477658592b7b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.155457 763 tablet_service.cc:1511] Processing CreateTablet for tablet f64cb61035034692b89c0673a1d73a63 (DEFAULT_TABLE table=default.Table_ddaf7a16b2a64e1187acd63181b8ec90 [id=7fdc48c322d44db4ac46c11b0acd79b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.162108 1196 consensus_queue.cc:260] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.162659 1196 ts_tablet_manager.cc:1434] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:20.163070 1196 tablet_bootstrap.cc:492] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:20.162271 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06a8b4004d040c09bc18117494a401c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:20.147310 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43642798648b4083bc3e6132accafbb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.169268 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64cb61035034692b89c0673a1d73a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.170315 1196 tablet_bootstrap.cc:654] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.158721 761 tablet_service.cc:1511] Processing CreateTablet for tablet 70d4330d155b4cdfa0e96e36ee531dae (DEFAULT_TABLE table=default.Table_afc9ed64b03e4d44b67116949d3be7de [id=5c0486f1857e434e8600f9f54ad3bd83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.172662 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d4330d155b4cdfa0e96e36ee531dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.173041 2963 raft_consensus.cc:493] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.173190 2963 raft_consensus.cc:515] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.173949 2963 leader_election.cc:290] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.174746 1191 ts_tablet_manager.cc:1929] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:20.174834 1191 log.cc:1199] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/4be902fe29bb46a4bf71ee6384e6722a
I20260616 19:52:20.175127 1191 ts_tablet_manager.cc:1950] T 4be902fe29bb46a4bf71ee6384e6722a P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:20.175886 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1200) took 3539 ms. Trace:
I20260616 19:52:20.175971 1191 rpcz_store.cc:276] 0616 19:52:16.636664 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.652301 (+ 15637us) service_pool.cc:224] Handling call
0616 19:52:20.124005 (+3471704us) ts_tablet_manager.cc:1151] Deleting tablet 4be902fe29bb46a4bf71ee6384e6722a
0616 19:52:20.124015 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.142435 (+ 18420us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.174693 (+ 32258us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.175867 (+ 1174us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3471471}
I20260616 19:52:20.176345 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1204) took 3524 ms. Trace:
I20260616 19:52:20.176420 1191 rpcz_store.cc:276] 0616 19:52:16.652252 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.652593 (+ 341us) service_pool.cc:224] Handling call
0616 19:52:20.176225 (+3523632us) ts_tablet_manager.cc:1151] Deleting tablet 7de044cb57e941ab9471ffe3bd7eeccb
0616 19:52:20.176235 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.176331 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3523474}
I20260616 19:52:20.177974 461 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 29df38f273494a079bdc76a915d43dab (table default.Table_c2ce6e69bb9245d8846dc2de654d9ba8 [id=1449ff28bd8546908359606f7272846f]). Expected version 3 got 0
I20260616 19:52:20.178267 461 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 2141b6c7013648a4b716642ccb4eccd6 (table default.Table_5047c84664124989b931ee92afc5b463 [id=bc83d5c728054794b2c3cc0f9b90e202]). Expected version 1 got 0
I20260616 19:52:20.178634 461 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 41f2d259a31c4f4eaeceaba57fb978b2 (table default.Table_7ffffaef50044d8ba89e6df198946113 [id=d49c093f51b04c2fa1b1f5daadd802cf]). Expected version 3 got 0
I20260616 19:52:20.178957 461 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet b5587d5aa8584cf49ef3cb113a1b64ca (table default.Table_0f374c454bc04298ba16dc14edb7bc9e [id=1105333647e747a39fc06efbcc95fa0d]). Expected version 1 got 0
I20260616 19:52:20.179198 461 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet a95c684f5fe54f7dad6300efb0c18780 (table default.Table_57baa761ff0f4e189d6b46fada3d0d9f [id=02d0cb31737b4289988e982dd24ae298]). Expected version 1 got 0
I20260616 19:52:20.181152 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faa62f03c2a4588a776883dc54d0426" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:20.181950 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1202) took 3532 ms. Trace:
I20260616 19:52:20.182035 1191 rpcz_store.cc:276] 0616 19:52:16.649682 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.668223 (+ 18541us) service_pool.cc:224] Handling call
0616 19:52:20.176662 (+3508439us) ts_tablet_manager.cc:1151] Deleting tablet ad0b7615a5934617be3d8e18a220fa31
0616 19:52:20.181827 (+ 5165us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.181930 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3507847}
W20260616 19:52:20.182554 993 leader_election.cc:343] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.184571 1198 tablet_bootstrap.cc:492] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:20.184870 1198 ts_tablet_manager.cc:1403] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.063s user 0.005s sys 0.000s
I20260616 19:52:20.185695 1196 tablet_bootstrap.cc:492] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:20.187855 1198 raft_consensus.cc:359] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.188078 1198 raft_consensus.cc:385] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.188182 1198 raft_consensus.cc:740] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.188546 1198 consensus_queue.cc:260] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.189258 1198 ts_tablet_manager.cc:1434] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260616 19:52:20.189815 1198 tablet_bootstrap.cc:492] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:20.189803 1196 ts_tablet_manager.cc:1403] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.001s
I20260616 19:52:20.191450 1196 raft_consensus.cc:359] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.191663 1196 raft_consensus.cc:385] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.191766 1198 tablet_bootstrap.cc:654] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.191769 1196 raft_consensus.cc:740] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.192096 1196 consensus_queue.cc:260] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.192742 1196 ts_tablet_manager.cc:1434] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:20.197129 1196 tablet_bootstrap.cc:492] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:20.198511 1196 tablet_bootstrap.cc:654] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.187927 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1209) took 3333 ms. Trace:
I20260616 19:52:20.200542 1191 rpcz_store.cc:276] 0616 19:52:16.854938 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.855003 (+ 65us) service_pool.cc:224] Handling call
0616 19:52:20.182293 (+3327290us) ts_tablet_manager.cc:1151] Deleting tablet a59409d014404ee6b446c5b405c04bc1
0616 19:52:20.187791 (+ 5498us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.187902 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3327092}
I20260616 19:52:20.200888 1191 tablet_replica.cc:333] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:20.201069 1191 raft_consensus.cc:2243] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:20.201241 1191 raft_consensus.cc:2272] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.201810 1191 ts_tablet_manager.cc:1916] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:20.209817 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32bc62e689e64af0a24cbd6cd5859a06 consensus state has no leader
I20260616 19:52:20.211676 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c2aef4e720784161927386e48b79286e
I20260616 19:52:20.213572 886 tablet_service.cc:1558] Processing DeleteTablet for tablet c2aef4e720784161927386e48b79286e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:20.213652 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 04f54a486d4b46248ef9eb7d9c67606a
I20260616 19:52:20.214334 455 catalog_manager.cc:6784] ReplaceTablet: tablet 04f54a486d4b46248ef9eb7d9c67606a deleted and replaced by tablet e6cbc5215f834fbd9392cd57574ae3f7
I20260616 19:52:20.215124 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f54a486d4b46248ef9eb7d9c67606a with delete_type TABLET_DATA_DELETED (replaced by tablet e6cbc5215f834fbd9392cd57574ae3f7) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.216035 746 tablet_service.cc:1558] Processing DeleteTablet for tablet c2aef4e720784161927386e48b79286e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:20.216542 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84b168fbd133466681c86513c4bacf8b consensus state has no leader
I20260616 19:52:20.216639 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f54a486d4b46248ef9eb7d9c67606a with delete_type TABLET_DATA_DELETED (replaced by tablet e6cbc5215f834fbd9392cd57574ae3f7) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:20.216898 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 352ca272888f4dd2ab1a8127bb8c2b6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:20.217063 996 leader_election.cc:343] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.217185 996 leader_election.cc:304] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:20.217440 2963 raft_consensus.cc:2749] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:20.218160 2642 consensus_queue.cc:1048] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:20.218302 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 1a7b177800174706a985c11e5876b9d3 (table default.Table_9b154e7b9f584385866a56cfaa2bbd49 [id=0f612612c8124e4a91a05c3e23a9d693]) successfully deleted
I20260616 19:52:20.218297 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faa62f03c2a4588a776883dc54d0426" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:20.218473 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 (table default.Table_1054530674ec44d19e673765aefe6cdf [id=1366cc6d014c4092a6ad2086b9f137e4]) successfully deleted
W20260616 19:52:20.218644 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 14a234e4e45f4b68be478bd4fe409225 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14a234e4e45f4b68be478bd4fe409225 already in progress: creating tablet
W20260616 19:52:20.218842 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 43e9d7a232f6444dbec3a3954bd47641 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43e9d7a232f6444dbec3a3954bd47641 already in progress: creating tablet
I20260616 19:52:20.219002 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]) successfully deleted
W20260616 19:52:20.219166 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 7de044cb57e941ab9471ffe3bd7eeccb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7de044cb57e941ab9471ffe3bd7eeccb already in progress: creating tablet
W20260616 19:52:20.219339 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ad0b7615a5934617be3d8e18a220fa31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad0b7615a5934617be3d8e18a220fa31 already in progress: creating tablet
W20260616 19:52:20.219529 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a59409d014404ee6b446c5b405c04bc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a59409d014404ee6b446c5b405c04bc1 already in progress: creating tablet
I20260616 19:52:20.221707 1192 tablet_bootstrap.cc:492] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:20.221864 1192 ts_tablet_manager.cc:1403] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.283s user 0.003s sys 0.001s
I20260616 19:52:20.222698 1192 raft_consensus.cc:359] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.222878 1192 raft_consensus.cc:385] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.222987 1192 raft_consensus.cc:740] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.223340 1192 consensus_queue.cc:260] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.224186 1192 ts_tablet_manager.cc:1434] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:20.224588 1192 tablet_bootstrap.cc:492] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:20.226697 1192 tablet_bootstrap.cc:654] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.232650 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 9951d4dcafd64f8180125bb0c25c67ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:19 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.233335 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 07077d9ecfae448a8a522b95e7dc33b0 (DEFAULT_TABLE table=default.Table_2dfdcf510b5c4e15abed203ee19760df [id=10972e091ba342e4ba2c7c4694e3340b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.233731 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07077d9ecfae448a8a522b95e7dc33b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.234784 2745 raft_consensus.cc:493] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.234915 2745 raft_consensus.cc:515] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.235502 2745 leader_election.cc:290] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.236394 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc0c02ef58d4e429855e5bbaa4752ad" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:20.236961 718 leader_election.cc:343] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.238390 1193 log.cc:1199] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/0d8b9d6b95a74dbe97461b4bc9984fe3
I20260616 19:52:20.238790 1193 ts_tablet_manager.cc:1950] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:20.239483 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1242) took 2535 ms. Trace:
I20260616 19:52:20.241901 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet d06a8b4004d040c09bc18117494a401c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:19 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.242069 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.242400 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 43dbb249d43d4c68b4ba831f2903e74a (DEFAULT_TABLE table=default.Table_47efe8b561e24ce78082f339ba9db1e2 [id=13b4f75609c74a0ea12b0c2f2fca13a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.242779 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43dbb249d43d4c68b4ba831f2903e74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.243280 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 9d99ea46b28447cab5bfe4b8c5fdbbe3 (DEFAULT_TABLE table=default.Table_dfb699d5dba24e07a034ab8ed349ebd3 [id=4993e41a918c48758dd95902e2a45b32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.243654 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d99ea46b28447cab5bfe4b8c5fdbbe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.244764 1040 tablet_service.cc:1511] Processing CreateTablet for tablet d06a8b4004d040c09bc18117494a401c (DEFAULT_TABLE table=default.Table_bc56a536b4ae4a45a371edc40efa390e [id=3512dcba0f354383a64477658592b7b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.245090 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06a8b4004d040c09bc18117494a401c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.249163 1023 tablet_service.cc:1511] Processing CreateTablet for tablet f64cb61035034692b89c0673a1d73a63 (DEFAULT_TABLE table=default.Table_ddaf7a16b2a64e1187acd63181b8ec90 [id=7fdc48c322d44db4ac46c11b0acd79b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.249476 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64cb61035034692b89c0673a1d73a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.252681 2745 raft_consensus.cc:493] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.252826 2745 raft_consensus.cc:515] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.253439 2745 leader_election.cc:290] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.254071 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c19c2e43a944893b86982bee1eb2f30" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:20.254612 718 leader_election.cc:343] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.256778 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 70d4330d155b4cdfa0e96e36ee531dae (DEFAULT_TABLE table=default.Table_afc9ed64b03e4d44b67116949d3be7de [id=5c0486f1857e434e8600f9f54ad3bd83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.256987 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet e3c4e584fad94633ae49332872de0fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.257052 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c19c2e43a944893b86982bee1eb2f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.257118 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d4330d155b4cdfa0e96e36ee531dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.257440 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet fab8282287434bf8b7e37f008a1b0166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.257711 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 54eb61046c954a36a036b24e9e16b5c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.257979 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 1142b61e40e6499e8244d71f2ad39b1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.258258 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet e03e6a2614564eeeb8ec382b16f0ece1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.258519 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.258819 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 335f7411fda84fada762345010a4339c with delete_type TABLET_DATA_DELETED (replaced by tablet 2171eb55560f44dd91ad52e0b5b49408) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.259083 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.259398 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 4faa62f03c2a4588a776883dc54d0426 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.260560 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet c2aef4e720784161927386e48b79286e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.260805 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b362fa598a54632880faa42a9224ffd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:04 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.256824 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f54a486d4b46248ef9eb7d9c67606a with delete_type TABLET_DATA_DELETED (replaced by tablet e6cbc5215f834fbd9392cd57574ae3f7) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.261296 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cd1ad6e8744d33a2845e9f3dda4a7b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:20.261471 1054 raft_consensus.cc:2468] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:20.270889 2937 raft_consensus.cc:493] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.271088 2937 raft_consensus.cc:515] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.271751 2937 leader_election.cc:290] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:20.272629 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03e6a2614564eeeb8ec382b16f0ece1" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:20.272809 1052 raft_consensus.cc:2468] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:20.273046 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03e6a2614564eeeb8ec382b16f0ece1" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:20.273289 775 raft_consensus.cc:2468] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:20.273604 858 leader_election.cc:304] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:20.274072 2937 raft_consensus.cc:2804] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:20.274189 2937 raft_consensus.cc:493] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:20.274449 2937 raft_consensus.cc:3060] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.277019 1190 ts_tablet_manager.cc:1929] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.277070 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc0c02ef58d4e429855e5bbaa4752ad" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:20.277168 1190 log.cc:1199] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/e6530753b4184cfe972ae3a43f23d589
I20260616 19:52:20.277236 1052 raft_consensus.cc:2468] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:20.277370 2937 raft_consensus.cc:515] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.277587 1190 ts_tablet_manager.cc:1950] T e6530753b4184cfe972ae3a43f23d589 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:20.277819 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c19c2e43a944893b86982bee1eb2f30" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:20.277956 1052 raft_consensus.cc:2468] T 8c19c2e43a944893b86982bee1eb2f30 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:20.278492 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03e6a2614564eeeb8ec382b16f0ece1" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:20.278995 719 leader_election.cc:304] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:20.279048 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1092) took 6076 ms. Trace:
I20260616 19:52:20.279163 1190 rpcz_store.cc:276] 0616 19:52:14.202643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.204354 (+ 1711us) service_pool.cc:224] Handling call
0616 19:52:19.994330 (+5789976us) ts_tablet_manager.cc:1151] Deleting tablet e6530753b4184cfe972ae3a43f23d589
0616 19:52:19.994340 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.113755 (+119415us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.276926 (+163171us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.278968 (+ 2042us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5789724}
I20260616 19:52:20.279575 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1096) took 6054 ms. Trace:
I20260616 19:52:20.279675 1190 rpcz_store.cc:276] 0616 19:52:14.224674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.230781 (+ 6107us) service_pool.cc:224] Handling call
0616 19:52:20.279406 (+6048625us) ts_tablet_manager.cc:1151] Deleting tablet 150af2d5b0614adc8ae7a2bdac076a87
0616 19:52:20.279414 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.279510 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6048450}
I20260616 19:52:20.279855 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet e6530753b4184cfe972ae3a43f23d589 (table default.Table_f05f097bf69a4898afcc750f4aa55d7f [id=99e870e6f821406bb65af1f96f5ad30f]) successfully deleted
I20260616 19:52:20.279932 2642 raft_consensus.cc:2804] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:20.280005 2642 raft_consensus.cc:493] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:20.280073 2642 raft_consensus.cc:3060] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.280200 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1099) took 5980 ms. Trace:
W20260616 19:52:20.280211 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 150af2d5b0614adc8ae7a2bdac076a87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 150af2d5b0614adc8ae7a2bdac076a87 already in progress: creating tablet
I20260616 19:52:20.280284 1190 rpcz_store.cc:276] 0616 19:52:14.299749 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.299799 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:20.280015 (+5980216us) ts_tablet_manager.cc:1151] Deleting tablet bd7b91e00d6c4f70b0eda75fe83d617e
0616 19:52:20.280025 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.280099 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5963728}
W20260616 19:52:20.280704 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet bd7b91e00d6c4f70b0eda75fe83d617e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd7b91e00d6c4f70b0eda75fe83d617e already in progress: creating tablet
I20260616 19:52:20.281085 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1103) took 5901 ms. Trace:
I20260616 19:52:20.281172 1190 rpcz_store.cc:276] 0616 19:52:14.379378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.400390 (+ 21012us) service_pool.cc:224] Handling call
0616 19:52:20.280943 (+5880553us) ts_tablet_manager.cc:1151] Deleting tablet 70e1f138c3154dfbb93aca7bed67719d
0616 19:52:20.280952 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.281025 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5856307}
W20260616 19:52:20.281535 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 70e1f138c3154dfbb93aca7bed67719d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70e1f138c3154dfbb93aca7bed67719d already in progress: creating tablet
I20260616 19:52:20.282822 2642 raft_consensus.cc:515] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.283609 2642 leader_election.cc:290] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.285014 719 leader_election.cc:304] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:20.285441 719 leader_election.cc:304] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:20.285923 2985 raft_consensus.cc:2804] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:20.285995 2985 raft_consensus.cc:493] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:20.286055 2985 raft_consensus.cc:3060] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.289144 2843 raft_consensus.cc:2804] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:20.289224 2843 raft_consensus.cc:493] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:20.289300 2843 raft_consensus.cc:3060] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.295931 1192 tablet_bootstrap.cc:492] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:20.296123 1192 ts_tablet_manager.cc:1403] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.000s
I20260616 19:52:20.297153 1192 raft_consensus.cc:359] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.297371 1192 raft_consensus.cc:385] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.297636 1192 raft_consensus.cc:740] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.297880 2679 raft_consensus.cc:493] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.298414 2679 raft_consensus.cc:515] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.300700 2679 leader_election.cc:290] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:20.301029 1190 tablet_replica.cc:333] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:20.301252 1190 raft_consensus.cc:2243] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:20.301654 1190 raft_consensus.cc:2272] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.302184 2843 raft_consensus.cc:515] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.302784 2843 leader_election.cc:290] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.301524 2985 raft_consensus.cc:515] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.303828 2985 leader_election.cc:290] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:20.279933 996 leader_election.cc:343] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.304237 1052 raft_consensus.cc:3060] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.304271 996 leader_election.cc:304] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:20.300305 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352ca272888f4dd2ab1a8127bb8c2b6e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:20.304517 2963 raft_consensus.cc:2749] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:20.304574 1060 raft_consensus.cc:2468] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:20.305132 858 leader_election.cc:304] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:20.305941 2662 raft_consensus.cc:2804] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:20.306042 2662 raft_consensus.cc:493] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:20.306161 2662 raft_consensus.cc:3060] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.307556 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c19c2e43a944893b86982bee1eb2f30" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:20.307708 1051 raft_consensus.cc:3060] T 8c19c2e43a944893b86982bee1eb2f30 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.307981 1198 tablet_bootstrap.cc:492] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:20.308102 1198 ts_tablet_manager.cc:1403] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.118s user 0.003s sys 0.000s
I20260616 19:52:20.308971 1198 raft_consensus.cc:359] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.309128 1198 raft_consensus.cc:385] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.309195 1198 raft_consensus.cc:740] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.309406 1198 consensus_queue.cc:260] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.309916 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cd1ad6e8744d33a2845e9f3dda4a7b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:20.310065 1060 raft_consensus.cc:3060] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.310420 1051 raft_consensus.cc:2468] T 8c19c2e43a944893b86982bee1eb2f30 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:20.311239 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc0c02ef58d4e429855e5bbaa4752ad" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:20.311503 1051 raft_consensus.cc:3060] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:20.312970 719 consensus_peers.cc:597] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a7b177800174706a985c11e5876b9d3. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:20.313211 719 leader_election.cc:304] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:20.313443 746 tablet_service.cc:1511] Processing CreateTablet for tablet 75fa8cc6ff73433e8522a182f866799f (DEFAULT_TABLE table=default.Table_89cbf050adb84a2f85b0c287219d61fb [id=b4a5a9bae1a9474ead8e6fd2d999ec89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.313843 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75fa8cc6ff73433e8522a182f866799f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.313779 896 tablet_service.cc:1511] Processing CreateTablet for tablet 70d4330d155b4cdfa0e96e36ee531dae (DEFAULT_TABLE table=default.Table_afc9ed64b03e4d44b67116949d3be7de [id=5c0486f1857e434e8600f9f54ad3bd83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.314213 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d4330d155b4cdfa0e96e36ee531dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.314134 2662 raft_consensus.cc:515] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.315078 2662 leader_election.cc:290] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:20.315676 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352ca272888f4dd2ab1a8127bb8c2b6e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:20.315867 1058 raft_consensus.cc:3060] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.316771 886 tablet_service.cc:1511] Processing CreateTablet for tablet 75fa8cc6ff73433e8522a182f866799f (DEFAULT_TABLE table=default.Table_89cbf050adb84a2f85b0c287219d61fb [id=b4a5a9bae1a9474ead8e6fd2d999ec89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.317178 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75fa8cc6ff73433e8522a182f866799f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.318857 1058 raft_consensus.cc:2468] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:20.319579 858 leader_election.cc:304] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:20.321151 1060 raft_consensus.cc:2468] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:20.321668 1190 ts_tablet_manager.cc:1916] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:20.324100 1052 raft_consensus.cc:2468] T e03e6a2614564eeeb8ec382b16f0ece1 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:20.324808 858 leader_election.cc:304] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:20.239553 1193 rpcz_store.cc:276] 0616 19:52:17.703732 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.704020 (+ 288us) service_pool.cc:224] Handling call
0616 19:52:20.075874 (+2371854us) ts_tablet_manager.cc:1151] Deleting tablet 0d8b9d6b95a74dbe97461b4bc9984fe3
0616 19:52:20.075883 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.105199 (+ 29316us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.147377 (+ 42178us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.239464 (+ 92087us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2371695}
I20260616 19:52:20.325070 2700 raft_consensus.cc:2804] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:20.325240 2700 raft_consensus.cc:697] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:20.325192 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 0d8b9d6b95a74dbe97461b4bc9984fe3 (table default.Table_d82de7981eb34e10866c36d2414328af [id=a4744c9d6db148a095891784f8e9bab6]) successfully deleted
I20260616 19:52:20.325486 2700 consensus_queue.cc:237] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.325639 2985 raft_consensus.cc:2804] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:20.325791 2985 raft_consensus.cc:697] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:20.326025 2985 consensus_queue.cc:237] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.326404 2679 raft_consensus.cc:2804] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:20.326562 2679 raft_consensus.cc:697] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:20.326792 2679 consensus_queue.cc:237] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.327663 2937 leader_election.cc:290] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:20.329869 1051 raft_consensus.cc:2468] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:20.330309 719 leader_election.cc:304] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:20.330626 719 leader_election.cc:304] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:20.330852 2745 raft_consensus.cc:2804] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:20.330967 2745 raft_consensus.cc:697] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:20.330910 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 75fa8cc6ff73433e8522a182f866799f (DEFAULT_TABLE table=default.Table_89cbf050adb84a2f85b0c287219d61fb [id=b4a5a9bae1a9474ead8e6fd2d999ec89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.331179 2745 consensus_queue.cc:237] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.331314 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75fa8cc6ff73433e8522a182f866799f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.332417 2845 raft_consensus.cc:2804] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:20.332545 2845 raft_consensus.cc:697] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:20.332762 2845 consensus_queue.cc:237] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.341925 763 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb486baf39d4f488475ce09b966109a (DEFAULT_TABLE table=default.Table_6452f8aede464c779152e21149033fd7 [id=22c0496a0de242e39800af009db03f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.342386 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb486baf39d4f488475ce09b966109a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.342655 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb486baf39d4f488475ce09b966109a (DEFAULT_TABLE table=default.Table_6452f8aede464c779152e21149033fd7 [id=22c0496a0de242e39800af009db03f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.342701 886 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb486baf39d4f488475ce09b966109a (DEFAULT_TABLE table=default.Table_6452f8aede464c779152e21149033fd7 [id=22c0496a0de242e39800af009db03f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.343025 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb486baf39d4f488475ce09b966109a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.343124 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb486baf39d4f488475ce09b966109a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.353626 2937 consensus_queue.cc:1048] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:20.356055 1198 ts_tablet_manager.cc:1434] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.048s user 0.002s sys 0.000s
I20260616 19:52:20.356419 1198 tablet_bootstrap.cc:492] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:20.357513 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_54f6ebbfc240450f84b9246a98f98ed4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.358394 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54f6ebbfc240450f84b9246a98f98ed4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.360558 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_009cedf56a574717833b8dfa77b297f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.361044 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_009cedf56a574717833b8dfa77b297f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.366215 453 catalog_manager.cc:5696] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:20.366730 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 76c48e233d184487b7651e9cb105c2cc (table default.Table_8640034462d64b5d879d28e067fe1b14 [id=d24b6a6d28c949b2880a34bfa227c585]). Expected version 2 got 0
I20260616 19:52:20.367079 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8e9f4830e713476d8fbd5693a5179d9a" } new_table_name: "default.Table_cd2f659c27624fbf81c09c8a3fe0e066" modify_external_catalogs: true
I20260616 19:52:20.367184 453 catalog_manager.cc:5696] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:20.367560 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet dd52351082274a4aa12cac468d9a512d (table default.Table_3bee557dbc924f6b982089749d9abe7b [id=ae7663c7da4444f1a6ef328ba7bd3494]). Expected version 2 got 0
I20260616 19:52:20.367823 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet e85e2861c41f402d88cafe64a6871429 (table default.Table_66d56024dca749dfb6300ffa4cb0dec9 [id=02a85fe82ed24f6b949c0ded2d9a7d5e]). Expected version 1 got 0
I20260616 19:52:20.367985 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 29df38f273494a079bdc76a915d43dab (table default.Table_c2ce6e69bb9245d8846dc2de654d9ba8 [id=1449ff28bd8546908359606f7272846f]). Expected version 3 got 0
I20260616 19:52:20.368207 453 catalog_manager.cc:5696] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:20.368611 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 61132c1c9cd24b7d923f1d65ad04c340 (table default.Table_9eb13a45afad449a9bf9b25a0f5d4d1d [id=e8db7417fd294af4b160a434625e9fd0]). Expected version 2 got 0
I20260616 19:52:20.376740 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9ebc1905db49466db1697dab76e8e7b2" } new_table_name: "default.Table_959f040a71324c8293ced4cc1df11f89" modify_external_catalogs: true
I20260616 19:52:20.389038 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 191965ba869541fca128dcb93fe8e5b5
I20260616 19:52:20.390991 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 191965ba869541fca128dcb93fe8e5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:20.391027 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 191965ba869541fca128dcb93fe8e5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.392743 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 24278ccfca6742aa8972d2b3d2c612d4
I20260616 19:52:20.393517 458 master_service.cc:960] ReplaceTablet: received request to replace tablet 50797706bd3a40099d64c292c32bf1f0 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:20.394985 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 24278ccfca6742aa8972d2b3d2c612d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:20.396878 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 24278ccfca6742aa8972d2b3d2c612d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.397359 761 tablet_service.cc:1511] Processing CreateTablet for tablet 22ff45b92e084ef58ec8f14947ac35bf (DEFAULT_TABLE table=default.Table_8073617fa67c44b28ca01c349241d3eb [id=dc612e13acc940a6b077d1b2e7b79f35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.397856 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ff45b92e084ef58ec8f14947ac35bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.404702 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 191965ba869541fca128dcb93fe8e5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.411316 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a2bc931572544f57a16d3c475a7a5b22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:20.411284 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a22790c0c8744187aefb960fb7c2c2e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.411844 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2bc931572544f57a16d3c475a7a5b22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:20.411902 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a22790c0c8744187aefb960fb7c2c2e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.412933 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_52ed7c99afcd4498b138637b87d7bcab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.413370 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52ed7c99afcd4498b138637b87d7bcab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.325680 1193 tablet_replica.cc:333] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:20.425066 1193 raft_consensus.cc:2243] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:20.425391 1193 raft_consensus.cc:2272] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.426170 1193 ts_tablet_manager.cc:1916] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:20.297935 1192 consensus_queue.cc:260] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.434057 1192 ts_tablet_manager.cc:1434] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.138s user 0.002s sys 0.000s
I20260616 19:52:20.434504 1192 tablet_bootstrap.cc:492] T dd52351082274a4aa12cac468d9a512d P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:20.436178 2960 raft_consensus.cc:493] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.436331 2960 raft_consensus.cc:515] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.436537 1192 tablet_bootstrap.cc:654] T dd52351082274a4aa12cac468d9a512d P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.436945 2960 leader_election.cc:290] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.437389 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c4e584fad94633ae49332872de0fc3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:20.437600 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c4e584fad94633ae49332872de0fc3" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:20.438026 996 leader_election.cc:343] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.445118 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_86bb57ef76364b77bae98ac8a2491a6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.445755 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86bb57ef76364b77bae98ac8a2491a6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.447438 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9579db20b0e241ecb10d538e86859ffc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.448146 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9579db20b0e241ecb10d538e86859ffc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.459774 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 22ff45b92e084ef58ec8f14947ac35bf (DEFAULT_TABLE table=default.Table_8073617fa67c44b28ca01c349241d3eb [id=dc612e13acc940a6b077d1b2e7b79f35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.460341 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ff45b92e084ef58ec8f14947ac35bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.467651 2960 raft_consensus.cc:493] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.467797 2960 raft_consensus.cc:515] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.468914 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1142b61e40e6499e8244d71f2ad39b1e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:20.469558 996 leader_election.cc:343] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.470429 457 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet a95c684f5fe54f7dad6300efb0c18780 (table default.Table_57baa761ff0f4e189d6b46fada3d0d9f [id=02d0cb31737b4289988e982dd24ae298]). Expected version 1 got 0
I20260616 19:52:20.470834 457 catalog_manager.cc:5696] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } }
I20260616 19:52:20.471278 457 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 8b7e2d8c25b8464b94ca386566abc2cc (table default.Table_9c19749d8e8a4eaeaa2294ca29ea85dc [id=a12694adb1ba4cfabe42db00e13b002b]). Expected version 1 got 0
W20260616 19:52:20.472379 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 685aadc62418461ebad96b58a9ccca35 consensus state has no leader
I20260616 19:52:20.474759 886 tablet_service.cc:1511] Processing CreateTablet for tablet 22ff45b92e084ef58ec8f14947ac35bf (DEFAULT_TABLE table=default.Table_8073617fa67c44b28ca01c349241d3eb [id=dc612e13acc940a6b077d1b2e7b79f35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.477275 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_57baa761ff0f4e189d6b46fada3d0d9f" } modify_external_catalogs: true
I20260616 19:52:20.477456 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_57baa761ff0f4e189d6b46fada3d0d9f" } modify_external_catalogs: true
I20260616 19:52:20.479457 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 50797706bd3a40099d64c292c32bf1f0
I20260616 19:52:20.480002 458 catalog_manager.cc:6784] ReplaceTablet: tablet 50797706bd3a40099d64c292c32bf1f0 deleted and replaced by tablet dbc1f0a59a9c4e37b5da131faaf04233
W20260616 19:52:20.482033 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04e36dc0843b438fa14a5c64e4f0d430 consensus state has no leader
I20260616 19:52:20.484679 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 50797706bd3a40099d64c292c32bf1f0 with delete_type TABLET_DATA_DELETED (replaced by tablet dbc1f0a59a9c4e37b5da131faaf04233) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:20.484942 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ff45b92e084ef58ec8f14947ac35bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.485263 763 tablet_service.cc:1511] Processing CreateTablet for tablet 37518377bea8455b98f0e802f9420b4d (DEFAULT_TABLE table=default.Table_44fee7679648424894edbdd8abdd1d22 [id=ac66fe34a8c849479617b68da1f5a159]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:20.438156 993 leader_election.cc:343] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.487516 2960 leader_election.cc:290] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.487677 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 50797706bd3a40099d64c292c32bf1f0 with delete_type TABLET_DATA_DELETED (replaced by tablet dbc1f0a59a9c4e37b5da131faaf04233) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.489636 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_45f727fb97db43d3bdbf9b1046001a45" } new_table_name: "default.Table_68e9accc13954f6aa73089a9af5f18a8" modify_external_catalogs: true
I20260616 19:52:20.491161 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9c4283b5023f48ce914506250ea80e4b" } modify_external_catalogs: true
I20260616 19:52:20.491382 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9c4283b5023f48ce914506250ea80e4b" } modify_external_catalogs: true
I20260616 19:52:20.491629 896 tablet_service.cc:1511] Processing CreateTablet for tablet 37518377bea8455b98f0e802f9420b4d (DEFAULT_TABLE table=default.Table_44fee7679648424894edbdd8abdd1d22 [id=ac66fe34a8c849479617b68da1f5a159]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.494174 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_809de6876da84671a331e9af0e5ba887"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.494704 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_809de6876da84671a331e9af0e5ba887 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.501370 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37518377bea8455b98f0e802f9420b4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.505019 1196 tablet_bootstrap.cc:492] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:20.507925 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37518377bea8455b98f0e802f9420b4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.512621 1193 ts_tablet_manager.cc:1929] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.512598 2745 consensus_queue.cc:1048] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260616 19:52:20.512598 1196 ts_tablet_manager.cc:1403] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.308s user 0.012s sys 0.008s
I20260616 19:52:20.514959 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 24278ccfca6742aa8972d2b3d2c612d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:20.519706 718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 240054us
I20260616 19:52:20.522233 2985 raft_consensus.cc:493] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.523274 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352ca272888f4dd2ab1a8127bb8c2b6e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:20.524047 1191 ts_tablet_manager.cc:1929] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.524204 1191 log.cc:1199] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/c48314f8e45d4b198306f0ae6e40def7
I20260616 19:52:20.524849 1191 ts_tablet_manager.cc:1950] T c48314f8e45d4b198306f0ae6e40def7 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:20.525218 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1212) took 3533 ms. Trace:
I20260616 19:52:20.525530 1191 rpcz_store.cc:276] 0616 19:52:16.991753 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.991800 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:20.200838 (+3209038us) ts_tablet_manager.cc:1151] Deleting tablet c48314f8e45d4b198306f0ae6e40def7
0616 19:52:20.200849 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.205333 (+ 4484us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.523983 (+318650us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.525204 (+ 1221us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3163599}
I20260616 19:52:20.487340 993 leader_election.cc:304] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:20.528553 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 90443us
I20260616 19:52:20.525938 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 37518377bea8455b98f0e802f9420b4d (DEFAULT_TABLE table=default.Table_44fee7679648424894edbdd8abdd1d22 [id=ac66fe34a8c849479617b68da1f5a159]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.529753 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37518377bea8455b98f0e802f9420b4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.530344 2960 raft_consensus.cc:2749] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:20.532624 1034 tablet_service.cc:1511] Processing CreateTablet for tablet be2d3e31cff94425b3d39099fbacf51d (DEFAULT_TABLE table=default.Table_73c81e294f264ad895094c30b52168f4 [id=3b179fd15b0645f68a3679f1efe3c2b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.532991 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be2d3e31cff94425b3d39099fbacf51d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.535715 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 337e69cd790146b59d443297ec220c9e (DEFAULT_TABLE table=default.Table_91f3b18de4544e1f955b7e68395c0c61 [id=866cb44087004030b8399634e7fcc0e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.539840 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cd1ad6e8744d33a2845e9f3dda4a7b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:20.539948 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352ca272888f4dd2ab1a8127bb8c2b6e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:20.543385 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1142b61e40e6499e8244d71f2ad39b1e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:20.543527 886 tablet_service.cc:1511] Processing CreateTablet for tablet be2d3e31cff94425b3d39099fbacf51d (DEFAULT_TABLE table=default.Table_73c81e294f264ad895094c30b52168f4 [id=3b179fd15b0645f68a3679f1efe3c2b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.543998 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c19c2e43a944893b86982bee1eb2f30" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:20.544291 784 raft_consensus.cc:3060] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.544356 2985 raft_consensus.cc:515] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.544940 2985 leader_election.cc:290] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.545744 2845 raft_consensus.cc:493] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.545885 2845 raft_consensus.cc:515] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.546403 2845 leader_election.cc:290] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.547079 784 raft_consensus.cc:2468] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:20.547020 757 tablet_service.cc:1511] Processing CreateTablet for tablet 337e69cd790146b59d443297ec220c9e (DEFAULT_TABLE table=default.Table_91f3b18de4544e1f955b7e68395c0c61 [id=866cb44087004030b8399634e7fcc0e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.547536 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337e69cd790146b59d443297ec220c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.547706 1193 log.cc:1199] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/2f1e12555be64192860eab59b3aeb562
I20260616 19:52:20.548454 1193 ts_tablet_manager.cc:1950] T 2f1e12555be64192860eab59b3aeb562 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:20.548482 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be2d3e31cff94425b3d39099fbacf51d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.548419 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc0c02ef58d4e429855e5bbaa4752ad" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:20.549244 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1243) took 2845 ms. Trace:
I20260616 19:52:20.549345 1193 rpcz_store.cc:276] 0616 19:52:17.703851 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.704226 (+ 375us) service_pool.cc:224] Handling call
0616 19:52:20.325622 (+2621396us) ts_tablet_manager.cc:1151] Deleting tablet 2f1e12555be64192860eab59b3aeb562
0616 19:52:20.325636 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.430104 (+104468us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.505919 (+ 75815us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.549195 (+ 43276us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2621262}
I20260616 19:52:20.549882 1193 tablet_replica.cc:333] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:20.550082 1193 raft_consensus.cc:2243] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:20.554435 892 tablet_service.cc:1511] Processing CreateTablet for tablet 337e69cd790146b59d443297ec220c9e (DEFAULT_TABLE table=default.Table_91f3b18de4544e1f955b7e68395c0c61 [id=866cb44087004030b8399634e7fcc0e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.555190 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 2f1e12555be64192860eab59b3aeb562 (table default.Table_3f1ead1791b844acbe29bd0f9c9e6488 [id=91826dbfc6aa417cba9e7f3cc5fb8dba]) successfully deleted
I20260616 19:52:20.555908 747 tablet_service.cc:1511] Processing CreateTablet for tablet 52bfc18649034216a2cca73c14a1495e (DEFAULT_TABLE table=default.Table_9eed87a7b66e4e379a000d4b0b594e69 [id=aaecd5b49a8541ea8d3c28e028bd7b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.556187 1193 raft_consensus.cc:2272] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.557669 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337e69cd790146b59d443297ec220c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.560583 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03e6a2614564eeeb8ec382b16f0ece1" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:20.561003 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52bfc18649034216a2cca73c14a1495e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.561088 781 raft_consensus.cc:3060] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.563531 781 raft_consensus.cc:2468] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:20.563722 1193 ts_tablet_manager.cc:1916] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:20.569420 781 raft_consensus.cc:3060] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.555769 746 tablet_service.cc:1511] Processing CreateTablet for tablet be2d3e31cff94425b3d39099fbacf51d (DEFAULT_TABLE table=default.Table_73c81e294f264ad895094c30b52168f4 [id=3b179fd15b0645f68a3679f1efe3c2b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.573433 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be2d3e31cff94425b3d39099fbacf51d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:20.573635 718 leader_election.cc:343] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:20.574069 718 leader_election.cc:343] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:20.574374 718 leader_election.cc:343] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.577471 898 tablet_service.cc:1511] Processing CreateTablet for tablet 52bfc18649034216a2cca73c14a1495e (DEFAULT_TABLE table=default.Table_9eed87a7b66e4e379a000d4b0b594e69 [id=aaecd5b49a8541ea8d3c28e028bd7b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.577867 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52bfc18649034216a2cca73c14a1495e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.579668 456 master_service.cc:960] ReplaceTablet: received request to replace tablet a0313e65e6a3441abcd663110cfcd70d from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:20.581717 2937 raft_consensus.cc:493] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.581776 2679 raft_consensus.cc:493] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.581887 2679 raft_consensus.cc:515] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.581890 2937 raft_consensus.cc:515] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.582652 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6dc34b00414a0d94b01f579994eb4c" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:20.582806 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 50797706bd3a40099d64c292c32bf1f0 with delete_type TABLET_DATA_DELETED (replaced by tablet dbc1f0a59a9c4e37b5da131faaf04233) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.583886 2662 consensus_queue.cc:1048] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:20.584084 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189a715da140a6833801681bbd5ef4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:20.585955 2700 consensus_queue.cc:1048] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260616 19:52:20.585995 1196 raft_consensus.cc:359] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.586171 1196 raft_consensus.cc:385] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.586268 1196 raft_consensus.cc:740] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.586417 1192 tablet_bootstrap.cc:492] T dd52351082274a4aa12cac468d9a512d P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:20.586490 1196 consensus_queue.cc:260] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.586581 1192 ts_tablet_manager.cc:1403] T dd52351082274a4aa12cac468d9a512d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.152s user 0.005s sys 0.007s
I20260616 19:52:20.586989 1196 ts_tablet_manager.cc:1434] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.074s user 0.002s sys 0.000s
I20260616 19:52:20.587294 1196 tablet_bootstrap.cc:492] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:20.587917 1192 raft_consensus.cc:359] T dd52351082274a4aa12cac468d9a512d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.588090 1192 raft_consensus.cc:385] T dd52351082274a4aa12cac468d9a512d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.588369 1192 raft_consensus.cc:740] T dd52351082274a4aa12cac468d9a512d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.588619 1192 consensus_queue.cc:260] T dd52351082274a4aa12cac468d9a512d P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.590118 2679 leader_election.cc:290] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:20.590358 1192 ts_tablet_manager.cc:1434] T dd52351082274a4aa12cac468d9a512d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260616 19:52:20.590464 718 leader_election.cc:343] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.590655 1192 tablet_bootstrap.cc:492] T 1a95eafa064b4b95b5281915ea5bd9f7 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:52:20.591524 718 leader_election.cc:343] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.593369 1196 tablet_bootstrap.cc:654] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.593623 1193 ts_tablet_manager.cc:1929] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.593748 1193 log.cc:1199] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/5c74b39e66d344b99f8fc75b855c0520
I20260616 19:52:20.594149 1193 ts_tablet_manager.cc:1950] T 5c74b39e66d344b99f8fc75b855c0520 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:20.594473 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e2861c41f402d88cafe64a6871429" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:20.596036 784 raft_consensus.cc:2468] T e85e2861c41f402d88cafe64a6871429 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:20.597867 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1244) took 2893 ms. Trace:
I20260616 19:52:20.598300 1193 rpcz_store.cc:276] 0616 19:52:17.703969 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.704384 (+ 415us) service_pool.cc:224] Handling call
0616 19:52:20.549803 (+2845419us) ts_tablet_manager.cc:1151] Deleting tablet 5c74b39e66d344b99f8fc75b855c0520
0616 19:52:20.549815 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.566276 (+ 16461us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.593549 (+ 27273us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.597559 (+ 4010us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2845255}
I20260616 19:52:20.599643 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 5c74b39e66d344b99f8fc75b855c0520 (table default.Table_7af2cb04d4654ceabe58936f5a687406 [id=7f7faf7145fd4ea5babd783d76d44821]) successfully deleted
I20260616 19:52:20.618690 2937 leader_election.cc:290] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:20.619861 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1245) took 2454 ms. Trace:
I20260616 19:52:20.619998 1193 rpcz_store.cc:276] 0616 19:52:18.165517 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.165571 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:20.600280 (+2434709us) ts_tablet_manager.cc:1151] Deleting tablet 4819496da1bc4421b1641b8441546879
0616 19:52:20.600290 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.619831 (+ 19541us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2434388}
I20260616 19:52:20.621405 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d277058fb12749f5b6c12e3d9e16919f" } new_table_name: "default.Table_add74956c05442b788a2161eaeda5d48" modify_external_catalogs: true
W20260616 19:52:20.622066 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 4819496da1bc4421b1641b8441546879 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4819496da1bc4421b1641b8441546879 already in progress: creating tablet
I20260616 19:52:20.622212 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e1ef4766e04c4030a2f1a81c5c761f0a" } modify_external_catalogs: true
I20260616 19:52:20.622362 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_e1ef4766e04c4030a2f1a81c5c761f0a" } modify_external_catalogs: true
I20260616 19:52:20.622625 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1246) took 2446 ms. Trace:
I20260616 19:52:20.622725 1193 rpcz_store.cc:276] 0616 19:52:18.175991 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.176043 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:20.622492 (+2446449us) ts_tablet_manager.cc:1151] Deleting tablet 892ec2013b9f4c9292bf745e2aeae4ed
0616 19:52:20.622503 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.622606 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2446284}
W20260616 19:52:20.623135 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 892ec2013b9f4c9292bf745e2aeae4ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 892ec2013b9f4c9292bf745e2aeae4ed already in progress: creating tablet
I20260616 19:52:20.623417 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fd2877e9bb114ec3ac154536733fe899" } new_table_name: "default.Table_0de44fae23f947f3bf6ab115c401073d" modify_external_catalogs: true
I20260616 19:52:20.624861 1190 ts_tablet_manager.cc:1929] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.626312 453 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_44aec49c206e4527939d533088c54ba6 [id=b7d5c502d76f428683cb0830f0819011] alter complete (version 3)
W20260616 19:52:20.626339 860 leader_election.cc:343] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 802d30c340494490896c8da33d110708
I20260616 19:52:20.627310 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1247) took 2439 ms. Trace:
I20260616 19:52:20.628417 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 61189a715da140a6833801681bbd5ef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.628692 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 352ca272888f4dd2ab1a8127bb8c2b6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.628644 757 tablet_service.cc:1558] Processing DeleteTablet for tablet e03e6a2614564eeeb8ec382b16f0ece1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.628185 1193 rpcz_store.cc:276] 0616 19:52:18.187485 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.187538 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:20.626136 (+2438598us) ts_tablet_manager.cc:1151] Deleting tablet 8e8ee572626a42909f31874a55b5cbb6
0616 19:52:20.626148 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.627142 (+ 994us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2438197}
W20260616 19:52:20.629518 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 8e8ee572626a42909f31874a55b5cbb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e8ee572626a42909f31874a55b5cbb6 already in progress: creating tablet
I20260616 19:52:20.631500 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3a39176359734a00bb540aaddb873b29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.632030 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a39176359734a00bb540aaddb873b29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.633424 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2a5f3eb8fe14467f80b2d3222e2f2963" } modify_external_catalogs: true
I20260616 19:52:20.633585 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2a5f3eb8fe14467f80b2d3222e2f2963" } modify_external_catalogs: true
I20260616 19:52:20.635161 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1248) took 2041 ms. Trace:
I20260616 19:52:20.635886 1193 rpcz_store.cc:276] 0616 19:52:18.593793 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.593950 (+ 157us) service_pool.cc:224] Handling call
0616 19:52:20.634012 (+2040062us) ts_tablet_manager.cc:1151] Deleting tablet 51983531f0f5423aa5f4bb3435cd5a7e
0616 19:52:20.634247 (+ 235us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.634919 (+ 672us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2039759}
W20260616 19:52:20.637737 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 51983531f0f5423aa5f4bb3435cd5a7e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51983531f0f5423aa5f4bb3435cd5a7e already in progress: creating tablet
I20260616 19:52:20.638762 1193 tablet_replica.cc:333] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
W20260616 19:52:20.639601 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1106555fe0f44aa595f2ba00a19e914a consensus state has no leader
I20260616 19:52:20.640770 1193 raft_consensus.cc:2243] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:20.644716 1190 log.cc:1199] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/67ac2e31a1ba40b39145c26a1e4e0884
I20260616 19:52:20.645263 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e2861c41f402d88cafe64a6871429" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:52:20.645449 993 leader_election.cc:343] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.645459 1057 raft_consensus.cc:2468] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:20.645591 993 leader_election.cc:304] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:20.646772 2960 raft_consensus.cc:2749] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:20.649454 1190 ts_tablet_manager.cc:1950] T 67ac2e31a1ba40b39145c26a1e4e0884 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:20.649961 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1105) took 6079 ms. Trace:
I20260616 19:52:20.650084 1190 rpcz_store.cc:276] 0616 19:52:14.570428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.570490 (+ 62us) service_pool.cc:224] Handling call
0616 19:52:20.297826 (+5727336us) ts_tablet_manager.cc:1151] Deleting tablet 67ac2e31a1ba40b39145c26a1e4e0884
0616 19:52:20.300926 (+ 3100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.483881 (+182955us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.621384 (+137503us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.649941 (+ 28557us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5727170}
I20260616 19:52:20.650655 1190 tablet_replica.cc:333] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:20.650807 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c1c2bc4741f3413c82928ec446904f14
I20260616 19:52:20.650897 1190 raft_consensus.cc:2243] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:20.651307 1190 raft_consensus.cc:2272] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.651844 761 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c2bc4741f3413c82928ec446904f14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.652001 1190 ts_tablet_manager.cc:1916] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:20.653887 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 67ac2e31a1ba40b39145c26a1e4e0884 (table default.Table_a438724efd6349269d52e1958ce629fc [id=979c551af45f4055ac350d0db71fa793]) successfully deleted
I20260616 19:52:20.656809 1193 raft_consensus.cc:2272] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.658281 1193 ts_tablet_manager.cc:1916] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:20.660601 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c42c60c1f10c4fc698f29ed1c5b728de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:20.661208 898 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c2bc4741f3413c82928ec446904f14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:20.661262 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c42c60c1f10c4fc698f29ed1c5b728de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.664312 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2758d8e8b9d74f17bf976b49f830f29c" } modify_external_catalogs: true
I20260616 19:52:20.664508 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2758d8e8b9d74f17bf976b49f830f29c" } modify_external_catalogs: true
I20260616 19:52:20.667338 1192 tablet_bootstrap.cc:654] T 1a95eafa064b4b95b5281915ea5bd9f7 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.669265 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 52bfc18649034216a2cca73c14a1495e (DEFAULT_TABLE table=default.Table_9eed87a7b66e4e379a000d4b0b594e69 [id=aaecd5b49a8541ea8d3c28e028bd7b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.671828 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337e69cd790146b59d443297ec220c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.672873 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6dc34b00414a0d94b01f579994eb4c" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:20.673043 1055 raft_consensus.cc:2468] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:20.673496 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189a715da140a6833801681bbd5ef4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:20.673641 1058 raft_consensus.cc:2468] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:20.673895 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52bfc18649034216a2cca73c14a1495e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.677487 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet c48314f8e45d4b198306f0ae6e40def7 (table default.Table_3fc9d9c9f0844372a2c28932bf508e6d [id=a1533cc8be3c405b9474aa29dc71aa5e]) successfully deleted
W20260616 19:52:20.677902 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 26f89b3c9aeb45b0bc096673c11b988e consensus state has no leader
I20260616 19:52:20.678649 719 leader_election.cc:304] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:20.679066 719 leader_election.cc:304] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:20.679513 2745 raft_consensus.cc:2804] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:20.679584 2745 raft_consensus.cc:493] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:20.679647 2745 raft_consensus.cc:3060] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.679687 2985 raft_consensus.cc:2804] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:20.679778 2985 raft_consensus.cc:493] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:20.679857 2985 raft_consensus.cc:3060] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.682431 2985 raft_consensus.cc:515] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.682494 2745 raft_consensus.cc:515] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.683050 2985 leader_election.cc:290] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.683230 2745 leader_election.cc:290] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.687003 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_257e05583d3a4741b5e7b618b460e212"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.687595 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_257e05583d3a4741b5e7b618b460e212 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.687726 860 leader_election.cc:304] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:20.688002 2937 raft_consensus.cc:2804] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:20.688066 2937 raft_consensus.cc:493] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:20.688117 2937 raft_consensus.cc:3060] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.688192 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189a715da140a6833801681bbd5ef4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:20.688351 1053 raft_consensus.cc:3060] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.688896 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6dc34b00414a0d94b01f579994eb4c" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:20.689049 1058 raft_consensus.cc:3060] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.690752 2937 raft_consensus.cc:515] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.691448 2937 leader_election.cc:290] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:20.698074 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c2bc4741f3413c82928ec446904f14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.704386 1198 tablet_bootstrap.cc:654] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.716027 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189a715da140a6833801681bbd5ef4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:20.716600 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6dc34b00414a0d94b01f579994eb4c" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:20.718051 718 leader_election.cc:343] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.721563 3032 tablet.cc:1724] T 29df38f273494a079bdc76a915d43dab P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:20.718236 2745 consensus_queue.cc:1048] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:20.724146 1191 tablet_replica.cc:333] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:20.724334 1191 raft_consensus.cc:2243] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:20.724500 1191 raft_consensus.cc:2272] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.725136 1191 ts_tablet_manager.cc:1916] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:20.724349 718 leader_election.cc:343] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.726248 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e2861c41f402d88cafe64a6871429" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:20.726468 775 raft_consensus.cc:3060] T e85e2861c41f402d88cafe64a6871429 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:20.726585 860 consensus_peers.cc:597] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f1e12555be64192860eab59b3aeb562. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:20.726847 916 raft_consensus.cc:3060] T dd52351082274a4aa12cac468d9a512d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.730690 775 raft_consensus.cc:2468] T e85e2861c41f402d88cafe64a6871429 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:20.732272 916 raft_consensus.cc:1275] T dd52351082274a4aa12cac468d9a512d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Refusing update from remote peer 7245e7dab0ec474a876537be514c8767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:52:20.723554 1192 tablet_bootstrap.cc:492] T 1a95eafa064b4b95b5281915ea5bd9f7 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:20.732645 1192 ts_tablet_manager.cc:1403] T 1a95eafa064b4b95b5281915ea5bd9f7 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.142s user 0.003s sys 0.006s
I20260616 19:52:20.733131 3013 tablet.cc:1724] T 73fc9d2ca8a644f69e0bc3e9ccecc3cf P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:20.738994 1190 ts_tablet_manager.cc:1929] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.739114 1190 log.cc:1199] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/9d9c89216995430188b1eed4c6b26d1e
I20260616 19:52:20.739563 1053 raft_consensus.cc:2468] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:20.740602 860 consensus_peers.cc:597] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba0d3e7da3c74f5ea5dc4aac80a01c82. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:20.742059 1192 raft_consensus.cc:359] T 1a95eafa064b4b95b5281915ea5bd9f7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.742246 1192 raft_consensus.cc:385] T 1a95eafa064b4b95b5281915ea5bd9f7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.742316 1192 raft_consensus.cc:740] T 1a95eafa064b4b95b5281915ea5bd9f7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.743242 860 leader_election.cc:304] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:20.743527 2937 raft_consensus.cc:2804] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:20.744060 719 leader_election.cc:304] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:20.744802 2937 raft_consensus.cc:697] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:20.745110 2937 consensus_queue.cc:237] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.747105 2985 raft_consensus.cc:2804] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:20.747252 2985 raft_consensus.cc:697] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:20.747493 2985 consensus_queue.cc:237] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.752645 1192 consensus_queue.cc:260] T 1a95eafa064b4b95b5281915ea5bd9f7 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.752910 1190 ts_tablet_manager.cc:1950] T 9d9c89216995430188b1eed4c6b26d1e P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:20.757578 3035 tablet.cc:1724] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:20.758569 2985 consensus_queue.cc:1048] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:20.760962 1192 ts_tablet_manager.cc:1434] T 1a95eafa064b4b95b5281915ea5bd9f7 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260616 19:52:20.761224 1192 tablet_bootstrap.cc:492] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:20.767549 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1106) took 6155 ms. Trace:
I20260616 19:52:20.767639 1190 rpcz_store.cc:276] 0616 19:52:14.613608 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.613675 (+ 67us) service_pool.cc:224] Handling call
0616 19:52:20.650598 (+6036923us) ts_tablet_manager.cc:1151] Deleting tablet 9d9c89216995430188b1eed4c6b26d1e
0616 19:52:20.650610 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.665529 (+ 14919us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.738925 (+ 73396us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.767530 (+ 28605us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13703,"tablet-delete.queue_time_us":6036747}
I20260616 19:52:20.768069 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 9d9c89216995430188b1eed4c6b26d1e (table default.Table_52ebd4cc32a242b6af90514f289aaffd [id=a02891a271e04ca084884abd17c9bee1]) successfully deleted
I20260616 19:52:20.770714 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1107) took 6113 ms. Trace:
I20260616 19:52:20.770843 1190 rpcz_store.cc:276] 0616 19:52:14.657293 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.657476 (+ 183us) service_pool.cc:224] Handling call
0616 19:52:20.770613 (+6113137us) ts_tablet_manager.cc:1151] Deleting tablet 76a89e7686aa44df9bb017816d1accb1
0616 19:52:20.770622 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.770699 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6112956}
W20260616 19:52:20.771435 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 76a89e7686aa44df9bb017816d1accb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76a89e7686aa44df9bb017816d1accb1 already in progress: creating tablet
I20260616 19:52:20.774055 1058 raft_consensus.cc:2468] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:20.774387 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1108) took 6083 ms. Trace:
I20260616 19:52:20.774463 1190 rpcz_store.cc:276] 0616 19:52:14.691367 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.691419 (+ 52us) service_pool.cc:224] Handling call
0616 19:52:20.774264 (+6082845us) ts_tablet_manager.cc:1151] Deleting tablet e88de49e07a4467d9698d71c321c16f5
0616 19:52:20.774274 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.774372 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6082665}
W20260616 19:52:20.774876 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet e88de49e07a4467d9698d71c321c16f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e88de49e07a4467d9698d71c321c16f5 already in progress: creating tablet
I20260616 19:52:20.776103 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1109) took 6043 ms. Trace:
I20260616 19:52:20.778761 719 leader_election.cc:304] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:20.779249 1196 tablet_bootstrap.cc:492] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:20.779675 1196 ts_tablet_manager.cc:1403] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.192s user 0.007s sys 0.001s
I20260616 19:52:20.779587 2985 raft_consensus.cc:2804] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:20.780735 2985 raft_consensus.cc:697] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:20.781124 2985 consensus_queue.cc:237] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.785202 1196 raft_consensus.cc:359] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.785440 1196 raft_consensus.cc:385] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.785568 1196 raft_consensus.cc:740] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.785853 1196 consensus_queue.cc:260] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.786471 1196 ts_tablet_manager.cc:1434] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260616 19:52:20.786813 1196 tablet_bootstrap.cc:492] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:20.791313 3013 tablet.cc:1724] T 29df38f273494a079bdc76a915d43dab P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:20.792222 1190 rpcz_store.cc:276] 0616 19:52:14.732857 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.732910 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:20.776006 (+6043096us) ts_tablet_manager.cc:1151] Deleting tablet cd19e83413ad420e97af92ca609757e5
0616 19:52:20.776015 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.776087 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6042904}
W20260616 19:52:20.792768 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet cd19e83413ad420e97af92ca609757e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd19e83413ad420e97af92ca609757e5 already in progress: creating tablet
I20260616 19:52:20.793560 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1110) took 6000 ms. Trace:
I20260616 19:52:20.795584 1190 rpcz_store.cc:276] 0616 19:52:14.793170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:14.793223 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:20.793424 (+6000201us) ts_tablet_manager.cc:1151] Deleting tablet 8f67e5add64244629cbe8694223bd00e
0616 19:52:20.793436 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.793540 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6000025}
W20260616 19:52:20.797408 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 8f67e5add64244629cbe8694223bd00e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f67e5add64244629cbe8694223bd00e already in progress: creating tablet
I20260616 19:52:20.792096 1192 tablet_bootstrap.cc:654] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.798697 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1112) took 5793 ms. Trace:
I20260616 19:52:20.796411 3013 tablet.cc:1724] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:20.801651 1053 raft_consensus.cc:1275] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Refusing update from remote peer 7245e7dab0ec474a876537be514c8767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260616 19:52:20.802217 747 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9f9b7d86984ee6b75f8cd4b87ca3b9 (DEFAULT_TABLE table=default.Table_48b28e7db53c426695b8938921f3a837 [id=3009ee31846f41cf8a489a729ec3d406]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.802237 3012 consensus_queue.cc:1048] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:20.802680 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9f9b7d86984ee6b75f8cd4b87ca3b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.810406 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 76c48e233d184487b7651e9cb105c2cc (table default.Table_8640034462d64b5d879d28e067fe1b14 [id=d24b6a6d28c949b2880a34bfa227c585]). Expected version 2 got 0
I20260616 19:52:20.810773 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 61132c1c9cd24b7d923f1d65ad04c340 (table default.Table_9eb13a45afad449a9bf9b25a0f5d4d1d [id=e8db7417fd294af4b160a434625e9fd0]). Expected version 2 got 0
I20260616 19:52:20.811082 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet dd52351082274a4aa12cac468d9a512d (table default.Table_3bee557dbc924f6b982089749d9abe7b [id=ae7663c7da4444f1a6ef328ba7bd3494]). Expected version 2 got 0
I20260616 19:52:20.811347 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 2141b6c7013648a4b716642ccb4eccd6 (table default.Table_5047c84664124989b931ee92afc5b463 [id=bc83d5c728054794b2c3cc0f9b90e202]). Expected version 1 got 0
I20260616 19:52:20.811743 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 41f2d259a31c4f4eaeceaba57fb978b2 (table default.Table_7ffffaef50044d8ba89e6df198946113 [id=d49c093f51b04c2fa1b1f5daadd802cf]). Expected version 3 got 0
I20260616 19:52:20.812186 460 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 31db3862f78943519bcd9531c5530048 (table default.Table_8cda9a799036458f9543a8a8aac3ee5a [id=c72157c1e0f943e4af149e7f692209ee]). Expected version 1 got 0
I20260616 19:52:20.815366 1190 rpcz_store.cc:276] 0616 19:52:15.005530 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.005585 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:20.798583 (+5792998us) ts_tablet_manager.cc:1151] Deleting tablet f5c46a428ff44d26a5c49322087cdf7a
0616 19:52:20.798591 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.798679 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5791924}
I20260616 19:52:20.816442 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1120) took 5386 ms. Trace:
I20260616 19:52:20.816538 1190 rpcz_store.cc:276] 0616 19:52:15.429468 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.430449 (+ 981us) service_pool.cc:224] Handling call
0616 19:52:20.816311 (+5385862us) ts_tablet_manager.cc:1151] Deleting tablet 0c281b936f2147b9989f03a3e1b6884e
0616 19:52:20.816332 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.816423 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5385709}
I20260616 19:52:20.818070 3047 tablet.cc:1724] T 29df38f273494a079bdc76a915d43dab P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:20.801266 898 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9f9b7d86984ee6b75f8cd4b87ca3b9 (DEFAULT_TABLE table=default.Table_48b28e7db53c426695b8938921f3a837 [id=3009ee31846f41cf8a489a729ec3d406]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.819048 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9f9b7d86984ee6b75f8cd4b87ca3b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.803905 3035 tablet.cc:1724] T dd52351082274a4aa12cac468d9a512d P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260616 19:52:20.824110 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet f5c46a428ff44d26a5c49322087cdf7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5c46a428ff44d26a5c49322087cdf7a already in progress: creating tablet
I20260616 19:52:20.824484 2845 consensus_queue.cc:1048] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:20.824569 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 0c281b936f2147b9989f03a3e1b6884e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c281b936f2147b9989f03a3e1b6884e already in progress: creating tablet
I20260616 19:52:20.825446 3033 tablet.cc:1724] T dd52351082274a4aa12cac468d9a512d P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:20.770961 3037 tablet.cc:1724] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260616 19:52:20.824360 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1142) took 5369 ms. Trace:
I20260616 19:52:20.826785 1190 rpcz_store.cc:276] 0616 19:52:15.454070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:15.688113 (+234043us) service_pool.cc:224] Handling call
0616 19:52:20.823706 (+5135593us) ts_tablet_manager.cc:1151] Deleting tablet 0a9e8877705840329d6a063bb5194965
0616 19:52:20.823714 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.823791 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5101112}
I20260616 19:52:20.827145 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1170) took 4763 ms. Trace:
I20260616 19:52:20.827221 1190 rpcz_store.cc:276] 0616 19:52:16.063939 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.160679 (+ 96740us) service_pool.cc:224] Handling call
0616 19:52:20.827039 (+4666360us) ts_tablet_manager.cc:1151] Deleting tablet 170cf5905025434995e7c9cdc802211b
0616 19:52:20.827049 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.827131 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4666148}
W20260616 19:52:20.830411 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 0a9e8877705840329d6a063bb5194965 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a9e8877705840329d6a063bb5194965 already in progress: creating tablet
W20260616 19:52:20.830687 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 170cf5905025434995e7c9cdc802211b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 170cf5905025434995e7c9cdc802211b already in progress: creating tablet
I20260616 19:52:20.832337 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1171) took 4731 ms. Trace:
I20260616 19:52:20.832414 1190 rpcz_store.cc:276] 0616 19:52:16.100817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.160900 (+ 60083us) service_pool.cc:224] Handling call
0616 19:52:20.827472 (+4666572us) ts_tablet_manager.cc:1151] Deleting tablet 5c6add7925294880a5a20eb3d189d1ee
0616 19:52:20.827480 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.832321 (+ 4841us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4666436}
W20260616 19:52:20.832825 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 5c6add7925294880a5a20eb3d189d1ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c6add7925294880a5a20eb3d189d1ee already in progress: creating tablet
I20260616 19:52:20.833834 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1172) took 4635 ms. Trace:
I20260616 19:52:20.834901 2985 consensus_queue.cc:1048] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:20.840770 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet bf8cd47ad89246fe8a7726aed35cf657
W20260616 19:52:20.841750 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe39df8bd431402ba646f632939eba3a consensus state has no leader
I20260616 19:52:20.842166 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_22f2a0166bdd4fdcbe77171612792138"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.842806 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22f2a0166bdd4fdcbe77171612792138 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.843735 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 73fc9d2ca8a644f69e0bc3e9ccecc3cf (table default.Table_44aec49c206e4527939d533088c54ba6 [id=b7d5c502d76f428683cb0830f0819011]). Expected version 3 got 0
I20260616 19:52:20.845773 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_ef3897a753a842809aa6476dbe464fe3" } new_table_name: "default.Table_7cb34f0e43a141ed8e0c480d973aa607" modify_external_catalogs: true
I20260616 19:52:20.846067 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a2e5bc2c47746e88e95634fb073273e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.846123 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet bf8cd47ad89246fe8a7726aed35cf657 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.833914 1190 rpcz_store.cc:276] 0616 19:52:16.198804 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.209463 (+ 10659us) service_pool.cc:224] Handling call
0616 19:52:20.833734 (+4624271us) ts_tablet_manager.cc:1151] Deleting tablet a12cd3744782442f94dc6e76727cca1c
0616 19:52:20.833744 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.833819 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4624049}
I20260616 19:52:20.851485 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1174) took 4563 ms. Trace:
I20260616 19:52:20.851568 1190 rpcz_store.cc:276] 0616 19:52:16.287652 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.288651 (+ 999us) service_pool.cc:224] Handling call
0616 19:52:20.851342 (+4562691us) ts_tablet_manager.cc:1151] Deleting tablet ba092edcdecf485e96a392b3ea79b01a
0616 19:52:20.851355 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.851464 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4562465}
I20260616 19:52:20.853819 1198 tablet_bootstrap.cc:492] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:20.854029 1198 ts_tablet_manager.cc:1403] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.498s user 0.008s sys 0.000s
W20260616 19:52:20.854610 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a12cd3744782442f94dc6e76727cca1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a12cd3744782442f94dc6e76727cca1c already in progress: creating tablet
W20260616 19:52:20.854919 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet ba092edcdecf485e96a392b3ea79b01a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba092edcdecf485e96a392b3ea79b01a already in progress: creating tablet
I20260616 19:52:20.854874 1198 raft_consensus.cc:359] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.855094 1198 raft_consensus.cc:385] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.855201 1198 raft_consensus.cc:740] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.855494 1198 consensus_queue.cc:260] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.855734 898 tablet_service.cc:1558] Processing DeleteTablet for tablet bf8cd47ad89246fe8a7726aed35cf657 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:20.855855 2962 raft_consensus.cc:493] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:20.855960 2962 raft_consensus.cc:515] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.856552 2962 leader_election.cc:290] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:20.857146 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91fad69dcb8d4e7b8c3dc6da0b941f5c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:20.857452 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1173) took 4570 ms. Trace:
I20260616 19:52:20.857520 1190 rpcz_store.cc:276] 0616 19:52:16.287513 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.289986 (+ 2473us) service_pool.cc:224] Handling call
0616 19:52:20.857349 (+4567363us) ts_tablet_manager.cc:1151] Deleting tablet 9f1940f3d73d472c9c68a10539848e9d
0616 19:52:20.857359 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.857436 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4499162}
W20260616 19:52:20.857659 993 leader_election.cc:343] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:20.857865 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 9f1940f3d73d472c9c68a10539848e9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f1940f3d73d472c9c68a10539848e9d already in progress: creating tablet
I20260616 19:52:20.859511 1198 ts_tablet_manager.cc:1434] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260616 19:52:20.859974 1198 tablet_bootstrap.cc:492] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:20.860706 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91fad69dcb8d4e7b8c3dc6da0b941f5c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:20.861249 996 leader_election.cc:343] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:20.861362 996 leader_election.cc:304] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:20.861725 2962 raft_consensus.cc:2749] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:20.863467 1198 tablet_bootstrap.cc:654] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.863407 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9f9b7d86984ee6b75f8cd4b87ca3b9 (DEFAULT_TABLE table=default.Table_48b28e7db53c426695b8938921f3a837 [id=3009ee31846f41cf8a489a729ec3d406]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.863866 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9f9b7d86984ee6b75f8cd4b87ca3b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.864445 761 tablet_service.cc:1511] Processing CreateTablet for tablet b74e00c410474276ba2b052afd9285e2 (DEFAULT_TABLE table=default.Table_06e2b90b7d114fdaa63c3075528179ff [id=c2a921e2accd4b83a2693f6da3d2a655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.864805 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74e00c410474276ba2b052afd9285e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.865290 1034 tablet_service.cc:1511] Processing CreateTablet for tablet b74e00c410474276ba2b052afd9285e2 (DEFAULT_TABLE table=default.Table_06e2b90b7d114fdaa63c3075528179ff [id=c2a921e2accd4b83a2693f6da3d2a655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.865607 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74e00c410474276ba2b052afd9285e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.865978 898 tablet_service.cc:1511] Processing CreateTablet for tablet b74e00c410474276ba2b052afd9285e2 (DEFAULT_TABLE table=default.Table_06e2b90b7d114fdaa63c3075528179ff [id=c2a921e2accd4b83a2693f6da3d2a655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.866619 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74e00c410474276ba2b052afd9285e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.866693 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 0b8477af0adb4e5da637334918fee36d (DEFAULT_TABLE table=default.Table_0acb0d2fafc04473871b8f4c15e6bfac [id=f574b5eee92d4bfc9ba7714b73132d31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.867192 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b8477af0adb4e5da637334918fee36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.868767 757 tablet_service.cc:1511] Processing CreateTablet for tablet 0b8477af0adb4e5da637334918fee36d (DEFAULT_TABLE table=default.Table_0acb0d2fafc04473871b8f4c15e6bfac [id=f574b5eee92d4bfc9ba7714b73132d31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.869084 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b8477af0adb4e5da637334918fee36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.873776 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1184) took 4213 ms. Trace:
I20260616 19:52:20.873870 1190 rpcz_store.cc:276] 0616 19:52:16.660136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.660182 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:20.873665 (+4213483us) ts_tablet_manager.cc:1151] Deleting tablet 14a234e4e45f4b68be478bd4fe409225
0616 19:52:20.873673 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.873758 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4204107}
W20260616 19:52:20.874272 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 14a234e4e45f4b68be478bd4fe409225 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14a234e4e45f4b68be478bd4fe409225 already in progress: creating tablet
I20260616 19:52:20.874809 1196 tablet_bootstrap.cc:654] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.877584 1190 tablet_replica.cc:333] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:20.877843 1190 raft_consensus.cc:2243] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:20.878208 1190 raft_consensus.cc:2272] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.878794 1190 ts_tablet_manager.cc:1916] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:20.881457 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_63c1b65ae6ec44da84f6afa7c1a16ec0" } new_table_name: "default.Table_854fe4853fc74097b1dd9cbbb120c4f4" modify_external_catalogs: true
I20260616 19:52:20.885933 2642 consensus_queue.cc:1048] T 61132c1c9cd24b7d923f1d65ad04c340 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:20.886850 1191 ts_tablet_manager.cc:1929] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.887041 1191 log.cc:1199] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/a0cb7a1acf35403192254bf5cd1170a2
I20260616 19:52:20.887863 1191 ts_tablet_manager.cc:1950] T a0cb7a1acf35403192254bf5cd1170a2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:20.892228 1193 ts_tablet_manager.cc:1929] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:20.892432 1193 log.cc:1199] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/1a95eafa064b4b95b5281915ea5bd9f7
I20260616 19:52:20.905730 1193 ts_tablet_manager.cc:1950] T 1a95eafa064b4b95b5281915ea5bd9f7 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:20.906517 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1249) took 2311 ms. Trace:
I20260616 19:52:20.906680 1193 rpcz_store.cc:276] 0616 19:52:18.595327 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.595583 (+ 256us) service_pool.cc:224] Handling call
0616 19:52:20.638445 (+2042862us) ts_tablet_manager.cc:1151] Deleting tablet 1a95eafa064b4b95b5281915ea5bd9f7
0616 19:52:20.638456 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.761350 (+122894us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.892172 (+130822us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.906499 (+ 14327us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2042487}
I20260616 19:52:20.908752 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet ea986e578afb4c838b15ca7be5f2cc0a
I20260616 19:52:20.912678 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1250) took 2313 ms. Trace:
I20260616 19:52:20.912814 1193 rpcz_store.cc:276] 0616 19:52:18.598917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.598971 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:20.912549 (+2313578us) ts_tablet_manager.cc:1151] Deleting tablet 33a6a46041464e93811b0c573db19f43
0616 19:52:20.912558 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.912661 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2313442}
I20260616 19:52:20.913269 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1251) took 2280 ms. Trace:
W20260616 19:52:20.913534 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 33a6a46041464e93811b0c573db19f43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33a6a46041464e93811b0c573db19f43 already in progress: creating tablet
I20260616 19:52:20.913467 1193 rpcz_store.cc:276] 0616 19:52:18.633060 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.633111 (+ 51us) service_pool.cc:224] Handling call
0616 19:52:20.913145 (+2280034us) ts_tablet_manager.cc:1151] Deleting tablet 574927dc3a804b059e71630c133dcbea
0616 19:52:20.913153 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.913240 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2279853}
I20260616 19:52:20.913998 761 tablet_service.cc:1558] Processing DeleteTablet for tablet ea986e578afb4c838b15ca7be5f2cc0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:20.914079 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 574927dc3a804b059e71630c133dcbea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 574927dc3a804b059e71630c133dcbea already in progress: creating tablet
I20260616 19:52:20.914239 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1253) took 2269 ms. Trace:
I20260616 19:52:20.914482 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet ea986e578afb4c838b15ca7be5f2cc0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.919102 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_2159d026adeb4590a238dacdfcb28e11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.919793 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2159d026adeb4590a238dacdfcb28e11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.920637 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1213) took 3928 ms. Trace:
I20260616 19:52:20.920774 1191 rpcz_store.cc:276] 0616 19:52:16.991832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.991877 (+ 45us) service_pool.cc:224] Handling call
0616 19:52:20.670759 (+3678882us) ts_tablet_manager.cc:1151] Deleting tablet a0cb7a1acf35403192254bf5cd1170a2
0616 19:52:20.724083 (+ 53324us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x61800000ed18. stack: 00007f92671a0086 00007f926719fe40 00007f92661593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f92671889bd 00007f9267189a2e 00007f927afd91ad 00007f927af581d3 00007f92770e1e96 00007f92770e3229 00007f9277116bb4 00007f92770f75d0 00007f92770f735d 0000000000aa681c
0616 19:52:20.724094 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.820370 (+ 96276us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.886769 (+ 66399us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.920614 (+ 33845us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72793856,"tablet-delete.queue_time_us":3633376}
I20260616 19:52:20.921290 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet a0cb7a1acf35403192254bf5cd1170a2 (table default.Table_667b7f908e7349bcb46f2df575854ac2 [id=278c6728a83248e9aaf08c4c18bba31f]) successfully deleted
I20260616 19:52:20.921380 1191 tablet_replica.cc:333] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:20.921576 1191 raft_consensus.cc:2243] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:20.921868 1191 raft_consensus.cc:2272] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.922161 898 tablet_service.cc:1558] Processing DeleteTablet for tablet ea986e578afb4c838b15ca7be5f2cc0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:20.922442 1191 ts_tablet_manager.cc:1916] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:20.923744 3035 tablet.cc:1719] T 41f2d259a31c4f4eaeceaba57fb978b2 P ae28da1c4102450ab76eb2946a5cbf2e: Skipping requested alter to schema version 3, tablet already version 3
I20260616 19:52:20.927716 3013 tablet.cc:1719] T 41f2d259a31c4f4eaeceaba57fb978b2 P 61c874fef3684d10a272a9c7f280e0e2: Skipping requested alter to schema version 3, tablet already version 3
I20260616 19:52:20.931447 898 tablet_service.cc:1511] Processing CreateTablet for tablet 0b8477af0adb4e5da637334918fee36d (DEFAULT_TABLE table=default.Table_0acb0d2fafc04473871b8f4c15e6bfac [id=f574b5eee92d4bfc9ba7714b73132d31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.932713 892 tablet_service.cc:1511] Processing CreateTablet for tablet ddbb87afa67742dc8dbfd84a2e344811 (DEFAULT_TABLE table=default.Table_febc1327d859443d8643ab1e5a58f6b8 [id=4332d3a52cbe407f93994b09d4abafac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.932977 1192 tablet_bootstrap.cc:492] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:20.933171 1192 ts_tablet_manager.cc:1403] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.172s user 0.006s sys 0.002s
I20260616 19:52:20.933952 1192 raft_consensus.cc:359] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.934181 1192 raft_consensus.cc:385] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.934266 1192 raft_consensus.cc:740] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.934562 1192 consensus_queue.cc:260] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.935190 1192 ts_tablet_manager.cc:1434] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:20.936404 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbb87afa67742dc8dbfd84a2e344811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.939479 1193 rpcz_store.cc:276] 0616 19:52:18.645162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.645222 (+ 60us) service_pool.cc:224] Handling call
0616 19:52:20.913824 (+2268602us) ts_tablet_manager.cc:1151] Deleting tablet 290d1bf172f949089e013d24ec64435d
0616 19:52:20.913838 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.914223 (+ 385us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2268401}
W20260616 19:52:20.939990 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 290d1bf172f949089e013d24ec64435d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 290d1bf172f949089e013d24ec64435d already in progress: creating tablet
I20260616 19:52:20.916200 746 tablet_service.cc:1558] Processing DeleteTablet for tablet bf8cd47ad89246fe8a7726aed35cf657 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.922842 3033 tablet.cc:1719] T 41f2d259a31c4f4eaeceaba57fb978b2 P 7245e7dab0ec474a876537be514c8767: Skipping requested alter to schema version 3, tablet already version 3
I20260616 19:52:20.932021 761 tablet_service.cc:1511] Processing CreateTablet for tablet ddbb87afa67742dc8dbfd84a2e344811 (DEFAULT_TABLE table=default.Table_febc1327d859443d8643ab1e5a58f6b8 [id=4332d3a52cbe407f93994b09d4abafac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.940634 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbb87afa67742dc8dbfd84a2e344811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.936039 2642 consensus_queue.cc:1048] T 76c48e233d184487b7651e9cb105c2cc P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:20.942467 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b8477af0adb4e5da637334918fee36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.943795 1193 tablet_replica.cc:333] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:20.944022 1193 raft_consensus.cc:2243] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:20.944370 1193 raft_consensus.cc:2272] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:20.944947 1193 ts_tablet_manager.cc:1916] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:20.948226 1192 tablet_bootstrap.cc:492] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:20.951746 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet a95c684f5fe54f7dad6300efb0c18780
I20260616 19:52:20.952454 1192 tablet_bootstrap.cc:654] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.956018 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 67ac2e31a1ba40b39145c26a1e4e0884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:56 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:20.957962 1198 tablet_bootstrap.cc:492] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:20.958093 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet a95c684f5fe54f7dad6300efb0c18780 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:20.958247 761 tablet_service.cc:1558] Processing DeleteTablet for tablet a95c684f5fe54f7dad6300efb0c18780 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.958123 1198 ts_tablet_manager.cc:1403] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.098s user 0.004s sys 0.000s
I20260616 19:52:20.959872 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c08452aeec471f8480a489620cca28 with delete_type TABLET_DATA_DELETED (replaced by tablet 12944efb54824dc4960db5d09c1a1684) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:20.960516 1198 raft_consensus.cc:359] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.960726 1198 raft_consensus.cc:385] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.960795 1198 raft_consensus.cc:740] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.960986 1198 consensus_queue.cc:260] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.961602 1198 ts_tablet_manager.cc:1434] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:20.961869 1198 tablet_bootstrap.cc:492] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:20.963531 3013 tablet.cc:1724] T dd52351082274a4aa12cac468d9a512d P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:20.964093 1198 tablet_bootstrap.cc:654] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.965641 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_94c9b55eea4049cc915a46464481047e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.966221 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94c9b55eea4049cc915a46464481047e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.967478 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4e014c2192ad4cb18fd99c3780311339"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:20.967947 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e014c2192ad4cb18fd99c3780311339 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.977998 460 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 76c48e233d184487b7651e9cb105c2cc (table default.Table_8640034462d64b5d879d28e067fe1b14 [id=d24b6a6d28c949b2880a34bfa227c585]). Expected version 2 got 0
I20260616 19:52:20.978251 460 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet dd52351082274a4aa12cac468d9a512d (table default.Table_3bee557dbc924f6b982089749d9abe7b [id=ae7663c7da4444f1a6ef328ba7bd3494]). Expected version 2 got 0
W20260616 19:52:20.986016 754 consensus_meta.cc:287] T 43dbb249d43d4c68b4ba831f2903e74a P 7245e7dab0ec474a876537be514c8767: Time spent flushing consensus metadata: real 0.824s user 0.018s sys 0.005s
I20260616 19:52:20.989029 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e2861c41f402d88cafe64a6871429" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:20.989213 1058 raft_consensus.cc:3060] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:20.989333 1190 ts_tablet_manager.cc:1929] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.989435 1190 log.cc:1199] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/269c1dea941c481fb6fd2e4d59c877c0
I20260616 19:52:20.989429 1193 ts_tablet_manager.cc:1929] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.989526 1193 log.cc:1199] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/a8708321fb0f4c409a66df75da4c6c0e
I20260616 19:52:20.989784 1190 ts_tablet_manager.cc:1950] T 269c1dea941c481fb6fd2e4d59c877c0 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:20.990536 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1188) took 4330 ms. Trace:
I20260616 19:52:20.990558 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ddbb87afa67742dc8dbfd84a2e344811 (DEFAULT_TABLE table=default.Table_febc1327d859443d8643ab1e5a58f6b8 [id=4332d3a52cbe407f93994b09d4abafac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:20.990614 1190 rpcz_store.cc:276] 0616 19:52:16.660522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.660572 (+ 50us) service_pool.cc:224] Handling call
0616 19:52:20.877518 (+4216946us) ts_tablet_manager.cc:1151] Deleting tablet 269c1dea941c481fb6fd2e4d59c877c0
0616 19:52:20.877532 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.930711 (+ 53179us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.989259 (+ 58548us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.990516 (+ 1257us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4207899}
I20260616 19:52:20.990986 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 269c1dea941c481fb6fd2e4d59c877c0 (table default.Table_9cdcaf8b537a452cb9e13d4a7ae939cb [id=2c7a8a72acf5496eaebb585c459112fb]) successfully deleted
I20260616 19:52:20.991026 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbb87afa67742dc8dbfd84a2e344811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:20.991973 1192 tablet_bootstrap.cc:492] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:20.992014 1058 raft_consensus.cc:2468] T e85e2861c41f402d88cafe64a6871429 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:20.992090 1192 ts_tablet_manager.cc:1403] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.000s
I20260616 19:52:20.993912 1192 raft_consensus.cc:359] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.994071 1192 raft_consensus.cc:385] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:20.994120 1192 raft_consensus.cc:740] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:20.994369 1192 consensus_queue.cc:260] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:20.994977 1192 ts_tablet_manager.cc:1434] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:20.995517 1192 tablet_bootstrap.cc:492] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:20.997238 1192 tablet_bootstrap.cc:654] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:20.998379 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a9f778dbd18d49379fbd6ffa4d08db6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:20.998651 1191 ts_tablet_manager.cc:1929] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:20.998744 1191 log.cc:1199] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/482411d57f24459d8e7ed0eeb573234d
W20260616 19:52:20.998970 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9f778dbd18d49379fbd6ffa4d08db6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:20.999063 1191 ts_tablet_manager.cc:1950] T 482411d57f24459d8e7ed0eeb573234d P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:20.999817 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a95eafa064b4b95b5281915ea5bd9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:18 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.000079 754 tablet_service.cc:1558] Processing DeleteTablet for tablet ceda5bcb16cf4b48bc1ca87d0a3a48d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.007519 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1186) took 4347 ms. Trace:
I20260616 19:52:21.007606 1190 rpcz_store.cc:276] 0616 19:52:16.660316 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.660709 (+ 393us) service_pool.cc:224] Handling call
0616 19:52:21.007405 (+4346696us) ts_tablet_manager.cc:1151] Deleting tablet 7de044cb57e941ab9471ffe3bd7eeccb
0616 19:52:21.007414 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.007502 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4337732}
I20260616 19:52:21.007999 1190 tablet_replica.cc:333] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
W20260616 19:52:21.007992 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 7de044cb57e941ab9471ffe3bd7eeccb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7de044cb57e941ab9471ffe3bd7eeccb already in progress: creating tablet
I20260616 19:52:21.008168 1190 raft_consensus.cc:2243] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:21.008406 1193 ts_tablet_manager.cc:1950] T a8708321fb0f4c409a66df75da4c6c0e P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:21.009207 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1254) took 2339 ms. Trace:
I20260616 19:52:21.009344 1193 rpcz_store.cc:276] 0616 19:52:18.669602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.669751 (+ 149us) service_pool.cc:224] Handling call
0616 19:52:20.943749 (+2273998us) ts_tablet_manager.cc:1151] Deleting tablet a8708321fb0f4c409a66df75da4c6c0e
0616 19:52:20.943758 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.947616 (+ 3858us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.989367 (+ 41751us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.009189 (+ 19822us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2273835}
I20260616 19:52:21.009850 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet a8708321fb0f4c409a66df75da4c6c0e (table default.Table_c63ea4e62e3e433b86b05b9a80a2fd49 [id=c29388becc784f90b536d84c8548774e]) successfully deleted
I20260616 19:52:21.010736 754 tablet_service.cc:1511] Processing CreateTablet for tablet d570ba0d10944fc88f221837d2fbc4d4 (DEFAULT_TABLE table=default.Table_9af38c47677c428f82e0a880edef1e6a [id=a2c99b29406c47d1a74ac41183b75110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.016745 1196 tablet_bootstrap.cc:492] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:21.016939 1196 ts_tablet_manager.cc:1403] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.230s user 0.003s sys 0.000s
I20260616 19:52:21.008433 1190 raft_consensus.cc:2272] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.017649 1196 raft_consensus.cc:359] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.017894 1190 ts_tablet_manager.cc:1916] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.017905 1196 raft_consensus.cc:385] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.018172 1196 raft_consensus.cc:740] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.018450 1196 consensus_queue.cc:260] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.020402 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d570ba0d10944fc88f221837d2fbc4d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.021174 1196 ts_tablet_manager.cc:1434] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260616 19:52:21.021394 898 tablet_service.cc:1558] Processing DeleteTablet for tablet a95c684f5fe54f7dad6300efb0c18780 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.023307 1196 tablet_bootstrap.cc:492] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:21.024722 1198 tablet_bootstrap.cc:492] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:21.024900 1198 ts_tablet_manager.cc:1403] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.000s
I20260616 19:52:21.025038 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1210) took 4033 ms. Trace:
I20260616 19:52:21.025177 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet cce749336e6146dda490587b01e071f0
I20260616 19:52:21.025135 1191 rpcz_store.cc:276] 0616 19:52:16.991566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.011456 (+ 19890us) service_pool.cc:224] Handling call
0616 19:52:20.921331 (+3909875us) ts_tablet_manager.cc:1151] Deleting tablet 482411d57f24459d8e7ed0eeb573234d
0616 19:52:20.921340 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:20.925861 (+ 4521us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:20.998606 (+ 72745us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.025019 (+ 26413us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3875460}
I20260616 19:52:21.025580 1191 tablet_replica.cc:333] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:21.025756 1191 raft_consensus.cc:2243] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:21.025892 1191 raft_consensus.cc:2272] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.026074 1198 raft_consensus.cc:359] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.026286 1198 raft_consensus.cc:385] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.026350 1191 ts_tablet_manager.cc:1916] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:21.026561 972 tablet.cc:2406] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260616 19:52:21.027554 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 482411d57f24459d8e7ed0eeb573234d (table default.Table_861e66e4d4424b7d91d0a3a5d3519db8 [id=1712ccef85b8436986d12a371de3a4eb]) successfully deleted
I20260616 19:52:21.026376 1198 raft_consensus.cc:740] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.029520 747 tablet_service.cc:1558] Processing DeleteTablet for tablet cce749336e6146dda490587b01e071f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.029978 1198 consensus_queue.cc:260] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.031634 1196 tablet_bootstrap.cc:654] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.032269 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet cce749336e6146dda490587b01e071f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:21.036728 1198 ts_tablet_manager.cc:1434] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260616 19:52:21.037129 1198 tablet_bootstrap.cc:492] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:21.037254 1192 tablet_bootstrap.cc:492] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:21.037403 1192 ts_tablet_manager.cc:1403] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.002s
I20260616 19:52:21.038038 458 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 76c48e233d184487b7651e9cb105c2cc (table default.Table_8640034462d64b5d879d28e067fe1b14 [id=d24b6a6d28c949b2880a34bfa227c585]). Expected version 2 got 0
I20260616 19:52:21.038113 1192 raft_consensus.cc:359] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.038291 1192 raft_consensus.cc:385] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.038357 1192 raft_consensus.cc:740] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.038558 1192 consensus_queue.cc:260] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.038760 1198 tablet_bootstrap.cc:654] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.039033 1192 ts_tablet_manager.cc:1434] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260616 19:52:21.039377 458 catalog_manager.cc:5696] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:21.040081 458 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 61132c1c9cd24b7d923f1d65ad04c340 (table default.Table_9eb13a45afad449a9bf9b25a0f5d4d1d [id=e8db7417fd294af4b160a434625e9fd0]). Expected version 2 got 0
I20260616 19:52:21.042001 1193 tablet_replica.cc:333] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:21.042202 1193 raft_consensus.cc:2243] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:21.042505 1193 raft_consensus.cc:2272] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.043025 1193 ts_tablet_manager.cc:1916] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:21.044955 860 consensus_peers.cc:597] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe2ac7d4df6a48d6a93d40c7eef38c9c. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:21.048847 1196 tablet_bootstrap.cc:492] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:21.049057 1196 ts_tablet_manager.cc:1403] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.002s
I20260616 19:52:21.049764 1196 raft_consensus.cc:359] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.049999 1196 raft_consensus.cc:385] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.050100 1196 raft_consensus.cc:740] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.050395 1196 consensus_queue.cc:260] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.051515 1196 ts_tablet_manager.cc:1434] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:52:21.051964 1196 tablet_bootstrap.cc:492] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:21.052289 896 tablet_service.cc:1511] Processing CreateTablet for tablet 482546ec9e8f418981c0c003a14d8889 (DEFAULT_TABLE table=default.Table_9b7db1fbbdd5489e808bdf3476b6090e [id=fb3b321a4cf44dd79863e8221c674f94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.052671 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482546ec9e8f418981c0c003a14d8889. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:21.053633 446 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet fe39df8bd431402ba646f632939eba3a (table default.Table_0de44fae23f947f3bf6ab115c401073d [id=e8d71c73e6234a2aa771f143b262fe94], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fe39df8bd431402ba646f632939eba3a consensus state has no leader
I20260616 19:52:21.054495 1196 tablet_bootstrap.cc:654] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.054519 898 tablet_service.cc:1558] Processing DeleteTablet for tablet cce749336e6146dda490587b01e071f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:20 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.055523 886 tablet_service.cc:1511] Processing CreateTablet for tablet 8017d5e26135433f944055c9a25b93dd (DEFAULT_TABLE table=default.Table_76b685a41bec414b8aa31150f92839aa [id=d0f282a70fc04b768f2929eaddc1d03b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.055649 898 tablet_service.cc:1511] Processing CreateTablet for tablet 12f7649182994b849fe4123033bb75f9 (DEFAULT_TABLE table=default.Table_e2c4a551aeaa41c4be9c40d9b5232686 [id=ccbbff729ef544fb9e39833b2fdf8897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.055897 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8017d5e26135433f944055c9a25b93dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.056072 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f7649182994b849fe4123033bb75f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.057502 892 tablet_service.cc:1511] Processing CreateTablet for tablet d570ba0d10944fc88f221837d2fbc4d4 (DEFAULT_TABLE table=default.Table_9af38c47677c428f82e0a880edef1e6a [id=a2c99b29406c47d1a74ac41183b75110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.057808 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d570ba0d10944fc88f221837d2fbc4d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.061444 1031 tablet_service.cc:1511] Processing CreateTablet for tablet d570ba0d10944fc88f221837d2fbc4d4 (DEFAULT_TABLE table=default.Table_9af38c47677c428f82e0a880edef1e6a [id=a2c99b29406c47d1a74ac41183b75110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.061808 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d570ba0d10944fc88f221837d2fbc4d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.069092 747 tablet_service.cc:1511] Processing CreateTablet for tablet 482546ec9e8f418981c0c003a14d8889 (DEFAULT_TABLE table=default.Table_9b7db1fbbdd5489e808bdf3476b6090e [id=fb3b321a4cf44dd79863e8221c674f94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.069648 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 482546ec9e8f418981c0c003a14d8889 (DEFAULT_TABLE table=default.Table_9b7db1fbbdd5489e808bdf3476b6090e [id=fb3b321a4cf44dd79863e8221c674f94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.069737 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 12f7649182994b849fe4123033bb75f9 (DEFAULT_TABLE table=default.Table_e2c4a551aeaa41c4be9c40d9b5232686 [id=ccbbff729ef544fb9e39833b2fdf8897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.070021 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482546ec9e8f418981c0c003a14d8889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.070152 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 8017d5e26135433f944055c9a25b93dd (DEFAULT_TABLE table=default.Table_76b685a41bec414b8aa31150f92839aa [id=d0f282a70fc04b768f2929eaddc1d03b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.070242 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f7649182994b849fe4123033bb75f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.072353 746 tablet_service.cc:1511] Processing CreateTablet for tablet 12f7649182994b849fe4123033bb75f9 (DEFAULT_TABLE table=default.Table_e2c4a551aeaa41c4be9c40d9b5232686 [id=ccbbff729ef544fb9e39833b2fdf8897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.072806 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8017d5e26135433f944055c9a25b93dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.075961 2962 raft_consensus.cc:493] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.076098 2962 raft_consensus.cc:515] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.076771 2962 leader_election.cc:290] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.080498 754 tablet_service.cc:1511] Processing CreateTablet for tablet 8017d5e26135433f944055c9a25b93dd (DEFAULT_TABLE table=default.Table_76b685a41bec414b8aa31150f92839aa [id=d0f282a70fc04b768f2929eaddc1d03b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.081040 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610d6197e35e447ea25cdba2cc454b8d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:21.081571 996 leader_election.cc:343] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.082268 1196 tablet_bootstrap.cc:492] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:21.082454 1196 ts_tablet_manager.cc:1403] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.004s
I20260616 19:52:21.082989 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610d6197e35e447ea25cdba2cc454b8d" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:21.083501 993 leader_election.cc:343] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.083545 1196 raft_consensus.cc:359] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.083626 993 leader_election.cc:304] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:21.083722 1196 raft_consensus.cc:385] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.083786 1196 raft_consensus.cc:740] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.084030 2962 raft_consensus.cc:2749] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:21.084012 1196 consensus_queue.cc:260] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.084666 1196 ts_tablet_manager.cc:1434] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260616 19:52:21.085017 1196 tablet_bootstrap.cc:492] T 23f280b9ea1147799635f8a6199f17c0 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:21.085531 719 consensus_peers.cc:597] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e68e2c6caff4ac38aa52b8b29f5ace6. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:21.086140 1198 tablet_bootstrap.cc:492] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:21.086118 3064 raft_consensus.cc:493] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.086246 3064 raft_consensus.cc:515] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.086333 1198 ts_tablet_manager.cc:1403] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20260616 19:52:21.086858 3064 leader_election.cc:290] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:21.087060 1198 raft_consensus.cc:359] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.087203 1198 raft_consensus.cc:385] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.087253 1198 raft_consensus.cc:740] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.087481 1198 consensus_queue.cc:260] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.088129 1198 ts_tablet_manager.cc:1434] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:21.089651 1196 tablet_bootstrap.cc:654] T 23f280b9ea1147799635f8a6199f17c0 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.088441 1198 tablet_bootstrap.cc:492] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:21.091955 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab8282287434bf8b7e37f008a1b0166" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:21.092406 860 leader_election.cc:343] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.092821 1198 tablet_bootstrap.cc:654] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.098151 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f7649182994b849fe4123033bb75f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.098452 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482546ec9e8f418981c0c003a14d8889. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:21.101492 858 leader_election.cc:343] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 802d30c340494490896c8da33d110708
I20260616 19:52:21.101624 858 leader_election.cc:304] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:21.101872 2937 raft_consensus.cc:2749] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:21.103807 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8017d5e26135433f944055c9a25b93dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.104175 3064 consensus_queue.cc:1048] T ceda5bcb16cf4b48bc1ca87d0a3a48d7 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.105845 761 tablet_service.cc:1511] Processing CreateTablet for tablet 03b301cbb377427c92538e82e5d8cd9f (DEFAULT_TABLE table=default.Table_9052d7e3461c48ea86abbc7e466a6610 [id=331537741977496688845dfb6c89fab0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.106467 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 03b301cbb377427c92538e82e5d8cd9f (DEFAULT_TABLE table=default.Table_9052d7e3461c48ea86abbc7e466a6610 [id=331537741977496688845dfb6c89fab0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.106914 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b301cbb377427c92538e82e5d8cd9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.107328 757 tablet_service.cc:1511] Processing CreateTablet for tablet 2b27dd98f1e245679f733b80ee2a3f5c (DEFAULT_TABLE table=default.Table_c2b3654ba2644023ac6959fa72488070 [id=02f6d136cb0f4db3a9d66541c2a7d7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.113073 886 tablet_service.cc:1511] Processing CreateTablet for tablet 03b301cbb377427c92538e82e5d8cd9f (DEFAULT_TABLE table=default.Table_9052d7e3461c48ea86abbc7e466a6610 [id=331537741977496688845dfb6c89fab0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.113761 892 tablet_service.cc:1511] Processing CreateTablet for tablet 2b27dd98f1e245679f733b80ee2a3f5c (DEFAULT_TABLE table=default.Table_c2b3654ba2644023ac6959fa72488070 [id=02f6d136cb0f4db3a9d66541c2a7d7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.114976 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 2b27dd98f1e245679f733b80ee2a3f5c (DEFAULT_TABLE table=default.Table_c2b3654ba2644023ac6959fa72488070 [id=02f6d136cb0f4db3a9d66541c2a7d7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.115366 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b27dd98f1e245679f733b80ee2a3f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.116590 1193 ts_tablet_manager.cc:1929] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.116740 1193 log.cc:1199] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/c48314f8e45d4b198306f0ae6e40def7
I20260616 19:52:21.117147 1193 ts_tablet_manager.cc:1950] T c48314f8e45d4b198306f0ae6e40def7 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:21.117869 2962 raft_consensus.cc:493] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.117977 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1256) took 2448 ms. Trace:
I20260616 19:52:21.117990 2962 raft_consensus.cc:515] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.118113 1193 rpcz_store.cc:276] 0616 19:52:18.669828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.669895 (+ 67us) service_pool.cc:224] Handling call
0616 19:52:21.010117 (+2340222us) ts_tablet_manager.cc:1151] Deleting tablet c48314f8e45d4b198306f0ae6e40def7
0616 19:52:21.010127 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.061890 (+ 51763us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.098348 (+ 36458us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.117925 (+ 19577us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2340042}
I20260616 19:52:21.118502 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet c48314f8e45d4b198306f0ae6e40def7 (table default.Table_3fc9d9c9f0844372a2c28932bf508e6d [id=a1533cc8be3c405b9474aa29dc71aa5e]) successfully deleted
I20260616 19:52:21.118618 1193 tablet_replica.cc:333] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:21.118613 2962 leader_election.cc:290] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.118835 1193 raft_consensus.cc:2243] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:21.119031 1193 raft_consensus.cc:2272] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.119125 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9800df09eecb4a299a6facf8b85a93e4" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:21.119560 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9800df09eecb4a299a6facf8b85a93e4" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:21.119647 1193 ts_tablet_manager.cc:1916] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:21.119632 993 leader_election.cc:343] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.120296 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8acc4e02fca3408ca9996c98f732938f" } new_table_name: "default.Table_61a11f0f6802483689c32c315f2061bf" modify_external_catalogs: true
W20260616 19:52:21.121183 996 leader_election.cc:343] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.121287 996 leader_election.cc:304] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:21.121507 2962 raft_consensus.cc:2749] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:21.125840 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed8e5b059700443faab937488002de37 consensus state has no leader
I20260616 19:52:21.126272 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3eb946a084f04151b6389333e33cc455" } modify_external_catalogs: true
I20260616 19:52:21.126338 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9052d7e3461c48ea86abbc7e466a6610" } new_table_name: "default.Table_bfe6f61e50e04ebf954b4931160bfc19" modify_external_catalogs: true
I20260616 19:52:21.126426 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3eb946a084f04151b6389333e33cc455" } modify_external_catalogs: true
I20260616 19:52:21.128950 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b301cbb377427c92538e82e5d8cd9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.132704 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b27dd98f1e245679f733b80ee2a3f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.134450 2962 raft_consensus.cc:493] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.134601 2962 raft_consensus.cc:515] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.135258 2962 leader_election.cc:290] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.135869 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5462af2002f9406b85ee20660e001a95" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:21.136059 1198 tablet_bootstrap.cc:492] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:21.136170 1198 ts_tablet_manager.cc:1403] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.001s
W20260616 19:52:21.136358 993 leader_election.cc:343] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.136584 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5462af2002f9406b85ee20660e001a95" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:21.136806 775 raft_consensus.cc:2468] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:21.136915 1198 raft_consensus.cc:359] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.137053 1198 raft_consensus.cc:385] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.137133 1198 raft_consensus.cc:740] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.137383 996 leader_election.cc:304] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:21.137408 1198 consensus_queue.cc:260] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.137925 1198 ts_tablet_manager.cc:1434] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:21.154217 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab8282287434bf8b7e37f008a1b0166" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:21.154570 1060 raft_consensus.cc:2468] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:21.155781 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b301cbb377427c92538e82e5d8cd9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.138190 1198 tablet_bootstrap.cc:492] T d1e3778611a24397a1a776be2cc76284 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:21.157541 1198 tablet_bootstrap.cc:654] T d1e3778611a24397a1a776be2cc76284 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.159442 3035 tablet.cc:1724] T a95c684f5fe54f7dad6300efb0c18780 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:21.160588 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b27dd98f1e245679f733b80ee2a3f5c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:21.161289 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2010246823574515a7437f92484bc701 consensus state has no leader
I20260616 19:52:21.163069 2700 raft_consensus.cc:493] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.163183 2700 raft_consensus.cc:515] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.163763 2700 leader_election.cc:290] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:21.164539 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6dc34b00414a0d94b01f579994eb4c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:21.170142 3033 tablet.cc:1724] T a95c684f5fe54f7dad6300efb0c18780 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260616 19:52:21.187583 2937 consensus_queue.cc:1048] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.189970 1192 tablet_bootstrap.cc:492] T e3c4e584fad94633ae49332872de0fc3 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:21.190265 1193 ts_tablet_manager.cc:1929] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.191969 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3a1847f489204e5eb7bf9a4608b85c57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:21.192301 1192 tablet_bootstrap.cc:654] T e3c4e584fad94633ae49332872de0fc3 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:21.192564 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a1847f489204e5eb7bf9a4608b85c57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:21.194061 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_03c1908087c44e4294ede2faa0d830cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:21.194530 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03c1908087c44e4294ede2faa0d830cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:21.194607 1190 ts_tablet_manager.cc:1929] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.194707 1190 log.cc:1199] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/c239a24dbdc047f9beb2ed7e1492acfe
I20260616 19:52:21.195065 1190 ts_tablet_manager.cc:1950] T c239a24dbdc047f9beb2ed7e1492acfe P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:21.195384 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1187) took 4535 ms. Trace:
I20260616 19:52:21.195458 1190 rpcz_store.cc:276] 0616 19:52:16.660400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.660842 (+ 442us) service_pool.cc:224] Handling call
0616 19:52:21.007961 (+4347119us) ts_tablet_manager.cc:1151] Deleting tablet c239a24dbdc047f9beb2ed7e1492acfe
0616 19:52:21.007970 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.021997 (+ 14027us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.194551 (+172554us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.195366 (+ 815us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4338253}
I20260616 19:52:21.195984 1190 tablet_replica.cc:333] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:21.196027 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet c239a24dbdc047f9beb2ed7e1492acfe (table default.Table_b9effa349ec04a8989934380e9153218 [id=bb33691603dd4d118134ed79f128e4d9]) successfully deleted
I20260616 19:52:21.196198 1190 raft_consensus.cc:2243] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:21.196570 1190 raft_consensus.cc:2272] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.196760 1193 log.cc:1199] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/272838af35d840faa7b11217456533c2
I20260616 19:52:21.197176 1193 ts_tablet_manager.cc:1950] T 272838af35d840faa7b11217456533c2 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:21.204581 457 master_service.cc:960] ReplaceTablet: received request to replace tablet f252ea7261ea42869e25245c7ee78c05 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:21.207696 2679 consensus_queue.cc:1048] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.208847 746 tablet_service.cc:1511] Processing CreateTablet for tablet 91ee15293fa74733a03ad11600224ae6 (DEFAULT_TABLE table=default.Table_798762eab3ea49818ee909f8b3207b1b [id=f35a951f1f444df6ae65095894d44a62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.212915 2662 consensus_queue.cc:1048] T 8b7e2d8c25b8464b94ca386566abc2cc P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.224375 858 leader_election.cc:304] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:21.224502 1196 tablet_bootstrap.cc:492] T 23f280b9ea1147799635f8a6199f17c0 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:21.224642 1196 ts_tablet_manager.cc:1403] T 23f280b9ea1147799635f8a6199f17c0 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.140s user 0.022s sys 0.025s
I20260616 19:52:21.225901 1196 raft_consensus.cc:359] T 23f280b9ea1147799635f8a6199f17c0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.226169 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 49f85f7727e447c88eb0287b19005b1b from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:21.163967 2962 raft_consensus.cc:493] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.226938 1196 raft_consensus.cc:385] T 23f280b9ea1147799635f8a6199f17c0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.227070 1196 raft_consensus.cc:740] T 23f280b9ea1147799635f8a6199f17c0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.227051 2962 raft_consensus.cc:515] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.227406 2679 raft_consensus.cc:2804] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:21.227496 2679 raft_consensus.cc:493] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:21.227555 2679 raft_consensus.cc:3060] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.227654 2962 leader_election.cc:290] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.227635 1196 consensus_queue.cc:260] T 23f280b9ea1147799635f8a6199f17c0 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.179450 2963 raft_consensus.cc:493] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.227838 2963 raft_consensus.cc:515] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.228315 2963 leader_election.cc:290] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.229648 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2e5bc2c47746e88e95634fb073273e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:21.230577 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d686190fb6a34ab18cc4799197765f1b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:21.230837 1196 ts_tablet_manager.cc:1434] T 23f280b9ea1147799635f8a6199f17c0 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260616 19:52:21.230852 2679 raft_consensus.cc:515] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:21.231246 993 leader_election.cc:343] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:21.231505 993 leader_election.cc:343] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.201211 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6dc34b00414a0d94b01f579994eb4c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:21.231773 2679 leader_election.cc:290] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:21.231873 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab8282287434bf8b7e37f008a1b0166" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:21.231997 1053 raft_consensus.cc:2393] T be6dc34b00414a0d94b01f579994eb4c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
W20260616 19:52:21.232359 860 leader_election.cc:343] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.234135 1192 tablet_bootstrap.cc:492] T e3c4e584fad94633ae49332872de0fc3 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:21.234956 757 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7be8c7d4cf471ca1ae840ef96f0daf (DEFAULT_TABLE table=default.Table_4fd1d944e4b54432979c16a8d23c9ee9 [id=88229c1dccd0404ab97e1375a2b19759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.236578 761 tablet_service.cc:1511] Processing CreateTablet for tablet 24b7cf4146314ee8900b852701fc4833 (DEFAULT_TABLE table=default.Table_d35aea801f0d481f897236926c33060c [id=4484e59361ea44b0a64cfa24bdbad6d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.236658 1192 ts_tablet_manager.cc:1403] T e3c4e584fad94633ae49332872de0fc3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.002s
I20260616 19:52:21.236675 2985 raft_consensus.cc:493] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.236821 2985 raft_consensus.cc:515] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.234503 886 tablet_service.cc:1511] Processing CreateTablet for tablet 91ee15293fa74733a03ad11600224ae6 (DEFAULT_TABLE table=default.Table_798762eab3ea49818ee909f8b3207b1b [id=f35a951f1f444df6ae65095894d44a62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.236236 2679 consensus_queue.cc:1048] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.237375 2985 leader_election.cc:290] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.237612 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ee15293fa74733a03ad11600224ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.238125 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faa62f03c2a4588a776883dc54d0426" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:21.238610 718 leader_election.cc:343] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.241089 754 tablet_service.cc:1511] Processing CreateTablet for tablet a740b0d5d2b04f81853d800962dd95fc (DEFAULT_TABLE table=default.Table_75dfd23bdd1e4538975aeae054d02379 [id=ccbcdc53c4a149d0894ea06f949d3655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.241974 892 tablet_service.cc:1511] Processing CreateTablet for tablet 24b7cf4146314ee8900b852701fc4833 (DEFAULT_TABLE table=default.Table_d35aea801f0d481f897236926c33060c [id=4484e59361ea44b0a64cfa24bdbad6d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.242388 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b7cf4146314ee8900b852701fc4833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.244163 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ee15293fa74733a03ad11600224ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.244233 1196 tablet_bootstrap.cc:492] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:21.244709 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7be8c7d4cf471ca1ae840ef96f0daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.245630 1196 tablet_bootstrap.cc:654] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.248879 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b7cf4146314ee8900b852701fc4833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.248945 2700 consensus_queue.cc:1048] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.250221 858 leader_election.cc:304] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:21.252895 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a740b0d5d2b04f81853d800962dd95fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.257774 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 61132c1c9cd24b7d923f1d65ad04c340 (table default.Table_9eb13a45afad449a9bf9b25a0f5d4d1d [id=e8db7417fd294af4b160a434625e9fd0]). Expected version 2 got 0
I20260616 19:52:21.258060 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 76c48e233d184487b7651e9cb105c2cc (table default.Table_8640034462d64b5d879d28e067fe1b14 [id=d24b6a6d28c949b2880a34bfa227c585]). Expected version 2 got 0
I20260616 19:52:21.258277 453 catalog_manager.cc:5696] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130). New cstate: current_term: 1 leader_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: HEALTHY } } }
I20260616 19:52:21.258612 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet e85e2861c41f402d88cafe64a6871429 (table default.Table_66d56024dca749dfb6300ffa4cb0dec9 [id=02a85fe82ed24f6b949c0ded2d9a7d5e]). Expected version 1 got 0
I20260616 19:52:21.258930 460 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_c2ce6e69bb9245d8846dc2de654d9ba8 [id=1449ff28bd8546908359606f7272846f] alter complete (version 3)
I20260616 19:52:21.260625 2700 raft_consensus.cc:3060] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.261595 898 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7be8c7d4cf471ca1ae840ef96f0daf (DEFAULT_TABLE table=default.Table_4fd1d944e4b54432979c16a8d23c9ee9 [id=88229c1dccd0404ab97e1375a2b19759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.261948 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7be8c7d4cf471ca1ae840ef96f0daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.263640 2700 raft_consensus.cc:2749] T be6dc34b00414a0d94b01f579994eb4c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:21.265000 1192 raft_consensus.cc:359] T e3c4e584fad94633ae49332872de0fc3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.265201 1192 raft_consensus.cc:385] T e3c4e584fad94633ae49332872de0fc3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.265264 1192 raft_consensus.cc:740] T e3c4e584fad94633ae49332872de0fc3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.265539 1192 consensus_queue.cc:260] T e3c4e584fad94633ae49332872de0fc3 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:21.265967 718 consensus_peers.cc:597] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:21.266175 1192 ts_tablet_manager.cc:1434] T e3c4e584fad94633ae49332872de0fc3 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.029s user 0.000s sys 0.002s
I20260616 19:52:21.266733 1192 tablet_bootstrap.cc:492] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:21.268833 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1258) took 2598 ms. Trace:
I20260616 19:52:21.269018 1193 rpcz_store.cc:276] 0616 19:52:18.670012 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.670118 (+ 106us) service_pool.cc:224] Handling call
0616 19:52:21.118551 (+2448433us) ts_tablet_manager.cc:1151] Deleting tablet 272838af35d840faa7b11217456533c2
0616 19:52:21.118561 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.122480 (+ 3919us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.190176 (+ 67696us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.268780 (+ 78604us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2448283}
I20260616 19:52:21.269214 1192 tablet_bootstrap.cc:654] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.269477 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 272838af35d840faa7b11217456533c2 (table default.Table_5993624d9698498986c80f02a4c7260b [id=9a09704d792a45f6a5fd8a90e5158110]) successfully deleted
I20260616 19:52:21.269833 1193 tablet_replica.cc:333] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:21.270081 1193 raft_consensus.cc:2243] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:21.270464 1193 raft_consensus.cc:2272] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.271088 1193 ts_tablet_manager.cc:1916] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:21.273401 718 consensus_peers.cc:597] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:21.273715 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab8282287434bf8b7e37f008a1b0166" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:21.273962 1053 raft_consensus.cc:3060] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.276436 1053 raft_consensus.cc:2468] T fab8282287434bf8b7e37f008a1b0166 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
W20260616 19:52:21.282032 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 35d79d86fc0a4594a4c6696bc4a30403 consensus state has no leader
I20260616 19:52:21.282150 1191 ts_tablet_manager.cc:1929] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.282238 1191 log.cc:1199] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/08db2c1398b946c180d81b88504c1d9c
I20260616 19:52:21.283480 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7af7e490f00745fb8ac2052e56b9d680" } modify_external_catalogs: true
I20260616 19:52:21.283639 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_7af7e490f00745fb8ac2052e56b9d680" } modify_external_catalogs: true
W20260616 19:52:21.295737 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 03b301cbb377427c92538e82e5d8cd9f consensus state has no leader
I20260616 19:52:21.297086 1191 ts_tablet_manager.cc:1950] T 08db2c1398b946c180d81b88504c1d9c P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:21.298027 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1211) took 4306 ms. Trace:
I20260616 19:52:21.298101 1191 rpcz_store.cc:276] 0616 19:52:16.991668 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.027013 (+ 35345us) service_pool.cc:224] Handling call
0616 19:52:21.025540 (+3998527us) ts_tablet_manager.cc:1151] Deleting tablet 08db2c1398b946c180d81b88504c1d9c
0616 19:52:21.025548 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.150403 (+124855us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.282099 (+131696us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.298008 (+ 15909us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3976833}
I20260616 19:52:21.298451 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1218) took 4193 ms. Trace:
I20260616 19:52:21.298508 1191 rpcz_store.cc:276] 0616 19:52:17.105489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.105548 (+ 59us) service_pool.cc:224] Handling call
0616 19:52:21.298343 (+4192795us) ts_tablet_manager.cc:1151] Deleting tablet a555ad9f529943558a5ef6ea5c99851d
0616 19:52:21.298352 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.298439 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4192609}
I20260616 19:52:21.298837 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1219) took 4179 ms. Trace:
I20260616 19:52:21.298914 1191 rpcz_store.cc:276] 0616 19:52:17.119384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.119607 (+ 223us) service_pool.cc:224] Handling call
0616 19:52:21.298724 (+4179117us) ts_tablet_manager.cc:1151] Deleting tablet 7d486a9c69954dc4a9b664d89d2bf28a
0616 19:52:21.298735 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.298821 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4178934}
I20260616 19:52:21.299211 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1221) took 4116 ms. Trace:
I20260616 19:52:21.299297 1191 rpcz_store.cc:276] 0616 19:52:17.182495 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.183225 (+ 730us) service_pool.cc:224] Handling call
0616 19:52:21.299138 (+4115913us) ts_tablet_manager.cc:1151] Deleting tablet 67ac2e31a1ba40b39145c26a1e4e0884
0616 19:52:21.299149 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.299198 (+ 49us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4115674}
I20260616 19:52:21.304829 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_63d5b017cead47c3b7859cb97f00d64f" } new_table_name: "default.Table_03a4fc97b694472c8a0476787c7a759a" modify_external_catalogs: true
I20260616 19:52:21.305208 1196 tablet_bootstrap.cc:492] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:21.305369 1196 ts_tablet_manager.cc:1403] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.061s user 0.009s sys 0.019s
I20260616 19:52:21.306862 1196 raft_consensus.cc:359] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.307114 1196 raft_consensus.cc:385] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.307261 1196 raft_consensus.cc:740] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.307540 1196 consensus_queue.cc:260] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.308179 1196 ts_tablet_manager.cc:1434] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:21.277813 1190 ts_tablet_manager.cc:1916] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.288751 2700 raft_consensus.cc:493] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:21.308753 2700 raft_consensus.cc:515] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:21.308745 2774 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260616 19:52:21.309175 2774 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260616 19:52:21.309295 2774 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260616 19:52:21.309358 2700 leader_election.cc:290] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:21.310401 860 leader_election.cc:343] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: af5e277102b8480db44e5ffe88267808
I20260616 19:52:21.313163 1193 ts_tablet_manager.cc:1929] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.313287 1193 log.cc:1199] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/5e68e2c6caff4ac38aa52b8b29f5ace6
I20260616 19:52:21.313673 1193 ts_tablet_manager.cc:1950] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:21.316268 1190 ts_tablet_manager.cc:1929] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.291329 858 leader_election.cc:304] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:21.316622 2700 raft_consensus.cc:2804] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:21.316743 2700 raft_consensus.cc:697] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:21.317032 1196 tablet_bootstrap.cc:492] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:21.316956 2700 consensus_queue.cc:237] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.318105 896 tablet_service.cc:1511] Processing CreateTablet for tablet a740b0d5d2b04f81853d800962dd95fc (DEFAULT_TABLE table=default.Table_75dfd23bdd1e4538975aeae054d02379 [id=ccbcdc53c4a149d0894ea06f949d3655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.318399 1196 tablet_bootstrap.cc:654] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.318466 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a740b0d5d2b04f81853d800962dd95fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.321686 746 tablet_service.cc:1511] Processing CreateTablet for tablet b950c2feed6d49ce87159366f02412dd (DEFAULT_TABLE table=default.Table_d9475c4c32a248de8a4ce51252e648aa [id=253c7ae83c7546f7bfa9651fde01d439]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.322731 1198 tablet_bootstrap.cc:492] T d1e3778611a24397a1a776be2cc76284 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:21.322687 893 tablet_service.cc:1511] Processing CreateTablet for tablet b950c2feed6d49ce87159366f02412dd (DEFAULT_TABLE table=default.Table_d9475c4c32a248de8a4ce51252e648aa [id=253c7ae83c7546f7bfa9651fde01d439]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.322974 1198 ts_tablet_manager.cc:1403] T d1e3778611a24397a1a776be2cc76284 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.185s user 0.003s sys 0.000s
I20260616 19:52:21.323105 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b950c2feed6d49ce87159366f02412dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.323455 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 67f092298661466aa8432baa61559325
I20260616 19:52:21.323829 1198 raft_consensus.cc:359] T d1e3778611a24397a1a776be2cc76284 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.324061 1198 raft_consensus.cc:385] T d1e3778611a24397a1a776be2cc76284 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.324165 1198 raft_consensus.cc:740] T d1e3778611a24397a1a776be2cc76284 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.324172 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_04a74087d23a4fb6a95133f1e1c97a53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:21.324559 1198 consensus_queue.cc:260] T d1e3778611a24397a1a776be2cc76284 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:21.324685 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04a74087d23a4fb6a95133f1e1c97a53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:21.325296 1198 ts_tablet_manager.cc:1434] T d1e3778611a24397a1a776be2cc76284 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:21.327543 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 67f092298661466aa8432baa61559325 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.328342 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 67f092298661466aa8432baa61559325 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.330286 754 tablet_service.cc:1511] Processing CreateTablet for tablet cd453c839b6c4d8ea1b51e44e1428352 (DEFAULT_TABLE table=default.Table_9106e27b54a6450aa0c0366fbda74e48 [id=228ff8d5b38d4709be22187cd0546231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.330533 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b950c2feed6d49ce87159366f02412dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.331585 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd453c839b6c4d8ea1b51e44e1428352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.334784 893 tablet_service.cc:1511] Processing CreateTablet for tablet cd453c839b6c4d8ea1b51e44e1428352 (DEFAULT_TABLE table=default.Table_9106e27b54a6450aa0c0366fbda74e48 [id=228ff8d5b38d4709be22187cd0546231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.335105 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd453c839b6c4d8ea1b51e44e1428352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.336159 757 tablet_service.cc:1511] Processing CreateTablet for tablet 8564366a68ed4af0a6c02b3a7eec4f0c (DEFAULT_TABLE table=default.Table_d727712bd5c04c0eb3f30732551a823d [id=b70eb90923064aeea2073f11c9302c33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.336548 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8564366a68ed4af0a6c02b3a7eec4f0c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:21.337524 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 46233us
I20260616 19:52:21.338642 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1261) took 2668 ms. Trace:
I20260616 19:52:21.338758 1193 rpcz_store.cc:276] 0616 19:52:18.670255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.670293 (+ 38us) service_pool.cc:224] Handling call
0616 19:52:21.269737 (+2599444us) ts_tablet_manager.cc:1151] Deleting tablet 5e68e2c6caff4ac38aa52b8b29f5ace6
0616 19:52:21.269746 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.273908 (+ 4162us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.313082 (+ 39174us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.338588 (+ 25506us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2599298}
I20260616 19:52:21.339107 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 5e68e2c6caff4ac38aa52b8b29f5ace6 (table default.Table_1054530674ec44d19e673765aefe6cdf [id=1366cc6d014c4092a6ad2086b9f137e4]) successfully deleted
I20260616 19:52:21.341166 2662 consensus_queue.cc:1048] T e03e6a2614564eeeb8ec382b16f0ece1 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.341926 754 tablet_service.cc:1511] Processing CreateTablet for tablet 1403dd096f3e47e69186c8fa618345a3 (DEFAULT_TABLE table=default.Table_f2243cb23a37411591f0cd2ef5a5ed61 [id=f3e5b0be30c44e8ebbaabaa746cac4f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.342149 896 tablet_service.cc:1511] Processing CreateTablet for tablet 8564366a68ed4af0a6c02b3a7eec4f0c (DEFAULT_TABLE table=default.Table_d727712bd5c04c0eb3f30732551a823d [id=b70eb90923064aeea2073f11c9302c33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.342403 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1403dd096f3e47e69186c8fa618345a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.342751 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8564366a68ed4af0a6c02b3a7eec4f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.350248 1196 tablet_bootstrap.cc:492] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:21.350409 1196 ts_tablet_manager.cc:1403] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.007s
I20260616 19:52:21.351261 1196 raft_consensus.cc:359] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.351459 1196 raft_consensus.cc:385] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.351567 1196 raft_consensus.cc:740] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.351845 1196 consensus_queue.cc:260] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.353047 1196 ts_tablet_manager.cc:1434] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:21.353744 1196 tablet_bootstrap.cc:492] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:21.355185 1196 tablet_bootstrap.cc:654] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.358155 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f252ea7261ea42869e25245c7ee78c05
I20260616 19:52:21.358557 457 catalog_manager.cc:6784] ReplaceTablet: tablet f252ea7261ea42869e25245c7ee78c05 deleted and replaced by tablet 0db1fd628cf047458664e20ab3a4d66b
W20260616 19:52:21.358585 2774 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260616 19:52:21.358681 2774 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260616 19:52:21.358765 2774 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260616 19:52:21.358862 2774 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260616 19:52:21.359043 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 49f85f7727e447c88eb0287b19005b1b
I20260616 19:52:21.359349 454 catalog_manager.cc:6784] ReplaceTablet: tablet 49f85f7727e447c88eb0287b19005b1b deleted and replaced by tablet 37d702a538ea477ba524ea7380980f43
I20260616 19:52:21.360149 1193 tablet_replica.cc:333] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:21.360363 1193 raft_consensus.cc:2243] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:21.360700 1193 raft_consensus.cc:2272] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.361320 1193 ts_tablet_manager.cc:1916] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.361410 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f85f7727e447c88eb0287b19005b1b with delete_type TABLET_DATA_DELETED (replaced by tablet 37d702a538ea477ba524ea7380980f43) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.361595 892 tablet_service.cc:1558] Processing DeleteTablet for tablet f252ea7261ea42869e25245c7ee78c05 with delete_type TABLET_DATA_DELETED (replaced by tablet 0db1fd628cf047458664e20ab3a4d66b) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.363556 746 tablet_service.cc:1558] Processing DeleteTablet for tablet f252ea7261ea42869e25245c7ee78c05 with delete_type TABLET_DATA_DELETED (replaced by tablet 0db1fd628cf047458664e20ab3a4d66b) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.363794 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f85f7727e447c88eb0287b19005b1b with delete_type TABLET_DATA_DELETED (replaced by tablet 37d702a538ea477ba524ea7380980f43) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:21.367534 1108 tablet.cc:2406] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260616 19:52:21.367733 3013 tablet.cc:1724] T a95c684f5fe54f7dad6300efb0c18780 P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260616 19:52:21.381376 858 leader_election.cc:343] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: af5e277102b8480db44e5ffe88267808
I20260616 19:52:21.381517 858 leader_election.cc:304] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:21.381733 2662 raft_consensus.cc:2749] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:21.382994 757 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0cceb288c841c0b25425cc1d75b8b8 (DEFAULT_TABLE table=default.Table_1a5924d3b655450a8804a5a77cd2181a [id=8578252ed1dd417abd0eba5a60e2a9f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.383481 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0cceb288c841c0b25425cc1d75b8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.384753 1193 ts_tablet_manager.cc:1929] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.384910 1193 log.cc:1199] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/a0cb7a1acf35403192254bf5cd1170a2
I20260616 19:52:21.385042 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1228) took 4011 ms. Trace:
I20260616 19:52:21.385155 1198 tablet_bootstrap.cc:492] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:21.386664 1198 tablet_bootstrap.cc:654] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.386994 898 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0cceb288c841c0b25425cc1d75b8b8 (DEFAULT_TABLE table=default.Table_1a5924d3b655450a8804a5a77cd2181a [id=8578252ed1dd417abd0eba5a60e2a9f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.387472 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0cceb288c841c0b25425cc1d75b8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.389144 1193 ts_tablet_manager.cc:1950] T a0cb7a1acf35403192254bf5cd1170a2 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:21.389920 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1259) took 2719 ms. Trace:
I20260616 19:52:21.390008 1193 rpcz_store.cc:276] 0616 19:52:18.670100 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.670293 (+ 193us) service_pool.cc:224] Handling call
0616 19:52:21.360070 (+2689777us) ts_tablet_manager.cc:1151] Deleting tablet a0cb7a1acf35403192254bf5cd1170a2
0616 19:52:21.360080 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.368666 (+ 8586us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.384666 (+ 16000us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.389900 (+ 5234us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2689600}
I20260616 19:52:21.390439 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet a0cb7a1acf35403192254bf5cd1170a2 (table default.Table_667b7f908e7349bcb46f2df575854ac2 [id=278c6728a83248e9aaf08c4c18bba31f]) successfully deleted
I20260616 19:52:21.392287 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9d39b60e1f084549aae7eafe209b9a8c" } modify_external_catalogs: true
I20260616 19:52:21.392432 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9d39b60e1f084549aae7eafe209b9a8c" } modify_external_catalogs: true
I20260616 19:52:21.384356 886 tablet_service.cc:1511] Processing CreateTablet for tablet 1403dd096f3e47e69186c8fa618345a3 (DEFAULT_TABLE table=default.Table_f2243cb23a37411591f0cd2ef5a5ed61 [id=f3e5b0be30c44e8ebbaabaa746cac4f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.392776 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1403dd096f3e47e69186c8fa618345a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.394928 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8137db8cd2914dd79478b66ddbff1c19" } modify_external_catalogs: true
I20260616 19:52:21.395068 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8137db8cd2914dd79478b66ddbff1c19" } modify_external_catalogs: true
I20260616 19:52:21.395617 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1262) took 2725 ms. Trace:
I20260616 19:52:21.395727 1193 rpcz_store.cc:276] 0616 19:52:18.670352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.670489 (+ 137us) service_pool.cc:224] Handling call
0616 19:52:21.395495 (+2725006us) ts_tablet_manager.cc:1151] Deleting tablet af5e277102b8480db44e5ffe88267808
0616 19:52:21.395509 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.395595 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2724892}
W20260616 19:52:21.396215 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet af5e277102b8480db44e5ffe88267808 because the tablet was not found. No further retry: Not found: Tablet not found: af5e277102b8480db44e5ffe88267808
I20260616 19:52:21.396404 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_771c21e2e42f493baa45a3dd0c7df5e0" } modify_external_catalogs: true
I20260616 19:52:21.396546 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_771c21e2e42f493baa45a3dd0c7df5e0" } modify_external_catalogs: true
I20260616 19:52:21.397673 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c9937edc05884c318c39cb7cd7184b85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:21.398142 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9937edc05884c318c39cb7cd7184b85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:21.401142 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1263) took 2730 ms. Trace:
I20260616 19:52:21.401230 1193 rpcz_store.cc:276] 0616 19:52:18.670468 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.670618 (+ 150us) service_pool.cc:224] Handling call
0616 19:52:21.401028 (+2730410us) ts_tablet_manager.cc:1151] Deleting tablet c7f724dc23024a7297cfb8689f199600
0616 19:52:21.401041 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.401124 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2730293}
W20260616 19:52:21.401664 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c7f724dc23024a7297cfb8689f199600 because the tablet was not found. No further retry: Not found: Tablet not found: c7f724dc23024a7297cfb8689f199600
I20260616 19:52:21.403106 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1264) took 2732 ms. Trace:
I20260616 19:52:21.403789 1193 rpcz_store.cc:276] 0616 19:52:18.670586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.670626 (+ 40us) service_pool.cc:224] Handling call
0616 19:52:21.402989 (+2732363us) ts_tablet_manager.cc:1151] Deleting tablet 269c1dea941c481fb6fd2e4d59c877c0
0616 19:52:21.403001 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.403087 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2732238}
W20260616 19:52:21.404695 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 269c1dea941c481fb6fd2e4d59c877c0 because the tablet was not found. No further retry: Not found: Tablet not found: 269c1dea941c481fb6fd2e4d59c877c0
W20260616 19:52:21.404918 718 consensus_peers.cc:597] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:21.405395 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1265) took 2734 ms. Trace:
I20260616 19:52:21.406100 1193 rpcz_store.cc:276] 0616 19:52:18.670675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.670755 (+ 80us) service_pool.cc:224] Handling call
0616 19:52:21.405293 (+2734538us) ts_tablet_manager.cc:1151] Deleting tablet bcc5116ef5df4140a96f03c003337c68
0616 19:52:21.405304 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.405374 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2734396}
W20260616 19:52:21.407086 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet bcc5116ef5df4140a96f03c003337c68 because the tablet was not found. No further retry: Not found: Tablet not found: bcc5116ef5df4140a96f03c003337c68
I20260616 19:52:21.407637 1193 tablet_replica.cc:333] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:21.385115 1191 rpcz_store.cc:276] 0616 19:52:17.373121 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.392427 (+ 19306us) service_pool.cc:224] Handling call
0616 19:52:21.299542 (+3907115us) ts_tablet_manager.cc:1151] Deleting tablet 9505120dd9f049c19cf2b84cabe021a6
0616 19:52:21.299552 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.385022 (+ 85470us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3906057}
I20260616 19:52:21.408700 2662 raft_consensus.cc:493] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.408737 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1231) took 3922 ms. Trace:
I20260616 19:52:21.408809 1191 rpcz_store.cc:276] 0616 19:52:17.486173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.488324 (+ 2151us) service_pool.cc:224] Handling call
0616 19:52:21.408607 (+3920283us) ts_tablet_manager.cc:1151] Deleting tablet cefa4f3eee5b49e6b23405cfd2daabaf
0616 19:52:21.408619 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.408719 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3919937}
I20260616 19:52:21.408866 2662 raft_consensus.cc:515] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.408262 1193 raft_consensus.cc:2243] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:21.409050 1191 tablet_replica.cc:333] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:21.409102 1193 raft_consensus.cc:2272] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.409225 1191 raft_consensus.cc:2243] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:21.409471 2662 leader_election.cc:290] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:21.409624 1193 ts_tablet_manager.cc:1916] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.410142 2985 raft_consensus.cc:493] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.410269 2985 raft_consensus.cc:515] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.410730 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f280b9ea1147799635f8a6199f17c0" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:21.410832 2985 leader_election.cc:290] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.410895 784 raft_consensus.cc:2468] T 23f280b9ea1147799635f8a6199f17c0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:21.411253 860 leader_election.cc:304] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:21.411618 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c08452aeec471f8480a489620cca28" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:21.411902 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f280b9ea1147799635f8a6199f17c0" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:52:21.412530 718 leader_election.cc:343] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:21.412384 858 leader_election.cc:343] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.413306 2662 raft_consensus.cc:2804] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:21.413424 2662 raft_consensus.cc:493] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:21.413529 2662 raft_consensus.cc:3060] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.415846 2662 raft_consensus.cc:515] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.417315 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f280b9ea1147799635f8a6199f17c0" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:21.417467 784 raft_consensus.cc:3060] T 23f280b9ea1147799635f8a6199f17c0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.420004 784 raft_consensus.cc:2468] T 23f280b9ea1147799635f8a6199f17c0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:21.420392 860 leader_election.cc:304] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:21.420658 2700 raft_consensus.cc:2804] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:21.420886 2700 raft_consensus.cc:697] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:21.422668 2700 consensus_queue.cc:237] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.423221 458 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_3bee557dbc924f6b982089749d9abe7b [id=ae7663c7da4444f1a6ef328ba7bd3494] alter complete (version 2)
I20260616 19:52:21.424010 460 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_7ffffaef50044d8ba89e6df198946113 [id=d49c093f51b04c2fa1b1f5daadd802cf] alter complete (version 3)
I20260616 19:52:21.425559 1198 tablet_bootstrap.cc:492] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:21.425698 1198 ts_tablet_manager.cc:1403] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.001s
I20260616 19:52:21.426196 1192 tablet_bootstrap.cc:492] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:21.426335 1192 ts_tablet_manager.cc:1403] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.160s user 0.000s sys 0.004s
I20260616 19:52:21.427055 1198 raft_consensus.cc:359] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.427213 1198 raft_consensus.cc:385] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.427258 1198 raft_consensus.cc:740] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.427459 1198 consensus_queue.cc:260] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.427984 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 4faa62f03c2a4588a776883dc54d0426 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:12 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.428431 1198 ts_tablet_manager.cc:1434] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:21.409406 1191 raft_consensus.cc:2272] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.429030 1191 ts_tablet_manager.cc:1916] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.431855 2662 leader_election.cc:290] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:21.432186 1190 log.cc:1199] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/ba0d3e7da3c74f5ea5dc4aac80a01c82
I20260616 19:52:21.432693 1190 ts_tablet_manager.cc:1950] T ba0d3e7da3c74f5ea5dc4aac80a01c82 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:21.433063 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1189) took 4772 ms. Trace:
I20260616 19:52:21.433156 1190 rpcz_store.cc:276] 0616 19:52:16.660823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.660945 (+ 122us) service_pool.cc:224] Handling call
0616 19:52:21.195932 (+4534987us) ts_tablet_manager.cc:1151] Deleting tablet ba0d3e7da3c74f5ea5dc4aac80a01c82
0616 19:52:21.195944 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.313416 (+117472us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.316225 (+ 2809us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.433047 (+116822us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4526178}
I20260616 19:52:21.433647 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 (table default.Table_08419ba303bb445eac997664503a70a7 [id=2f996fd8aa154e608653b56bc8d01990]) successfully deleted
I20260616 19:52:21.434712 1196 tablet_bootstrap.cc:492] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:21.434963 1196 ts_tablet_manager.cc:1403] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.082s user 0.005s sys 0.014s
I20260616 19:52:21.440176 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_fa74da20235f4832b8b37639a4a88b57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:21.440335 1192 raft_consensus.cc:359] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.440524 1192 raft_consensus.cc:385] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.440577 1192 raft_consensus.cc:740] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
W20260616 19:52:21.440740 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa74da20235f4832b8b37639a4a88b57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:21.441490 1190 tablet_replica.cc:333] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:21.441552 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_62387b40bb174f7e863bfe1bd975d949" } new_table_name: "default.Table_ccb660ffb17a4a01840efa8c374603d8" modify_external_catalogs: true
I20260616 19:52:21.441676 1190 raft_consensus.cc:2243] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:21.441975 1190 raft_consensus.cc:2272] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.442479 1190 ts_tablet_manager.cc:1916] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.444169 1196 raft_consensus.cc:359] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.444868 1196 raft_consensus.cc:385] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.445192 1196 raft_consensus.cc:740] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.445614 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f280b9ea1147799635f8a6199f17c0" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:21.446055 1196 consensus_queue.cc:260] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.448356 1196 ts_tablet_manager.cc:1434] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260616 19:52:21.449347 1196 tablet_bootstrap.cc:492] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:21.449672 1192 consensus_queue.cc:260] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.449975 1198 tablet_bootstrap.cc:492] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:21.451452 1198 tablet_bootstrap.cc:654] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.451982 1192 ts_tablet_manager.cc:1434] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.026s user 0.001s sys 0.001s
I20260616 19:52:21.455825 2774 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:35857,127.0.105.189:43055,127.0.105.188:34219
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:34219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.188
--webserver_port=35247
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 16 Jun 2026 19:43:22 UTC on bdcb31816ec0
build id 12426
ASAN enabled
I20260616 19:52:21.461831 901 tablet_service.cc:1558] Processing DeleteTablet for tablet c239a24dbdc047f9beb2ed7e1492acfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.462038 892 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.462262 893 tablet_service.cc:1558] Processing DeleteTablet for tablet fab8282287434bf8b7e37f008a1b0166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.462471 896 tablet_service.cc:1558] Processing DeleteTablet for tablet e03e6a2614564eeeb8ec382b16f0ece1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.462656 1192 tablet_bootstrap.cc:492] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:21.464320 1192 tablet_bootstrap.cc:654] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:21.450981 858 leader_election.cc:343] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.466877 2774 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260616 19:52:21.472337 2774 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260616 19:52:21.481412 1191 ts_tablet_manager.cc:1929] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:21.481552 1191 log.cc:1199] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/fe2ac7d4df6a48d6a93d40c7eef38c9c
I20260616 19:52:21.481899 1191 ts_tablet_manager.cc:1950] T fe2ac7d4df6a48d6a93d40c7eef38c9c P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:21.482694 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1232) took 3983 ms. Trace:
I20260616 19:52:21.482785 1191 rpcz_store.cc:276] 0616 19:52:17.498839 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.498987 (+ 148us) service_pool.cc:224] Handling call
0616 19:52:21.409010 (+3910023us) ts_tablet_manager.cc:1151] Deleting tablet fe2ac7d4df6a48d6a93d40c7eef38c9c
0616 19:52:21.409018 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.431864 (+ 22846us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.481344 (+ 49480us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.482673 (+ 1329us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3909693}
I20260616 19:52:21.483117 1191 tablet_replica.cc:333] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:21.483294 1191 raft_consensus.cc:2243] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:21.483464 1191 raft_consensus.cc:2272] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.484011 1191 ts_tablet_manager.cc:1916] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.505987 1198 tablet_bootstrap.cc:492] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:21.506253 1198 ts_tablet_manager.cc:1403] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.001s
I20260616 19:52:21.506814 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 23f280b9ea1147799635f8a6199f17c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.507121 1198 raft_consensus.cc:359] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.507404 1198 raft_consensus.cc:385] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.507537 1198 raft_consensus.cc:740] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.507865 1198 consensus_queue.cc:260] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.508150 2700 raft_consensus.cc:493] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.508354 2700 raft_consensus.cc:515] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.508653 1198 ts_tablet_manager.cc:1434] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:21.508994 1198 tablet_bootstrap.cc:492] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:21.509514 2700 leader_election.cc:290] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:21.509598 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2e5bc2c47746e88e95634fb073273e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:21.509773 775 raft_consensus.cc:2468] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:21.510142 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2e5bc2c47746e88e95634fb073273e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:21.510339 1053 raft_consensus.cc:2468] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:21.510465 1198 tablet_bootstrap.cc:654] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.511039 860 leader_election.cc:304] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:21.511780 2700 raft_consensus.cc:2804] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:21.511942 2700 raft_consensus.cc:493] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:21.512084 2700 raft_consensus.cc:3060] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.515671 2700 raft_consensus.cc:515] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.516952 2700 leader_election.cc:290] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:21.517007 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2e5bc2c47746e88e95634fb073273e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:21.517158 775 raft_consensus.cc:3060] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.517503 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2e5bc2c47746e88e95634fb073273e" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:21.517668 1053 raft_consensus.cc:3060] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.520833 1053 raft_consensus.cc:2468] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:21.521503 858 leader_election.cc:304] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:21.521950 2700 raft_consensus.cc:2804] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:21.522243 2700 raft_consensus.cc:697] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:21.523450 2700 consensus_queue.cc:237] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.525548 1192 tablet_bootstrap.cc:492] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:21.525797 1192 ts_tablet_manager.cc:1403] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.000s
I20260616 19:52:21.526726 1192 raft_consensus.cc:359] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.527014 1192 raft_consensus.cc:385] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.527141 1192 raft_consensus.cc:740] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.527491 1192 consensus_queue.cc:260] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.528262 1192 ts_tablet_manager.cc:1434] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:21.528988 2662 raft_consensus.cc:493] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:21.529152 2662 raft_consensus.cc:515] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.529652 2662 leader_election.cc:290] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:21.530601 1196 tablet_bootstrap.cc:654] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:21.530616 860 leader_election.cc:343] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 40bdb01a15254c329d82f0d40919b880
W20260616 19:52:21.532604 858 leader_election.cc:343] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 40bdb01a15254c329d82f0d40919b880
I20260616 19:52:21.532723 858 leader_election.cc:304] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:21.532958 2662 raft_consensus.cc:2749] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:21.535885 2963 raft_consensus.cc:2804] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:21.535977 2963 raft_consensus.cc:493] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:21.536064 2963 raft_consensus.cc:3060] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.538007 775 raft_consensus.cc:2468] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:21.538556 2963 raft_consensus.cc:515] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.539959 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5462af2002f9406b85ee20660e001a95" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:21.540151 1193 ts_tablet_manager.cc:1929] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.540251 1193 log.cc:1199] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/90bc7409e31043bd9f47d3628278a2fa
I20260616 19:52:21.540426 2963 leader_election.cc:290] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.540622 1193 ts_tablet_manager.cc:1950] T 90bc7409e31043bd9f47d3628278a2fa P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:52:21.540959 993 leader_election.cc:343] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.542323 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1266) took 2871 ms. Trace:
I20260616 19:52:21.543175 1193 rpcz_store.cc:276] 0616 19:52:18.670789 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.672090 (+ 1301us) service_pool.cc:224] Handling call
0616 19:52:21.407585 (+2735495us) ts_tablet_manager.cc:1151] Deleting tablet 90bc7409e31043bd9f47d3628278a2fa
0616 19:52:21.407597 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.533920 (+126323us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.540102 (+ 6182us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.542307 (+ 2205us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2735344}
I20260616 19:52:21.543852 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 90bc7409e31043bd9f47d3628278a2fa (table default.Table_a4a6f573af0d49d58db91ad41beb2ac1 [id=f120198cf70040b982289f0a239f2e5c]) successfully deleted
I20260616 19:52:21.543928 1193 tablet_replica.cc:333] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:21.544094 1193 raft_consensus.cc:2243] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:21.544328 1193 raft_consensus.cc:2272] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.545289 1198 tablet_bootstrap.cc:492] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:21.545495 1198 ts_tablet_manager.cc:1403] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20260616 19:52:21.545532 1193 ts_tablet_manager.cc:1916] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.546312 1198 raft_consensus.cc:359] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.546551 1198 raft_consensus.cc:385] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.546669 1198 raft_consensus.cc:740] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.546986 1198 consensus_queue.cc:260] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.547695 1198 ts_tablet_manager.cc:1434] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:21.548029 1198 tablet_bootstrap.cc:492] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
W20260616 19:52:21.548887 833 tablet.cc:2406] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260616 19:52:21.549501 1198 tablet_bootstrap.cc:654] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.554919 1192 tablet_bootstrap.cc:492] T 610d6197e35e447ea25cdba2cc454b8d P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:21.556754 1192 tablet_bootstrap.cc:654] T 610d6197e35e447ea25cdba2cc454b8d P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.558295 1193 ts_tablet_manager.cc:1929] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.558394 1193 log.cc:1199] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/1a7b177800174706a985c11e5876b9d3
I20260616 19:52:21.558539 1190 ts_tablet_manager.cc:1929] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.558660 1190 log.cc:1199] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/2e1696a3c9f24001a4aaf99725f73f62
I20260616 19:52:21.558738 1193 ts_tablet_manager.cc:1950] T 1a7b177800174706a985c11e5876b9d3 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:21.559063 1190 ts_tablet_manager.cc:1950] T 2e1696a3c9f24001a4aaf99725f73f62 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:21.559392 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1190) took 4898 ms. Trace:
I20260616 19:52:21.559477 1190 rpcz_store.cc:276] 0616 19:52:16.660915 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.661048 (+ 133us) service_pool.cc:224] Handling call
0616 19:52:21.441444 (+4780396us) ts_tablet_manager.cc:1151] Deleting tablet 2e1696a3c9f24001a4aaf99725f73f62
0616 19:52:21.441454 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.501761 (+ 60307us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.558490 (+ 56729us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.559343 (+ 853us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4771644}
I20260616 19:52:21.559885 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 2e1696a3c9f24001a4aaf99725f73f62 (table default.Table_186eb03ebeeb4351b7cd0feeaebd1ef3 [id=9f49b3a822224b5082a631394c44a5b2]) successfully deleted
I20260616 19:52:21.559475 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1260) took 2889 ms. Trace:
I20260616 19:52:21.567850 1193 rpcz_store.cc:276] 0616 19:52:18.670173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.670219 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:21.543882 (+2873663us) ts_tablet_manager.cc:1151] Deleting tablet 1a7b177800174706a985c11e5876b9d3
0616 19:52:21.543892 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.551039 (+ 7147us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.558248 (+ 7209us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.559455 (+ 1207us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2870789}
I20260616 19:52:21.568711 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 1a7b177800174706a985c11e5876b9d3 (table default.Table_9b154e7b9f584385866a56cfaa2bbd49 [id=0f612612c8124e4a91a05c3e23a9d693]) successfully deleted
I20260616 19:52:21.568856 1193 tablet_replica.cc:333] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:21.569011 1193 raft_consensus.cc:2243] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:21.569919 1193 raft_consensus.cc:2272] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.571453 1193 ts_tablet_manager.cc:1916] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:21.586685 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 449279us
I20260616 19:52:21.587127 1191 ts_tablet_manager.cc:1929] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.587263 1191 log.cc:1199] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/efd5fecc6d444e5fba9103287c09542e
I20260616 19:52:21.587318 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2e5bc2c47746e88e95634fb073273e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:21.587545 775 raft_consensus.cc:2393] T 7a2e5bc2c47746e88e95634fb073273e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61c874fef3684d10a272a9c7f280e0e2 in current term 1: Already voted for candidate ae28da1c4102450ab76eb2946a5cbf2e in this term.
I20260616 19:52:21.587623 1191 ts_tablet_manager.cc:1950] T efd5fecc6d444e5fba9103287c09542e P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:21.588821 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d686190fb6a34ab18cc4799197765f1b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:21.589192 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 08db2c1398b946c180d81b88504c1d9c (table default.Table_1b0deebdd1844949b9064d3e3ab11920 [id=70f7e3e96e524037a13e7c49678a3a8c]) successfully deleted
W20260616 19:52:21.589910 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet a555ad9f529943558a5ef6ea5c99851d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a555ad9f529943558a5ef6ea5c99851d already in progress: creating tablet
I20260616 19:52:21.593498 2963 raft_consensus.cc:493] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.593657 2963 raft_consensus.cc:515] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.594460 2963 leader_election.cc:290] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.594729 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d686afeeed4729bd2069296aec82a1" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:21.595348 993 leader_election.cc:343] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:21.597373 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 7d486a9c69954dc4a9b664d89d2bf28a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d486a9c69954dc4a9b664d89d2bf28a already in progress: creating tablet
I20260616 19:52:21.597473 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5462af2002f9406b85ee20660e001a95" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:21.597585 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 67ac2e31a1ba40b39145c26a1e4e0884 because the tablet was not found. No further retry: Not found: Tablet not found: 67ac2e31a1ba40b39145c26a1e4e0884
I20260616 19:52:21.597606 784 raft_consensus.cc:3060] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:21.597837 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 9505120dd9f049c19cf2b84cabe021a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9505120dd9f049c19cf2b84cabe021a6 already in progress: creating tablet
W20260616 19:52:21.597977 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet cefa4f3eee5b49e6b23405cfd2daabaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cefa4f3eee5b49e6b23405cfd2daabaf already in progress: creating tablet
I20260616 19:52:21.598089 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet fe2ac7d4df6a48d6a93d40c7eef38c9c (table default.Table_edb542c197924a81a6ae1a4a8a16f34a [id=1e3bc78bafc8405c8e57142c8236aef3]) successfully deleted
I20260616 19:52:21.600065 784 raft_consensus.cc:2468] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:21.600525 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 91ee15293fa74733a03ad11600224ae6 (DEFAULT_TABLE table=default.Table_798762eab3ea49818ee909f8b3207b1b [id=f35a951f1f444df6ae65095894d44a62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.600873 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 24b7cf4146314ee8900b852701fc4833 (DEFAULT_TABLE table=default.Table_d35aea801f0d481f897236926c33060c [id=4484e59361ea44b0a64cfa24bdbad6d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.600916 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7be8c7d4cf471ca1ae840ef96f0daf (DEFAULT_TABLE table=default.Table_4fd1d944e4b54432979c16a8d23c9ee9 [id=88229c1dccd0404ab97e1375a2b19759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.601397 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a740b0d5d2b04f81853d800962dd95fc (DEFAULT_TABLE table=default.Table_75dfd23bdd1e4538975aeae054d02379 [id=ccbcdc53c4a149d0894ea06f949d3655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.601505 1025 tablet_service.cc:1511] Processing CreateTablet for tablet b950c2feed6d49ce87159366f02412dd (DEFAULT_TABLE table=default.Table_d9475c4c32a248de8a4ce51252e648aa [id=253c7ae83c7546f7bfa9651fde01d439]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.601610 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 67f092298661466aa8432baa61559325 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:21.601740 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet f252ea7261ea42869e25245c7ee78c05 with delete_type TABLET_DATA_DELETED (replaced by tablet 0db1fd628cf047458664e20ab3a4d66b) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:21.601784 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 8564366a68ed4af0a6c02b3a7eec4f0c (DEFAULT_TABLE table=default.Table_d727712bd5c04c0eb3f30732551a823d [id=b70eb90923064aeea2073f11c9302c33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.601907 1023 tablet_service.cc:1511] Processing CreateTablet for tablet cd453c839b6c4d8ea1b51e44e1428352 (DEFAULT_TABLE table=default.Table_9106e27b54a6450aa0c0366fbda74e48 [id=228ff8d5b38d4709be22187cd0546231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.602066 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f85f7727e447c88eb0287b19005b1b with delete_type TABLET_DATA_DELETED (replaced by tablet 37d702a538ea477ba524ea7380980f43) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:21.602547 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 1403dd096f3e47e69186c8fa618345a3 (DEFAULT_TABLE table=default.Table_f2243cb23a37411591f0cd2ef5a5ed61 [id=f3e5b0be30c44e8ebbaabaa746cac4f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.603020 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 610d6197e35e447ea25cdba2cc454b8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:21.603112 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0cceb288c841c0b25425cc1d75b8b8 (DEFAULT_TABLE table=default.Table_1a5924d3b655450a8804a5a77cd2181a [id=8578252ed1dd417abd0eba5a60e2a9f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:21.603484 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faa62f03c2a4588a776883dc54d0426" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:21.603653 1053 raft_consensus.cc:2468] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:21.605428 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c08452aeec471f8480a489620cca28" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:21.605576 1196 tablet_bootstrap.cc:492] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:21.605584 1053 raft_consensus.cc:2468] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:21.605697 1196 ts_tablet_manager.cc:1403] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.157s user 0.001s sys 0.024s
I20260616 19:52:21.606449 1196 raft_consensus.cc:359] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.606564 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1182) took 4946 ms. Trace:
I20260616 19:52:21.606670 1196 raft_consensus.cc:385] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.606765 1196 raft_consensus.cc:740] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.606670 1190 rpcz_store.cc:276] 0616 19:52:16.659954 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.660023 (+ 69us) service_pool.cc:224] Handling call
0616 19:52:21.606406 (+4946383us) ts_tablet_manager.cc:1151] Deleting tablet 43e9d7a232f6444dbec3a3954bd47641
0616 19:52:21.606416 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.606506 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4936575}
W20260616 19:52:21.607091 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 43e9d7a232f6444dbec3a3954bd47641 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43e9d7a232f6444dbec3a3954bd47641 already in progress: creating tablet
I20260616 19:52:21.607146 1190 tablet_replica.cc:333] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:21.607039 1196 consensus_queue.cc:260] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.607385 1190 raft_consensus.cc:2243] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:21.608559 1190 raft_consensus.cc:2272] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.609135 1190 ts_tablet_manager.cc:1916] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.612210 2985 raft_consensus.cc:493] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.612339 2985 raft_consensus.cc:515] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.612949 2985 leader_election.cc:290] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.613729 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a406124a8d34e578ba94fab2a873a55" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:21.614259 718 leader_election.cc:343] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.615173 1196 ts_tablet_manager.cc:1434] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260616 19:52:21.617342 2963 raft_consensus.cc:493] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.617528 2963 raft_consensus.cc:515] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.618093 2963 leader_election.cc:290] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.618763 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a95eafa064b4b95b5281915ea5bd9f7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:21.618971 918 raft_consensus.cc:2468] T 1a95eafa064b4b95b5281915ea5bd9f7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:21.619364 993 leader_election.cc:304] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:21.619844 2963 raft_consensus.cc:2804] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:21.619931 2963 raft_consensus.cc:493] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:21.619998 2963 raft_consensus.cc:3060] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.621135 1196 tablet_bootstrap.cc:492] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:21.625561 1196 tablet_bootstrap.cc:654] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.631453 1192 tablet_bootstrap.cc:492] T 610d6197e35e447ea25cdba2cc454b8d P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:21.631589 1192 ts_tablet_manager.cc:1403] T 610d6197e35e447ea25cdba2cc454b8d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.103s user 0.003s sys 0.000s
I20260616 19:52:21.632299 1192 raft_consensus.cc:359] T 610d6197e35e447ea25cdba2cc454b8d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.632477 1192 raft_consensus.cc:385] T 610d6197e35e447ea25cdba2cc454b8d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.632542 1192 raft_consensus.cc:740] T 610d6197e35e447ea25cdba2cc454b8d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.632772 1192 consensus_queue.cc:260] T 610d6197e35e447ea25cdba2cc454b8d P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.633945 1192 ts_tablet_manager.cc:1434] T 610d6197e35e447ea25cdba2cc454b8d P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:21.634383 1192 tablet_bootstrap.cc:492] T 8c19c2e43a944893b86982bee1eb2f30 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:21.628428 2963 raft_consensus.cc:515] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.635578 1193 ts_tablet_manager.cc:1929] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.636561 1193 log.cc:1199] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/482411d57f24459d8e7ed0eeb573234d
I20260616 19:52:21.637113 1193 ts_tablet_manager.cc:1950] T 482411d57f24459d8e7ed0eeb573234d P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:21.636919 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ee15293fa74733a03ad11600224ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.641779 1192 tablet_bootstrap.cc:654] T 8c19c2e43a944893b86982bee1eb2f30 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.643371 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1257) took 2973 ms. Trace:
I20260616 19:52:21.644991 1193 rpcz_store.cc:276] 0616 19:52:18.669929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.673456 (+ 3527us) service_pool.cc:224] Handling call
0616 19:52:21.568809 (+2895353us) ts_tablet_manager.cc:1151] Deleting tablet 482411d57f24459d8e7ed0eeb573234d
0616 19:52:21.568819 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.603514 (+ 34695us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.635516 (+ 32002us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.643349 (+ 7833us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2895198}
I20260616 19:52:21.645826 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 482411d57f24459d8e7ed0eeb573234d (table default.Table_861e66e4d4424b7d91d0a3a5d3519db8 [id=1712ccef85b8436986d12a371de3a4eb]) successfully deleted
I20260616 19:52:21.648730 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1282) took 2625 ms. Trace:
I20260616 19:52:21.649201 1193 rpcz_store.cc:276] 0616 19:52:19.023343 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.023995 (+ 652us) service_pool.cc:224] Handling call
0616 19:52:21.648586 (+2624591us) ts_tablet_manager.cc:1151] Deleting tablet 7d4d05b550f645e3a4b156bd79a58456
0616 19:52:21.648596 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.648713 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2624185}
W20260616 19:52:21.649899 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 7d4d05b550f645e3a4b156bd79a58456 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d4d05b550f645e3a4b156bd79a58456 already in progress: creating tablet
I20260616 19:52:21.650393 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1283) took 2599 ms. Trace:
I20260616 19:52:21.652211 1193 rpcz_store.cc:276] 0616 19:52:19.050605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.059136 (+ 8531us) service_pool.cc:224] Handling call
0616 19:52:21.650251 (+2591115us) ts_tablet_manager.cc:1151] Deleting tablet 29712de1da8b47098aad2b962390f790
0616 19:52:21.650264 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.650375 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2590926}
W20260616 19:52:21.652907 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 29712de1da8b47098aad2b962390f790 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29712de1da8b47098aad2b962390f790 already in progress: creating tablet
I20260616 19:52:21.653343 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1290) took 2223 ms. Trace:
I20260616 19:52:21.653842 1193 rpcz_store.cc:276] 0616 19:52:19.429796 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.430854 (+ 1058us) service_pool.cc:224] Handling call
0616 19:52:21.653244 (+2222390us) ts_tablet_manager.cc:1151] Deleting tablet 964384a661834a6e9ffaa4724a0ee3be
0616 19:52:21.653253 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.653327 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2222227}
W20260616 19:52:21.654371 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 964384a661834a6e9ffaa4724a0ee3be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 964384a661834a6e9ffaa4724a0ee3be already in progress: creating tablet
I20260616 19:52:21.654780 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1291) took 2207 ms. Trace:
I20260616 19:52:21.655172 1193 rpcz_store.cc:276] 0616 19:52:19.447272 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.447334 (+ 62us) service_pool.cc:224] Handling call
0616 19:52:21.654677 (+2207343us) ts_tablet_manager.cc:1151] Deleting tablet 78cef79e6b324df7943e6f499516c5d9
0616 19:52:21.654685 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.654766 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2207172}
W20260616 19:52:21.655784 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 78cef79e6b324df7943e6f499516c5d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78cef79e6b324df7943e6f499516c5d9 already in progress: creating tablet
I20260616 19:52:21.656147 1193 tablet_replica.cc:333] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:21.656862 1193 raft_consensus.cc:2243] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:21.659439 1193 raft_consensus.cc:2272] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.665429 1193 ts_tablet_manager.cc:1916] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.661258 1196 tablet_bootstrap.cc:492] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:21.668843 2642 raft_consensus.cc:493] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.668985 2642 raft_consensus.cc:515] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.669824 2642 leader_election.cc:290] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.670743 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c4e584fad94633ae49332872de0fc3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:21.670955 918 raft_consensus.cc:2468] T e3c4e584fad94633ae49332872de0fc3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:21.671443 718 leader_election.cc:304] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:21.671761 2642 raft_consensus.cc:2804] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:21.671854 2642 raft_consensus.cc:493] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:21.671923 2642 raft_consensus.cc:3060] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.674285 2642 raft_consensus.cc:515] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.675516 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c4e584fad94633ae49332872de0fc3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:21.675673 918 raft_consensus.cc:3060] T e3c4e584fad94633ae49332872de0fc3 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.678390 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b950c2feed6d49ce87159366f02412dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.678436 918 raft_consensus.cc:2468] T e3c4e584fad94633ae49332872de0fc3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:21.678685 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7be8c7d4cf471ca1ae840ef96f0daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.678900 718 leader_election.cc:304] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:21.679157 2845 raft_consensus.cc:2804] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:21.679270 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b7cf4146314ee8900b852701fc4833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.679266 2845 raft_consensus.cc:697] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:21.679488 2845 consensus_queue.cc:237] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.680833 2642 leader_election.cc:290] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.684582 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0cceb288c841c0b25425cc1d75b8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.668680 1196 ts_tablet_manager.cc:1403] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.048s user 0.006s sys 0.003s
I20260616 19:52:21.687602 1196 raft_consensus.cc:359] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.687764 1196 raft_consensus.cc:385] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.687829 1196 raft_consensus.cc:740] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.688884 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd453c839b6c4d8ea1b51e44e1428352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.689007 1196 consensus_queue.cc:260] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.692188 1196 ts_tablet_manager.cc:1434] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260616 19:52:21.693313 1192 tablet_bootstrap.cc:492] T 8c19c2e43a944893b86982bee1eb2f30 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:21.693461 1192 ts_tablet_manager.cc:1403] T 8c19c2e43a944893b86982bee1eb2f30 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.003s
I20260616 19:52:21.694347 1192 raft_consensus.cc:359] T 8c19c2e43a944893b86982bee1eb2f30 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.694494 1192 raft_consensus.cc:385] T 8c19c2e43a944893b86982bee1eb2f30 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.694536 1192 raft_consensus.cc:740] T 8c19c2e43a944893b86982bee1eb2f30 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.697831 1196 tablet_bootstrap.cc:492] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:21.701682 1190 ts_tablet_manager.cc:1929] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.701785 1190 log.cc:1199] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/e6f309caaa9042f99432a61fd2ebb089
I20260616 19:52:21.702134 1190 ts_tablet_manager.cc:1950] T e6f309caaa9042f99432a61fd2ebb089 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:21.717463 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1403dd096f3e47e69186c8fa618345a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.717746 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1236) took 3935 ms. Trace:
I20260616 19:52:21.722479 1191 rpcz_store.cc:276] 0616 19:52:17.704828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.704883 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:21.483070 (+3778187us) ts_tablet_manager.cc:1151] Deleting tablet efd5fecc6d444e5fba9103287c09542e
0616 19:52:21.483079 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.515568 (+ 32489us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.587053 (+ 71485us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.640379 (+ 53326us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3778008}
I20260616 19:52:21.734256 2700 consensus_queue.cc:1048] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.735647 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8564366a68ed4af0a6c02b3a7eec4f0c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:21.737674 3110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:52:21.739096 1192 consensus_queue.cc:260] T 8c19c2e43a944893b86982bee1eb2f30 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.749140 1196 tablet_bootstrap.cc:654] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.750548 1192 ts_tablet_manager.cc:1434] T 8c19c2e43a944893b86982bee1eb2f30 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.057s user 0.001s sys 0.001s
I20260616 19:52:21.751945 2962 raft_consensus.cc:493] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.753171 1192 tablet_bootstrap.cc:492] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:21.753903 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1191) took 5092 ms. Trace:
I20260616 19:52:21.754027 1190 rpcz_store.cc:276] 0616 19:52:16.661028 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.661074 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:21.607066 (+4945992us) ts_tablet_manager.cc:1151] Deleting tablet e6f309caaa9042f99432a61fd2ebb089
0616 19:52:21.607075 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.649919 (+ 42844us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.701625 (+ 51706us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.753887 (+ 52262us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4937210}
I20260616 19:52:21.754575 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet e6f309caaa9042f99432a61fd2ebb089 (table default.Table_148c23f911c0426e857f5f3cd973d63e [id=fa08d08f5e8a4f9d8616afb37792fbeb]) successfully deleted
I20260616 19:52:21.754643 1190 tablet_replica.cc:333] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:21.754819 1190 raft_consensus.cc:2243] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:21.754973 1190 raft_consensus.cc:2272] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.759671 2774 server_base.cc:1061] running on GCE node
I20260616 19:52:21.759932 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c4e584fad94633ae49332872de0fc3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:21.760037 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c4e584fad94633ae49332872de0fc3" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:21.760149 1059 raft_consensus.cc:3060] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.762603 2700 raft_consensus.cc:493] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260616 19:52:21.743177 3107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260616 19:52:21.752738 3114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260616 19:52:21.762723 2700 raft_consensus.cc:515] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.763388 2700 leader_election.cc:290] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:21.764117 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c08452aeec471f8480a489620cca28" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:21.764287 784 raft_consensus.cc:2468] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:21.764528 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a406124a8d34e578ba94fab2a873a55" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:21.764971 2774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260616 19:52:21.765650 860 leader_election.cc:304] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:21.766144 2679 raft_consensus.cc:2804] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:21.766219 2679 raft_consensus.cc:493] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:21.766278 2679 raft_consensus.cc:3060] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.768698 2679 raft_consensus.cc:515] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.769255 2679 leader_election.cc:290] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:21.770474 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c08452aeec471f8480a489620cca28" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:21.770634 784 raft_consensus.cc:3060] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.777139 784 raft_consensus.cc:2468] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:21.777583 860 leader_election.cc:304] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:21.779594 2774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260616 19:52:21.780375 2662 raft_consensus.cc:2804] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:21.780544 2662 raft_consensus.cc:697] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
W20260616 19:52:21.781723 447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.188:34219, user_credentials={real_user=slave}} blocked reactor thread for 80778.5us
I20260616 19:52:21.780773 2662 consensus_queue.cc:237] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:21.782480 718 consensus_peers.cc:597] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:21.783581 1190 ts_tablet_manager.cc:1916] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.783874 2962 raft_consensus.cc:515] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.784041 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a740b0d5d2b04f81853d800962dd95fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:21.785730 1192 tablet_bootstrap.cc:654] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.789641 1193 ts_tablet_manager.cc:1929] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.789824 1193 log.cc:1199] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/efd5fecc6d444e5fba9103287c09542e
I20260616 19:52:21.790159 1198 tablet_bootstrap.cc:492] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:21.791958 2962 leader_election.cc:290] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.794386 1193 ts_tablet_manager.cc:1950] T efd5fecc6d444e5fba9103287c09542e P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:21.795295 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1293) took 2347 ms. Trace:
I20260616 19:52:21.795523 1193 rpcz_store.cc:276] 0616 19:52:19.447529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.447571 (+ 42us) service_pool.cc:224] Handling call
0616 19:52:21.656105 (+2208534us) ts_tablet_manager.cc:1151] Deleting tablet efd5fecc6d444e5fba9103287c09542e
0616 19:52:21.656114 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.736521 (+ 80407us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.762464 (+ 25943us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.795275 (+ 32811us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2208383}
I20260616 19:52:21.796243 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet efd5fecc6d444e5fba9103287c09542e (table default.Table_3a7e97060a4b49078e3a1d6d87337196 [id=c44c8263ef0247ffabb1e337409d1aad]) successfully deleted
I20260616 19:52:21.796634 1193 tablet_replica.cc:333] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:21.797639 1193 raft_consensus.cc:2243] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:21.797446 1196 tablet_bootstrap.cc:492] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:21.797915 1196 ts_tablet_manager.cc:1403] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.105s user 0.004s sys 0.000s
I20260616 19:52:21.798589 1196 raft_consensus.cc:359] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.798795 1196 raft_consensus.cc:385] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.798892 1196 raft_consensus.cc:740] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.799145 1196 consensus_queue.cc:260] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.800668 1059 raft_consensus.cc:2468] T e3c4e584fad94633ae49332872de0fc3 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:21.804710 3064 raft_consensus.cc:493] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:21.804858 3064 raft_consensus.cc:515] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.805469 3064 leader_election.cc:290] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:21.806527 860 leader_election.cc:343] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 1d825bcf365f424fb99a10afe3e96501
I20260616 19:52:21.810576 1196 ts_tablet_manager.cc:1434] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260616 19:52:21.811810 2774 hybrid_clock.cc:648] HybridClock initialized: now 1781639541811642 us; error 153 us; skew 500 ppm
I20260616 19:52:21.812325 2774 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260616 19:52:21.819657 2845 raft_consensus.cc:493] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.819936 2845 raft_consensus.cc:515] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.820865 2845 leader_election.cc:290] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.821461 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9befb557d84f3bb7781664cbf2f28f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:21.822016 718 leader_election.cc:343] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.822603 1198 ts_tablet_manager.cc:1403] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.242s user 0.006s sys 0.010s
I20260616 19:52:21.829772 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 3519b095ba404049a6799b58160061ac
I20260616 19:52:21.830576 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 3519b095ba404049a6799b58160061ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.830837 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1237) took 3655 ms. Trace:
I20260616 19:52:21.831072 1196 tablet_bootstrap.cc:492] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:21.831027 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 3519b095ba404049a6799b58160061ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:21.837458 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 315c62f70754447c827f303e29168a5f consensus state has no leader
I20260616 19:52:21.837803 1193 raft_consensus.cc:2272] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.838424 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_53d08888495247c286bec025bc90c392"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:21.838992 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53d08888495247c286bec025bc90c392 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:21.839025 1192 tablet_bootstrap.cc:492] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:21.839217 1192 ts_tablet_manager.cc:1403] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.086s user 0.001s sys 0.001s
I20260616 19:52:21.839300 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 375c577934d04e41b31ed6ef90ff4fd4
I20260616 19:52:21.840592 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 375c577934d04e41b31ed6ef90ff4fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.840526 1192 raft_consensus.cc:359] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.840785 1192 raft_consensus.cc:385] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.840839 455 master_service.cc:960] ReplaceTablet: received request to replace tablet e1ab9d0ac7df4d549d52014a0ecd9d1a from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:21.840922 1192 raft_consensus.cc:740] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.841195 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet c1978faeb31f43a1b0ac40c60cdfab9a
I20260616 19:52:21.841203 1192 consensus_queue.cc:260] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.842147 1192 ts_tablet_manager.cc:1434] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260616 19:52:21.842427 1192 tablet_bootstrap.cc:492] T 28cd1ad6e8744d33a2845e9f3dda4a7b P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:21.842532 886 tablet_service.cc:1558] Processing DeleteTablet for tablet c1978faeb31f43a1b0ac40c60cdfab9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.842773 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5030578ef2be4c15836c8043b7346740" } new_table_name: "default.Table_fb110e67ccc8443db8ea0bf1efc8f495" modify_external_catalogs: true
I20260616 19:52:21.844481 1192 tablet_bootstrap.cc:654] T 28cd1ad6e8744d33a2845e9f3dda4a7b P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.840320 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 375c577934d04e41b31ed6ef90ff4fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.841794 754 tablet_service.cc:1558] Processing DeleteTablet for tablet c1978faeb31f43a1b0ac40c60cdfab9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.845746 1193 ts_tablet_manager.cc:1916] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.847834 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 861a73a46dad41b6b5eb59503d9e2ace
I20260616 19:52:21.848399 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 861a73a46dad41b6b5eb59503d9e2ace with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:21.854066 447 consensus_peers.cc:597] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704 -> Peer c404c91cd2194cf6838fddd212f2f4ae (127.0.105.188:34219): Couldn't send request to peer c404c91cd2194cf6838fddd212f2f4ae. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260616 19:52:21.848995 1196 tablet_bootstrap.cc:654] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.849644 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 861a73a46dad41b6b5eb59503d9e2ace with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.856935 456 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 8b7e2d8c25b8464b94ca386566abc2cc (table default.Table_9c19749d8e8a4eaeaa2294ca29ea85dc [id=a12694adb1ba4cfabe42db00e13b002b]). Expected version 1 got 0
I20260616 19:52:21.858135 1190 ts_tablet_manager.cc:1929] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.858314 1190 log.cc:1199] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/a817b1d4c7b640db8894bc801878caae
I20260616 19:52:21.858801 1190 ts_tablet_manager.cc:1950] T a817b1d4c7b640db8894bc801878caae P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:21.859541 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1192) took 5198 ms. Trace:
I20260616 19:52:21.859668 1190 rpcz_store.cc:276] 0616 19:52:16.661274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.661318 (+ 44us) service_pool.cc:224] Handling call
0616 19:52:21.754600 (+5093282us) ts_tablet_manager.cc:1151] Deleting tablet a817b1d4c7b640db8894bc801878caae
0616 19:52:21.754609 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.835261 (+ 80652us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.858085 (+ 22824us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.859525 (+ 1440us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5084671}
I20260616 19:52:21.860136 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet a817b1d4c7b640db8894bc801878caae (table default.Table_516f90bc9f17467796c1a387794b5568 [id=f212bb8d2d614707bc55ef08138d29d3]) successfully deleted
I20260616 19:52:21.860491 1190 tablet_replica.cc:333] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:21.860718 1190 raft_consensus.cc:2243] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:21.861210 1190 raft_consensus.cc:2272] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.861248 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a41d72c27346424094e075a0f485e5ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:21.861732 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a41d72c27346424094e075a0f485e5ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:21.862432 1190 ts_tablet_manager.cc:1916] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:21.863252 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_02efbb98552d4e9a992a27e5e7b51110"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:21.863790 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02efbb98552d4e9a992a27e5e7b51110 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:21.866106 2774 webserver.cc:533] Webserver started at http://127.0.105.188:35247/ using document root <none> and password file <none>
W20260616 19:52:21.870438 719 consensus_peers.cc:597] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08db2c1398b946c180d81b88504c1d9c. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:21.870661 719 leader_election.cc:304] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:21.871304 719 leader_election.cc:304] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:21.871613 2845 raft_consensus.cc:2804] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:21.871681 2845 raft_consensus.cc:493] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:21.871747 2845 raft_consensus.cc:3060] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.871707 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d686afeeed4729bd2069296aec82a1" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:21.874305 2845 raft_consensus.cc:515] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.875005 2642 consensus_queue.cc:1048] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.875424 2642 consensus_queue.cc:1048] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.875772 2642 raft_consensus.cc:2764] T 75c08452aeec471f8480a489620cca28 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260616 19:52:21.876368 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faa62f03c2a4588a776883dc54d0426" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:21.877151 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c9fee0c747ca409ea7fe1dd19294ace8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:21.877239 718 leader_election.cc:343] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.877418 2845 leader_election.cc:290] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:21.877770 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9fee0c747ca409ea7fe1dd19294ace8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:21.878856 2963 leader_election.cc:290] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.879803 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet efd5fecc6d444e5fba9103287c09542e (table default.Table_3a7e97060a4b49078e3a1d6d87337196 [id=c44c8263ef0247ffabb1e337409d1aad]) successfully deleted
I20260616 19:52:21.880961 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf86e5d5f2341c78705f78c02695c17" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:21.881963 996 leader_election.cc:304] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
W20260616 19:52:21.882381 996 leader_election.cc:343] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.882622 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 5462af2002f9406b85ee20660e001a95 (table default.Table_52c372106d354fba9e90c5be75714312 [id=d2574a03769945e99b662ed1015b2703]). Expected version 1 got 0
I20260616 19:52:21.882961 453 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 8b7e2d8c25b8464b94ca386566abc2cc (table default.Table_9c19749d8e8a4eaeaa2294ca29ea85dc [id=a12694adb1ba4cfabe42db00e13b002b]). Expected version 1 got 0
I20260616 19:52:21.883212 1191 rpcz_store.cc:276] 0616 19:52:18.168270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.172905 (+ 4635us) service_pool.cc:224] Handling call
0616 19:52:21.722790 (+3549885us) ts_tablet_manager.cc:1151] Deleting tablet 4819496da1bc4421b1641b8441546879
0616 19:52:21.761212 (+ 38422us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x61800000ed18. stack: 00007f92671a0086 00007f926719fe40 00007f92661593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f92671889bd 00007f9267189a2e 00007f927afd91ad 00007f927af581d3 00007f92770e1e96 00007f92770e3229 00007f9277116bb4 00007f92770f75d0 00007f92770f735d 0000000000aa681c
0616 19:52:21.824032 (+ 62820us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.824150 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11506048,"tablet-delete.queue_time_us":3549708}
I20260616 19:52:21.885730 754 tablet_service.cc:1558] Processing DeleteTablet for tablet e3c4e584fad94633ae49332872de0fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.886217 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a406124a8d34e578ba94fab2a873a55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.887574 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 76c48e233d184487b7651e9cb105c2cc (table default.Table_8640034462d64b5d879d28e067fe1b14 [id=d24b6a6d28c949b2880a34bfa227c585]). Expected version 2 got 0
I20260616 19:52:21.888165 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a9befb557d84f3bb7781664cbf2f28f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.888833 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 23f280b9ea1147799635f8a6199f17c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.889454 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a2e5bc2c47746e88e95634fb073273e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:21.892899 1192 tablet_bootstrap.cc:492] T 28cd1ad6e8744d33a2845e9f3dda4a7b P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:21.892923 2963 raft_consensus.cc:493] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.893165 1192 ts_tablet_manager.cc:1403] T 28cd1ad6e8744d33a2845e9f3dda4a7b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.051s user 0.005s sys 0.000s
I20260616 19:52:21.867475 2774 fs_manager.cc:362] Metadata directory not provided
I20260616 19:52:21.893366 2774 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260616 19:52:21.894845 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 5462af2002f9406b85ee20660e001a95 (table default.Table_52c372106d354fba9e90c5be75714312 [id=d2574a03769945e99b662ed1015b2703]). Expected version 1 got 0
I20260616 19:52:21.895112 1196 tablet_bootstrap.cc:492] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:21.895248 1196 ts_tablet_manager.cc:1403] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.064s user 0.005s sys 0.001s
I20260616 19:52:21.895526 2662 consensus_queue.cc:1048] T e85e2861c41f402d88cafe64a6871429 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.895658 996 leader_election.cc:304] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:21.896039 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 61132c1c9cd24b7d923f1d65ad04c340 (table default.Table_9eb13a45afad449a9bf9b25a0f5d4d1d [id=e8db7417fd294af4b160a434625e9fd0]). Expected version 2 got 0
I20260616 19:52:21.896032 1196 raft_consensus.cc:359] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.896175 1196 raft_consensus.cc:385] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.896239 1196 raft_consensus.cc:740] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.896214 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 8b7e2d8c25b8464b94ca386566abc2cc (table default.Table_9c19749d8e8a4eaeaa2294ca29ea85dc [id=a12694adb1ba4cfabe42db00e13b002b]). Expected version 1 got 0
I20260616 19:52:21.896364 457 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 26503d1293be438dae39fa1e1ea1885b (table default.Table_62387b40bb174f7e863bfe1bd975d949 [id=467b42cd85544c589d2cf3f9eaf21754]). Expected version 1 got 0
I20260616 19:52:21.896631 1192 raft_consensus.cc:359] T 28cd1ad6e8744d33a2845e9f3dda4a7b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.896783 1192 raft_consensus.cc:385] T 28cd1ad6e8744d33a2845e9f3dda4a7b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.896832 1192 raft_consensus.cc:740] T 28cd1ad6e8744d33a2845e9f3dda4a7b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.899246 2845 consensus_queue.cc:1048] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.900157 2845 consensus_queue.cc:1048] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.902230 2845 consensus_queue.cc:1048] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:21.902320 1192 consensus_queue.cc:260] T 28cd1ad6e8744d33a2845e9f3dda4a7b P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.904114 1192 ts_tablet_manager.cc:1434] T 28cd1ad6e8744d33a2845e9f3dda4a7b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260616 19:52:21.906176 1192 tablet_bootstrap.cc:492] T 4fc0c02ef58d4e429855e5bbaa4752ad P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:21.906683 886 tablet_service.cc:1558] Processing DeleteTablet for tablet e3c4e584fad94633ae49332872de0fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.895623 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_671a5d7432df46509cd6770d03c2ae6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:21.907075 719 leader_election.cc:343] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:21.907163 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_671a5d7432df46509cd6770d03c2ae6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:21.907231 719 leader_election.cc:304] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:21.907529 2845 raft_consensus.cc:2749] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:21.908061 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 26503d1293be438dae39fa1e1ea1885b consensus state has no leader
I20260616 19:52:21.908975 2845 raft_consensus.cc:493] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.909147 2845 raft_consensus.cc:515] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.910118 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9800df09eecb4a299a6facf8b85a93e4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:21.910606 718 leader_election.cc:343] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.910792 2845 leader_election.cc:290] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.912658 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_963b2a8a65b14b5caecd9f3b7bcd615d" } new_table_name: "default.Table_8b8de534ca734e109a07486fa21dcfa7" modify_external_catalogs: true
I20260616 19:52:21.914925 1192 tablet_bootstrap.cc:654] T 4fc0c02ef58d4e429855e5bbaa4752ad P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.917306 1193 ts_tablet_manager.cc:1929] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:21.917691 1193 log.cc:1199] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/0b362fa598a54632880faa42a9224ffd
I20260616 19:52:21.918100 1193 ts_tablet_manager.cc:1950] T 0b362fa598a54632880faa42a9224ffd P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:21.921442 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_26590e65265a4f7f9bdba214ba969d00" } new_table_name: "default.Table_a728b56f9dcb4a91a23b97affc968eca" modify_external_catalogs: true
I20260616 19:52:21.924930 1192 tablet_bootstrap.cc:492] T 4fc0c02ef58d4e429855e5bbaa4752ad P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:21.925544 1192 ts_tablet_manager.cc:1403] T 4fc0c02ef58d4e429855e5bbaa4752ad P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260616 19:52:21.927183 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1696a3c9f24001a4aaf99725f73f62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:57 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.927709 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a2e5bc2c47746e88e95634fb073273e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:21.928042 1192 raft_consensus.cc:359] T 4fc0c02ef58d4e429855e5bbaa4752ad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.928437 1192 raft_consensus.cc:385] T 4fc0c02ef58d4e429855e5bbaa4752ad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:21.928687 1192 raft_consensus.cc:740] T 4fc0c02ef58d4e429855e5bbaa4752ad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:21.929111 1192 consensus_queue.cc:260] T 4fc0c02ef58d4e429855e5bbaa4752ad P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.917521 1196 consensus_queue.cc:260] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.928857 2845 consensus_queue.cc:1048] T be6dc34b00414a0d94b01f579994eb4c P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260616 19:52:21.932777 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2cd95a123854d18beabedb341db0563 consensus state has no leader
I20260616 19:52:21.934103 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a8c2577365414efab85e2417e855994f" } modify_external_catalogs: true
I20260616 19:52:21.934332 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a8c2577365414efab85e2417e855994f" } modify_external_catalogs: true
I20260616 19:52:21.936784 1192 ts_tablet_manager.cc:1434] T 4fc0c02ef58d4e429855e5bbaa4752ad P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260616 19:52:21.939903 1192 tablet_bootstrap.cc:492] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:21.941136 1196 ts_tablet_manager.cc:1434] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.046s user 0.001s sys 0.001s
I20260616 19:52:21.944568 1196 tablet_bootstrap.cc:492] T fab8282287434bf8b7e37f008a1b0166 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:21.946595 1192 tablet_bootstrap.cc:654] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.948761 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1296) took 2482 ms. Trace:
I20260616 19:52:21.948899 1193 rpcz_store.cc:276] 0616 19:52:19.447789 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.447831 (+ 42us) service_pool.cc:224] Handling call
0616 19:52:21.796585 (+2348754us) ts_tablet_manager.cc:1151] Deleting tablet 0b362fa598a54632880faa42a9224ffd
0616 19:52:21.796596 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.851935 (+ 55339us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.917252 (+ 65317us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:21.929833 (+ 12581us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2348625}
I20260616 19:52:21.949407 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 0b362fa598a54632880faa42a9224ffd (table default.Table_74f3d2b26e0d4319b73c964c2eaf9204 [id=a67306640a5b4c0a91a283892a3a8062]) successfully deleted
I20260616 19:52:21.950217 1193 tablet_replica.cc:333] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:21.950619 1193 raft_consensus.cc:2243] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:21.951155 1193 raft_consensus.cc:2272] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:21.951858 1193 ts_tablet_manager.cc:1916] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:21.955173 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 194900us
I20260616 19:52:21.955271 3116 raft_consensus.cc:2749] T 7a2e5bc2c47746e88e95634fb073273e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:21.955374 1192 tablet_bootstrap.cc:492] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:21.955456 3116 raft_consensus.cc:2749] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:21.955971 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf86e5d5f2341c78705f78c02695c17" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:21.956284 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a95eafa064b4b95b5281915ea5bd9f7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:21.956645 2962 raft_consensus.cc:493] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.956812 2962 raft_consensus.cc:515] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.957427 2962 leader_election.cc:290] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.957664 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c08452aeec471f8480a489620cca28" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:21.957844 1059 raft_consensus.cc:2468] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:21.951013 1196 tablet_bootstrap.cc:654] T fab8282287434bf8b7e37f008a1b0166 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:21.956642 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c08452aeec471f8480a489620cca28" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:21.959350 1052 raft_consensus.cc:3060] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.956440 916 raft_consensus.cc:3060] T 1a95eafa064b4b95b5281915ea5bd9f7 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.965658 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 90630f9e6f314c5d9589e673339f475a from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:21.966264 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_fb6e0f1c1a21489a9aacd2329cf3b9e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:21.960901 858 leader_election.cc:343] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 1d825bcf365f424fb99a10afe3e96501
W20260616 19:52:21.966998 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb6e0f1c1a21489a9aacd2329cf3b9e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:21.967034 858 leader_election.cc:304] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:21.967651 2662 raft_consensus.cc:2749] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:21.968966 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b22e6fce6e0b43e09d11fca821f0934d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:21.969460 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b22e6fce6e0b43e09d11fca821f0934d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:21.970019 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3706f41b0e342a69f66c936173f2ae0" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:21.972119 916 raft_consensus.cc:2468] T 1a95eafa064b4b95b5281915ea5bd9f7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:21.976604 2662 raft_consensus.cc:493] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.976749 2662 raft_consensus.cc:515] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.977293 2662 leader_election.cc:290] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:21.978233 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189a715da140a6833801681bbd5ef4" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:21.984652 2642 raft_consensus.cc:493] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:21.984781 2642 raft_consensus.cc:515] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.985345 2642 leader_election.cc:290] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.985901 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610d6197e35e447ea25cdba2cc454b8d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:21.986083 916 raft_consensus.cc:2468] T 610d6197e35e447ea25cdba2cc454b8d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:21.986537 718 leader_election.cc:304] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:21.986786 2642 raft_consensus.cc:2804] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:21.986868 2642 raft_consensus.cc:493] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:21.986931 2642 raft_consensus.cc:3060] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.987249 2662 raft_consensus.cc:493] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:21.987362 2662 raft_consensus.cc:515] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.987845 2662 leader_election.cc:290] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:21.989115 860 leader_election.cc:343] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: fbe784716b3c4293bd4eddf57f6c9048
I20260616 19:52:21.989413 2642 raft_consensus.cc:515] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.990083 2642 leader_election.cc:290] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:21.990460 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610d6197e35e447ea25cdba2cc454b8d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:21.990608 916 raft_consensus.cc:3060] T 610d6197e35e447ea25cdba2cc454b8d P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:21.993345 916 raft_consensus.cc:2468] T 610d6197e35e447ea25cdba2cc454b8d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:21.993795 718 leader_election.cc:304] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:21.994127 2642 raft_consensus.cc:2804] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:21.994246 2963 raft_consensus.cc:515] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:21.994853 2642 raft_consensus.cc:697] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:21.995160 2642 consensus_queue.cc:237] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:21.999684 993 leader_election.cc:343] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:21.999727 1198 raft_consensus.cc:359] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:22.000711 2963 leader_election.cc:290] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.000723 1052 raft_consensus.cc:2468] T 75c08452aeec471f8480a489620cca28 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:22.002606 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1238) took 3823 ms. Trace:
I20260616 19:52:22.002648 1198 raft_consensus.cc:385] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260616 19:52:22.002734 993 leader_election.cc:343] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.003005 1191 rpcz_store.cc:276] 0616 19:52:18.176882 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.177281 (+ 399us) service_pool.cc:224] Handling call
0616 19:52:21.883519 (+3706238us) ts_tablet_manager.cc:1151] Deleting tablet 892ec2013b9f4c9292bf745e2aeae4ed
0616 19:52:22.000427 (+116908us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.000562 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3706074}
I20260616 19:52:22.003474 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1239) took 3814 ms. Trace:
I20260616 19:52:22.003554 1191 rpcz_store.cc:276] 0616 19:52:18.189249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.189297 (+ 48us) service_pool.cc:224] Handling call
0616 19:52:22.003277 (+3813980us) ts_tablet_manager.cc:1151] Deleting tablet 8e8ee572626a42909f31874a55b5cbb6
0616 19:52:22.003286 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.003373 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3813809}
I20260616 19:52:22.003834 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1240) took 3409 ms. Trace:
I20260616 19:52:22.003913 1191 rpcz_store.cc:276] 0616 19:52:18.594476 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.594537 (+ 61us) service_pool.cc:224] Handling call
0616 19:52:22.003730 (+3409193us) ts_tablet_manager.cc:1151] Deleting tablet 51983531f0f5423aa5f4bb3435cd5a7e
0616 19:52:22.003737 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.003796 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3409015}
I20260616 19:52:22.004153 1191 tablet_replica.cc:333] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:22.004371 1191 raft_consensus.cc:2243] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:22.004526 1191 raft_consensus.cc:2272] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.004681 1198 raft_consensus.cc:740] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.005031 1191 ts_tablet_manager.cc:1916] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.004942 1198 consensus_queue.cc:260] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:22.003014 993 leader_election.cc:304] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:22.010664 1190 ts_tablet_manager.cc:1929] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:22.010797 1190 log.cc:1199] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/c7f724dc23024a7297cfb8689f199600
I20260616 19:52:22.011214 1190 ts_tablet_manager.cc:1950] T c7f724dc23024a7297cfb8689f199600 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
W20260616 19:52:22.020560 993 raft_consensus.cc:2686] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260616 19:52:22.021603 1196 tablet_bootstrap.cc:492] T fab8282287434bf8b7e37f008a1b0166 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:22.021740 1196 ts_tablet_manager.cc:1403] T fab8282287434bf8b7e37f008a1b0166 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.080s user 0.003s sys 0.003s
I20260616 19:52:22.022251 1198 ts_tablet_manager.cc:1434] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.187s user 0.001s sys 0.001s
I20260616 19:52:22.022766 1196 raft_consensus.cc:359] T fab8282287434bf8b7e37f008a1b0166 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.022979 1196 raft_consensus.cc:385] T fab8282287434bf8b7e37f008a1b0166 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.023031 1196 raft_consensus.cc:740] T fab8282287434bf8b7e37f008a1b0166 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.023259 1196 consensus_queue.cc:260] T fab8282287434bf8b7e37f008a1b0166 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.024201 1196 ts_tablet_manager.cc:1434] T fab8282287434bf8b7e37f008a1b0166 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:22.025032 1196 tablet_bootstrap.cc:492] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:22.028812 1198 tablet_bootstrap.cc:492] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:22.030496 1198 tablet_bootstrap.cc:654] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.033226 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1193) took 5371 ms. Trace:
I20260616 19:52:22.033385 1190 rpcz_store.cc:276] 0616 19:52:16.661517 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.661570 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:21.860421 (+5198851us) ts_tablet_manager.cc:1151] Deleting tablet c7f724dc23024a7297cfb8689f199600
0616 19:52:21.860432 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.947369 (+ 86937us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.010593 (+ 63224us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.033206 (+ 22613us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5190437}
I20260616 19:52:22.033501 1191 ts_tablet_manager.cc:1929] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:22.034360 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189a715da140a6833801681bbd5ef4" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:22.034576 1054 raft_consensus.cc:2393] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:22.036372 1191 log.cc:1199] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/1a95eafa064b4b95b5281915ea5bd9f7
I20260616 19:52:22.036760 1191 ts_tablet_manager.cc:1950] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:22.037643 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1241) took 3441 ms. Trace:
I20260616 19:52:22.037748 1191 rpcz_store.cc:276] 0616 19:52:18.596347 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.596425 (+ 78us) service_pool.cc:224] Handling call
0616 19:52:22.004082 (+3407657us) ts_tablet_manager.cc:1151] Deleting tablet 1a95eafa064b4b95b5281915ea5bd9f7
0616 19:52:22.004090 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.007999 (+ 3909us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.012451 (+ 4452us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.037609 (+ 25158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3407501}
I20260616 19:52:22.038230 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1242) took 3438 ms. Trace:
W20260616 19:52:22.036572 858 consensus_peers.cc:597] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe2ac7d4df6a48d6a93d40c7eef38c9c. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:22.038326 1191 rpcz_store.cc:276] 0616 19:52:18.599403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.599456 (+ 53us) service_pool.cc:224] Handling call
0616 19:52:22.038114 (+3438658us) ts_tablet_manager.cc:1151] Deleting tablet 33a6a46041464e93811b0c573db19f43
0616 19:52:22.038125 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.038200 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3438508}
I20260616 19:52:22.038580 858 leader_election.cc:304] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:22.038633 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1243) took 3406 ms. Trace:
I20260616 19:52:22.038720 1191 rpcz_store.cc:276] 0616 19:52:18.631697 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.631754 (+ 57us) service_pool.cc:224] Handling call
0616 19:52:22.038523 (+3406769us) ts_tablet_manager.cc:1151] Deleting tablet 574927dc3a804b059e71630c133dcbea
0616 19:52:22.038532 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.038599 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3406598}
W20260616 19:52:22.038937 858 leader_election.cc:343] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: fbe784716b3c4293bd4eddf57f6c9048
I20260616 19:52:22.039028 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1244) took 3390 ms. Trace:
I20260616 19:52:22.039024 858 leader_election.cc:304] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:22.039106 1191 rpcz_store.cc:276] 0616 19:52:18.648823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.648890 (+ 67us) service_pool.cc:224] Handling call
0616 19:52:22.038924 (+3390034us) ts_tablet_manager.cc:1151] Deleting tablet 290d1bf172f949089e013d24ec64435d
0616 19:52:22.038932 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.038999 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3389832}
I20260616 19:52:22.039462 3064 raft_consensus.cc:3060] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.039556 2700 raft_consensus.cc:2749] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260616 19:52:22.041407 447 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.188:34219: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20260616 19:52:22.042610 3064 raft_consensus.cc:2749] T 61189a715da140a6833801681bbd5ef4 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:22.044337 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:22.044701 3125 raft_consensus.cc:493] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.045324 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c08452aeec471f8480a489620cca28 with delete_type TABLET_DATA_DELETED (replaced by tablet 12944efb54824dc4960db5d09c1a1684) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:22.045385 3125 raft_consensus.cc:515] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.045791 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc0c02ef58d4e429855e5bbaa4752ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:22.046116 3125 leader_election.cc:290] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.046116 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 61189a715da140a6833801681bbd5ef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:01 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:22.046547 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c19c2e43a944893b86982bee1eb2f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:22.046986 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 610d6197e35e447ea25cdba2cc454b8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:22.037510 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26503d1293be438dae39fa1e1ea1885b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:22.046867 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e3778611a24397a1a776be2cc76284" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:22.047111 2774 fs_manager.cc:714] Time spent opening directory manager: real 0.099s user 0.001s sys 0.004s
I20260616 19:52:22.047524 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 14a703acc7804dedbf29b15893e63402 from {username='slave'} at 127.0.0.1:41696
W20260616 19:52:22.047899 718 leader_election.cc:343] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.048077 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1194) took 5386 ms. Trace:
I20260616 19:52:22.048319 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet c7f724dc23024a7297cfb8689f199600 (table default.Table_7cdef69863694f0ba023c214e42394e8 [id=a7f1b3885b764715a88750ea3752dbdb]) successfully deleted
I20260616 19:52:22.049057 1190 rpcz_store.cc:276] 0616 19:52:16.661618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.661687 (+ 69us) service_pool.cc:224] Handling call
0616 19:52:22.048009 (+5386322us) ts_tablet_manager.cc:1151] Deleting tablet aabf57dd6d704645b6bf97b730dbe964
0616 19:52:22.048018 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.048064 (+ 46us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5377971}
I20260616 19:52:22.050271 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9b4c9fb1e2f641f28cbd42c2c093a835" } modify_external_catalogs: true
I20260616 19:52:22.050513 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9b4c9fb1e2f641f28cbd42c2c093a835" } modify_external_catalogs: true
I20260616 19:52:22.051254 1190 tablet_replica.cc:333] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:22.051438 1190 raft_consensus.cc:2243] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260616 19:52:22.051350 445 catalog_manager.cc:4994] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet aabf57dd6d704645b6bf97b730dbe964 because the tablet was not found. No further retry: Not found: Tablet not found: aabf57dd6d704645b6bf97b730dbe964
W20260616 19:52:22.053282 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 124657us
I20260616 19:52:22.054068 1190 raft_consensus.cc:2272] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.054600 1190 ts_tablet_manager.cc:1916] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:22.055153 993 leader_election.cc:343] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.055218 1192 ts_tablet_manager.cc:1403] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.118s user 0.003s sys 0.000s
W20260616 19:52:22.055646 996 consensus_peers.cc:597] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90bc7409e31043bd9f47d3628278a2fa. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:22.055922 996 leader_election.cc:304] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.057024 1192 raft_consensus.cc:359] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.057163 1192 raft_consensus.cc:385] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.057214 1192 raft_consensus.cc:740] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.057458 1192 consensus_queue.cc:260] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.057531 1193 ts_tablet_manager.cc:1929] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:22.057633 1193 log.cc:1199] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/3f96ef25396a4092bc475f4aab269bc7
I20260616 19:52:22.058027 1192 ts_tablet_manager.cc:1434] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260616 19:52:22.064105 1193 ts_tablet_manager.cc:1950] T 3f96ef25396a4092bc475f4aab269bc7 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:52:22.064451 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet b2cd95a123854d18beabedb341db0563 (table default.Table_fb110e67ccc8443db8ea0bf1efc8f495 [id=d84ad2b4bd274b6fb7104cd4461998c1], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b2cd95a123854d18beabedb341db0563 consensus state has no leader
I20260616 19:52:22.064975 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1298) took 2617 ms. Trace:
I20260616 19:52:22.065065 1193 rpcz_store.cc:276] 0616 19:52:19.447945 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.447991 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:21.950166 (+2502175us) ts_tablet_manager.cc:1151] Deleting tablet 3f96ef25396a4092bc475f4aab269bc7
0616 19:52:21.950177 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:21.997839 (+ 47662us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.057478 (+ 59639us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.064952 (+ 7474us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2502012}
I20260616 19:52:22.065464 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 3f96ef25396a4092bc475f4aab269bc7 (table default.Table_8f2f5974ba694802a093f7c3adbacd48 [id=85bdc981552e4f50a725c53285275af3]) successfully deleted
I20260616 19:52:22.059793 1196 tablet_bootstrap.cc:654] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.072839 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1246) took 3398 ms. Trace:
I20260616 19:52:22.073750 454 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet da039dbc1089426dba1226940e37469e (table default.Table_88aaf292b9144d75a8bea47d896a63bf [id=f223ad08623343aeb681a65b744d2476]). Expected version 1 got 0
I20260616 19:52:22.073900 1192 tablet_bootstrap.cc:492] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:22.074090 3126 raft_consensus.cc:2804] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:22.074287 454 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet e85e2861c41f402d88cafe64a6871429 (table default.Table_66d56024dca749dfb6300ffa4cb0dec9 [id=02a85fe82ed24f6b949c0ded2d9a7d5e]). Expected version 1 got 0
W20260616 19:52:22.075194 996 leader_election.cc:343] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.075431 996 leader_election.cc:304] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.075551 1193 tablet_replica.cc:333] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:22.075681 3116 raft_consensus.cc:2749] T 79d686afeeed4729bd2069296aec82a1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:22.075801 1193 raft_consensus.cc:2243] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:22.075969 1193 raft_consensus.cc:2272] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260616 19:52:22.076143 996 leader_election.cc:343] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 1a95eafa064b4b95b5281915ea5bd9f7
W20260616 19:52:22.076442 996 leader_election.cc:343] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.076561 3126 raft_consensus.cc:697] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:22.076632 1191 rpcz_store.cc:276] 0616 19:52:18.657091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.657149 (+ 58us) service_pool.cc:224] Handling call
0616 19:52:22.039286 (+3382137us) ts_tablet_manager.cc:1151] Deleting tablet ba0d3e7da3c74f5ea5dc4aac80a01c82
0616 19:52:22.039293 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.055496 (+ 16203us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3381945}
I20260616 19:52:22.077013 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1249) took 3419 ms. Trace:
I20260616 19:52:22.077111 1191 rpcz_store.cc:276] 0616 19:52:18.657442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.657503 (+ 61us) service_pool.cc:224] Handling call
0616 19:52:22.076897 (+3419394us) ts_tablet_manager.cc:1151] Deleting tablet e6f309caaa9042f99432a61fd2ebb089
0616 19:52:22.076907 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.076979 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3419231}
I20260616 19:52:22.077394 1191 tablet_replica.cc:333] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:22.077596 1191 raft_consensus.cc:2243] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:22.077757 1191 raft_consensus.cc:2272] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.078073 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_48b28e7db53c426695b8938921f3a837" } new_table_name: "default.Table_b1b0d8e4d7b94dd58a1bb41bdfa9113a" modify_external_catalogs: true
I20260616 19:52:22.078299 1191 ts_tablet_manager.cc:1916] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.076886 3126 consensus_queue.cc:237] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.076582 996 leader_election.cc:304] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.080883 3116 raft_consensus.cc:2749] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:22.081290 996 leader_election.cc:343] T 1a95eafa064b4b95b5281915ea5bd9f7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 1a95eafa064b4b95b5281915ea5bd9f7
I20260616 19:52:22.082068 1193 ts_tablet_manager.cc:1916] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.085183 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 3519b095ba404049a6799b58160061ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.085595 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 375c577934d04e41b31ed6ef90ff4fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.085994 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet c1978faeb31f43a1b0ac40c60cdfab9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.086380 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 861a73a46dad41b6b5eb59503d9e2ace with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.086783 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet daf86e5d5f2341c78705f78c02695c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.087142 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet d686190fb6a34ab18cc4799197765f1b with delete_type TABLET_DATA_DELETED (replaced by tablet 3d44aed473e44e2eaa0d166f164c9309) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.088313 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 79d686afeeed4729bd2069296aec82a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 81618a3f43ad40fc8173e266cc106899) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.090020 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet d1e3778611a24397a1a776be2cc76284 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f9beca7b7d749bea74949dde5a1a6cb) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.091167 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9befb557d84f3bb7781664cbf2f28f" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:22.091567 3116 raft_consensus.cc:493] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.091696 3116 raft_consensus.cc:515] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.092443 3116 leader_election.cc:290] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.093716 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da039dbc1089426dba1226940e37469e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:22.093892 916 raft_consensus.cc:2468] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:22.096185 458 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet da039dbc1089426dba1226940e37469e (table default.Table_88aaf292b9144d75a8bea47d896a63bf [id=f223ad08623343aeb681a65b744d2476]). Expected version 1 got 0
I20260616 19:52:22.097186 993 leader_election.cc:304] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:22.100055 1190 ts_tablet_manager.cc:1929] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:22.101783 1198 tablet_bootstrap.cc:492] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:22.101974 1198 ts_tablet_manager.cc:1403] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.079s user 0.002s sys 0.007s
I20260616 19:52:22.102154 1190 log.cc:1199] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/647b1abeb3c14b11b9a5c62b67e83cf8
I20260616 19:52:22.102713 1190 ts_tablet_manager.cc:1950] T 647b1abeb3c14b11b9a5c62b67e83cf8 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:22.102802 1198 raft_consensus.cc:359] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.102986 1198 raft_consensus.cc:385] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.103089 1198 raft_consensus.cc:740] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.100845 916 raft_consensus.cc:3060] T 28cd1ad6e8744d33a2845e9f3dda4a7b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.103883 1198 consensus_queue.cc:260] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.104277 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1195) took 5442 ms. Trace:
I20260616 19:52:22.104312 3116 raft_consensus.cc:2804] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:22.104403 3116 raft_consensus.cc:493] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:22.104516 3116 raft_consensus.cc:3060] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.105115 1190 rpcz_store.cc:276] 0616 19:52:16.662073 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.662154 (+ 81us) service_pool.cc:224] Handling call
0616 19:52:22.051209 (+5389055us) ts_tablet_manager.cc:1151] Deleting tablet 647b1abeb3c14b11b9a5c62b67e83cf8
0616 19:52:22.051218 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.080497 (+ 29279us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.100001 (+ 19504us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.104260 (+ 4259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1,"tablet-delete.queue_time_us":5381133}
I20260616 19:52:22.105556 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 647b1abeb3c14b11b9a5c62b67e83cf8 (table default.Table_120e5c908fe348a7ab3ff54504e841ec [id=508154cdccf0482b890ef231e6fac070]) successfully deleted
I20260616 19:52:22.107010 3116 raft_consensus.cc:515] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.107630 3116 leader_election.cc:290] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:22.108939 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e8d16ee7d094d61884c72d8eac98e37 consensus state has no leader
I20260616 19:52:22.109436 1190 tablet_replica.cc:333] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:22.109624 1190 raft_consensus.cc:2243] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:22.109748 1190 raft_consensus.cc:2272] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.110231 1190 ts_tablet_manager.cc:1916] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.111053 1198 ts_tablet_manager.cc:1434] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260616 19:52:22.111363 1198 tablet_bootstrap.cc:492] T 0a406124a8d34e578ba94fab2a873a55 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:22.111398 459 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet e85e2861c41f402d88cafe64a6871429 (table default.Table_66d56024dca749dfb6300ffa4cb0dec9 [id=02a85fe82ed24f6b949c0ded2d9a7d5e]). Expected version 1 got 0
I20260616 19:52:22.112150 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_75c27ca6a3694b52bc0fcca1ab38b143" } modify_external_catalogs: true
I20260616 19:52:22.112326 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_75c27ca6a3694b52bc0fcca1ab38b143" } modify_external_catalogs: true
I20260616 19:52:22.113472 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da039dbc1089426dba1226940e37469e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:22.113621 916 raft_consensus.cc:3060] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.114774 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet bb9509607ee04d7bb3b412f539af21ce
I20260616 19:52:22.115383 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f2243cb23a37411591f0cd2ef5a5ed61" } modify_external_catalogs: true
I20260616 19:52:22.115517 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f2243cb23a37411591f0cd2ef5a5ed61" } modify_external_catalogs: true
I20260616 19:52:22.116050 1198 tablet_bootstrap.cc:654] T 0a406124a8d34e578ba94fab2a873a55 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.116516 916 raft_consensus.cc:2468] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:22.117091 993 leader_election.cc:304] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:22.117440 3126 raft_consensus.cc:2804] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:22.117514 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faa62f03c2a4588a776883dc54d0426" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:22.117667 3126 raft_consensus.cc:697] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:22.117713 1054 raft_consensus.cc:3060] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.117717 754 tablet_service.cc:1558] Processing DeleteTablet for tablet bb9509607ee04d7bb3b412f539af21ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:22.117923 3126 consensus_queue.cc:237] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.118518 886 tablet_service.cc:1558] Processing DeleteTablet for tablet bb9509607ee04d7bb3b412f539af21ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:22.120332 1054 raft_consensus.cc:2468] T 4faa62f03c2a4588a776883dc54d0426 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:22.130014 1193 ts_tablet_manager.cc:1929] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:22.130496 1193 log.cc:1199] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/db750fc9641f492494fdb167de86f6df
I20260616 19:52:22.131047 1193 ts_tablet_manager.cc:1950] T db750fc9641f492494fdb167de86f6df P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:22.132166 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1292) took 2684 ms. Trace:
I20260616 19:52:22.132304 1193 rpcz_store.cc:276] 0616 19:52:19.447425 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.448082 (+ 657us) service_pool.cc:224] Handling call
0616 19:52:22.074723 (+2626641us) ts_tablet_manager.cc:1151] Deleting tablet db750fc9641f492494fdb167de86f6df
0616 19:52:22.074734 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.091365 (+ 16631us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.129940 (+ 38575us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.132146 (+ 2206us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2626490}
I20260616 19:52:22.132805 1196 tablet_bootstrap.cc:492] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:22.133307 1193 tablet_replica.cc:333] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:22.133553 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet db750fc9641f492494fdb167de86f6df (table default.Table_1c49293ffd514b55954730a8880aab95 [id=4f3dc165f3d84700856eebc8f3243acf]) successfully deleted
I20260616 19:52:22.134923 1192 tablet_bootstrap.cc:654] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.135025 1196 ts_tablet_manager.cc:1403] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.110s user 0.007s sys 0.002s
I20260616 19:52:22.135363 1193 raft_consensus.cc:2243] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:22.138041 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9800df09eecb4a299a6facf8b85a93e4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:22.138252 1060 raft_consensus.cc:2468] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:22.140381 1193 raft_consensus.cc:2272] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.141103 1193 ts_tablet_manager.cc:1916] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.145807 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610d6197e35e447ea25cdba2cc454b8d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:22.146029 1052 raft_consensus.cc:2468] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:22.146260 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e3778611a24397a1a776be2cc76284" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:22.146453 1058 raft_consensus.cc:2468] T d1e3778611a24397a1a776be2cc76284 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:22.136212 1196 raft_consensus.cc:359] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.148536 1196 raft_consensus.cc:385] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.148615 1196 raft_consensus.cc:740] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.148626 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610d6197e35e447ea25cdba2cc454b8d" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:22.148788 1060 raft_consensus.cc:3060] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.148859 1196 consensus_queue.cc:260] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.149358 1196 ts_tablet_manager.cc:1434] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260616 19:52:22.149617 1196 tablet_bootstrap.cc:492] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:22.151590 2845 raft_consensus.cc:493] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.151696 2845 raft_consensus.cc:515] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.151752 1060 raft_consensus.cc:2468] T 610d6197e35e447ea25cdba2cc454b8d P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:22.152312 2845 leader_election.cc:290] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.152894 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1142b61e40e6499e8244d71f2ad39b1e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:22.153769 718 leader_election.cc:343] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.157721 916 raft_consensus.cc:3060] T 8c19c2e43a944893b86982bee1eb2f30 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.161571 1196 tablet_bootstrap.cc:654] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.163815 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_3f99dd18dc7f47eab04d25ddc25b8e4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:22.164705 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f99dd18dc7f47eab04d25ddc25b8e4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.166381 1190 ts_tablet_manager.cc:1929] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:22.166745 1190 log.cc:1199] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/802d30c340494490896c8da33d110708
I20260616 19:52:22.167225 1190 ts_tablet_manager.cc:1950] T 802d30c340494490896c8da33d110708 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:22.168286 1192 tablet_bootstrap.cc:492] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:22.168488 1192 ts_tablet_manager.cc:1403] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.095s user 0.004s sys 0.000s
I20260616 19:52:22.168558 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1196) took 5506 ms. Trace:
I20260616 19:52:22.169651 1191 ts_tablet_manager.cc:1929] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260616 19:52:22.169796 1191 log.cc:1199] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/61189a715da140a6833801681bbd5ef4
I20260616 19:52:22.170130 1191 ts_tablet_manager.cc:1950] T 61189a715da140a6833801681bbd5ef4 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:22.170904 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1247) took 3513 ms. Trace:
I20260616 19:52:22.169286 1192 raft_consensus.cc:359] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.171108 1192 raft_consensus.cc:385] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.171013 1191 rpcz_store.cc:276] 0616 19:52:18.657262 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.657626 (+ 364us) service_pool.cc:224] Handling call
0616 19:52:22.077331 (+3419705us) ts_tablet_manager.cc:1151] Deleting tablet 61189a715da140a6833801681bbd5ef4
0616 19:52:22.077342 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.166766 (+ 89424us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.169583 (+ 2817us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.170868 (+ 1285us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3419535}
I20260616 19:52:22.171284 1192 raft_consensus.cc:740] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.171331 1191 tablet_replica.cc:333] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:22.171536 1191 raft_consensus.cc:2243] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:22.171720 1191 raft_consensus.cc:2272] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.172102 1192 consensus_queue.cc:260] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.172254 1191 ts_tablet_manager.cc:1916] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.173499 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1305053f736840b0934912ca14c3eea9" } modify_external_catalogs: true
I20260616 19:52:22.174075 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_1305053f736840b0934912ca14c3eea9" } modify_external_catalogs: true
W20260616 19:52:22.177951 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 4819496da1bc4421b1641b8441546879 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4819496da1bc4421b1641b8441546879 already in progress: creating tablet
I20260616 19:52:22.178297 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3706f41b0e342a69f66c936173f2ae0" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:22.180532 1192 ts_tablet_manager.cc:1434] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260616 19:52:22.171430 1190 rpcz_store.cc:276] 0616 19:52:16.662447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.662521 (+ 74us) service_pool.cc:224] Handling call
0616 19:52:22.109389 (+5446868us) ts_tablet_manager.cc:1151] Deleting tablet 802d30c340494490896c8da33d110708
0616 19:52:22.109398 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.124304 (+ 14906us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.166324 (+ 42020us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.168541 (+ 2217us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5439204}
I20260616 19:52:22.180946 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 802d30c340494490896c8da33d110708 (table default.Table_368e4b7684c64cdcb5a8ac4665e649d2 [id=cb3eb4838e8a48108a44c7940a73765e]) successfully deleted
I20260616 19:52:22.181888 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26503d1293be438dae39fa1e1ea1885b" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:22.184209 1192 tablet_bootstrap.cc:492] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:22.185904 1192 tablet_bootstrap.cc:654] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.186985 1190 tablet_replica.cc:333] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:22.187610 1190 raft_consensus.cc:2243] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:22.187996 1190 raft_consensus.cc:2272] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.188390 1196 tablet_bootstrap.cc:492] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:22.188980 1190 ts_tablet_manager.cc:1916] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.189188 1196 ts_tablet_manager.cc:1403] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.002s
I20260616 19:52:22.190271 3153 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260616 19:52:22.191501 1196 raft_consensus.cc:359] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.195036 1196 raft_consensus.cc:385] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.196609 1196 raft_consensus.cc:740] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.197494 460 master_service.cc:960] ReplaceTablet: received request to replace tablet b57d6f12255e43ea9c35aedd388913e0 from {username='slave'} at 127.0.0.1:41696
W20260616 19:52:22.203536 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 892ec2013b9f4c9292bf745e2aeae4ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 892ec2013b9f4c9292bf745e2aeae4ed already in progress: creating tablet
W20260616 19:52:22.203771 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 8e8ee572626a42909f31874a55b5cbb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e8ee572626a42909f31874a55b5cbb6 already in progress: creating tablet
W20260616 19:52:22.203953 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 51983531f0f5423aa5f4bb3435cd5a7e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51983531f0f5423aa5f4bb3435cd5a7e already in progress: creating tablet
W20260616 19:52:22.204174 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 33a6a46041464e93811b0c573db19f43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33a6a46041464e93811b0c573db19f43 already in progress: creating tablet
W20260616 19:52:22.204375 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 574927dc3a804b059e71630c133dcbea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 574927dc3a804b059e71630c133dcbea already in progress: creating tablet
I20260616 19:52:22.196954 1196 consensus_queue.cc:260] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:22.204582 446 catalog_manager.cc:5007] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet 290d1bf172f949089e013d24ec64435d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 290d1bf172f949089e013d24ec64435d already in progress: creating tablet
I20260616 19:52:22.204950 1196 ts_tablet_manager.cc:1434] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260616 19:52:22.205349 1196 tablet_bootstrap.cc:492] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:22.206784 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet ba0d3e7da3c74f5ea5dc4aac80a01c82 because the tablet was not found. No further retry: Not found: Tablet not found: ba0d3e7da3c74f5ea5dc4aac80a01c82
W20260616 19:52:22.207085 446 catalog_manager.cc:4994] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): delete failed for tablet e6f309caaa9042f99432a61fd2ebb089 because the tablet was not found. No further retry: Not found: Tablet not found: e6f309caaa9042f99432a61fd2ebb089
I20260616 19:52:22.207525 1196 tablet_bootstrap.cc:654] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:22.207494 719 leader_election.cc:343] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.207553 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da039dbc1089426dba1226940e37469e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:22.207641 719 leader_election.cc:304] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.208199 2642 raft_consensus.cc:2749] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:22.208323 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da039dbc1089426dba1226940e37469e" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:22.208539 1193 ts_tablet_manager.cc:1929] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:22.208726 1193 log.cc:1199] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/2d05c86bca9343a2bc8c5709e1c49647
I20260616 19:52:22.209210 1193 ts_tablet_manager.cc:1950] T 2d05c86bca9343a2bc8c5709e1c49647 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
W20260616 19:52:22.209376 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f9f9b7d86984ee6b75f8cd4b87ca3b9 consensus state has no leader
I20260616 19:52:22.210026 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1299) took 2761 ms. Trace:
I20260616 19:52:22.210114 1193 rpcz_store.cc:276] 0616 19:52:19.448036 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.448179 (+ 143us) service_pool.cc:224] Handling call
0616 19:52:22.133259 (+2685080us) ts_tablet_manager.cc:1151] Deleting tablet 2d05c86bca9343a2bc8c5709e1c49647
0616 19:52:22.133269 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.164957 (+ 31688us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.208459 (+ 43502us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.209970 (+ 1511us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2684966}
I20260616 19:52:22.210505 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 2d05c86bca9343a2bc8c5709e1c49647 (table default.Table_4f13e0ca57ec46899092c426fb249611 [id=d93c65e8731244c4b0df941577a30010]) successfully deleted
I20260616 19:52:22.210872 1193 tablet_replica.cc:333] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:22.211099 1193 raft_consensus.cc:2243] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:22.211407 1193 raft_consensus.cc:2272] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.211408 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_5cc8bbc6835d4a33a0d3e91245da3096"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:22.211958 1193 ts_tablet_manager.cc:1916] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:22.212072 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cc8bbc6835d4a33a0d3e91245da3096 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.217461 1192 tablet_bootstrap.cc:492] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:22.217592 1192 ts_tablet_manager.cc:1403] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260616 19:52:22.218137 719 leader_election.cc:304] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.218245 1192 raft_consensus.cc:359] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.218384 1192 raft_consensus.cc:385] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.218423 1192 raft_consensus.cc:740] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.218619 1192 consensus_queue.cc:260] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:22.218758 719 consensus_peers.cc:597] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:22.218953 719 leader_election.cc:304] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.219177 1192 ts_tablet_manager.cc:1434] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260616 19:52:22.219151 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet bb9509607ee04d7bb3b412f539af21ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:21 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.219442 1192 tablet_bootstrap.cc:492] T 9800df09eecb4a299a6facf8b85a93e4 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:22.219496 2985 raft_consensus.cc:2804] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
W20260616 19:52:22.220220 996 consensus_peers.cc:597] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 272838af35d840faa7b11217456533c2. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:22.220377 996 leader_election.cc:343] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.220556 996 leader_election.cc:304] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.220860 3116 raft_consensus.cc:2749] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:22.221176 1192 tablet_bootstrap.cc:654] T 9800df09eecb4a299a6facf8b85a93e4 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.221491 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1142b61e40e6499e8244d71f2ad39b1e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:22.221783 1053 raft_consensus.cc:2468] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:22.224355 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 61189a715da140a6833801681bbd5ef4 (table default.Table_e6e1b5837078493bae82bdb7db0c81dd [id=45b3473eea3f4c6cba1561fee495371a]) successfully deleted
I20260616 19:52:22.224937 2774 fs_manager.cc:730] Time spent opening block manager: real 0.157s user 0.004s sys 0.002s
I20260616 19:52:22.225150 2774 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data,/tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
uuid: "c404c91cd2194cf6838fddd212f2f4ae"
format_stamp: "Formatted at 2026-06-16 19:51:47 on dist-test-slave-s7fg"
I20260616 19:52:22.226382 2774 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260616 19:52:22.232199 3145 raft_consensus.cc:493] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.233067 3145 raft_consensus.cc:515] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.233668 3145 leader_election.cc:290] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:22.232923 1190 ts_tablet_manager.cc:1929] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:22.234300 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5462af2002f9406b85ee20660e001a95" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:22.234403 1190 log.cc:1199] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/d4a2855b7dec4244a3fc52bdca7e7eb3
I20260616 19:52:22.234635 780 raft_consensus.cc:2393] T 5462af2002f9406b85ee20660e001a95 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae28da1c4102450ab76eb2946a5cbf2e in current term 1: Already voted for candidate 61c874fef3684d10a272a9c7f280e0e2 in this term.
I20260616 19:52:22.234741 1190 ts_tablet_manager.cc:1950] T d4a2855b7dec4244a3fc52bdca7e7eb3 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:22.235052 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1197) took 5572 ms. Trace:
I20260616 19:52:22.235165 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5462af2002f9406b85ee20660e001a95" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:22.235138 1190 rpcz_store.cc:276] 0616 19:52:16.662716 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.662810 (+ 94us) service_pool.cc:224] Handling call
0616 19:52:22.180719 (+5517909us) ts_tablet_manager.cc:1151] Deleting tablet d4a2855b7dec4244a3fc52bdca7e7eb3
0616 19:52:22.186945 (+ 6226us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.214699 (+ 27754us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.232873 (+ 18174us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.235037 (+ 2164us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5510492}
I20260616 19:52:22.235658 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet d4a2855b7dec4244a3fc52bdca7e7eb3 (table default.Table_2b005a492d164f608d275c8e23da534a [id=29105635fc2f455a8b53ed105028ac13]) successfully deleted
I20260616 19:52:22.235670 858 leader_election.cc:304] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:22.236052 3145 raft_consensus.cc:3060] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.237443 3165 raft_consensus.cc:2804] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:22.237600 3165 raft_consensus.cc:493] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:22.237664 719 leader_election.cc:304] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.237799 3165 raft_consensus.cc:3060] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.238464 3145 raft_consensus.cc:2749] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:22.240012 2985 raft_consensus.cc:697] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:22.240370 2985 consensus_queue.cc:237] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.241669 1198 tablet_bootstrap.cc:492] T 0a406124a8d34e578ba94fab2a873a55 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:22.241914 1198 ts_tablet_manager.cc:1403] T 0a406124a8d34e578ba94fab2a873a55 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.131s user 0.004s sys 0.000s
I20260616 19:52:22.242322 1196 tablet_bootstrap.cc:492] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:22.242494 1196 ts_tablet_manager.cc:1403] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.002s
I20260616 19:52:22.242846 1198 raft_consensus.cc:359] T 0a406124a8d34e578ba94fab2a873a55 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.243088 1198 raft_consensus.cc:385] T 0a406124a8d34e578ba94fab2a873a55 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.243227 1198 raft_consensus.cc:740] T 0a406124a8d34e578ba94fab2a873a55 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.243209 1196 raft_consensus.cc:359] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.243506 1196 raft_consensus.cc:385] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.243619 1196 raft_consensus.cc:740] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.243541 1198 consensus_queue.cc:260] T 0a406124a8d34e578ba94fab2a873a55 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.243919 1196 consensus_queue.cc:260] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.244423 1196 ts_tablet_manager.cc:1434] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:22.245157 1196 tablet_bootstrap.cc:492] T 3c90eb04585c4fa992435d11015ffec7 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:22.245152 1198 ts_tablet_manager.cc:1434] T 0a406124a8d34e578ba94fab2a873a55 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:22.246096 1198 tablet_bootstrap.cc:492] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:22.247177 1196 tablet_bootstrap.cc:654] T 3c90eb04585c4fa992435d11015ffec7 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.247932 1198 tablet_bootstrap.cc:654] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.249454 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1183) took 5589 ms. Trace:
I20260616 19:52:22.249567 1190 rpcz_store.cc:276] 0616 19:52:16.660047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.662271 (+ 2224us) service_pool.cc:224] Handling call
0616 19:52:22.235441 (+5573170us) ts_tablet_manager.cc:1151] Deleting tablet ad0b7615a5934617be3d8e18a220fa31
0616 19:52:22.235449 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.249434 (+ 13985us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5564943}
I20260616 19:52:22.253192 1190 tablet_replica.cc:333] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
W20260616 19:52:22.253378 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet ad0b7615a5934617be3d8e18a220fa31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad0b7615a5934617be3d8e18a220fa31 already in progress: creating tablet
I20260616 19:52:22.253419 1190 raft_consensus.cc:2243] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:22.253719 1190 raft_consensus.cc:2272] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.254154 3125 raft_consensus.cc:2804] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:22.254199 1190 ts_tablet_manager.cc:1916] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.254304 3125 raft_consensus.cc:493] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:22.254403 3125 raft_consensus.cc:3060] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.257129 1192 tablet_bootstrap.cc:492] T 9800df09eecb4a299a6facf8b85a93e4 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:22.257247 1192 ts_tablet_manager.cc:1403] T 9800df09eecb4a299a6facf8b85a93e4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.000s
I20260616 19:52:22.258828 1192 raft_consensus.cc:359] T 9800df09eecb4a299a6facf8b85a93e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.264572 1192 raft_consensus.cc:385] T 9800df09eecb4a299a6facf8b85a93e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.264775 1192 raft_consensus.cc:740] T 9800df09eecb4a299a6facf8b85a93e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.266125 1192 consensus_queue.cc:260] T 9800df09eecb4a299a6facf8b85a93e4 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:22.266439 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 46060us
I20260616 19:52:22.267256 1192 ts_tablet_manager.cc:1434] T 9800df09eecb4a299a6facf8b85a93e4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260616 19:52:22.268170 1192 tablet_bootstrap.cc:492] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:22.270498 1192 tablet_bootstrap.cc:654] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.271236 1193 ts_tablet_manager.cc:1929] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260616 19:52:22.273497 996 leader_election.cc:343] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.273643 996 leader_election.cc:304] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.274091 1193 log.cc:1199] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/08db2c1398b946c180d81b88504c1d9c
I20260616 19:52:22.274708 1193 ts_tablet_manager.cc:1950] T 08db2c1398b946c180d81b88504c1d9c P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:22.277308 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1294) took 2829 ms. Trace:
W20260616 19:52:22.281493 858 consensus_peers.cc:597] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:22.281733 3116 raft_consensus.cc:2749] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:22.281791 1190 ts_tablet_manager.cc:1929] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:22.281876 1190 log.cc:1199] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/4be902fe29bb46a4bf71ee6384e6722a
I20260616 19:52:22.282245 1190 ts_tablet_manager.cc:1950] T 4be902fe29bb46a4bf71ee6384e6722a P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:22.282739 1193 rpcz_store.cc:276] 0616 19:52:19.447631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.448260 (+ 629us) service_pool.cc:224] Handling call
0616 19:52:22.210782 (+2762522us) ts_tablet_manager.cc:1151] Deleting tablet 08db2c1398b946c180d81b88504c1d9c
0616 19:52:22.210791 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.225884 (+ 15093us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.271139 (+ 45255us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.277265 (+ 6126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2762381}
W20260616 19:52:22.283232 996 leader_election.cc:343] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.279013 780 raft_consensus.cc:3060] T fab8282287434bf8b7e37f008a1b0166 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.283792 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 08db2c1398b946c180d81b88504c1d9c (table default.Table_1b0deebdd1844949b9064d3e3ab11920 [id=70f7e3e96e524037a13e7c49678a3a8c]) successfully deleted
I20260616 19:52:22.278127 1196 tablet_bootstrap.cc:492] T 3c90eb04585c4fa992435d11015ffec7 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:22.284204 1196 ts_tablet_manager.cc:1403] T 3c90eb04585c4fa992435d11015ffec7 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260616 19:52:22.285104 1196 raft_consensus.cc:359] T 3c90eb04585c4fa992435d11015ffec7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:22.285692 1196 raft_consensus.cc:385] T 3c90eb04585c4fa992435d11015ffec7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.285568 1193 tablet_replica.cc:333] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:22.286958 1193 raft_consensus.cc:2243] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:22.287779 1193 raft_consensus.cc:2272] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.288444 3125 raft_consensus.cc:515] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:22.291478 996 leader_election.cc:343] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.287724 2679 consensus_queue.cc:1048] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:22.292982 1192 tablet_bootstrap.cc:492] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:22.294500 1192 ts_tablet_manager.cc:1403] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.003s
I20260616 19:52:22.296113 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_d5b58242e0e1482bb075c36a0a36d598" } new_table_name: "default.Table_d4388ea4e0b14fd0b13d0166ef731df6" modify_external_catalogs: true
I20260616 19:52:22.297338 2679 raft_consensus.cc:493] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:22.297456 2679 raft_consensus.cc:515] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.297946 2679 leader_election.cc:290] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:22.299099 860 leader_election.cc:343] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 0d8b9d6b95a74dbe97461b4bc9984fe3
W20260616 19:52:22.299553 858 leader_election.cc:343] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 0d8b9d6b95a74dbe97461b4bc9984fe3
I20260616 19:52:22.299644 858 leader_election.cc:304] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:22.300060 2679 raft_consensus.cc:2749] T 0d8b9d6b95a74dbe97461b4bc9984fe3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260616 19:52:22.303293 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 92e3849e91824e17b4b196f367da9127 consensus state has no leader
I20260616 19:52:22.305123 1192 raft_consensus.cc:359] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.286499 1196 raft_consensus.cc:740] T 3c90eb04585c4fa992435d11015ffec7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.306699 1196 consensus_queue.cc:260] T 3c90eb04585c4fa992435d11015ffec7 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:22.307296 1196 ts_tablet_manager.cc:1434] T 3c90eb04585c4fa992435d11015ffec7 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.023s user 0.000s sys 0.001s
I20260616 19:52:22.307647 1196 tablet_bootstrap.cc:492] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:22.308933 3165 raft_consensus.cc:515] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.309082 1192 raft_consensus.cc:385] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.309194 1192 raft_consensus.cc:740] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.309540 3165 leader_election.cc:290] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.309480 1192 consensus_queue.cc:260] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.308917 3176 tablet.cc:1724] T 1d62405248304339a03b01bc28238b8b P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:52:22.310118 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9800df09eecb4a299a6facf8b85a93e4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:22.310186 3125 leader_election.cc:290] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.310273 923 raft_consensus.cc:3060] T 9800df09eecb4a299a6facf8b85a93e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.310127 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e3778611a24397a1a776be2cc76284" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:22.312860 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_869029b8c3a444579bb7aac23503358b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:22.313357 718 leader_election.cc:343] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:22.313441 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_869029b8c3a444579bb7aac23503358b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.313864 923 raft_consensus.cc:2468] T 9800df09eecb4a299a6facf8b85a93e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:22.314211 1192 ts_tablet_manager.cc:1434] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.020s user 0.000s sys 0.001s
I20260616 19:52:22.314350 718 leader_election.cc:304] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:22.314791 1196 tablet_bootstrap.cc:654] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
W20260616 19:52:22.295172 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 57510.7us
I20260616 19:52:22.316648 719 leader_election.cc:304] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.316792 3175 tablet.cc:1724] T 1d62405248304339a03b01bc28238b8b P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:52:22.317687 3166 raft_consensus.cc:2804] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:22.316701 3125 raft_consensus.cc:2804] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:22.289256 1193 ts_tablet_manager.cc:1916] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.322436 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e3778611a24397a1a776be2cc76284" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:22.322669 1059 raft_consensus.cc:3060] T d1e3778611a24397a1a776be2cc76284 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.325268 2662 consensus_queue.cc:1048] T fab8282287434bf8b7e37f008a1b0166 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:22.325506 1059 raft_consensus.cc:2468] T d1e3778611a24397a1a776be2cc76284 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:22.317858 3166 raft_consensus.cc:493] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:22.327185 3166 raft_consensus.cc:3060] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.327608 3167 raft_consensus.cc:493] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.327811 3167 raft_consensus.cc:515] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.328691 3167 leader_election.cc:290] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.329537 3125 raft_consensus.cc:697] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:22.329861 3125 consensus_queue.cc:237] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.330842 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eb61046c954a36a036b24e9e16b5c4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:22.331342 718 leader_election.cc:343] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.336898 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3ea40ffcc904453a9d49c71e251e88ab" } new_table_name: "default.Table_11ac4ca1ae1f44618ba944b9a3aadc4b" modify_external_catalogs: true
I20260616 19:52:22.339546 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9800df09eecb4a299a6facf8b85a93e4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:22.339828 1053 raft_consensus.cc:3060] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.340201 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1181) took 5680 ms. Trace:
I20260616 19:52:22.340312 1190 rpcz_store.cc:276] 0616 19:52:16.659832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.681544 (+ 21712us) service_pool.cc:224] Handling call
0616 19:52:22.253147 (+5571603us) ts_tablet_manager.cc:1151] Deleting tablet 4be902fe29bb46a4bf71ee6384e6722a
0616 19:52:22.253157 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.272638 (+ 19481us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.281746 (+ 9108us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.340183 (+ 58437us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5571034}
I20260616 19:52:22.340716 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1203) took 5477 ms. Trace:
I20260616 19:52:22.340785 1190 rpcz_store.cc:276] 0616 19:52:16.862854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:16.863186 (+ 332us) service_pool.cc:224] Handling call
0616 19:52:22.340608 (+5477422us) ts_tablet_manager.cc:1151] Deleting tablet a59409d014404ee6b446c5b405c04bc1
0616 19:52:22.340616 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.340700 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5477230}
I20260616 19:52:22.341044 1190 tablet_replica.cc:333] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:22.341229 1190 raft_consensus.cc:2243] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:22.341534 1190 raft_consensus.cc:2272] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.342056 1193 ts_tablet_manager.cc:1929] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:22.342069 1190 ts_tablet_manager.cc:1916] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.342176 1193 log.cc:1199] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/cc22cdaecf2c46b5b69e5dc4f8eb04fd
I20260616 19:52:22.342576 1193 ts_tablet_manager.cc:1950] T cc22cdaecf2c46b5b69e5dc4f8eb04fd P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:22.342571 1053 raft_consensus.cc:2468] T 9800df09eecb4a299a6facf8b85a93e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:22.345005 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 4be902fe29bb46a4bf71ee6384e6722a (table default.Table_6084b95509cf42a180b1753a884ecf4e [id=1da8c69819444e57b8c96d27abb2b4bc]) successfully deleted
W20260616 19:52:22.345261 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a59409d014404ee6b446c5b405c04bc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a59409d014404ee6b446c5b405c04bc1 already in progress: creating tablet
I20260616 19:52:22.346122 1192 tablet_bootstrap.cc:492] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
W20260616 19:52:22.348512 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 538c5095791d4266b885cb8cee445fa6 consensus state has no leader
I20260616 19:52:22.349249 1192 tablet_bootstrap.cc:654] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.349361 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4d5f1ebe3db245b0a974c41a5c38d0c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:22.349898 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d5f1ebe3db245b0a974c41a5c38d0c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.341249 3166 raft_consensus.cc:515] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.354358 1190 ts_tablet_manager.cc:1929] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:22.354508 1190 log.cc:1199] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/bcc5116ef5df4140a96f03c003337c68
I20260616 19:52:22.354847 1198 tablet_bootstrap.cc:492] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:22.355010 1190 ts_tablet_manager.cc:1950] T bcc5116ef5df4140a96f03c003337c68 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:22.355065 1198 ts_tablet_manager.cc:1403] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.109s user 0.001s sys 0.003s
I20260616 19:52:22.355412 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1208) took 5283 ms. Trace:
I20260616 19:52:22.355522 1190 rpcz_store.cc:276] 0616 19:52:17.072307 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.072352 (+ 45us) service_pool.cc:224] Handling call
0616 19:52:22.341006 (+5268654us) ts_tablet_manager.cc:1151] Deleting tablet bcc5116ef5df4140a96f03c003337c68
0616 19:52:22.341014 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.351567 (+ 10553us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.354314 (+ 2747us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.355397 (+ 1083us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5268471}
I20260616 19:52:22.355844 1198 raft_consensus.cc:359] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:22.356096 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet bcc5116ef5df4140a96f03c003337c68 (table default.Table_60ba0f6f88634456a3d4afc9f759c4a7 [id=9c7b653f62ef4b74946cc87069f8df6e]) successfully deleted
I20260616 19:52:22.356393 1190 tablet_replica.cc:333] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:22.356886 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1142b61e40e6499e8244d71f2ad39b1e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:22.356981 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1295) took 2909 ms. Trace:
I20260616 19:52:22.357082 1193 rpcz_store.cc:276] 0616 19:52:19.447711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.448422 (+ 711us) service_pool.cc:224] Handling call
0616 19:52:22.285492 (+2837070us) ts_tablet_manager.cc:1151] Deleting tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd
0616 19:52:22.285502 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.324366 (+ 38864us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.341982 (+ 17616us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.356908 (+ 14926us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2836936}
W20260616 19:52:22.357388 718 leader_election.cc:343] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.357569 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet cc22cdaecf2c46b5b69e5dc4f8eb04fd (table default.Table_c99b06b04b8743d5ab70f7e50b641736 [id=e7d3c7f7cee242c6b5f66df9ec3d2dff]) successfully deleted
I20260616 19:52:22.357647 1190 raft_consensus.cc:2243] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:22.357808 1190 raft_consensus.cc:2272] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.357877 3166 leader_election.cc:290] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.358381 1190 ts_tablet_manager.cc:1916] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.359038 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1297) took 2911 ms. Trace:
I20260616 19:52:22.359176 1193 rpcz_store.cc:276] 0616 19:52:19.447881 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.448066 (+ 185us) service_pool.cc:224] Handling call
0616 19:52:22.358911 (+2910845us) ts_tablet_manager.cc:1151] Deleting tablet 40bdb01a15254c329d82f0d40919b880
0616 19:52:22.358920 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.358980 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2910284}
W20260616 19:52:22.359618 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 40bdb01a15254c329d82f0d40919b880 because the tablet was not found. No further retry: Not found: Tablet not found: 40bdb01a15254c329d82f0d40919b880
I20260616 19:52:22.359994 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1300) took 2886 ms. Trace:
I20260616 19:52:22.360906 1193 rpcz_store.cc:276] 0616 19:52:19.473259 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.473315 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:22.359857 (+2886542us) ts_tablet_manager.cc:1151] Deleting tablet 17d5740c8bc14441a4f5d7c509791679
0616 19:52:22.359866 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.359937 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2886363}
W20260616 19:52:22.361338 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 17d5740c8bc14441a4f5d7c509791679 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17d5740c8bc14441a4f5d7c509791679 already in progress: creating tablet
I20260616 19:52:22.361716 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1301) took 2666 ms. Trace:
I20260616 19:52:22.362567 1193 rpcz_store.cc:276] 0616 19:52:19.695335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.695399 (+ 64us) service_pool.cc:224] Handling call
0616 19:52:22.361582 (+2666183us) ts_tablet_manager.cc:1151] Deleting tablet f851c41915c44cdea7cd46da2ad886ea
0616 19:52:22.361591 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.361658 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2665990}
I20260616 19:52:22.364880 1190 ts_tablet_manager.cc:1929] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:22.362884 1196 tablet_bootstrap.cc:492] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:22.366519 1196 ts_tablet_manager.cc:1403] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.059s user 0.010s sys 0.002s
I20260616 19:52:22.366959 916 raft_consensus.cc:3060] T 4fc0c02ef58d4e429855e5bbaa4752ad P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.367445 1196 raft_consensus.cc:359] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.367635 1196 raft_consensus.cc:385] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.367702 1196 raft_consensus.cc:740] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.367964 1196 consensus_queue.cc:260] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.368496 1196 ts_tablet_manager.cc:1434] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:22.369669 1196 tablet_bootstrap.cc:492] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:22.371510 1196 tablet_bootstrap.cc:654] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.365684 1192 tablet_bootstrap.cc:492] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:22.373262 1192 ts_tablet_manager.cc:1403] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.004s
I20260616 19:52:22.374114 1192 raft_consensus.cc:359] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.374755 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_922b2f64bba34026a097e8cfed2b655d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:22.375149 1192 raft_consensus.cc:385] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.375300 1192 raft_consensus.cc:740] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
W20260616 19:52:22.375286 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_922b2f64bba34026a097e8cfed2b655d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.375702 1192 consensus_queue.cc:260] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.356459 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eb61046c954a36a036b24e9e16b5c4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:22.376734 1054 raft_consensus.cc:2468] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
W20260616 19:52:22.356734 996 consensus_peers.cc:597] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d05c86bca9343a2bc8c5709e1c49647. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:22.377408 719 leader_election.cc:304] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.377923 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1142b61e40e6499e8244d71f2ad39b1e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:22.378173 1054 raft_consensus.cc:3060] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.378281 719 leader_election.cc:304] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.378656 3168 raft_consensus.cc:493] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.378795 3168 raft_consensus.cc:515] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.379877 3168 leader_election.cc:290] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.379897 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26503d1293be438dae39fa1e1ea1885b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:22.380031 3168 raft_consensus.cc:2804] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:22.380055 923 raft_consensus.cc:2468] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:22.380200 3168 raft_consensus.cc:697] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:22.380432 3168 consensus_queue.cc:237] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.380852 718 leader_election.cc:304] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:22.381526 1054 raft_consensus.cc:2468] T 1142b61e40e6499e8244d71f2ad39b1e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:22.381997 3167 raft_consensus.cc:2804] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:22.382220 3167 raft_consensus.cc:493] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:22.382392 3167 raft_consensus.cc:3060] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.382937 2845 raft_consensus.cc:2804] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:22.383039 2845 raft_consensus.cc:493] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:22.383137 2845 raft_consensus.cc:3060] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.383502 1198 raft_consensus.cc:385] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.383582 1198 raft_consensus.cc:740] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.383803 1198 consensus_queue.cc:260] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:22.384254 1198 ts_tablet_manager.cc:1434] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.029s user 0.000s sys 0.002s
I20260616 19:52:22.384727 1190 log.cc:1199] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/fbe784716b3c4293bd4eddf57f6c9048
I20260616 19:52:22.385017 3167 raft_consensus.cc:515] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.385124 1190 ts_tablet_manager.cc:1950] T fbe784716b3c4293bd4eddf57f6c9048 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:22.385550 3167 leader_election.cc:290] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.385947 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eb61046c954a36a036b24e9e16b5c4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:22.385948 2845 raft_consensus.cc:515] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:22.386438 718 leader_election.cc:343] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.387034 719 leader_election.cc:304] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.387514 3166 raft_consensus.cc:2804] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:22.387660 3166 raft_consensus.cc:697] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:22.387897 3166 consensus_queue.cc:237] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.388062 2845 leader_election.cc:290] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.388170 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26503d1293be438dae39fa1e1ea1885b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:22.388434 1059 raft_consensus.cc:2468] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:22.388787 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eb61046c954a36a036b24e9e16b5c4" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:22.388932 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26503d1293be438dae39fa1e1ea1885b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:22.389065 923 raft_consensus.cc:3060] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.389070 1054 raft_consensus.cc:3060] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.391307 923 raft_consensus.cc:2468] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:22.391489 1054 raft_consensus.cc:2468] T 54eb61046c954a36a036b24e9e16b5c4 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:22.391762 718 leader_election.cc:304] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:22.392108 3165 raft_consensus.cc:2804] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:22.392266 3165 raft_consensus.cc:697] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:22.391846 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26503d1293be438dae39fa1e1ea1885b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:22.394212 1053 raft_consensus.cc:3060] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.396240 3165 consensus_queue.cc:237] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.396706 1053 raft_consensus.cc:2468] T 26503d1293be438dae39fa1e1ea1885b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:22.397123 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet f851c41915c44cdea7cd46da2ad886ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f851c41915c44cdea7cd46da2ad886ea already in progress: creating tablet
I20260616 19:52:22.397647 719 leader_election.cc:304] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.398871 3177 raft_consensus.cc:2804] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:22.399143 3177 raft_consensus.cc:697] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:22.399492 3177 consensus_queue.cc:237] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.396768 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7d0ee1a50ca4433fba8c946527f0f596"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:22.401551 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d0ee1a50ca4433fba8c946527f0f596 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.398082 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1302) took 2702 ms. Trace:
I20260616 19:52:22.401741 1193 rpcz_store.cc:276] 0616 19:52:19.695830 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.695876 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:22.397934 (+2702058us) ts_tablet_manager.cc:1151] Deleting tablet 1d98a5dc581f4594a832f6390837cd57
0616 19:52:22.397943 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.398030 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2701916}
I20260616 19:52:22.402503 1193 tablet_replica.cc:333] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:22.402753 1193 raft_consensus.cc:2243] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:22.403015 1193 raft_consensus.cc:2272] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.403611 1193 ts_tablet_manager.cc:1916] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.395915 1196 tablet_bootstrap.cc:492] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:22.404659 1196 ts_tablet_manager.cc:1403] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.003s
I20260616 19:52:22.405993 1198 tablet_bootstrap.cc:492] T 83a199f25e5c4accba0acd1007fc73d1 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:22.407264 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1209) took 5334 ms. Trace:
I20260616 19:52:22.407413 1190 rpcz_store.cc:276] 0616 19:52:17.072788 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.072833 (+ 45us) service_pool.cc:224] Handling call
0616 19:52:22.356349 (+5283516us) ts_tablet_manager.cc:1151] Deleting tablet fbe784716b3c4293bd4eddf57f6c9048
0616 19:52:22.356358 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.361290 (+ 4932us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.364839 (+ 3549us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.406854 (+ 42015us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5283371}
I20260616 19:52:22.407896 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1211) took 5273 ms. Trace:
I20260616 19:52:22.408244 1198 tablet_bootstrap.cc:654] T 83a199f25e5c4accba0acd1007fc73d1 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.408130 1190 rpcz_store.cc:276] 0616 19:52:17.134289 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.134345 (+ 56us) service_pool.cc:224] Handling call
0616 19:52:22.407782 (+5273437us) ts_tablet_manager.cc:1151] Deleting tablet 7d486a9c69954dc4a9b664d89d2bf28a
0616 19:52:22.407791 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.407881 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5273177}
I20260616 19:52:22.410336 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1210) took 5278 ms. Trace:
I20260616 19:52:22.410467 1190 rpcz_store.cc:276] 0616 19:52:17.131583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.133651 (+ 2068us) service_pool.cc:224] Handling call
0616 19:52:22.410082 (+5276431us) ts_tablet_manager.cc:1151] Deleting tablet a555ad9f529943558a5ef6ea5c99851d
0616 19:52:22.410091 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.410320 (+ 229us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5275412}
I20260616 19:52:22.411451 1190 tablet_replica.cc:333] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:22.411665 1190 raft_consensus.cc:2243] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:22.411840 1190 raft_consensus.cc:2272] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.412356 1190 ts_tablet_manager.cc:1916] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.414034 1191 ts_tablet_manager.cc:1929] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:22.414177 1191 log.cc:1199] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/a8708321fb0f4c409a66df75da4c6c0e
I20260616 19:52:22.414584 1191 ts_tablet_manager.cc:1950] T a8708321fb0f4c409a66df75da4c6c0e P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:22.418501 1190 ts_tablet_manager.cc:1929] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:22.418502 3188 tablet.cc:1724] T 1d62405248304339a03b01bc28238b8b P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260616 19:52:22.419106 1196 raft_consensus.cc:359] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.419303 1196 raft_consensus.cc:385] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.419394 1196 raft_consensus.cc:740] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.419656 1196 consensus_queue.cc:260] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:22.402248 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1d98a5dc581f4594a832f6390837cd57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d98a5dc581f4594a832f6390837cd57 already in progress: creating tablet
I20260616 19:52:22.407967 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet fbe784716b3c4293bd4eddf57f6c9048 (table default.Table_dc19f0ab5b6c47ea854f9d8bfdf6f905 [id=16e9ecefa14243e9988253004dcd756b]) successfully deleted
W20260616 19:52:22.421080 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 7d486a9c69954dc4a9b664d89d2bf28a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d486a9c69954dc4a9b664d89d2bf28a already in progress: creating tablet
W20260616 19:52:22.421264 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet a555ad9f529943558a5ef6ea5c99851d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a555ad9f529943558a5ef6ea5c99851d already in progress: creating tablet
I20260616 19:52:22.443127 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 733f4f262ed64a01a5f5f4c68ba37872 from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:22.444329 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_99d70ef34e6b4c759db2d8a8d70772c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:22.445197 1196 ts_tablet_manager.cc:1434] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.040s user 0.000s sys 0.002s
I20260616 19:52:22.452545 1196 tablet_bootstrap.cc:492] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:22.452950 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1250) took 3795 ms. Trace:
I20260616 19:52:22.453063 1191 rpcz_store.cc:276] 0616 19:52:18.657554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.657839 (+ 285us) service_pool.cc:224] Handling call
0616 19:52:22.171267 (+3513428us) ts_tablet_manager.cc:1151] Deleting tablet a8708321fb0f4c409a66df75da4c6c0e
0616 19:52:22.171277 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.315056 (+143779us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.413965 (+ 98909us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.452891 (+ 38926us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3513302}
I20260616 19:52:22.453568 1191 tablet_replica.cc:333] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:22.453765 1191 raft_consensus.cc:2243] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:22.454114 1191 raft_consensus.cc:2272] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.455094 1191 ts_tablet_manager.cc:1916] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.457119 1198 tablet_bootstrap.cc:492] T 83a199f25e5c4accba0acd1007fc73d1 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:22.457365 1198 ts_tablet_manager.cc:1403] T 83a199f25e5c4accba0acd1007fc73d1 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.073s user 0.004s sys 0.000s
I20260616 19:52:22.458109 1198 raft_consensus.cc:359] T 83a199f25e5c4accba0acd1007fc73d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.458335 1198 raft_consensus.cc:385] T 83a199f25e5c4accba0acd1007fc73d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.458454 1198 raft_consensus.cc:740] T 83a199f25e5c4accba0acd1007fc73d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.459151 1198 consensus_queue.cc:260] T 83a199f25e5c4accba0acd1007fc73d1 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.460253 1198 ts_tablet_manager.cc:1434] T 83a199f25e5c4accba0acd1007fc73d1 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260616 19:52:22.460597 1198 tablet_bootstrap.cc:492] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:22.462687 1198 tablet_bootstrap.cc:654] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.453433 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet a8708321fb0f4c409a66df75da4c6c0e (table default.Table_c63ea4e62e3e433b86b05b9a80a2fd49 [id=c29388becc784f90b536d84c8548774e]) successfully deleted
W20260616 19:52:22.488095 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99d70ef34e6b4c759db2d8a8d70772c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.493796 1196 tablet_bootstrap.cc:654] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.498095 1191 ts_tablet_manager.cc:1929] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:22.498245 1191 log.cc:1199] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/2d05c86bca9343a2bc8c5709e1c49647
I20260616 19:52:22.498674 1191 ts_tablet_manager.cc:1950] T 2d05c86bca9343a2bc8c5709e1c49647 P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:22.499431 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1248) took 3842 ms. Trace:
I20260616 19:52:22.499550 1191 rpcz_store.cc:276] 0616 19:52:18.657355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.657987 (+ 632us) service_pool.cc:224] Handling call
0616 19:52:22.453479 (+3795492us) ts_tablet_manager.cc:1151] Deleting tablet 2d05c86bca9343a2bc8c5709e1c49647
0616 19:52:22.453489 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.488553 (+ 35064us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.497994 (+ 9441us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.499398 (+ 1404us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3795363}
I20260616 19:52:22.499864 1191 tablet_replica.cc:333] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:22.500088 1191 raft_consensus.cc:2243] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:22.500133 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 2d05c86bca9343a2bc8c5709e1c49647 (table default.Table_4f13e0ca57ec46899092c426fb249611 [id=d93c65e8731244c4b0df941577a30010]) successfully deleted
I20260616 19:52:22.419909 1192 ts_tablet_manager.cc:1434] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.046s user 0.016s sys 0.001s
I20260616 19:52:22.454928 2662 consensus_queue.cc:1048] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:22.501523 1190 log.cc:1199] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/af5e277102b8480db44e5ffe88267808
I20260616 19:52:22.501929 1190 ts_tablet_manager.cc:1950] T af5e277102b8480db44e5ffe88267808 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:22.504829 3177 consensus_queue.cc:1048] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:22.506479 1192 tablet_bootstrap.cc:492] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:22.508687 1192 tablet_bootstrap.cc:654] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.511056 2662 consensus_queue.cc:1048] T 7a2e5bc2c47746e88e95634fb073273e P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:22.512689 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1221) took 5061 ms. Trace:
I20260616 19:52:22.515844 1190 rpcz_store.cc:276] 0616 19:52:17.451289 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.451347 (+ 58us) service_pool.cc:224] Handling call
0616 19:52:22.411411 (+4960064us) ts_tablet_manager.cc:1151] Deleting tablet af5e277102b8480db44e5ffe88267808
0616 19:52:22.411419 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.415698 (+ 4279us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.418449 (+ 2751us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.512664 (+ 94215us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4959880}
W20260616 19:52:22.518736 996 consensus_peers.cc:597] T db750fc9641f492494fdb167de86f6df P 61c874fef3684d10a272a9c7f280e0e2 -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db750fc9641f492494fdb167de86f6df. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:22.520906 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet af5e277102b8480db44e5ffe88267808 (table default.Table_d19f51d7b61e47dea882c1fd07d9a122 [id=00510df65be542a98fec0f25a07d1542]) successfully deleted
I20260616 19:52:22.521420 1190 tablet_replica.cc:333] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:22.521790 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6dbb237ba04f42998b1557760ce6f8c3" } new_table_name: "default.Table_5dd300a732b54570b17bd1872a13fd13" modify_external_catalogs: true
I20260616 19:52:22.522423 1190 raft_consensus.cc:2243] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:22.524159 1190 raft_consensus.cc:2272] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:22.526957 1190 ts_tablet_manager.cc:1916] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:22.533095 3166 consensus_queue.cc:1048] T e3c4e584fad94633ae49332872de0fc3 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:22.539345 1193 ts_tablet_manager.cc:1929] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:22.542635 1192 tablet_bootstrap.cc:492] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:22.542853 1192 ts_tablet_manager.cc:1403] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.009s
W20260616 19:52:22.544724 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a889853940f2445aa808904c14a883e8 consensus state has no leader
I20260616 19:52:22.545250 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_b8e53692fe644e23bb67d13957bd8313" } new_table_name: "default.Table_c56541bb35f74ff399442a37b91266f3" modify_external_catalogs: true
I20260616 19:52:22.548493 1192 raft_consensus.cc:359] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.548663 1192 raft_consensus.cc:385] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.548715 1192 raft_consensus.cc:740] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.548940 1192 consensus_queue.cc:260] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.550105 1192 ts_tablet_manager.cc:1434] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260616 19:52:22.550460 1192 tablet_bootstrap.cc:492] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:22.556365 3064 raft_consensus.cc:493] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.556501 3064 raft_consensus.cc:515] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.557142 3064 leader_election.cc:290] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:22.561197 3126 raft_consensus.cc:493] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.561340 3126 raft_consensus.cc:515] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:22.561946 3126 leader_election.cc:290] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.562826 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a406124a8d34e578ba94fab2a873a55" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:22.563025 1054 raft_consensus.cc:2468] T 0a406124a8d34e578ba94fab2a873a55 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:22.564460 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2159d026adeb4590a238dacdfcb28e11" } modify_external_catalogs: true
I20260616 19:52:22.564630 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_2159d026adeb4590a238dacdfcb28e11" } modify_external_catalogs: true
I20260616 19:52:22.566354 858 leader_election.cc:304] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:22.566893 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c90eb04585c4fa992435d11015ffec7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:22.567355 3064 raft_consensus.cc:2804] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:22.567437 3064 raft_consensus.cc:493] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260616 19:52:22.567441 993 leader_election.cc:343] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.567502 3064 raft_consensus.cc:3060] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.570943 3064 raft_consensus.cc:515] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:22.572392 860 consensus_peers.cc:597] T 0b362fa598a54632880faa42a9224ffd P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0b362fa598a54632880faa42a9224ffd. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:22.574807 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a406124a8d34e578ba94fab2a873a55" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:22.575008 1054 raft_consensus.cc:3060] T 0a406124a8d34e578ba94fab2a873a55 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.576278 458 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 26503d1293be438dae39fa1e1ea1885b (table default.Table_ccb660ffb17a4a01840efa8c374603d8 [id=467b42cd85544c589d2cf3f9eaf21754]). Expected version 2 got 0
I20260616 19:52:22.576490 458 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet da039dbc1089426dba1226940e37469e (table default.Table_88aaf292b9144d75a8bea47d896a63bf [id=f223ad08623343aeb681a65b744d2476]). Expected version 1 got 0
I20260616 19:52:22.576645 458 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet e85e2861c41f402d88cafe64a6871429 (table default.Table_66d56024dca749dfb6300ffa4cb0dec9 [id=02a85fe82ed24f6b949c0ded2d9a7d5e]). Expected version 1 got 0
I20260616 19:52:22.577764 1054 raft_consensus.cc:2468] T 0a406124a8d34e578ba94fab2a873a55 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:22.578183 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_005105e1e70940179d673f31a9bd3ba9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:22.578677 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_005105e1e70940179d673f31a9bd3ba9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.579984 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 26503d1293be438dae39fa1e1ea1885b (table default.Table_ccb660ffb17a4a01840efa8c374603d8 [id=467b42cd85544c589d2cf3f9eaf21754]). Expected version 2 got 0
I20260616 19:52:22.580969 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7c13eda9355d4c7b9afab94974ec41d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:22.581367 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c13eda9355d4c7b9afab94974ec41d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.583181 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet c3706f41b0e342a69f66c936173f2ae0 with delete_type TABLET_DATA_DELETED (replaced by tablet d69db202af9e4d4f86a9d8d40e9fe3af) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.583518 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c90eb04585c4fa992435d11015ffec7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.583930 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 4afa8264128f429984d73140c974d21a (DEFAULT_TABLE table=default.Table_a9f778dbd18d49379fbd6ffa4d08db6d [id=7569aa05ce4841b589943be95f5a4ca4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.584271 452 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet e85e2861c41f402d88cafe64a6871429 (table default.Table_66d56024dca749dfb6300ffa4cb0dec9 [id=02a85fe82ed24f6b949c0ded2d9a7d5e]). Expected version 1 got 0
I20260616 19:52:22.584326 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afa8264128f429984d73140c974d21a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.586185 2774 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260616 19:52:22.586251 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_511a88d0bc7d41a1abb0d969e99d67f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:22.586651 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_511a88d0bc7d41a1abb0d969e99d67f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.587154 2774 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260616 19:52:22.587443 2774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260616 19:52:22.589244 1027 tablet_service.cc:1511] Processing CreateTablet for tablet c422fdeef8e14eb69a49f26293a4ff11 (DEFAULT_TABLE table=default.Table_4e014c2192ad4cb18fd99c3780311339 [id=c50ffea84a9d4663aa8f58829d9b2700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.589311 3145 consensus_queue.cc:1048] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:22.589567 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c422fdeef8e14eb69a49f26293a4ff11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.593955 1037 tablet_service.cc:1511] Processing CreateTablet for tablet c49f2d78ba074e2da0c529cb257f728e (DEFAULT_TABLE table=default.Table_94c9b55eea4049cc915a46464481047e [id=f78482bb51b442b582d69c7a78c256d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.594276 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49f2d78ba074e2da0c529cb257f728e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.594241 898 tablet_service.cc:1511] Processing CreateTablet for tablet c422fdeef8e14eb69a49f26293a4ff11 (DEFAULT_TABLE table=default.Table_4e014c2192ad4cb18fd99c3780311339 [id=c50ffea84a9d4663aa8f58829d9b2700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.594568 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c422fdeef8e14eb69a49f26293a4ff11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.594748 886 tablet_service.cc:1511] Processing CreateTablet for tablet 4afa8264128f429984d73140c974d21a (DEFAULT_TABLE table=default.Table_a9f778dbd18d49379fbd6ffa4d08db6d [id=7569aa05ce4841b589943be95f5a4ca4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.595038 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afa8264128f429984d73140c974d21a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.596678 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 9e84e5f3a0984b87ad1a4fe9bab2e427 (DEFAULT_TABLE table=default.Table_2159d026adeb4590a238dacdfcb28e11 [id=456c565d92844371bbe00ad07450068f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.596961 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e84e5f3a0984b87ad1a4fe9bab2e427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.598881 896 tablet_service.cc:1511] Processing CreateTablet for tablet 9e84e5f3a0984b87ad1a4fe9bab2e427 (DEFAULT_TABLE table=default.Table_2159d026adeb4590a238dacdfcb28e11 [id=456c565d92844371bbe00ad07450068f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.599200 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e84e5f3a0984b87ad1a4fe9bab2e427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.604725 893 tablet_service.cc:1511] Processing CreateTablet for tablet c49f2d78ba074e2da0c529cb257f728e (DEFAULT_TABLE table=default.Table_94c9b55eea4049cc915a46464481047e [id=f78482bb51b442b582d69c7a78c256d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.604971 3064 leader_election.cc:290] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:22.605022 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49f2d78ba074e2da0c529cb257f728e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.605052 2962 raft_consensus.cc:493] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.605177 2962 raft_consensus.cc:515] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:22.605901 2962 leader_election.cc:290] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.606631 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c940bd14a040ddba5ea058e732bf0c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:22.607189 993 leader_election.cc:343] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.615213 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 1403dd096f3e47e69186c8fa618345a3
I20260616 19:52:22.621683 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 5671428d9c394a17a4fe4207684d4719 (DEFAULT_TABLE table=default.Table_22f2a0166bdd4fdcbe77171612792138 [id=f64fcac0bd7e49e793698454dec47680]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.622063 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5671428d9c394a17a4fe4207684d4719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.624083 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 86ceac112ffb44a5b6007a4a1280d8cb (DEFAULT_TABLE table=default.Table_9579db20b0e241ecb10d538e86859ffc [id=305a99db92ea464195144e9b5db7c633]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.624419 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ceac112ffb44a5b6007a4a1280d8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.627154 901 tablet_service.cc:1511] Processing CreateTablet for tablet 86ceac112ffb44a5b6007a4a1280d8cb (DEFAULT_TABLE table=default.Table_9579db20b0e241ecb10d538e86859ffc [id=305a99db92ea464195144e9b5db7c633]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.627526 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ceac112ffb44a5b6007a4a1280d8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.629317 3064 consensus_queue.cc:1048] T 23f280b9ea1147799635f8a6199f17c0 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:22.631495 892 tablet_service.cc:1511] Processing CreateTablet for tablet afa6f9c0e1214849b0d68650de126955 (DEFAULT_TABLE table=default.Table_809de6876da84671a331e9af0e5ba887 [id=6ad7d636895f4cf9a4f9f5a5f73513f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.631801 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa6f9c0e1214849b0d68650de126955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.633200 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 40b37f237dea4c31afb1f78e20b0ac77 (DEFAULT_TABLE table=default.Table_52ed7c99afcd4498b138637b87d7bcab [id=fc2df23d78dd40ad9d7fa81c2060f1de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.633524 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b37f237dea4c31afb1f78e20b0ac77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.633989 1040 tablet_service.cc:1511] Processing CreateTablet for tablet c10ba31c640d4b9bb58dff344548727a (DEFAULT_TABLE table=default.Table_86bb57ef76364b77bae98ac8a2491a6f [id=b9f2acc6cb0f42e4bc28ecb90eb2c209]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.634263 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10ba31c640d4b9bb58dff344548727a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.636340 895 tablet_service.cc:1511] Processing CreateTablet for tablet 40b37f237dea4c31afb1f78e20b0ac77 (DEFAULT_TABLE table=default.Table_52ed7c99afcd4498b138637b87d7bcab [id=fc2df23d78dd40ad9d7fa81c2060f1de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.636663 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b37f237dea4c31afb1f78e20b0ac77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.638499 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 1403dd096f3e47e69186c8fa618345a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:22.639358 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 7e839760ca8841cc92c21cd439c20c4b (DEFAULT_TABLE table=default.Table_a2bc931572544f57a16d3c475a7a5b22 [id=deaa6bb931274470aab173659b8e37eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.639678 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e839760ca8841cc92c21cd439c20c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.641191 1025 tablet_service.cc:1511] Processing CreateTablet for tablet a1bd5f33b75c47f69aa1ca8b1dda681e (DEFAULT_TABLE table=default.Table_43642798648b4083bc3e6132accafbb2 [id=506f223f308d4609b1d6b7b7bf4b9d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.641462 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bd5f33b75c47f69aa1ca8b1dda681e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.646889 1038 tablet_service.cc:1511] Processing CreateTablet for tablet f02f7a2952c94af797ce8d5246457b1c (DEFAULT_TABLE table=default.Table_3a39176359734a00bb540aaddb873b29 [id=9a1b47c6a84f40f691f6a083bc18ed9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.647267 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f02f7a2952c94af797ce8d5246457b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.648713 889 tablet_service.cc:1511] Processing CreateTablet for tablet c10ba31c640d4b9bb58dff344548727a (DEFAULT_TABLE table=default.Table_86bb57ef76364b77bae98ac8a2491a6f [id=b9f2acc6cb0f42e4bc28ecb90eb2c209]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.649037 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10ba31c640d4b9bb58dff344548727a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.650357 461 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 5462af2002f9406b85ee20660e001a95 (table default.Table_52c372106d354fba9e90c5be75714312 [id=d2574a03769945e99b662ed1015b2703]). Expected version 1 got 0
I20260616 19:52:22.652707 899 tablet_service.cc:1511] Processing CreateTablet for tablet 7e839760ca8841cc92c21cd439c20c4b (DEFAULT_TABLE table=default.Table_a2bc931572544f57a16d3c475a7a5b22 [id=deaa6bb931274470aab173659b8e37eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.653000 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e839760ca8841cc92c21cd439c20c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.653618 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 1403dd096f3e47e69186c8fa618345a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.656096 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 430b810fd7dd4d0bae046834c8c42b99
I20260616 19:52:22.656347 902 tablet_service.cc:1511] Processing CreateTablet for tablet a1bd5f33b75c47f69aa1ca8b1dda681e (DEFAULT_TABLE table=default.Table_43642798648b4083bc3e6132accafbb2 [id=506f223f308d4609b1d6b7b7bf4b9d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.656685 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bd5f33b75c47f69aa1ca8b1dda681e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.657506 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 14a703acc7804dedbf29b15893e63402
I20260616 19:52:22.657920 455 catalog_manager.cc:6784] ReplaceTablet: tablet 14a703acc7804dedbf29b15893e63402 deleted and replaced by tablet f61ac677d890487e8d6f478146a0b527
I20260616 19:52:22.660419 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 430b810fd7dd4d0bae046834c8c42b99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:22.660609 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 14a703acc7804dedbf29b15893e63402 with delete_type TABLET_DATA_DELETED (replaced by tablet f61ac677d890487e8d6f478146a0b527) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:22.660722 898 tablet_service.cc:1511] Processing CreateTablet for tablet 918f35b507c5463b8897c2f6a221abfb (DEFAULT_TABLE table=default.Table_f54d915ba23e4f42becad23e4e9951cc [id=ca16774ed1a14166aab2027237663539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.661105 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918f35b507c5463b8897c2f6a221abfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.664044 901 tablet_service.cc:1511] Processing CreateTablet for tablet f2e5446813a44f2789ea146cff78817a (DEFAULT_TABLE table=default.Table_11d98749e6df433ab4df38f2991dbf08 [id=5fe61993eb404b1e8a6189cfeb109223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.664335 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e5446813a44f2789ea146cff78817a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.665958 1023 tablet_service.cc:1511] Processing CreateTablet for tablet f2e5446813a44f2789ea146cff78817a (DEFAULT_TABLE table=default.Table_11d98749e6df433ab4df38f2991dbf08 [id=5fe61993eb404b1e8a6189cfeb109223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.666324 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e5446813a44f2789ea146cff78817a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.667997 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 14a703acc7804dedbf29b15893e63402 with delete_type TABLET_DATA_DELETED (replaced by tablet f61ac677d890487e8d6f478146a0b527) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.667780 886 tablet_service.cc:1511] Processing CreateTablet for tablet f02f7a2952c94af797ce8d5246457b1c (DEFAULT_TABLE table=default.Table_3a39176359734a00bb540aaddb873b29 [id=9a1b47c6a84f40f691f6a083bc18ed9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.668423 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f02f7a2952c94af797ce8d5246457b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.668665 896 tablet_service.cc:1511] Processing CreateTablet for tablet 406f8ab1ae2346e48f4d3d22bf33ba53 (DEFAULT_TABLE table=default.Table_95c15a9d564140b6a153f6acf270f21e [id=1d4da8051a204059b64f0cfa0329b5c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.668957 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406f8ab1ae2346e48f4d3d22bf33ba53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.672622 1040 tablet_service.cc:1511] Processing CreateTablet for tablet e0bec1190f904ca886a9eaac544d6ba4 (DEFAULT_TABLE table=default.Table_c8e40b7e46144c01b81b302e91eee634 [id=3ff7b6b83ddc4b73a97221c033dafcba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.673010 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bec1190f904ca886a9eaac544d6ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.673266 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 406f8ab1ae2346e48f4d3d22bf33ba53 (DEFAULT_TABLE table=default.Table_95c15a9d564140b6a153f6acf270f21e [id=1d4da8051a204059b64f0cfa0329b5c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.673550 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406f8ab1ae2346e48f4d3d22bf33ba53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.674616 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 430b810fd7dd4d0bae046834c8c42b99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:22.675304 893 tablet_service.cc:1511] Processing CreateTablet for tablet 5671428d9c394a17a4fe4207684d4719 (DEFAULT_TABLE table=default.Table_22f2a0166bdd4fdcbe77171612792138 [id=f64fcac0bd7e49e793698454dec47680]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.675628 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5671428d9c394a17a4fe4207684d4719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.678452 1027 tablet_service.cc:1511] Processing CreateTablet for tablet afa6f9c0e1214849b0d68650de126955 (DEFAULT_TABLE table=default.Table_809de6876da84671a331e9af0e5ba887 [id=6ad7d636895f4cf9a4f9f5a5f73513f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.678753 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa6f9c0e1214849b0d68650de126955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.680024 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 918f35b507c5463b8897c2f6a221abfb (DEFAULT_TABLE table=default.Table_f54d915ba23e4f42becad23e4e9951cc [id=ca16774ed1a14166aab2027237663539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.682019 895 tablet_service.cc:1511] Processing CreateTablet for tablet e0bec1190f904ca886a9eaac544d6ba4 (DEFAULT_TABLE table=default.Table_c8e40b7e46144c01b81b302e91eee634 [id=3ff7b6b83ddc4b73a97221c033dafcba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.682457 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e452f7be1e0a41cc95a05b1e44cce7f7 (DEFAULT_TABLE table=default.Table_5d6fdacece394c618e52a026584d5018 [id=ec1a3a1ee3b0497a88acfbaa2c7c1240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.682559 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bec1190f904ca886a9eaac544d6ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.682771 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e452f7be1e0a41cc95a05b1e44cce7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.682853 901 tablet_service.cc:1511] Processing CreateTablet for tablet e452f7be1e0a41cc95a05b1e44cce7f7 (DEFAULT_TABLE table=default.Table_5d6fdacece394c618e52a026584d5018 [id=ec1a3a1ee3b0497a88acfbaa2c7c1240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.683211 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e452f7be1e0a41cc95a05b1e44cce7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.685066 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918f35b507c5463b8897c2f6a221abfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.558068 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a406124a8d34e578ba94fab2a873a55" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:22.692041 775 raft_consensus.cc:2468] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:22.692054 2662 raft_consensus.cc:493] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.563839 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c90eb04585c4fa992435d11015ffec7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:22.692167 2662 raft_consensus.cc:515] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.692363 784 raft_consensus.cc:2468] T 3c90eb04585c4fa992435d11015ffec7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:22.574358 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a406124a8d34e578ba94fab2a873a55" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:22.692654 781 raft_consensus.cc:3060] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.692806 2662 leader_election.cc:290] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:22.693444 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91fad69dcb8d4e7b8c3dc6da0b941f5c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:22.693655 1060 raft_consensus.cc:2468] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 0.
I20260616 19:52:22.694020 858 leader_election.cc:304] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:22.694249 2662 raft_consensus.cc:2804] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:22.694314 2662 raft_consensus.cc:493] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:22.694376 2662 raft_consensus.cc:3060] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.695430 781 raft_consensus.cc:2468] T 0a406124a8d34e578ba94fab2a873a55 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:22.590531 754 tablet_service.cc:1511] Processing CreateTablet for tablet 4afa8264128f429984d73140c974d21a (DEFAULT_TABLE table=default.Table_a9f778dbd18d49379fbd6ffa4d08db6d [id=7569aa05ce4841b589943be95f5a4ca4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.695895 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afa8264128f429984d73140c974d21a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.696672 2662 raft_consensus.cc:515] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.696867 860 leader_election.cc:304] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:22.697082 3145 raft_consensus.cc:2804] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:22.591511 757 tablet_service.cc:1511] Processing CreateTablet for tablet c422fdeef8e14eb69a49f26293a4ff11 (DEFAULT_TABLE table=default.Table_4e014c2192ad4cb18fd99c3780311339 [id=c50ffea84a9d4663aa8f58829d9b2700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.697170 3145 raft_consensus.cc:697] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:22.697422 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c422fdeef8e14eb69a49f26293a4ff11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.697386 3145 consensus_queue.cc:237] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.592650 746 tablet_service.cc:1558] Processing DeleteTablet for tablet d686190fb6a34ab18cc4799197765f1b with delete_type TABLET_DATA_DELETED (replaced by tablet 3d44aed473e44e2eaa0d166f164c9309) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:22.698559 746 tablet_service.cc:1511] Processing CreateTablet for tablet 406f8ab1ae2346e48f4d3d22bf33ba53 (DEFAULT_TABLE table=default.Table_95c15a9d564140b6a153f6acf270f21e [id=1d4da8051a204059b64f0cfa0329b5c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.698889 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406f8ab1ae2346e48f4d3d22bf33ba53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.592797 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 54eb61046c954a36a036b24e9e16b5c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:22.700817 761 tablet_service.cc:1511] Processing CreateTablet for tablet e0bec1190f904ca886a9eaac544d6ba4 (DEFAULT_TABLE table=default.Table_c8e40b7e46144c01b81b302e91eee634 [id=3ff7b6b83ddc4b73a97221c033dafcba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.701125 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bec1190f904ca886a9eaac544d6ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.701447 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91fad69dcb8d4e7b8c3dc6da0b941f5c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:22.702673 757 tablet_service.cc:1511] Processing CreateTablet for tablet e452f7be1e0a41cc95a05b1e44cce7f7 (DEFAULT_TABLE table=default.Table_5d6fdacece394c618e52a026584d5018 [id=ec1a3a1ee3b0497a88acfbaa2c7c1240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.703022 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e452f7be1e0a41cc95a05b1e44cce7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.703050 754 tablet_service.cc:1511] Processing CreateTablet for tablet 4afebf0ff4b04066b2cdc62360a7be5b (DEFAULT_TABLE table=default.Table_f7d0ca5e4788407381cd7ad2a4ed9561 [id=bd6adbaa6a134d299edf1860dc3ba200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.703493 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afebf0ff4b04066b2cdc62360a7be5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.592953 747 tablet_service.cc:1558] Processing DeleteTablet for tablet d1e3778611a24397a1a776be2cc76284 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f9beca7b7d749bea74949dde5a1a6cb) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:22.704890 860 leader_election.cc:343] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.705562 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91fad69dcb8d4e7b8c3dc6da0b941f5c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
W20260616 19:52:22.705967 860 leader_election.cc:343] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.706310 996 leader_election.cc:304] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.706586 3126 raft_consensus.cc:2804] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:22.706665 3126 raft_consensus.cc:493] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:22.706724 3126 raft_consensus.cc:3060] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.598881 752 tablet_service.cc:1511] Processing CreateTablet for tablet c49f2d78ba074e2da0c529cb257f728e (DEFAULT_TABLE table=default.Table_94c9b55eea4049cc915a46464481047e [id=f78482bb51b442b582d69c7a78c256d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.708704 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49f2d78ba074e2da0c529cb257f728e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.709021 3126 raft_consensus.cc:515] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:22.709591 3126 leader_election.cc:290] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.711189 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c90eb04585c4fa992435d11015ffec7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:22.711339 781 raft_consensus.cc:3060] T 3c90eb04585c4fa992435d11015ffec7 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.600737 763 tablet_service.cc:1511] Processing CreateTablet for tablet 9e84e5f3a0984b87ad1a4fe9bab2e427 (DEFAULT_TABLE table=default.Table_2159d026adeb4590a238dacdfcb28e11 [id=456c565d92844371bbe00ad07450068f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.712723 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e84e5f3a0984b87ad1a4fe9bab2e427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.713722 781 raft_consensus.cc:2468] T 3c90eb04585c4fa992435d11015ffec7 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:22.714100 996 leader_election.cc:304] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:22.714344 3126 raft_consensus.cc:2804] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:22.714457 3126 raft_consensus.cc:697] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:22.714670 3126 consensus_queue.cc:237] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:22.601048 765 tablet_service.cc:1511] Processing CreateTablet for tablet 5671428d9c394a17a4fe4207684d4719 (DEFAULT_TABLE table=default.Table_22f2a0166bdd4fdcbe77171612792138 [id=f64fcac0bd7e49e793698454dec47680]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.716580 1193 log.cc:1199] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/335f7411fda84fada762345010a4339c
I20260616 19:52:22.716703 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5671428d9c394a17a4fe4207684d4719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.717011 1193 ts_tablet_manager.cc:1950] T 335f7411fda84fada762345010a4339c P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:22.717692 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1303) took 2865 ms. Trace:
I20260616 19:52:22.717777 1193 rpcz_store.cc:276] 0616 19:52:19.852580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.852635 (+ 55us) service_pool.cc:224] Handling call
0616 19:52:22.402416 (+2549781us) ts_tablet_manager.cc:1151] Deleting tablet 335f7411fda84fada762345010a4339c
0616 19:52:22.402426 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.450585 (+ 48159us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.539163 (+ 88578us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:22.717677 (+178514us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2546832}
I20260616 19:52:22.718178 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 335f7411fda84fada762345010a4339c (table default.Table_79b6231edaca4531929b2578e8468670 [id=be40d7e74be1474c98f06b62d98de5db]) successfully deleted
I20260616 19:52:22.718557 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1304) took 2865 ms. Trace:
I20260616 19:52:22.718621 1193 rpcz_store.cc:276] 0616 19:52:19.852924 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:19.852978 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:22.718475 (+2865497us) ts_tablet_manager.cc:1151] Deleting tablet 1d825bcf365f424fb99a10afe3e96501
0616 19:52:22.718484 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.718544 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1,"tablet-delete.queue_time_us":2862883}
W20260616 19:52:22.718984 448 catalog_manager.cc:4994] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 1d825bcf365f424fb99a10afe3e96501 because the tablet was not found. No further retry: Not found: Tablet not found: 1d825bcf365f424fb99a10afe3e96501
I20260616 19:52:22.606988 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c940bd14a040ddba5ea058e732bf0c" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:22.623216 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 1403dd096f3e47e69186c8fa618345a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:22.623588 756 tablet_service.cc:1511] Processing CreateTablet for tablet f02f7a2952c94af797ce8d5246457b1c (DEFAULT_TABLE table=default.Table_3a39176359734a00bb540aaddb873b29 [id=9a1b47c6a84f40f691f6a083bc18ed9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.720920 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f02f7a2952c94af797ce8d5246457b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.623857 764 tablet_service.cc:1511] Processing CreateTablet for tablet afa6f9c0e1214849b0d68650de126955 (DEFAULT_TABLE table=default.Table_809de6876da84671a331e9af0e5ba887 [id=6ad7d636895f4cf9a4f9f5a5f73513f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.623955 749 tablet_service.cc:1511] Processing CreateTablet for tablet 86ceac112ffb44a5b6007a4a1280d8cb (DEFAULT_TABLE table=default.Table_9579db20b0e241ecb10d538e86859ffc [id=305a99db92ea464195144e9b5db7c633]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.624152 755 tablet_service.cc:1511] Processing CreateTablet for tablet 40b37f237dea4c31afb1f78e20b0ac77 (DEFAULT_TABLE table=default.Table_52ed7c99afcd4498b138637b87d7bcab [id=fc2df23d78dd40ad9d7fa81c2060f1de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.721374 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa6f9c0e1214849b0d68650de126955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.624652 751 tablet_service.cc:1511] Processing CreateTablet for tablet c10ba31c640d4b9bb58dff344548727a (DEFAULT_TABLE table=default.Table_86bb57ef76364b77bae98ac8a2491a6f [id=b9f2acc6cb0f42e4bc28ecb90eb2c209]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.721599 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ceac112ffb44a5b6007a4a1280d8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.721829 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10ba31c640d4b9bb58dff344548727a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.627761 758 tablet_service.cc:1511] Processing CreateTablet for tablet 7e839760ca8841cc92c21cd439c20c4b (DEFAULT_TABLE table=default.Table_a2bc931572544f57a16d3c475a7a5b22 [id=deaa6bb931274470aab173659b8e37eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.724756 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e839760ca8841cc92c21cd439c20c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.725385 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b37f237dea4c31afb1f78e20b0ac77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.726178 3177 raft_consensus.cc:493] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.726293 3177 raft_consensus.cc:515] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.726792 3177 leader_election.cc:290] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.628108 748 tablet_service.cc:1511] Processing CreateTablet for tablet a1bd5f33b75c47f69aa1ca8b1dda681e (DEFAULT_TABLE table=default.Table_43642798648b4083bc3e6132accafbb2 [id=506f223f308d4609b1d6b7b7bf4b9d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.729031 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bd5f33b75c47f69aa1ca8b1dda681e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.697175 2662 leader_election.cc:290] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:22.731873 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91fad69dcb8d4e7b8c3dc6da0b941f5c" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:22.732054 1060 raft_consensus.cc:3060] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.628702 750 tablet_service.cc:1511] Processing CreateTablet for tablet 918f35b507c5463b8897c2f6a221abfb (DEFAULT_TABLE table=default.Table_f54d915ba23e4f42becad23e4e9951cc [id=ca16774ed1a14166aab2027237663539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.732757 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918f35b507c5463b8897c2f6a221abfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.734570 1060 raft_consensus.cc:2468] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae28da1c4102450ab76eb2946a5cbf2e in term 1.
I20260616 19:52:22.735006 858 leader_election.cc:304] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 7245e7dab0ec474a876537be514c8767
I20260616 19:52:22.735373 2662 raft_consensus.cc:2804] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:22.735468 2662 raft_consensus.cc:697] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Becoming Leader. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Running, Role: LEADER
I20260616 19:52:22.735656 2662 consensus_queue.cc:237] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.657801 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 430b810fd7dd4d0bae046834c8c42b99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:22.658632 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 14a703acc7804dedbf29b15893e63402 with delete_type TABLET_DATA_DELETED (replaced by tablet f61ac677d890487e8d6f478146a0b527) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:22.664978 753 tablet_service.cc:1511] Processing CreateTablet for tablet f2e5446813a44f2789ea146cff78817a (DEFAULT_TABLE table=default.Table_11d98749e6df433ab4df38f2991dbf08 [id=5fe61993eb404b1e8a6189cfeb109223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.736850 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e5446813a44f2789ea146cff78817a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.753135 2962 raft_consensus.cc:493] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.753300 2962 raft_consensus.cc:515] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.753943 2962 leader_election.cc:290] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.755908 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d686190fb6a34ab18cc4799197765f1b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:22.756166 1060 raft_consensus.cc:2468] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:22.758296 719 leader_election.cc:304] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:22.758556 3177 raft_consensus.cc:2804] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:22.758621 3177 raft_consensus.cc:493] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:22.758677 3177 raft_consensus.cc:3060] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.760761 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9befb557d84f3bb7781664cbf2f28f" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:22.760912 3177 raft_consensus.cc:515] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.761147 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c90eb04585c4fa992435d11015ffec7" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:22.761445 3177 leader_election.cc:290] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:22.761801 993 leader_election.cc:343] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:22.762054 993 leader_election.cc:343] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.769101 3177 raft_consensus.cc:493] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.769253 3177 raft_consensus.cc:515] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.769830 3177 leader_election.cc:290] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.774190 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d686190fb6a34ab18cc4799197765f1b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:22.776248 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d686190fb6a34ab18cc4799197765f1b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:22.777100 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf86e5d5f2341c78705f78c02695c17" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:22.777838 718 leader_election.cc:343] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:22.778443 718 leader_election.cc:343] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:22.778589 718 leader_election.cc:343] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.781096 892 tablet_service.cc:1511] Processing CreateTablet for tablet 4afebf0ff4b04066b2cdc62360a7be5b (DEFAULT_TABLE table=default.Table_f7d0ca5e4788407381cd7ad2a4ed9561 [id=bd6adbaa6a134d299edf1860dc3ba200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.781267 896 tablet_service.cc:1511] Processing CreateTablet for tablet a2f3bfb239d24960b43e333b4f946331 (DEFAULT_TABLE table=default.Table_6454fb2cae974195b380fd6b2ae1ec44 [id=4516d58e0ead443ca5b8027c226fb2d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.781498 902 tablet_service.cc:1511] Processing CreateTablet for tablet 67dffa8402e84e0986b883783171cd4a (DEFAULT_TABLE table=default.Table_cfe9357976fa469aa84822173ab350d1 [id=bd53b589dabf4771bef230fa32eaa7ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.781806 889 tablet_service.cc:1511] Processing CreateTablet for tablet 096f1b671b434b8d9aaf894f8d916d42 (DEFAULT_TABLE table=default.Table_1a8cf36c967745d685873eaa02896d04 [id=4ae14258e63f4a15a47537257eb4cba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.781932 885 tablet_service.cc:1511] Processing CreateTablet for tablet efd43f2bbc934c5eaf7f0a3b907391a5 (DEFAULT_TABLE table=default.Table_e2fb7eef7b82491ab920e5278f9b2abf [id=96d783136e044dffb056eb3d3224a265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.782101 899 tablet_service.cc:1511] Processing CreateTablet for tablet 5836f1c6735d415387d4aef13f3d2721 (DEFAULT_TABLE table=default.Table_9ae3d5cd3dc546c0b88e9142d5803827 [id=dff7eca4de864b3f96fe9b8027b33da2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.782305 890 tablet_service.cc:1511] Processing CreateTablet for tablet 247faffcca3542e6afb85f0b777e4c5e (DEFAULT_TABLE table=default.Table_c42c60c1f10c4fc698f29ed1c5b728de [id=b291618ae1ce4954b66a8303211895e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.783118 900 tablet_service.cc:1511] Processing CreateTablet for tablet 507f4529753d4aff8eb2a44d5e4b1e47 (DEFAULT_TABLE table=default.Table_54f6ebbfc240450f84b9246a98f98ed4 [id=abb2ac4e4a6b45629bfe58a01f5388ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.785218 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9befb557d84f3bb7781664cbf2f28f" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:22.785355 753 tablet_service.cc:1511] Processing CreateTablet for tablet 5836f1c6735d415387d4aef13f3d2721 (DEFAULT_TABLE table=default.Table_9ae3d5cd3dc546c0b88e9142d5803827 [id=dff7eca4de864b3f96fe9b8027b33da2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.785423 779 raft_consensus.cc:2468] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:22.785698 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5836f1c6735d415387d4aef13f3d2721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.785652 746 tablet_service.cc:1511] Processing CreateTablet for tablet 507f4529753d4aff8eb2a44d5e4b1e47 (DEFAULT_TABLE table=default.Table_54f6ebbfc240450f84b9246a98f98ed4 [id=abb2ac4e4a6b45629bfe58a01f5388ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.785923 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507f4529753d4aff8eb2a44d5e4b1e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.786299 750 tablet_service.cc:1511] Processing CreateTablet for tablet 096f1b671b434b8d9aaf894f8d916d42 (DEFAULT_TABLE table=default.Table_1a8cf36c967745d685873eaa02896d04 [id=4ae14258e63f4a15a47537257eb4cba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.786600 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096f1b671b434b8d9aaf894f8d916d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.787672 748 tablet_service.cc:1511] Processing CreateTablet for tablet a2f3bfb239d24960b43e333b4f946331 (DEFAULT_TABLE table=default.Table_6454fb2cae974195b380fd6b2ae1ec44 [id=4516d58e0ead443ca5b8027c226fb2d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.788008 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f3bfb239d24960b43e333b4f946331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.789165 763 tablet_service.cc:1511] Processing CreateTablet for tablet 8fdfa9fa0a834c50a978019da9def032 (DEFAULT_TABLE table=default.Table_a063d8f3960c4fc68928fce3710aeefd [id=4685e6b6d7184635afe9dbf327485543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.789978 758 tablet_service.cc:1511] Processing CreateTablet for tablet 67dffa8402e84e0986b883783171cd4a (DEFAULT_TABLE table=default.Table_cfe9357976fa469aa84822173ab350d1 [id=bd53b589dabf4771bef230fa32eaa7ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.790807 751 tablet_service.cc:1511] Processing CreateTablet for tablet efd43f2bbc934c5eaf7f0a3b907391a5 (DEFAULT_TABLE table=default.Table_e2fb7eef7b82491ab920e5278f9b2abf [id=96d783136e044dffb056eb3d3224a265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.791148 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fdfa9fa0a834c50a978019da9def032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.791970 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67dffa8402e84e0986b883783171cd4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.792569 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd43f2bbc934c5eaf7f0a3b907391a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.796200 764 tablet_service.cc:1511] Processing CreateTablet for tablet 247faffcca3542e6afb85f0b777e4c5e (DEFAULT_TABLE table=default.Table_c42c60c1f10c4fc698f29ed1c5b728de [id=b291618ae1ce4954b66a8303211895e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.797570 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247faffcca3542e6afb85f0b777e4c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.798471 894 tablet_service.cc:1511] Processing CreateTablet for tablet 5b522109fed7400fbc20b0e359a25163 (DEFAULT_TABLE table=default.Table_3a1847f489204e5eb7bf9a4608b85c57 [id=9daaf7def2ef44f7bc1581bb6d8d115c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.798669 897 tablet_service.cc:1511] Processing CreateTablet for tablet 8fdfa9fa0a834c50a978019da9def032 (DEFAULT_TABLE table=default.Table_a063d8f3960c4fc68928fce3710aeefd [id=4685e6b6d7184635afe9dbf327485543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.799149 903 tablet_service.cc:1511] Processing CreateTablet for tablet cd1055d5f27d4fe5bf864b15c942d8d1 (DEFAULT_TABLE table=default.Table_22869952175a4723a7ea94a9237354d8 [id=92ef8e73042c4d068d5b0e515b9314cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.799528 891 tablet_service.cc:1511] Processing CreateTablet for tablet 21b285ac3a0e4e3e935d6a6a38e51f35 (DEFAULT_TABLE table=default.Table_3d98401012fb44179d92d887233d208f [id=76d3fc86be404170beadf884fb79f8a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.803567 904 tablet_service.cc:1511] Processing CreateTablet for tablet 0b43647aa23f401fb16ef484e710bbd5 (DEFAULT_TABLE table=default.Table_4413cec10d7c4ff2904219f7bd57c03e [id=e6eeb6aed8c84760bc0d28b69c6c5655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.803972 888 tablet_service.cc:1511] Processing CreateTablet for tablet 1eceb472cc8f4f518c82003ef455e91f (DEFAULT_TABLE table=default.Table_0da36efbb8ce483d944db33901a29766 [id=e1c4e340002245208cc1ebb62fc9c71a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:22.804344 996 leader_election.cc:343] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.807689 765 tablet_service.cc:1511] Processing CreateTablet for tablet cd1055d5f27d4fe5bf864b15c942d8d1 (DEFAULT_TABLE table=default.Table_22869952175a4723a7ea94a9237354d8 [id=92ef8e73042c4d068d5b0e515b9314cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.808040 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1055d5f27d4fe5bf864b15c942d8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.811367 996 leader_election.cc:304] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:22.814239 887 tablet_service.cc:1511] Processing CreateTablet for tablet e6cbc5215f834fbd9392cd57574ae3f7 (DEFAULT_TABLE table=default.Table_01232f43cf644a519f3a37450e610110 [id=f0a646ee88c64c3b9df7553453b35b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.815783 3116 raft_consensus.cc:2749] T 93c940bd14a040ddba5ea058e732bf0c P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:22.816265 752 tablet_service.cc:1511] Processing CreateTablet for tablet 1eceb472cc8f4f518c82003ef455e91f (DEFAULT_TABLE table=default.Table_0da36efbb8ce483d944db33901a29766 [id=e1c4e340002245208cc1ebb62fc9c71a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.816675 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eceb472cc8f4f518c82003ef455e91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.819136 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 4afebf0ff4b04066b2cdc62360a7be5b (DEFAULT_TABLE table=default.Table_f7d0ca5e4788407381cd7ad2a4ed9561 [id=bd6adbaa6a134d299edf1860dc3ba200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.819499 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afebf0ff4b04066b2cdc62360a7be5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.820851 756 tablet_service.cc:1511] Processing CreateTablet for tablet 21b285ac3a0e4e3e935d6a6a38e51f35 (DEFAULT_TABLE table=default.Table_3d98401012fb44179d92d887233d208f [id=76d3fc86be404170beadf884fb79f8a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.821148 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b285ac3a0e4e3e935d6a6a38e51f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.825245 761 tablet_service.cc:1511] Processing CreateTablet for tablet 0b43647aa23f401fb16ef484e710bbd5 (DEFAULT_TABLE table=default.Table_4413cec10d7c4ff2904219f7bd57c03e [id=e6eeb6aed8c84760bc0d28b69c6c5655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.825577 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b43647aa23f401fb16ef484e710bbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.829921 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 096f1b671b434b8d9aaf894f8d916d42 (DEFAULT_TABLE table=default.Table_1a8cf36c967745d685873eaa02896d04 [id=4ae14258e63f4a15a47537257eb4cba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.830323 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096f1b671b434b8d9aaf894f8d916d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.831977 759 tablet_service.cc:1511] Processing CreateTablet for tablet 37d702a538ea477ba524ea7380980f43 (DEFAULT_TABLE table=default.Table_acc65356a0ab40718b59c65302fecca8 [id=1a14eab021da4b06a92693023a8a51cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.832281 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d702a538ea477ba524ea7380980f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.829922 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 67dffa8402e84e0986b883783171cd4a (DEFAULT_TABLE table=default.Table_cfe9357976fa469aa84822173ab350d1 [id=bd53b589dabf4771bef230fa32eaa7ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.832880 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67dffa8402e84e0986b883783171cd4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.836410 749 tablet_service.cc:1511] Processing CreateTablet for tablet e6cbc5215f834fbd9392cd57574ae3f7 (DEFAULT_TABLE table=default.Table_01232f43cf644a519f3a37450e610110 [id=f0a646ee88c64c3b9df7553453b35b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.836722 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6cbc5215f834fbd9392cd57574ae3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.839493 1035 tablet_service.cc:1511] Processing CreateTablet for tablet a2f3bfb239d24960b43e333b4f946331 (DEFAULT_TABLE table=default.Table_6454fb2cae974195b380fd6b2ae1ec44 [id=4516d58e0ead443ca5b8027c226fb2d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.839810 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f3bfb239d24960b43e333b4f946331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.840018 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 8fdfa9fa0a834c50a978019da9def032 (DEFAULT_TABLE table=default.Table_a063d8f3960c4fc68928fce3710aeefd [id=4685e6b6d7184635afe9dbf327485543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.840399 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fdfa9fa0a834c50a978019da9def032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.841461 759 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0fa00bb250499389f34ada189391d7 (DEFAULT_TABLE table=default.Table_257e05583d3a4741b5e7b618b460e212 [id=ec2012c9c57e43a7a6d41cb5235dc131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.841761 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0fa00bb250499389f34ada189391d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.844724 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 5836f1c6735d415387d4aef13f3d2721 (DEFAULT_TABLE table=default.Table_9ae3d5cd3dc546c0b88e9142d5803827 [id=dff7eca4de864b3f96fe9b8027b33da2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.844771 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 5b522109fed7400fbc20b0e359a25163 (DEFAULT_TABLE table=default.Table_3a1847f489204e5eb7bf9a4608b85c57 [id=9daaf7def2ef44f7bc1581bb6d8d115c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.845026 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5836f1c6735d415387d4aef13f3d2721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.845278 1032 tablet_service.cc:1511] Processing CreateTablet for tablet cd1055d5f27d4fe5bf864b15c942d8d1 (DEFAULT_TABLE table=default.Table_22869952175a4723a7ea94a9237354d8 [id=92ef8e73042c4d068d5b0e515b9314cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.845561 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1055d5f27d4fe5bf864b15c942d8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.848694 1039 tablet_service.cc:1511] Processing CreateTablet for tablet efd43f2bbc934c5eaf7f0a3b907391a5 (DEFAULT_TABLE table=default.Table_e2fb7eef7b82491ab920e5278f9b2abf [id=96d783136e044dffb056eb3d3224a265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.848973 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd43f2bbc934c5eaf7f0a3b907391a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.849141 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b522109fed7400fbc20b0e359a25163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.849385 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 247faffcca3542e6afb85f0b777e4c5e (DEFAULT_TABLE table=default.Table_c42c60c1f10c4fc698f29ed1c5b728de [id=b291618ae1ce4954b66a8303211895e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.849658 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247faffcca3542e6afb85f0b777e4c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.683549 1196 tablet_bootstrap.cc:492] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:22.851250 1196 ts_tablet_manager.cc:1403] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.405s user 0.002s sys 0.004s
I20260616 19:52:22.851938 1196 raft_consensus.cc:359] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.852106 1196 raft_consensus.cc:385] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:22.852155 1196 raft_consensus.cc:740] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:22.852692 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 507f4529753d4aff8eb2a44d5e4b1e47 (DEFAULT_TABLE table=default.Table_54f6ebbfc240450f84b9246a98f98ed4 [id=abb2ac4e4a6b45629bfe58a01f5388ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.852738 762 tablet_service.cc:1511] Processing CreateTablet for tablet dbc1f0a59a9c4e37b5da131faaf04233 (DEFAULT_TABLE table=default.Table_b38a7f54b0584662954227bde2b75aeb [id=089bc577e3f14d10abaff39c002261f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.852981 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507f4529753d4aff8eb2a44d5e4b1e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.853029 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc1f0a59a9c4e37b5da131faaf04233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.860208 762 tablet_service.cc:1511] Processing CreateTablet for tablet bcad1b80726b46949c9953c67dbce23a (DEFAULT_TABLE table=default.Table_9b0f947c2cb64fbd89900c3decc44c56 [id=b50fdbf79fb9444797edae6ae352f821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.860569 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcad1b80726b46949c9953c67dbce23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.865163 755 tablet_service.cc:1511] Processing CreateTablet for tablet a778e75c6dc44f85aff4f9d75934d6c8 (DEFAULT_TABLE table=default.Table_a22790c0c8744187aefb960fb7c2c2e7 [id=8ad867c2e3694aba8ce8647fcfc63eab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.865314 760 tablet_service.cc:1511] Processing CreateTablet for tablet f22839ad451d4c43bdf8e72f0a785cc6 (DEFAULT_TABLE table=default.Table_58889a74cc6b4c8f835ac834eda1583e [id=09827ce2adbe471897a66b11ed6b9899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.865532 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a778e75c6dc44f85aff4f9d75934d6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.865592 757 tablet_service.cc:1511] Processing CreateTablet for tablet 0db1fd628cf047458664e20ab3a4d66b (DEFAULT_TABLE table=default.Table_4d937ed6c0714153993ea132f1eb2b3c [id=5e7b87ea6e424b179eaee22711702ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.865729 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f22839ad451d4c43bdf8e72f0a785cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.865942 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db1fd628cf047458664e20ab3a4d66b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.871135 751 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa42c9623f14a84ae80542ad987af5c (DEFAULT_TABLE table=default.Table_05ada076635d40b6998e1b4787ac3d9a [id=34582017ce9e4ecf93915fe6844c6330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.871438 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa42c9623f14a84ae80542ad987af5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.885238 3177 raft_consensus.cc:493] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:22.885558 3177 raft_consensus.cc:515] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:22.886605 3177 leader_election.cc:290] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:22.887326 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a199f25e5c4accba0acd1007fc73d1" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:22.888003 718 leader_election.cc:343] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:22.892421 1196 consensus_queue.cc:260] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:22.897457 860 consensus_peers.cc:597] T 335f7411fda84fada762345010a4339c P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 335f7411fda84fada762345010a4339c. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:22.899442 1192 tablet_bootstrap.cc:700] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e: Time spent opening tablet: real 0.347s user 0.000s sys 0.000s
I20260616 19:52:22.899781 1192 tablet_bootstrap.cc:654] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.901104 1196 ts_tablet_manager.cc:1434] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.050s user 0.001s sys 0.000s
I20260616 19:52:22.901422 1196 tablet_bootstrap.cc:492] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:22.902793 1196 tablet_bootstrap.cc:654] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:22.910328 759 tablet_service.cc:1511] Processing CreateTablet for tablet b279025fb55448a3ac57e487fee26c9f (DEFAULT_TABLE table=default.Table_03c1908087c44e4294ede2faa0d830cc [id=3046411f8b1f4b7b95c2465077a20bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.911001 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b279025fb55448a3ac57e487fee26c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.921985 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1306) took 2814 ms. Trace:
I20260616 19:52:22.932564 1193 rpcz_store.cc:276] 0616 19:52:20.107263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:20.107425 (+ 162us) service_pool.cc:224] Handling call
0616 19:52:22.921861 (+2814436us) ts_tablet_manager.cc:1151] Deleting tablet 9951d4dcafd64f8180125bb0c25c67ef
0616 19:52:22.921871 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.921961 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2814257}
I20260616 19:52:22.938509 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 4cbbc95ca5f24d1381f3d1b18c89a6bf
I20260616 19:52:22.939672 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 577b529dca234e07b3db1e0334fe4270
I20260616 19:52:22.942591 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 9e84e5f3a0984b87ad1a4fe9bab2e427
I20260616 19:52:22.942589 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 21b285ac3a0e4e3e935d6a6a38e51f35 (DEFAULT_TABLE table=default.Table_3d98401012fb44179d92d887233d208f [id=76d3fc86be404170beadf884fb79f8a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.942976 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b285ac3a0e4e3e935d6a6a38e51f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.944689 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet b57d6f12255e43ea9c35aedd388913e0
I20260616 19:52:22.945103 460 catalog_manager.cc:6784] ReplaceTablet: tablet b57d6f12255e43ea9c35aedd388913e0 deleted and replaced by tablet 882ee6bd90ef4833a801f60ec5ecae22
I20260616 19:52:22.946436 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4c00dea516a54aa8b930b4169522fece"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:22.946574 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_b4d12c6bb0d74fa0a3ab09a57cea73fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:22.946987 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4d12c6bb0d74fa0a3ab09a57cea73fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.947193 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_cd3fa037a4fa4959bfea35fbc223bcc9" } new_table_name: "default.Table_138387ac04a04482be4b9c5ed863c0b1" modify_external_catalogs: true
I20260616 19:52:22.948215 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_8c12d91d70ef4877b6b806553f5b4b41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:22.948431 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_fb121c44335544e99513d82eafb2df23" } new_table_name: "default.Table_c884c1ea462d4d8bbce725aa54749090" modify_external_catalogs: true
W20260616 19:52:22.948660 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c12d91d70ef4877b6b806553f5b4b41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.948959 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_4207c0c8d20748bdbf6ed637e13bc9e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:22.949164 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_cc29c68650374453856228941db4d3c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:22.949308 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4207c0c8d20748bdbf6ed637e13bc9e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:22.949579 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc29c68650374453856228941db4d3c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.948238 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8d6b895b77014dab9e9cbd601d9d9ac2" } new_table_name: "default.Table_92094d8fafd048968dbe0e966a3dd805" modify_external_catalogs: true
I20260616 19:52:22.950412 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_84018a61ca554c75b43d48bea4250dbd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:22.950817 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84018a61ca554c75b43d48bea4250dbd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:22.946987 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c00dea516a54aa8b930b4169522fece in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:22.980208 898 tablet_service.cc:1511] Processing CreateTablet for tablet 37d702a538ea477ba524ea7380980f43 (DEFAULT_TABLE table=default.Table_acc65356a0ab40718b59c65302fecca8 [id=1a14eab021da4b06a92693023a8a51cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.983757 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 0b43647aa23f401fb16ef484e710bbd5 (DEFAULT_TABLE table=default.Table_4413cec10d7c4ff2904219f7bd57c03e [id=e6eeb6aed8c84760bc0d28b69c6c5655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.984776 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d686190fb6a34ab18cc4799197765f1b" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:22.984987 1060 raft_consensus.cc:3060] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:22.987771 1060 raft_consensus.cc:2468] T d686190fb6a34ab18cc4799197765f1b P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:22.982112 886 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0fa00bb250499389f34ada189391d7 (DEFAULT_TABLE table=default.Table_257e05583d3a4741b5e7b618b460e212 [id=ec2012c9c57e43a7a6d41cb5235dc131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.982580 893 tablet_service.cc:1511] Processing CreateTablet for tablet b279025fb55448a3ac57e487fee26c9f (DEFAULT_TABLE table=default.Table_03c1908087c44e4294ede2faa0d830cc [id=3046411f8b1f4b7b95c2465077a20bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.983062 895 tablet_service.cc:1511] Processing CreateTablet for tablet dbc1f0a59a9c4e37b5da131faaf04233 (DEFAULT_TABLE table=default.Table_b38a7f54b0584662954227bde2b75aeb [id=089bc577e3f14d10abaff39c002261f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.983790 901 tablet_service.cc:1511] Processing CreateTablet for tablet bcad1b80726b46949c9953c67dbce23a (DEFAULT_TABLE table=default.Table_9b0f947c2cb64fbd89900c3decc44c56 [id=b50fdbf79fb9444797edae6ae352f821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.984200 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afebf0ff4b04066b2cdc62360a7be5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.990435 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b43647aa23f401fb16ef484e710bbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.990617 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247faffcca3542e6afb85f0b777e4c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.990787 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b522109fed7400fbc20b0e359a25163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.992045 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1055d5f27d4fe5bf864b15c942d8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.992563 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eceb472cc8f4f518c82003ef455e91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.952309 758 tablet_service.cc:1511] Processing CreateTablet for tablet 5b522109fed7400fbc20b0e359a25163 (DEFAULT_TABLE table=default.Table_3a1847f489204e5eb7bf9a4608b85c57 [id=9daaf7def2ef44f7bc1581bb6d8d115c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:22.993637 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b522109fed7400fbc20b0e359a25163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.996583 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5836f1c6735d415387d4aef13f3d2721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:22.998529 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b285ac3a0e4e3e935d6a6a38e51f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.000355 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fdfa9fa0a834c50a978019da9def032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.000555 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67dffa8402e84e0986b883783171cd4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.002895 1191 raft_consensus.cc:2272] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:23.004585 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096f1b671b434b8d9aaf894f8d916d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.006258 1191 ts_tablet_manager.cc:1916] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:23.008559 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6cbc5215f834fbd9392cd57574ae3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.008764 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507f4529753d4aff8eb2a44d5e4b1e47. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:23.010324 1198 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.547s user 0.018s sys 0.012s
W20260616 19:52:23.010388 1198 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.547s user 0.018s sys 0.012s
I20260616 19:52:23.011116 1198 tablet_bootstrap.cc:492] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:23.011221 1198 ts_tablet_manager.cc:1403] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.551s user 0.018s sys 0.013s
I20260616 19:52:23.011883 1198 raft_consensus.cc:359] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.012032 1198 raft_consensus.cc:385] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:23.012079 1198 raft_consensus.cc:740] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:23.012302 1198 consensus_queue.cc:260] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.012580 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd43f2bbc934c5eaf7f0a3b907391a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.013563 1198 ts_tablet_manager.cc:1434] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260616 19:52:23.015851 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f3bfb239d24960b43e333b4f946331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.032298 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 577b529dca234e07b3db1e0334fe4270 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:23.032531 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e84e5f3a0984b87ad1a4fe9bab2e427 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:23.032924 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cbbc95ca5f24d1381f3d1b18c89a6bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:23.033097 747 tablet_service.cc:1558] Processing DeleteTablet for tablet b57d6f12255e43ea9c35aedd388913e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 882ee6bd90ef4833a801f60ec5ecae22) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:23.033537 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d702a538ea477ba524ea7380980f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.033715 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0fa00bb250499389f34ada189391d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.034736 3225 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260616 19:52:23.035509 719 leader_election.cc:304] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:23.035900 3177 raft_consensus.cc:2804] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:23.036087 3177 raft_consensus.cc:697] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:23.036290 3177 consensus_queue.cc:237] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.038156 900 tablet_service.cc:1511] Processing CreateTablet for tablet c797ac456cc44686a878a8d8a4a21b44 (DEFAULT_TABLE table=default.Table_009cedf56a574717833b8dfa77b297f7 [id=68601561decc41f3a7a7b9e37f264bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.038533 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c797ac456cc44686a878a8d8a4a21b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.043231 889 tablet_service.cc:1511] Processing CreateTablet for tablet a778e75c6dc44f85aff4f9d75934d6c8 (DEFAULT_TABLE table=default.Table_a22790c0c8744187aefb960fb7c2c2e7 [id=8ad867c2e3694aba8ce8647fcfc63eab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.043710 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a778e75c6dc44f85aff4f9d75934d6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.043723 764 tablet_service.cc:1511] Processing CreateTablet for tablet c797ac456cc44686a878a8d8a4a21b44 (DEFAULT_TABLE table=default.Table_009cedf56a574717833b8dfa77b297f7 [id=68601561decc41f3a7a7b9e37f264bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.044203 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c797ac456cc44686a878a8d8a4a21b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.044978 903 tablet_service.cc:1511] Processing CreateTablet for tablet 0db1fd628cf047458664e20ab3a4d66b (DEFAULT_TABLE table=default.Table_4d937ed6c0714153993ea132f1eb2b3c [id=5e7b87ea6e424b179eaee22711702ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.045353 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db1fd628cf047458664e20ab3a4d66b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.046218 885 tablet_service.cc:1511] Processing CreateTablet for tablet f22839ad451d4c43bdf8e72f0a785cc6 (DEFAULT_TABLE table=default.Table_58889a74cc6b4c8f835ac834eda1583e [id=09827ce2adbe471897a66b11ed6b9899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.046504 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f22839ad451d4c43bdf8e72f0a785cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.047248 888 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa42c9623f14a84ae80542ad987af5c (DEFAULT_TABLE table=default.Table_05ada076635d40b6998e1b4787ac3d9a [id=34582017ce9e4ecf93915fe6844c6330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.047542 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa42c9623f14a84ae80542ad987af5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.048806 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcad1b80726b46949c9953c67dbce23a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:23.048970 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 9951d4dcafd64f8180125bb0c25c67ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9951d4dcafd64f8180125bb0c25c67ef already in progress: creating tablet
I20260616 19:52:23.049331 1193 tablet_replica.cc:333] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:23.049559 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc1f0a59a9c4e37b5da131faaf04233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.049592 1193 raft_consensus.cc:2243] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:23.049945 1193 raft_consensus.cc:2272] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:23.050117 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b279025fb55448a3ac57e487fee26c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.050994 1193 ts_tablet_manager.cc:1916] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:23.057006 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cbbc95ca5f24d1381f3d1b18c89a6bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.057256 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 577b529dca234e07b3db1e0334fe4270 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.057483 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e84e5f3a0984b87ad1a4fe9bab2e427 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.057670 897 tablet_service.cc:1558] Processing DeleteTablet for tablet b57d6f12255e43ea9c35aedd388913e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 882ee6bd90ef4833a801f60ec5ecae22) from {username='slave'} at 127.0.0.1:48636
W20260616 19:52:23.068375 446 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet fe39df8bd431402ba646f632939eba3a (table default.Table_0de44fae23f947f3bf6ab115c401073d [id=e8d71c73e6234a2aa771f143b262fe94], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fe39df8bd431402ba646f632939eba3a consensus state has no leader
I20260616 19:52:23.073173 996 leader_election.cc:304] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:23.073652 3126 raft_consensus.cc:2804] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:23.073751 3126 raft_consensus.cc:493] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:23.073820 3126 raft_consensus.cc:3060] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:23.077327 3126 raft_consensus.cc:515] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.078269 3126 leader_election.cc:290] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:23.105676 3166 raft_consensus.cc:493] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:23.105883 3166 raft_consensus.cc:515] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.106694 3166 leader_election.cc:290] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:23.108791 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9befb557d84f3bb7781664cbf2f28f" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:23.108968 778 raft_consensus.cc:3060] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:23.111526 778 raft_consensus.cc:2468] T 5a9befb557d84f3bb7781664cbf2f28f P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:23.114095 1192 tablet_bootstrap.cc:492] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:23.114284 1192 ts_tablet_manager.cc:1403] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.564s user 0.006s sys 0.000s
I20260616 19:52:23.114959 1192 raft_consensus.cc:359] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.115180 1192 raft_consensus.cc:385] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:23.115262 1192 raft_consensus.cc:740] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:23.115520 1192 consensus_queue.cc:260] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.115934 1191 ts_tablet_manager.cc:1929] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:23.116056 1191 log.cc:1199] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/352ca272888f4dd2ab1a8127bb8c2b6e
I20260616 19:52:23.116415 1191 ts_tablet_manager.cc:1950] T 352ca272888f4dd2ab1a8127bb8c2b6e P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:23.116420 1192 ts_tablet_manager.cc:1434] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:23.117115 1192 tablet_bootstrap.cc:492] T 1142b61e40e6499e8244d71f2ad39b1e P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:23.119073 1192 tablet_bootstrap.cc:654] T 1142b61e40e6499e8244d71f2ad39b1e P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:23.126684 3064 consensus_queue.cc:1048] T 75c08452aeec471f8480a489620cca28 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.134601 1190 ts_tablet_manager.cc:1929] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:23.140961 461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_8b8de534ca734e109a07486fa21dcfa7 [id=26e971fd00814ec89e4b45ad7544739b] alter complete (version 4)
W20260616 19:52:23.144959 445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:43055, user_credentials={real_user=slave}} blocked reactor thread for 164180us
I20260616 19:52:23.150866 3177 consensus_queue.cc:1048] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.150089 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3fbf302cbe4c5d8cc3cf8fa52baacc" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:23.172415 1190 log.cc:1199] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/1d825bcf365f424fb99a10afe3e96501
I20260616 19:52:23.172508 923 raft_consensus.cc:2468] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:23.152137 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a406124a8d34e578ba94fab2a873a55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.152773 902 tablet_service.cc:1558] Processing DeleteTablet for tablet f293d557a9aa4ca4885aa917fe1565e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.153303 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 91fad69dcb8d4e7b8c3dc6da0b941f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:13 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.173131 1190 ts_tablet_manager.cc:1950] T 1d825bcf365f424fb99a10afe3e96501 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:23.155030 3219 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
W20260616 19:52:23.174295 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2dfa92a1ce0448c1ba877319cdd4e9b5 consensus state has no leader
I20260616 19:52:23.160254 1192 tablet_bootstrap.cc:492] T 1142b61e40e6499e8244d71f2ad39b1e P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
W20260616 19:52:23.164767 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 196489us
I20260616 19:52:23.175274 1192 ts_tablet_manager.cc:1403] T 1142b61e40e6499e8244d71f2ad39b1e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.011s
I20260616 19:52:23.176321 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9befb557d84f3bb7781664cbf2f28f" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:23.177999 1192 raft_consensus.cc:359] T 1142b61e40e6499e8244d71f2ad39b1e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.178206 1192 raft_consensus.cc:385] T 1142b61e40e6499e8244d71f2ad39b1e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:23.186542 718 leader_election.cc:304] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters:
I20260616 19:52:23.186952 3165 raft_consensus.cc:2804] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:23.187100 3165 raft_consensus.cc:493] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:23.187243 3165 raft_consensus.cc:3060] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:23.190420 3165 raft_consensus.cc:515] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.191830 3165 leader_election.cc:290] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:23.201473 1196 tablet_bootstrap.cc:492] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:23.201639 1196 ts_tablet_manager.cc:1403] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.300s user 0.003s sys 0.001s
W20260616 19:52:23.203933 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cbbbfa65120b4b9b98ef0fc30a13f2d3 consensus state has no leader
I20260616 19:52:23.204625 458 master_service.cc:960] ReplaceTablet: received request to replace tablet fe39df8bd431402ba646f632939eba3a from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:23.205351 1196 raft_consensus.cc:359] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.205533 1196 raft_consensus.cc:385] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:23.205597 1196 raft_consensus.cc:740] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:23.205766 1196 consensus_queue.cc:260] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:23.206723 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0851460d14b64c4d91ab7318f982dba9 consensus state has no leader
I20260616 19:52:23.206818 1196 ts_tablet_manager.cc:1434] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:52:23.206948 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 03098d9d34484d5cbdd488264adbd3cf from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:23.207073 1196 tablet_bootstrap.cc:492] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:23.211556 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_323f0e585ad6419a8a9221edf79f8716" } new_table_name: "default.Table_c2fa4521145e496788ab6b135dbd246e" modify_external_catalogs: true
I20260616 19:52:23.212740 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3dea2593211d4e4c990c543a009c1ad3" } modify_external_catalogs: true
I20260616 19:52:23.212875 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3dea2593211d4e4c990c543a009c1ad3" } modify_external_catalogs: true
I20260616 19:52:23.214524 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_0d0dc8e6e8b94b42a633512f5d869265" } new_table_name: "default.Table_5f3097d551834881927a1d8a0bb1cfab" modify_external_catalogs: true
I20260616 19:52:23.215022 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c37e016be0824abbb0517ace718aed30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:23.215224 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9810eaebc13d4be7982c010c4988788e" } modify_external_catalogs: true
I20260616 19:52:23.215358 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9810eaebc13d4be7982c010c4988788e" } modify_external_catalogs: true
W20260616 19:52:23.215590 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c37e016be0824abbb0517ace718aed30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.119362 996 leader_election.cc:304] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:23.126731 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a199f25e5c4accba0acd1007fc73d1" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:23.227996 1055 raft_consensus.cc:2468] T 83a199f25e5c4accba0acd1007fc73d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
W20260616 19:52:23.227996 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 108657us
I20260616 19:52:23.127055 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf86e5d5f2341c78705f78c02695c17" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:52:23.228271 996 consensus_peers.cc:597] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:23.228323 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1266) took 4247 ms. Trace:
I20260616 19:52:23.228294 1057 raft_consensus.cc:2468] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:23.228384 1191 rpcz_store.cc:276] 0616 19:52:18.980725 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.980801 (+ 76us) service_pool.cc:224] Handling call
0616 19:52:22.499808 (+3519007us) ts_tablet_manager.cc:1151] Deleting tablet 352ca272888f4dd2ab1a8127bb8c2b6e
0616 19:52:22.499817 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.030302 (+530485us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.115869 (+ 85567us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.228307 (+112438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":465106,"tablet-delete.queue_time_us":3518828}
I20260616 19:52:23.228935 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3fbf302cbe4c5d8cc3cf8fa52baacc" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:23.229005 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3fbf302cbe4c5d8cc3cf8fa52baacc" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:23.230142 719 leader_election.cc:304] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:23.230201 3126 raft_consensus.cc:2804] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:23.230319 3126 raft_consensus.cc:697] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:23.230576 719 leader_election.cc:304] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:23.230546 3126 consensus_queue.cc:237] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:23.230901 719 leader_election.cc:343] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:23.231145 719 leader_election.cc:343] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:23.231568 3166 consensus_queue.cc:1048] T 610d6197e35e447ea25cdba2cc454b8d P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.232095 3166 raft_consensus.cc:2804] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:23.232167 3166 raft_consensus.cc:493] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:23.232231 3166 raft_consensus.cc:3060] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:23.232429 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 352ca272888f4dd2ab1a8127bb8c2b6e (table default.Table_3e975395a7f54cc6bda4ad65f522a3c2 [id=55ebc40e7e83434fadff7113c194e90d]) successfully deleted
W20260616 19:52:23.233177 993 leader_election.cc:343] T 5a9befb557d84f3bb7781664cbf2f28f P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:23.233728 993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 56706.6us
I20260616 19:52:23.234992 3166 raft_consensus.cc:515] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.235273 3237 raft_consensus.cc:2804] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:23.236197 3237 raft_consensus.cc:493] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:23.236284 3237 raft_consensus.cc:3060] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:23.238979 3237 raft_consensus.cc:515] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.235389 3177 consensus_queue.cc:1048] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.240131 3237 leader_election.cc:290] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:23.240927 3166 leader_election.cc:290] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:23.241216 3116 consensus_queue.cc:1048] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.127571 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 1eceb472cc8f4f518c82003ef455e91f (DEFAULT_TABLE table=default.Table_0da36efbb8ce483d944db33901a29766 [id=e1c4e340002245208cc1ebb62fc9c71a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.127944 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b43647aa23f401fb16ef484e710bbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.247320 1193 ts_tablet_manager.cc:1929] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:23.128872 1034 tablet_service.cc:1511] Processing CreateTablet for tablet e6cbc5215f834fbd9392cd57574ae3f7 (DEFAULT_TABLE table=default.Table_01232f43cf644a519f3a37450e610110 [id=f0a646ee88c64c3b9df7553453b35b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.248891 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6cbc5215f834fbd9392cd57574ae3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.252054 1191 tablet_replica.cc:333] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:23.252285 1191 raft_consensus.cc:2243] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:23.129388 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 37d702a538ea477ba524ea7380980f43 (DEFAULT_TABLE table=default.Table_acc65356a0ab40718b59c65302fecca8 [id=1a14eab021da4b06a92693023a8a51cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.129835 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0fa00bb250499389f34ada189391d7 (DEFAULT_TABLE table=default.Table_257e05583d3a4741b5e7b618b460e212 [id=ec2012c9c57e43a7a6d41cb5235dc131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.130620 1027 tablet_service.cc:1511] Processing CreateTablet for tablet b279025fb55448a3ac57e487fee26c9f (DEFAULT_TABLE table=default.Table_03c1908087c44e4294ede2faa0d830cc [id=3046411f8b1f4b7b95c2465077a20bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.130952 1198 tablet_bootstrap.cc:492] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:23.131049 1032 tablet_service.cc:1511] Processing CreateTablet for tablet dbc1f0a59a9c4e37b5da131faaf04233 (DEFAULT_TABLE table=default.Table_b38a7f54b0584662954227bde2b75aeb [id=089bc577e3f14d10abaff39c002261f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.131479 1030 tablet_service.cc:1511] Processing CreateTablet for tablet bcad1b80726b46949c9953c67dbce23a (DEFAULT_TABLE table=default.Table_9b0f947c2cb64fbd89900c3decc44c56 [id=b50fdbf79fb9444797edae6ae352f821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.252761 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d702a538ea477ba524ea7380980f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.252988 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b279025fb55448a3ac57e487fee26c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.132678 1026 tablet_service.cc:1511] Processing CreateTablet for tablet a778e75c6dc44f85aff4f9d75934d6c8 (DEFAULT_TABLE table=default.Table_a22790c0c8744187aefb960fb7c2c2e7 [id=8ad867c2e3694aba8ce8647fcfc63eab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.133016 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 0db1fd628cf047458664e20ab3a4d66b (DEFAULT_TABLE table=default.Table_4d937ed6c0714153993ea132f1eb2b3c [id=5e7b87ea6e424b179eaee22711702ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.133392 1040 tablet_service.cc:1511] Processing CreateTablet for tablet f22839ad451d4c43bdf8e72f0a785cc6 (DEFAULT_TABLE table=default.Table_58889a74cc6b4c8f835ac834eda1583e [id=09827ce2adbe471897a66b11ed6b9899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.136524 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa42c9623f14a84ae80542ad987af5c (DEFAULT_TABLE table=default.Table_05ada076635d40b6998e1b4787ac3d9a [id=34582017ce9e4ecf93915fe6844c6330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.136821 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cbbc95ca5f24d1381f3d1b18c89a6bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:23.137059 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 577b529dca234e07b3db1e0334fe4270 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:23.137235 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e84e5f3a0984b87ad1a4fe9bab2e427 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:22 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:23.137403 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet b57d6f12255e43ea9c35aedd388913e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 882ee6bd90ef4833a801f60ec5ecae22) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:23.258179 1198 tablet_bootstrap.cc:654] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:23.259255 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a778e75c6dc44f85aff4f9d75934d6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.263370 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eceb472cc8f4f518c82003ef455e91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.264652 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db1fd628cf047458664e20ab3a4d66b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.264816 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f22839ad451d4c43bdf8e72f0a785cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.268846 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa42c9623f14a84ae80542ad987af5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.273075 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcad1b80726b46949c9953c67dbce23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.276678 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc1f0a59a9c4e37b5da131faaf04233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.280254 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0fa00bb250499389f34ada189391d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.284017 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3fbf302cbe4c5d8cc3cf8fa52baacc" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:23.284238 921 raft_consensus.cc:3060] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:23.284564 2962 consensus_queue.cc:1048] T 5462af2002f9406b85ee20660e001a95 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.286993 921 raft_consensus.cc:2468] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:23.153846 3234 tablet.cc:1724] T da380823d0ae437d9f1d9d0f633f74bb P 61c874fef3684d10a272a9c7f280e0e2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260616 19:52:23.131852 1021 tablet_service.cc:1511] Processing CreateTablet for tablet c797ac456cc44686a878a8d8a4a21b44 (DEFAULT_TABLE table=default.Table_009cedf56a574717833b8dfa77b297f7 [id=68601561decc41f3a7a7b9e37f264bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.287503 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c797ac456cc44686a878a8d8a4a21b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.290185 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf86e5d5f2341c78705f78c02695c17" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:23.291370 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a199f25e5c4accba0acd1007fc73d1" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:23.313612 3116 consensus_queue.cc:1048] T da039dbc1089426dba1226940e37469e P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.313711 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1222) took 5857 ms. Trace:
I20260616 19:52:23.313787 1190 rpcz_store.cc:276] 0616 19:52:17.456081 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.456135 (+ 54us) service_pool.cc:224] Handling call
0616 19:52:22.521359 (+5065224us) ts_tablet_manager.cc:1151] Deleting tablet 1d825bcf365f424fb99a10afe3e96501
0616 19:52:22.521372 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:22.913073 (+391701us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.134523 (+221450us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.313693 (+179170us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5065020}
I20260616 19:52:23.314195 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1223) took 5857 ms. Trace:
I20260616 19:52:23.314303 1190 rpcz_store.cc:276] 0616 19:52:17.456506 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.456549 (+ 43us) service_pool.cc:224] Handling call
0616 19:52:23.314091 (+5857542us) ts_tablet_manager.cc:1151] Deleting tablet 9505120dd9f049c19cf2b84cabe021a6
0616 19:52:23.314099 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.314179 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5854828}
I20260616 19:52:23.314636 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1227) took 5791 ms. Trace:
I20260616 19:52:23.314720 1190 rpcz_store.cc:276] 0616 19:52:17.523684 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.523753 (+ 69us) service_pool.cc:224] Handling call
0616 19:52:23.314545 (+5790792us) ts_tablet_manager.cc:1151] Deleting tablet cefa4f3eee5b49e6b23405cfd2daabaf
0616 19:52:23.314553 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.314625 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5790585}
I20260616 19:52:23.314981 1190 tablet_replica.cc:333] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:23.315191 1190 raft_consensus.cc:2243] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:23.317394 2662 raft_consensus.cc:493] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:23.317570 2662 raft_consensus.cc:515] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:23.318164 2662 leader_election.cc:290] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:23.319950 858 leader_election.cc:343] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 5c74b39e66d344b99f8fc75b855c0520
I20260616 19:52:23.320416 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 1d825bcf365f424fb99a10afe3e96501 (table default.Table_b6f1fb47223d447fb0c0eed0f8b52102 [id=d3197da9180e47e18f4e1573504ae8c7]) successfully deleted
W20260616 19:52:23.320817 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet 9505120dd9f049c19cf2b84cabe021a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9505120dd9f049c19cf2b84cabe021a6 already in progress: creating tablet
I20260616 19:52:23.322314 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.329736 1191 raft_consensus.cc:2272] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:23.330514 1191 ts_tablet_manager.cc:1916] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260616 19:52:23.331827 445 catalog_manager.cc:5007] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): delete failed for tablet cefa4f3eee5b49e6b23405cfd2daabaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cefa4f3eee5b49e6b23405cfd2daabaf already in progress: creating tablet
I20260616 19:52:23.332437 1190 raft_consensus.cc:2272] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:23.333142 1190 ts_tablet_manager.cc:1916] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:23.347630 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bb73cdb58e944393b45a9218e3deaa8b" } modify_external_catalogs: true
I20260616 19:52:23.347867 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_bb73cdb58e944393b45a9218e3deaa8b" } modify_external_catalogs: true
I20260616 19:52:23.349355 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_271beee9b8bf4b7983773430ad7b346d" } modify_external_catalogs: true
I20260616 19:52:23.349458 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_271beee9b8bf4b7983773430ad7b346d" } modify_external_catalogs: true
W20260616 19:52:23.352276 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 25f8901f52a14e8fb7412bac53212bd6 consensus state has no leader
I20260616 19:52:23.352603 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 8c21ccda106e4c7a9906861f409a6151
I20260616 19:52:23.353072 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d8b843fe456b46aea6c6277416f24719
I20260616 19:52:23.353586 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_678e58d369004dd58c9fc0e0ced4ad20" } modify_external_catalogs: true
I20260616 19:52:23.353734 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_678e58d369004dd58c9fc0e0ced4ad20" } modify_external_catalogs: true
W20260616 19:52:23.355091 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f300180868342918598c1c3eb288c16 consensus state has no leader
I20260616 19:52:23.355400 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_520a5b0139984270971fd6fb61992bad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:23.355957 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_520a5b0139984270971fd6fb61992bad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.356875 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c21ccda106e4c7a9906861f409a6151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.357283 889 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b843fe456b46aea6c6277416f24719 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.357452 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_7fc54afa42384de79ec3d82b301d2a47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:23.357908 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fc54afa42384de79ec3d82b301d2a47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.360355 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c21ccda106e4c7a9906861f409a6151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:23.361096 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b843fe456b46aea6c6277416f24719 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:23.369772 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet fe39df8bd431402ba646f632939eba3a
I20260616 19:52:23.370338 458 catalog_manager.cc:6784] ReplaceTablet: tablet fe39df8bd431402ba646f632939eba3a deleted and replaced by tablet fd9887efbe1c4e0e9b103be823afe4b8
I20260616 19:52:23.370754 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6a7f9410388b4970b52fd27c14bccecf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:23.371289 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a7f9410388b4970b52fd27c14bccecf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.373764 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet fe39df8bd431402ba646f632939eba3a with delete_type TABLET_DATA_DELETED (replaced by tablet fd9887efbe1c4e0e9b103be823afe4b8) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:23.374346 889 tablet_service.cc:1558] Processing DeleteTablet for tablet fe39df8bd431402ba646f632939eba3a with delete_type TABLET_DATA_DELETED (replaced by tablet fd9887efbe1c4e0e9b103be823afe4b8) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.375445 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet f68719133f9340399dfdd97a07abf331
I20260616 19:52:23.376243 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_d2bc908292024b1d9232d12dea3f21d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:23.376812 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2bc908292024b1d9232d12dea3f21d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.375213 1198 tablet_bootstrap.cc:492] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:23.380849 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet f68719133f9340399dfdd97a07abf331 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:23.381067 1198 ts_tablet_manager.cc:1403] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.250s user 0.001s sys 0.008s
I20260616 19:52:23.381325 889 tablet_service.cc:1558] Processing DeleteTablet for tablet f68719133f9340399dfdd97a07abf331 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.381953 1198 raft_consensus.cc:359] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.382191 1198 raft_consensus.cc:385] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:23.382288 1198 raft_consensus.cc:740] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:23.382598 1198 consensus_queue.cc:260] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.386502 1198 ts_tablet_manager.cc:1434] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260616 19:52:23.386824 1198 tablet_bootstrap.cc:492] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:23.305004 718 leader_election.cc:304] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2
W20260616 19:52:23.396893 718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:42787, user_credentials={real_user=slave}} blocked reactor thread for 91914.2us
W20260616 19:52:23.398098 718 consensus_peers.cc:597] T 54eb61046c954a36a036b24e9e16b5c4 P 7245e7dab0ec474a876537be514c8767 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:23.398253 718 leader_election.cc:343] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:23.398406 718 leader_election.cc:343] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:23.398806 3177 raft_consensus.cc:2804] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:23.398937 3177 raft_consensus.cc:697] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:23.399188 3177 consensus_queue.cc:237] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
W20260616 19:52:23.313025 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 81643.3us
I20260616 19:52:23.342664 3165 raft_consensus.cc:493] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:23.401149 3165 raft_consensus.cc:515] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.401347 3237 consensus_queue.cc:1048] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.401697 3165 leader_election.cc:290] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:23.357049 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c21ccda106e4c7a9906861f409a6151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:23.357419 759 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b843fe456b46aea6c6277416f24719 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:23.370518 764 tablet_service.cc:1558] Processing DeleteTablet for tablet fe39df8bd431402ba646f632939eba3a with delete_type TABLET_DATA_DELETED (replaced by tablet fd9887efbe1c4e0e9b103be823afe4b8) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:23.380651 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f68719133f9340399dfdd97a07abf331 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:23.402594 860 leader_election.cc:343] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 5c74b39e66d344b99f8fc75b855c0520
I20260616 19:52:23.402710 860 leader_election.cc:304] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:23.403227 2700 raft_consensus.cc:2749] T 5c74b39e66d344b99f8fc75b855c0520 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:23.408979 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da039dbc1089426dba1226940e37469e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:23.409659 718 consensus_peers.cc:597] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:23.381595 1196 tablet_bootstrap.cc:700] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767: Time spent opening tablet: real 0.173s user 0.002s sys 0.000s
I20260616 19:52:23.410161 1196 tablet_bootstrap.cc:654] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:23.416180 1193 log.cc:1199] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/8c19c2e43a944893b86982bee1eb2f30
I20260616 19:52:23.421020 1196 tablet_bootstrap.cc:492] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:23.421268 1196 ts_tablet_manager.cc:1403] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.214s user 0.003s sys 0.001s
I20260616 19:52:23.422168 1196 raft_consensus.cc:359] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.422403 1196 raft_consensus.cc:385] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:23.422497 1196 raft_consensus.cc:740] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:23.422749 1196 consensus_queue.cc:260] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.422849 1193 ts_tablet_manager.cc:1950] T 8c19c2e43a944893b86982bee1eb2f30 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:23.424955 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1311) took 3287 ms. Trace:
I20260616 19:52:23.425078 1193 rpcz_store.cc:276] 0616 19:52:20.137665 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:20.137712 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:23.049266 (+2911554us) ts_tablet_manager.cc:1151] Deleting tablet 8c19c2e43a944893b86982bee1eb2f30
0616 19:52:23.049278 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.237667 (+188389us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.247264 (+ 9597us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.424936 (+177672us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":881,"tablet-delete.queue_time_us":2911333}
I20260616 19:52:23.425598 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 8c19c2e43a944893b86982bee1eb2f30 (table default.Table_af4ff5c6788b42c9942e0038b22cd2bf [id=12dff8f6fa4d45d3999ba67bf5584c29]) successfully deleted
I20260616 19:52:23.426045 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1309) took 3288 ms. Trace:
I20260616 19:52:23.426182 1193 rpcz_store.cc:276] 0616 19:52:20.137486 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:20.138590 (+ 1104us) service_pool.cc:224] Handling call
0616 19:52:23.425919 (+3287329us) ts_tablet_manager.cc:1151] Deleting tablet d06a8b4004d040c09bc18117494a401c
0616 19:52:23.425929 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.426022 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3287162}
W20260616 19:52:23.426656 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet d06a8b4004d040c09bc18117494a401c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d06a8b4004d040c09bc18117494a401c already in progress: creating tablet
I20260616 19:52:23.426999 1193 tablet_replica.cc:333] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:23.427232 1193 raft_consensus.cc:2243] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:23.427718 1196 ts_tablet_manager.cc:1434] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260616 19:52:23.428925 1196 tablet_bootstrap.cc:492] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
W20260616 19:52:23.454260 858 consensus_peers.cc:597] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Couldn't send request to peer 61c874fef3684d10a272a9c7f280e0e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 352ca272888f4dd2ab1a8127bb8c2b6e. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:23.456878 1198 tablet_bootstrap.cc:654] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:23.463420 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet d775748ab84144a0b9395d04ea3bd562
I20260616 19:52:23.464181 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_92ba13ce312d41f29620ddcca694a28d" } new_table_name: "default.Table_4a81e2ad784a45daa240be9e2c644e1c" modify_external_catalogs: true
I20260616 19:52:23.466409 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet d775748ab84144a0b9395d04ea3bd562 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:23.469103 889 tablet_service.cc:1558] Processing DeleteTablet for tablet d775748ab84144a0b9395d04ea3bd562 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.483455 454 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: default.Table_c56541bb35f74ff399442a37b91266f3 [id=46c822de2dc2471d847af2e018102efc] alter complete (version 6)
I20260616 19:52:23.483999 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c1f5270ae4c64309818ce61a8b5c0291"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:23.484553 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1f5270ae4c64309818ce61a8b5c0291 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.494741 1198 tablet_bootstrap.cc:492] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:23.494961 1198 ts_tablet_manager.cc:1403] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.108s user 0.005s sys 0.005s
I20260616 19:52:23.495988 1198 raft_consensus.cc:359] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.496229 1198 raft_consensus.cc:385] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:23.496335 1198 raft_consensus.cc:740] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:23.496594 1198 consensus_queue.cc:260] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.497136 1198 ts_tablet_manager.cc:1434] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260616 19:52:23.506986 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c0c8778e0f164dffb49efc8ff88ce6f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:23.507570 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0c8778e0f164dffb49efc8ff88ce6f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.508836 3221 raft_consensus.cc:493] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:23.508968 3221 raft_consensus.cc:515] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.509558 3221 leader_election.cc:290] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411)
I20260616 19:52:23.510702 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f293d557a9aa4ca4885aa917fe1565e4" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
W20260616 19:52:23.511986 858 leader_election.cc:343] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:23.513013 3221 consensus_queue.cc:1048] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.516497 1198 tablet_bootstrap.cc:492] T bc2006e262cc4bbb9b291a5bf52653cd P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:23.520104 1198 tablet_bootstrap.cc:654] T bc2006e262cc4bbb9b291a5bf52653cd P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:23.521487 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_6b844c4a5e574d50b5009e9808740cda" } new_table_name: "default.Table_291aea79e73c40eaa95a21a70e54bf9f" modify_external_catalogs: true
I20260616 19:52:23.524644 3221 consensus_queue.cc:1048] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.526036 1190 ts_tablet_manager.cc:1929] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260616 19:52:23.526175 1190 log.cc:1199] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/fe2ac7d4df6a48d6a93d40c7eef38c9c
I20260616 19:52:23.526569 1190 ts_tablet_manager.cc:1950] T fe2ac7d4df6a48d6a93d40c7eef38c9c P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:23.526880 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1228) took 6002 ms. Trace:
I20260616 19:52:23.526948 1190 rpcz_store.cc:276] 0616 19:52:17.524559 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.524607 (+ 48us) service_pool.cc:224] Handling call
0616 19:52:23.314943 (+5790336us) ts_tablet_manager.cc:1151] Deleting tablet fe2ac7d4df6a48d6a93d40c7eef38c9c
0616 19:52:23.314951 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.392689 (+ 77738us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.525975 (+133286us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.526864 (+ 889us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5790172}
I20260616 19:52:23.527276 1190 tablet_replica.cc:333] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:23.527478 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet fe2ac7d4df6a48d6a93d40c7eef38c9c (table default.Table_edb542c197924a81a6ae1a4a8a16f34a [id=1e3bc78bafc8405c8e57142c8236aef3]) successfully deleted
I20260616 19:52:23.527513 1190 raft_consensus.cc:2243] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:23.527772 1190 raft_consensus.cc:2272] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:23.529135 1190 ts_tablet_manager.cc:1916] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:23.430856 1196 tablet_bootstrap.cc:654] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:23.510249 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f293d557a9aa4ca4885aa917fe1565e4" candidate_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
W20260616 19:52:23.517122 718 consensus_peers.cc:597] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260616 19:52:23.532797 860 leader_election.cc:343] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:23.532907 860 leader_election.cc:304] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:23.466120 758 tablet_service.cc:1558] Processing DeleteTablet for tablet d775748ab84144a0b9395d04ea3bd562 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:23.533349 3221 raft_consensus.cc:2749] T f293d557a9aa4ca4885aa917fe1565e4 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:23.478860 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 77629.4us
W20260616 19:52:23.540535 718 consensus_peers.cc:597] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:23.541332 3273 consensus_queue.cc:1048] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.545275 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_97c7a90aaa9944b9ae25939f9f8c43f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:23.545792 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97c7a90aaa9944b9ae25939f9f8c43f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.550889 3221 raft_consensus.cc:493] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:23.551028 3221 raft_consensus.cc:515] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.551604 3221 leader_election.cc:290] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:23.552650 860 leader_election.cc:343] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: a8708321fb0f4c409a66df75da4c6c0e
W20260616 19:52:23.553351 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet afe118a94c3749078d8e5b919f71b04c consensus state has no leader
W20260616 19:52:23.554540 858 leader_election.cc:343] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: a8708321fb0f4c409a66df75da4c6c0e
I20260616 19:52:23.554644 858 leader_election.cc:304] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:23.555224 3145 raft_consensus.cc:2749] T a8708321fb0f4c409a66df75da4c6c0e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:23.556205 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_9a3b6fe9775847cebbad8b396935bbbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:23.556756 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a3b6fe9775847cebbad8b396935bbbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.569070 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_5dd300a732b54570b17bd1872a13fd13" } new_table_name: "default.Table_9b32e9b4aae946ccb9ccf6a43dd6021f" modify_external_catalogs: true
I20260616 19:52:23.576812 3237 consensus_queue.cc:1048] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.579243 3237 consensus_queue.cc:1048] T d1e3778611a24397a1a776be2cc76284 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.535233 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf86e5d5f2341c78705f78c02695c17" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:23.582469 1056 raft_consensus.cc:3060] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:23.583103 1196 tablet_bootstrap.cc:492] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:23.494815 1191 ts_tablet_manager.cc:1929] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:23.535856 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da039dbc1089426dba1226940e37469e" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:23.553383 3126 raft_consensus.cc:493] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:23.535768 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a199f25e5c4accba0acd1007fc73d1" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:23.583540 3126 raft_consensus.cc:515] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.583649 1050 raft_consensus.cc:3060] T 83a199f25e5c4accba0acd1007fc73d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:23.584074 3126 leader_election.cc:290] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
W20260616 19:52:23.556442 993 consensus_peers.cc:597] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:23.584649 1196 ts_tablet_manager.cc:1403] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.156s user 0.005s sys 0.000s
I20260616 19:52:23.584944 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0a6191ad334400a319778fc4e559af" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
W20260616 19:52:23.585554 993 leader_election.cc:343] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:23.587347 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0a6191ad334400a319778fc4e559af" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:23.587522 780 raft_consensus.cc:2468] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 0.
I20260616 19:52:23.588114 996 leader_election.cc:304] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:23.588459 3126 raft_consensus.cc:2804] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:23.588547 3126 raft_consensus.cc:493] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:23.588605 3126 raft_consensus.cc:3060] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:23.589846 1191 log.cc:1199] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/90bc7409e31043bd9f47d3628278a2fa
I20260616 19:52:23.590101 3237 consensus_queue.cc:1048] T 4faa62f03c2a4588a776883dc54d0426 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.590509 3221 raft_consensus.cc:493] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:23.590642 3221 raft_consensus.cc:515] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.591207 3221 leader_election.cc:290] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:23.592031 860 leader_election.cc:343] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: c48314f8e45d4b198306f0ae6e40def7
I20260616 19:52:23.592283 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_bea68566391b4258af2a2c0c6d8d068e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:23.592837 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bea68566391b4258af2a2c0c6d8d068e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:23.593196 858 leader_election.cc:343] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: c48314f8e45d4b198306f0ae6e40def7
I20260616 19:52:23.593286 858 leader_election.cc:304] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:23.593638 3221 raft_consensus.cc:2749] T c48314f8e45d4b198306f0ae6e40def7 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:23.597347 1191 ts_tablet_manager.cc:1950] T 90bc7409e31043bd9f47d3628278a2fa P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:23.478205 1193 raft_consensus.cc:2272] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:23.598950 1193 ts_tablet_manager.cc:1916] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:23.602313 719 leader_election.cc:304] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7245e7dab0ec474a876537be514c8767; no voters: 61c874fef3684d10a272a9c7f280e0e2, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:23.603525 3237 raft_consensus.cc:2749] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260616 19:52:23.604682 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3fea425b08e2452fbe30de2d64c00dde consensus state has no leader
I20260616 19:52:23.604676 3237 consensus_queue.cc:1048] T 1142b61e40e6499e8244d71f2ad39b1e P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.608918 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9155a2bee4b44dcc89a4732cfbd04ab0" } modify_external_catalogs: true
I20260616 19:52:23.609086 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_9155a2bee4b44dcc89a4732cfbd04ab0" } modify_external_catalogs: true
I20260616 19:52:23.609090 1193 ts_tablet_manager.cc:1929] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:23.609210 1193 log.cc:1199] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/28cd1ad6e8744d33a2845e9f3dda4a7b
I20260616 19:52:23.609539 1193 ts_tablet_manager.cc:1950] T 28cd1ad6e8744d33a2845e9f3dda4a7b P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:23.610291 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1310) took 3472 ms. Trace:
I20260616 19:52:23.610425 1193 rpcz_store.cc:276] 0616 19:52:20.137587 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:20.138779 (+ 1192us) service_pool.cc:224] Handling call
0616 19:52:23.426949 (+3288170us) ts_tablet_manager.cc:1151] Deleting tablet 28cd1ad6e8744d33a2845e9f3dda4a7b
0616 19:52:23.426958 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.477955 (+ 50997us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x6170000e3b70. stack: 00007f140f1b8086 00007f140f1b7e40 00007f140e1713ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f141b0cb91f 00007f141b17c46c 00007f141b1ec8c3 00007f141c538933 00007f141f0fbae7 00007f141f12ebb4 00007f141f10f5d0 00007f141f10f35d 0000000000aa681c 00007f140f1fdf6f
0616 19:52:23.602223 (+124268us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.609021 (+ 6798us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.610272 (+ 1251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114755840,"tablet-delete.queue_time_us":3288059}
I20260616 19:52:23.611136 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 28cd1ad6e8744d33a2845e9f3dda4a7b (table default.Table_5376eb58bd584cce9ea6b9260d89a57c [id=33517e3e567c4b59be27cc606c6c905c]) successfully deleted
I20260616 19:52:23.611469 1193 tablet_replica.cc:333] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:23.611697 1193 raft_consensus.cc:2243] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:23.612025 1193 raft_consensus.cc:2272] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:23.612617 1193 ts_tablet_manager.cc:1916] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:23.613293 3177 consensus_queue.cc:1048] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.633733 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_8cda9a799036458f9543a8a8aac3ee5a" } new_table_name: "default.Table_e683963a81e2477db642d40dc39a256c" modify_external_catalogs: true
I20260616 19:52:23.646595 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f7a41c7ea8ae42618e88dfbe92c30830" } modify_external_catalogs: true
I20260616 19:52:23.646783 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f7a41c7ea8ae42618e88dfbe92c30830" } modify_external_catalogs: true
I20260616 19:52:23.649827 3221 consensus_queue.cc:1048] T 0a406124a8d34e578ba94fab2a873a55 P ae28da1c4102450ab76eb2946a5cbf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.653563 1192 raft_consensus.cc:740] T 1142b61e40e6499e8244d71f2ad39b1e P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:23.657426 1056 raft_consensus.cc:2468] T daf86e5d5f2341c78705f78c02695c17 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:23.658170 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a889853940f2445aa808904c14a883e8 consensus state has no leader
I20260616 19:52:23.658671 2962 consensus_queue.cc:1048] T 3c90eb04585c4fa992435d11015ffec7 P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:23.663705 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_16b6dddb0e0844758b17a720a494e216" } new_table_name: "default.Table_8146303aca754a2ebb98c8037e8d39bc" modify_external_catalogs: true
I20260616 19:52:23.670895 3126 raft_consensus.cc:515] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.671465 3126 leader_election.cc:290] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:23.673018 3237 raft_consensus.cc:493] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:23.673200 3237 raft_consensus.cc:515] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.673837 3237 leader_election.cc:290] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:23.676105 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0a6191ad334400a319778fc4e559af" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767"
I20260616 19:52:23.676255 776 raft_consensus.cc:3060] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:23.676775 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3706f41b0e342a69f66c936173f2ae0" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2" is_pre_election: true
I20260616 19:52:23.676997 1056 raft_consensus.cc:2468] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 0.
I20260616 19:52:23.677817 719 leader_election.cc:304] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:23.678778 3237 raft_consensus.cc:2804] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:23.678900 3237 raft_consensus.cc:697] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:23.678970 776 raft_consensus.cc:2468] T 8c0a6191ad334400a319778fc4e559af P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61c874fef3684d10a272a9c7f280e0e2 in term 1.
I20260616 19:52:23.679227 3237 consensus_queue.cc:237] T daf86e5d5f2341c78705f78c02695c17 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.679695 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e1868c2834f04dda8f0cc2f8609b71d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:23.679895 996 leader_election.cc:304] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
W20260616 19:52:23.680289 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1868c2834f04dda8f0cc2f8609b71d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.680303 3126 raft_consensus.cc:2804] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:23.680429 3126 raft_consensus.cc:697] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Running, Role: LEADER
I20260616 19:52:23.680717 3126 consensus_queue.cc:237] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.686694 719 leader_election.cc:304] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters:
I20260616 19:52:23.687048 3273 raft_consensus.cc:2804] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260616 19:52:23.687192 3273 raft_consensus.cc:493] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260616 19:52:23.687340 3273 raft_consensus.cc:3060] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:23.691716 3273 raft_consensus.cc:515] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.692361 1050 raft_consensus.cc:2468] T 83a199f25e5c4accba0acd1007fc73d1 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
I20260616 19:52:23.699111 719 leader_election.cc:304] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:23.718952 3177 raft_consensus.cc:2804] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:23.719959 3177 raft_consensus.cc:697] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:23.720837 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1267) took 4739 ms. Trace:
I20260616 19:52:23.720849 3177 consensus_queue.cc:237] T 83a199f25e5c4accba0acd1007fc73d1 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.720930 1191 rpcz_store.cc:276] 0616 19:52:18.981238 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.981285 (+ 47us) service_pool.cc:224] Handling call
0616 19:52:23.228696 (+4247411us) ts_tablet_manager.cc:1151] Deleting tablet 90bc7409e31043bd9f47d3628278a2fa
0616 19:52:23.228707 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.387107 (+158400us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.494760 (+107653us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.720819 (+226059us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4247253}
I20260616 19:52:23.721329 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 90bc7409e31043bd9f47d3628278a2fa (table default.Table_a4a6f573af0d49d58db91ad41beb2ac1 [id=f120198cf70040b982289f0a239f2e5c]) successfully deleted
I20260616 19:52:23.721709 1191 tablet_replica.cc:333] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:23.722431 1191 raft_consensus.cc:2243] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:23.723125 1191 raft_consensus.cc:2272] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:23.724162 1191 ts_tablet_manager.cc:1916] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:23.725600 3273 leader_election.cc:290] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Requested vote from peers 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:23.701277 1196 raft_consensus.cc:359] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.703933 1193 ts_tablet_manager.cc:1929] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:23.727599 1193 log.cc:1199] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/4fc0c02ef58d4e429855e5bbaa4752ad
I20260616 19:52:23.728163 1193 ts_tablet_manager.cc:1950] T 4fc0c02ef58d4e429855e5bbaa4752ad P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:23.727452 1196 raft_consensus.cc:385] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:23.728574 1196 raft_consensus.cc:740] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:23.728921 1196 consensus_queue.cc:260] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.728881 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3706f41b0e342a69f66c936173f2ae0" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c874fef3684d10a272a9c7f280e0e2"
I20260616 19:52:23.736322 1051 raft_consensus.cc:3060] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:23.745512 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1312) took 3607 ms. Trace:
I20260616 19:52:23.745675 1193 rpcz_store.cc:276] 0616 19:52:20.137780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:20.138909 (+ 1129us) service_pool.cc:224] Handling call
0616 19:52:23.611423 (+3472514us) ts_tablet_manager.cc:1151] Deleting tablet 4fc0c02ef58d4e429855e5bbaa4752ad
0616 19:52:23.611432 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.678154 (+ 66722us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.703873 (+ 25719us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.745491 (+ 41618us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3472375}
I20260616 19:52:23.746167 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 4fc0c02ef58d4e429855e5bbaa4752ad (table default.Table_98561738ee7d4ad8bf14170c99d01b96 [id=601faf6d488e40c584a3537834653ae9]) successfully deleted
I20260616 19:52:23.746692 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1318) took 3531 ms. Trace:
I20260616 19:52:23.746827 1193 rpcz_store.cc:276] 0616 19:52:20.215029 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:20.215078 (+ 49us) service_pool.cc:224] Handling call
0616 19:52:23.746457 (+3531379us) ts_tablet_manager.cc:1151] Deleting tablet 04f54a486d4b46248ef9eb7d9c67606a
0616 19:52:23.746466 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.746676 (+ 210us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3531206}
W20260616 19:52:23.747272 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 04f54a486d4b46248ef9eb7d9c67606a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04f54a486d4b46248ef9eb7d9c67606a already in progress: creating tablet
I20260616 19:52:23.756860 453 catalog_manager.cc:5696] T 5462af2002f9406b85ee20660e001a95 P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131). New cstate: current_term: 1 leader_uuid: "61c874fef3684d10a272a9c7f280e0e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } }
I20260616 19:52:23.757308 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 5462af2002f9406b85ee20660e001a95 (table default.Table_52c372106d354fba9e90c5be75714312 [id=d2574a03769945e99b662ed1015b2703]). Expected version 1 got 0
I20260616 19:52:23.757561 453 catalog_manager.cc:5696] T da039dbc1089426dba1226940e37469e P ae28da1c4102450ab76eb2946a5cbf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131). New cstate: current_term: 1 leader_uuid: "61c874fef3684d10a272a9c7f280e0e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } }
I20260616 19:52:23.757889 453 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet da039dbc1089426dba1226940e37469e (table default.Table_88aaf292b9144d75a8bea47d896a63bf [id=f223ad08623343aeb681a65b744d2476]). Expected version 1 got 0
I20260616 19:52:23.760821 758 tablet_service.cc:1511] Processing CreateTablet for tablet a3fa3b8b341f413d8ea0496c295d2ca9 (DEFAULT_TABLE table=default.Table_511a88d0bc7d41a1abb0d969e99d67f2 [id=a0186075777744e597dd7b33109c1285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.761238 3325 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.188:34219 every 8 connection(s)
I20260616 19:52:23.761572 2774 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.188:34219
I20260616 19:52:23.762501 764 tablet_service.cc:1511] Processing CreateTablet for tablet abc9e02174434363977a77fbe9c4992e (DEFAULT_TABLE table=default.Table_7c13eda9355d4c7b9afab94974ec41d0 [id=c6c7e04be00d4daf9c08a0a27406ea69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.763616 759 tablet_service.cc:1511] Processing CreateTablet for tablet e51ac8e2dd0c4918980ece25c75d7359 (DEFAULT_TABLE table=default.Table_005105e1e70940179d673f31a9bd3ba9 [id=846b4ae11ce643abb01dc825f2417e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.763752 2774 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/master-2/data/info.pb
I20260616 19:52:23.763782 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1317) took 3550 ms. Trace:
I20260616 19:52:23.763841 1193 rpcz_store.cc:276] 0616 19:52:20.213019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:20.215985 (+ 2966us) service_pool.cc:224] Handling call
0616 19:52:23.747529 (+3531544us) ts_tablet_manager.cc:1151] Deleting tablet c2aef4e720784161927386e48b79286e
0616 19:52:23.762925 (+ 15396us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.763122 (+ 197us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3531372}
W20260616 19:52:23.764417 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet c2aef4e720784161927386e48b79286e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2aef4e720784161927386e48b79286e already in progress: creating tablet
I20260616 19:52:23.766474 751 tablet_service.cc:1511] Processing CreateTablet for tablet 8439e4138e264ab0b4eec50e5a34cf5b (DEFAULT_TABLE table=default.Table_7d0ee1a50ca4433fba8c946527f0f596 [id=c1896e1ad0544edfb1cff0b2713e8562]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.766508 1025 tablet_service.cc:1511] Processing CreateTablet for tablet abc9e02174434363977a77fbe9c4992e (DEFAULT_TABLE table=default.Table_7c13eda9355d4c7b9afab94974ec41d0 [id=c6c7e04be00d4daf9c08a0a27406ea69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.766889 1021 tablet_service.cc:1511] Processing CreateTablet for tablet e51ac8e2dd0c4918980ece25c75d7359 (DEFAULT_TABLE table=default.Table_005105e1e70940179d673f31a9bd3ba9 [id=846b4ae11ce643abb01dc825f2417e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.766908 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc9e02174434363977a77fbe9c4992e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.766889 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a3fa3b8b341f413d8ea0496c295d2ca9 (DEFAULT_TABLE table=default.Table_511a88d0bc7d41a1abb0d969e99d67f2 [id=a0186075777744e597dd7b33109c1285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.768252 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3fa3b8b341f413d8ea0496c295d2ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.771373 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51ac8e2dd0c4918980ece25c75d7359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.773989 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasknFdngH/build/asan/bin/kudu as pid 2774
I20260616 19:52:23.672258 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0a6191ad334400a319778fc4e559af" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
I20260616 19:52:23.792526 1192 consensus_queue.cc:260] T 1142b61e40e6499e8244d71f2ad39b1e P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.693329 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3706f41b0e342a69f66c936173f2ae0" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e"
W20260616 19:52:23.708833 860 consensus_peers.cc:597] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn't send request to peer 7245e7dab0ec474a876537be514c8767. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:23.793077 1192 ts_tablet_manager.cc:1434] T 1142b61e40e6499e8244d71f2ad39b1e P ae28da1c4102450ab76eb2946a5cbf2e: Time spent starting tablet: real 0.618s user 0.023s sys 0.000s
I20260616 19:52:23.761427 889 tablet_service.cc:1511] Processing CreateTablet for tablet a3fa3b8b341f413d8ea0496c295d2ca9 (DEFAULT_TABLE table=default.Table_511a88d0bc7d41a1abb0d969e99d67f2 [id=a0186075777744e597dd7b33109c1285]), partition=RANGE (key) PARTITION UNBOUNDED
W20260616 19:52:23.793169 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:46411, user_credentials={real_user=slave}} blocked reactor thread for 84370.3us
W20260616 19:52:23.793995 993 leader_election.cc:343] T 8c0a6191ad334400a319778fc4e559af P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
W20260616 19:52:23.796815 718 leader_election.cc:343] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:23.771839 1190 ts_tablet_manager.cc:1929] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:23.797220 1190 log.cc:1199] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/40bdb01a15254c329d82f0d40919b880
I20260616 19:52:23.797593 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3fa3b8b341f413d8ea0496c295d2ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.801512 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc9e02174434363977a77fbe9c4992e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.804677 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51ac8e2dd0c4918980ece25c75d7359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.811791 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8439e4138e264ab0b4eec50e5a34cf5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.815388 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1323) took 3425 ms. Trace:
I20260616 19:52:23.815497 1193 rpcz_store.cc:276] 0616 19:52:20.390120 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:20.404519 (+ 14399us) service_pool.cc:224] Handling call
0616 19:52:23.765318 (+3360799us) ts_tablet_manager.cc:1151] Deleting tablet 191965ba869541fca128dcb93fe8e5b5
0616 19:52:23.811566 (+ 46248us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.815361 (+ 3795us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3360422}
W20260616 19:52:23.816095 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 191965ba869541fca128dcb93fe8e5b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 191965ba869541fca128dcb93fe8e5b5 already in progress: creating tablet
I20260616 19:52:23.816895 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1324) took 3420 ms. Trace:
I20260616 19:52:23.818112 1193 rpcz_store.cc:276] 0616 19:52:20.396868 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:20.484097 (+ 87229us) service_pool.cc:224] Handling call
0616 19:52:23.816753 (+3332656us) ts_tablet_manager.cc:1151] Deleting tablet 24278ccfca6742aa8972d2b3d2c612d4
0616 19:52:23.816767 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.816872 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3301590}
W20260616 19:52:23.819152 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 24278ccfca6742aa8972d2b3d2c612d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24278ccfca6742aa8972d2b3d2c612d4 already in progress: creating tablet
I20260616 19:52:23.819653 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1326) took 3338 ms. Trace:
I20260616 19:52:23.820097 1193 rpcz_store.cc:276] 0616 19:52:20.480971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:20.515208 (+ 34237us) service_pool.cc:224] Handling call
0616 19:52:23.819525 (+3304317us) ts_tablet_manager.cc:1151] Deleting tablet 50797706bd3a40099d64c292c32bf1f0
0616 19:52:23.819537 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.819632 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3236588}
W20260616 19:52:23.821346 448 catalog_manager.cc:5007] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): delete failed for tablet 50797706bd3a40099d64c292c32bf1f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50797706bd3a40099d64c292c32bf1f0 already in progress: creating tablet
I20260616 19:52:23.822863 3326 sys_catalog.cc:263] Verifying existing consensus state
I20260616 19:52:23.785320 903 tablet_service.cc:1511] Processing CreateTablet for tablet e51ac8e2dd0c4918980ece25c75d7359 (DEFAULT_TABLE table=default.Table_005105e1e70940179d673f31a9bd3ba9 [id=846b4ae11ce643abb01dc825f2417e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.785634 885 tablet_service.cc:1511] Processing CreateTablet for tablet 8439e4138e264ab0b4eec50e5a34cf5b (DEFAULT_TABLE table=default.Table_7d0ee1a50ca4433fba8c946527f0f596 [id=c1896e1ad0544edfb1cff0b2713e8562]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.674510 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3706f41b0e342a69f66c936173f2ae0" candidate_uuid: "7245e7dab0ec474a876537be514c8767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:23.784950 900 tablet_service.cc:1511] Processing CreateTablet for tablet abc9e02174434363977a77fbe9c4992e (DEFAULT_TABLE table=default.Table_7c13eda9355d4c7b9afab94974ec41d0 [id=c6c7e04be00d4daf9c08a0a27406ea69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.830412 1190 ts_tablet_manager.cc:1950] T 40bdb01a15254c329d82f0d40919b880 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:23.803399 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3fa3b8b341f413d8ea0496c295d2ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.829576 898 tablet_service.cc:1511] Processing CreateTablet for tablet 2d2b51c7727344e98c58190738f0dbbd (DEFAULT_TABLE table=default.Table_5cc8bbc6835d4a33a0d3e91245da3096 [id=4328e58bc3bd409489110807dcda9416]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.829645 888 tablet_service.cc:1511] Processing CreateTablet for tablet 82757fd3d1624b7483fd7416735abc10 (DEFAULT_TABLE table=default.Table_4d5f1ebe3db245b0a974c41a5c38d0c1 [id=d130ae17878840c696bed8217c5249bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.830824 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d2b51c7727344e98c58190738f0dbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.831059 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82757fd3d1624b7483fd7416735abc10. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:23.835170 718 leader_election.cc:343] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Illegal state: must be running to vote when last-logged opid is not known
I20260616 19:52:23.835116 747 tablet_service.cc:1511] Processing CreateTablet for tablet 82757fd3d1624b7483fd7416735abc10 (DEFAULT_TABLE table=default.Table_4d5f1ebe3db245b0a974c41a5c38d0c1 [id=d130ae17878840c696bed8217c5249bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.835606 746 tablet_service.cc:1511] Processing CreateTablet for tablet 2d2b51c7727344e98c58190738f0dbbd (DEFAULT_TABLE table=default.Table_5cc8bbc6835d4a33a0d3e91245da3096 [id=4328e58bc3bd409489110807dcda9416]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.835994 765 tablet_service.cc:1511] Processing CreateTablet for tablet cac9a722ca4a462f9547065c6f4907d7 (DEFAULT_TABLE table=default.Table_fb6e0f1c1a21489a9aacd2329cf3b9e3 [id=4d0b3ab0480d4266baa51e74ab65a977]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.836647 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc9e02174434363977a77fbe9c4992e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.838644 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1233) took 5987 ms. Trace:
I20260616 19:52:23.838729 1190 rpcz_store.cc:276] 0616 19:52:17.850921 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.850967 (+ 46us) service_pool.cc:224] Handling call
0616 19:52:23.527205 (+5676238us) ts_tablet_manager.cc:1151] Deleting tablet 40bdb01a15254c329d82f0d40919b880
0616 19:52:23.527217 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.621860 (+ 94643us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.771772 (+149912us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.838630 (+ 66858us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5676057}
I20260616 19:52:23.839066 1190 tablet_replica.cc:333] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:23.839234 1190 raft_consensus.cc:2243] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:23.839555 1190 raft_consensus.cc:2272] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:23.840139 1190 ts_tablet_manager.cc:1916] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:23.840754 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 40bdb01a15254c329d82f0d40919b880 (table default.Table_d2ddb45a3fbb446689cb737dcb4fbc12 [id=ccddc1e63f194e539a50d511f05eff8a]) successfully deleted
I20260616 19:52:23.840418 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8439e4138e264ab0b4eec50e5a34cf5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.847499 1190 ts_tablet_manager.cc:1929] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:23.847594 1190 log.cc:1199] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-1/wal/wals/43b4c3bd370749b18fb86f7a0aae2c50
I20260616 19:52:23.847903 1190 ts_tablet_manager.cc:1950] T 43b4c3bd370749b18fb86f7a0aae2c50 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting consensus metadata
I20260616 19:52:23.848163 1190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48636 (request call id 1234) took 5996 ms. Trace:
I20260616 19:52:23.848237 1190 rpcz_store.cc:276] 0616 19:52:17.851425 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:17.851466 (+ 41us) service_pool.cc:224] Handling call
0616 19:52:23.839021 (+5987555us) ts_tablet_manager.cc:1151] Deleting tablet 43b4c3bd370749b18fb86f7a0aae2c50
0616 19:52:23.839031 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.844979 (+ 5948us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.847456 (+ 2477us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.848148 (+ 692us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5987412}
I20260616 19:52:23.848608 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51ac8e2dd0c4918980ece25c75d7359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.850244 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 8439e4138e264ab0b4eec50e5a34cf5b (DEFAULT_TABLE table=default.Table_7d0ee1a50ca4433fba8c946527f0f596 [id=c1896e1ad0544edfb1cff0b2713e8562]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.850649 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8439e4138e264ab0b4eec50e5a34cf5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.852834 445 catalog_manager.cc:5027] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): tablet 43b4c3bd370749b18fb86f7a0aae2c50 (table default.Table_7ad7ef9c768d41edaa47c8cd68466731 [id=217c0ab9c81b4dae8666abc02dfeb60b]) successfully deleted
I20260616 19:52:23.854060 1196 ts_tablet_manager.cc:1434] T 91fad69dcb8d4e7b8c3dc6da0b941f5c P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.269s user 0.009s sys 0.001s
I20260616 19:52:23.859668 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 2d2b51c7727344e98c58190738f0dbbd (DEFAULT_TABLE table=default.Table_5cc8bbc6835d4a33a0d3e91245da3096 [id=4328e58bc3bd409489110807dcda9416]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.860383 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d2b51c7727344e98c58190738f0dbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.863178 1022 tablet_service.cc:1511] Processing CreateTablet for tablet cac9a722ca4a462f9547065c6f4907d7 (DEFAULT_TABLE table=default.Table_fb6e0f1c1a21489a9aacd2329cf3b9e3 [id=4d0b3ab0480d4266baa51e74ab65a977]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.863529 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac9a722ca4a462f9547065c6f4907d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.863830 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 82757fd3d1624b7483fd7416735abc10 (DEFAULT_TABLE table=default.Table_4d5f1ebe3db245b0a974c41a5c38d0c1 [id=d130ae17878840c696bed8217c5249bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.864111 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82757fd3d1624b7483fd7416735abc10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.865459 753 tablet_service.cc:1511] Processing CreateTablet for tablet b0d543da47b14673848d56661a96db58 (DEFAULT_TABLE table=default.Table_671a5d7432df46509cd6770d03c2ae6b [id=4ce21c59d8924a9ebd82657d25282755]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.871711 1193 tablet_replica.cc:333] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:23.872017 1193 raft_consensus.cc:2243] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:23.872229 1193 raft_consensus.cc:2272] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:23.872849 1193 ts_tablet_manager.cc:1916] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:23.873057 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a9f778dbd18d49379fbd6ffa4d08db6d" } modify_external_catalogs: true
I20260616 19:52:23.873260 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_a9f778dbd18d49379fbd6ffa4d08db6d" } modify_external_catalogs: true
I20260616 19:52:23.880582 1193 ts_tablet_manager.cc:1929] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:23.880777 1193 log.cc:1199] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/352ca272888f4dd2ab1a8127bb8c2b6e
I20260616 19:52:23.881373 1193 ts_tablet_manager.cc:1950] T 352ca272888f4dd2ab1a8127bb8c2b6e P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:23.884922 1051 raft_consensus.cc:2468] T c3706f41b0e342a69f66c936173f2ae0 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7245e7dab0ec474a876537be514c8767 in term 1.
W20260616 19:52:23.886729 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4970ac68130e40fa8288c8c74f705378 consensus state has no leader
I20260616 19:52:23.887005 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 76c48e233d184487b7651e9cb105c2cc from {username='slave'} at 127.0.0.1:41696
I20260616 19:52:23.887579 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 03098d9d34484d5cbdd488264adbd3cf
I20260616 19:52:23.887966 456 catalog_manager.cc:6784] ReplaceTablet: tablet 03098d9d34484d5cbdd488264adbd3cf deleted and replaced by tablet 68ab931aa64b4a0fa58e71cb646211c0
I20260616 19:52:23.891198 893 tablet_service.cc:1511] Processing CreateTablet for tablet b0d543da47b14673848d56661a96db58 (DEFAULT_TABLE table=default.Table_671a5d7432df46509cd6770d03c2ae6b [id=4ce21c59d8924a9ebd82657d25282755]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.892879 1021 tablet_service.cc:1511] Processing CreateTablet for tablet b0d543da47b14673848d56661a96db58 (DEFAULT_TABLE table=default.Table_671a5d7432df46509cd6770d03c2ae6b [id=4ce21c59d8924a9ebd82657d25282755]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.893693 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 03098d9d34484d5cbdd488264adbd3cf with delete_type TABLET_DATA_DELETED (replaced by tablet 68ab931aa64b4a0fa58e71cb646211c0) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.895800 898 tablet_service.cc:1511] Processing CreateTablet for tablet 572a7c469a894e6e8a9333b78f8a564e (DEFAULT_TABLE table=default.Table_c9fee0c747ca409ea7fe1dd19294ace8 [id=ecc73c78d4b14a308f3ec12c627b8e05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.896219 900 tablet_service.cc:1511] Processing CreateTablet for tablet cac9a722ca4a462f9547065c6f4907d7 (DEFAULT_TABLE table=default.Table_fb6e0f1c1a21489a9aacd2329cf3b9e3 [id=4d0b3ab0480d4266baa51e74ab65a977]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.897889 1105 heartbeater.cc:344] Connected to a master server at 127.0.105.188:34219
I20260616 19:52:23.901824 895 tablet_service.cc:1511] Processing CreateTablet for tablet a3305009232443ce933452e03255f955 (DEFAULT_TABLE table=default.Table_02efbb98552d4e9a992a27e5e7b51110 [id=aa582a0d5abd4433b7a9f1d91a4a56c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.902037 1025 tablet_service.cc:1511] Processing CreateTablet for tablet a3305009232443ce933452e03255f955 (DEFAULT_TABLE table=default.Table_02efbb98552d4e9a992a27e5e7b51110 [id=aa582a0d5abd4433b7a9f1d91a4a56c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.902611 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3305009232443ce933452e03255f955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.901820 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 03098d9d34484d5cbdd488264adbd3cf with delete_type TABLET_DATA_DELETED (replaced by tablet 68ab931aa64b4a0fa58e71cb646211c0) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:23.901685 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 572a7c469a894e6e8a9333b78f8a564e (DEFAULT_TABLE table=default.Table_c9fee0c747ca409ea7fe1dd19294ace8 [id=ecc73c78d4b14a308f3ec12c627b8e05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.905077 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572a7c469a894e6e8a9333b78f8a564e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.910682 901 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbd22f0ac144f72b6d2e602002c91a8 (DEFAULT_TABLE table=default.Table_a41d72c27346424094e075a0f485e5ee [id=dc7250a0d80c4aa28ad8b5c22c9f8ecc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.916204 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbd22f0ac144f72b6d2e602002c91a8 (DEFAULT_TABLE table=default.Table_a41d72c27346424094e075a0f485e5ee [id=dc7250a0d80c4aa28ad8b5c22c9f8ecc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.917263 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbd22f0ac144f72b6d2e602002c91a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.917330 899 tablet_service.cc:1511] Processing CreateTablet for tablet 19d62c2293284ff8adb3c79d5f8f07c2 (DEFAULT_TABLE table=default.Table_c9937edc05884c318c39cb7cd7184b85 [id=819ea35ef8804a558f97d7fa6cf93343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.917845 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 19d62c2293284ff8adb3c79d5f8f07c2 (DEFAULT_TABLE table=default.Table_c9937edc05884c318c39cb7cd7184b85 [id=819ea35ef8804a558f97d7fa6cf93343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.918629 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d62c2293284ff8adb3c79d5f8f07c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.920368 902 tablet_service.cc:1511] Processing CreateTablet for tablet 3d239af45a224aecaefa1dc8a787d4e5 (DEFAULT_TABLE table=default.Table_b22e6fce6e0b43e09d11fca821f0934d [id=18764e6357dc4add8e6f90a6ef0c65cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.920418 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 3d239af45a224aecaefa1dc8a787d4e5 (DEFAULT_TABLE table=default.Table_b22e6fce6e0b43e09d11fca821f0934d [id=18764e6357dc4add8e6f90a6ef0c65cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.920747 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d239af45a224aecaefa1dc8a787d4e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.921931 1198 tablet_bootstrap.cc:492] T bc2006e262cc4bbb9b291a5bf52653cd P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:23.922116 1198 ts_tablet_manager.cc:1403] T bc2006e262cc4bbb9b291a5bf52653cd P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.406s user 0.012s sys 0.002s
I20260616 19:52:23.923027 896 tablet_service.cc:1511] Processing CreateTablet for tablet f61ac677d890487e8d6f478146a0b527 (DEFAULT_TABLE table=default.Table_2c2be2e62d114c318e2d9fe6b6f2421f [id=7246d1b3c155431fa46c4624e274e5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.930265 1029 tablet_service.cc:1511] Processing CreateTablet for tablet f61ac677d890487e8d6f478146a0b527 (DEFAULT_TABLE table=default.Table_2c2be2e62d114c318e2d9fe6b6f2421f [id=7246d1b3c155431fa46c4624e274e5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.931041 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61ac677d890487e8d6f478146a0b527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.923815 1198 raft_consensus.cc:359] T bc2006e262cc4bbb9b291a5bf52653cd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.931655 1198 raft_consensus.cc:385] T bc2006e262cc4bbb9b291a5bf52653cd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:23.931845 1198 raft_consensus.cc:740] T bc2006e262cc4bbb9b291a5bf52653cd P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:23.932379 1198 consensus_queue.cc:260] T bc2006e262cc4bbb9b291a5bf52653cd P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.892930 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 03098d9d34484d5cbdd488264adbd3cf with delete_type TABLET_DATA_DELETED (replaced by tablet 68ab931aa64b4a0fa58e71cb646211c0) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:23.893709 719 leader_election.cc:304] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767; no voters: ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:23.895226 761 tablet_service.cc:1511] Processing CreateTablet for tablet 572a7c469a894e6e8a9333b78f8a564e (DEFAULT_TABLE table=default.Table_c9fee0c747ca409ea7fe1dd19294ace8 [id=ecc73c78d4b14a308f3ec12c627b8e05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.934546 886 tablet_service.cc:1511] Processing CreateTablet for tablet 74a52fe3f0594b379d770797bfcf601e (DEFAULT_TABLE table=default.Table_922b2f64bba34026a097e8cfed2b655d [id=92bfd9ffc8984afba3c757f5b1adcb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.895409 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82757fd3d1624b7483fd7416735abc10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.936839 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d2b51c7727344e98c58190738f0dbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.940335 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572a7c469a894e6e8a9333b78f8a564e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.940871 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac9a722ca4a462f9547065c6f4907d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.941463 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 3ebd245b36b94e5b94c48fd368a1e4ef
I20260616 19:52:23.942539 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 32bf8c116d6d4c8780dc6aecb2570f9a
I20260616 19:52:23.944039 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ebd245b36b94e5b94c48fd368a1e4ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.944504 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 32bf8c116d6d4c8780dc6aecb2570f9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.945498 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d543da47b14673848d56661a96db58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.947868 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 74a52fe3f0594b379d770797bfcf601e (DEFAULT_TABLE table=default.Table_922b2f64bba34026a097e8cfed2b655d [id=92bfd9ffc8984afba3c757f5b1adcb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.948066 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet bb02ec3fe424408aa60f74517203146a
I20260616 19:52:23.948253 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a52fe3f0594b379d770797bfcf601e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.951704 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 76c48e233d184487b7651e9cb105c2cc (table default.Table_8640034462d64b5d879d28e067fe1b14 [id=d24b6a6d28c949b2880a34bfa227c585]). Expected version 2 got 0
I20260616 19:52:23.951949 461 catalog_manager.cc:5696] T 9800df09eecb4a299a6facf8b85a93e4 P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:23.953121 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ebd245b36b94e5b94c48fd368a1e4ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:23.952404 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet e85e2861c41f402d88cafe64a6871429 (table default.Table_66d56024dca749dfb6300ffa4cb0dec9 [id=02a85fe82ed24f6b949c0ded2d9a7d5e]). Expected version 1 got 0
I20260616 19:52:23.954136 461 catalog_manager.cc:5696] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7245e7dab0ec474a876537be514c8767 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "7245e7dab0ec474a876537be514c8767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260616 19:52:23.954478 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 26503d1293be438dae39fa1e1ea1885b (table default.Table_ccb660ffb17a4a01840efa8c374603d8 [id=467b42cd85544c589d2cf3f9eaf21754]). Expected version 2 got 0
I20260616 19:52:23.954856 461 catalog_manager.cc:5788] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411) does not have the latest schema for tablet 61132c1c9cd24b7d923f1d65ad04c340 (table default.Table_9eb13a45afad449a9bf9b25a0f5d4d1d [id=e8db7417fd294af4b160a434625e9fd0]). Expected version 2 got 0
I20260616 19:52:23.954941 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 32bf8c116d6d4c8780dc6aecb2570f9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:23.955798 3318 raft_consensus.cc:2804] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Leader election won for term 1
I20260616 19:52:23.955919 3318 raft_consensus.cc:697] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Becoming Leader. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Running, Role: LEADER
I20260616 19:52:23.956128 3318 consensus_queue.cc:237] T c3706f41b0e342a69f66c936173f2ae0 P 7245e7dab0ec474a876537be514c8767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.956405 890 tablet_service.cc:1558] Processing DeleteTablet for tablet bb02ec3fe424408aa60f74517203146a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.956914 890 tablet_service.cc:1558] Processing DeleteTablet for tablet fe2ac7d4df6a48d6a93d40c7eef38c9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:17 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:23.957808 754 tablet_service.cc:1558] Processing DeleteTablet for tablet bb02ec3fe424408aa60f74517203146a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:23.959272 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f23ea74ac0fe43bebde78acffb4c1a04" } modify_external_catalogs: true
I20260616 19:52:23.959345 761 tablet_service.cc:1511] Processing CreateTablet for tablet 93c016b8453e488591ec1abba2f3270b (DEFAULT_TABLE table=default.Table_869029b8c3a444579bb7aac23503358b [id=f77b687fc2f04456a25454b9fca36157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.959434 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_f23ea74ac0fe43bebde78acffb4c1a04" } modify_external_catalogs: true
I20260616 19:52:23.959514 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_a16d6018f349477cba91d5c2ae37a141"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:23.959704 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c016b8453e488591ec1abba2f3270b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:23.960044 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a16d6018f349477cba91d5c2ae37a141 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.960779 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_3e1dcfe4518549b894954f78c6d060d2" } new_table_name: "default.Table_ad704105426243838c69041c540c42a9" modify_external_catalogs: true
I20260616 19:52:23.961391 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_ba58e232b21e44739ae72c26a513d702"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:23.962039 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba58e232b21e44739ae72c26a513d702 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:23.962266 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:37571, user_credentials={real_user=slave}} blocked reactor thread for 68583.5us
I20260616 19:52:23.963303 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_99f724c98b3c4df6a3c2818194386279"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:23.963800 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99f724c98b3c4df6a3c2818194386279 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.902231 751 tablet_service.cc:1511] Processing CreateTablet for tablet a3305009232443ce933452e03255f955 (DEFAULT_TABLE table=default.Table_02efbb98552d4e9a992a27e5e7b51110 [id=aa582a0d5abd4433b7a9f1d91a4a56c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.964787 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3305009232443ce933452e03255f955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.965577 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_0218d3534a5942f786d0ae51445500df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:23.966105 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0218d3534a5942f786d0ae51445500df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:23.906092 1196 tablet_bootstrap.cc:492] T 93c940bd14a040ddba5ea058e732bf0c P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:23.970153 1196 tablet_bootstrap.cc:654] T 93c940bd14a040ddba5ea058e732bf0c P 7245e7dab0ec474a876537be514c8767: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:23.974949 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ebd245b36b94e5b94c48fd368a1e4ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:23.910555 758 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbd22f0ac144f72b6d2e602002c91a8 (DEFAULT_TABLE table=default.Table_a41d72c27346424094e075a0f485e5ee [id=dc7250a0d80c4aa28ad8b5c22c9f8ecc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.976514 890 tablet_service.cc:1511] Processing CreateTablet for tablet 93c016b8453e488591ec1abba2f3270b (DEFAULT_TABLE table=default.Table_869029b8c3a444579bb7aac23503358b [id=f77b687fc2f04456a25454b9fca36157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.917191 764 tablet_service.cc:1511] Processing CreateTablet for tablet 19d62c2293284ff8adb3c79d5f8f07c2 (DEFAULT_TABLE table=default.Table_c9937edc05884c318c39cb7cd7184b85 [id=819ea35ef8804a558f97d7fa6cf93343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.919651 763 tablet_service.cc:1511] Processing CreateTablet for tablet 3d239af45a224aecaefa1dc8a787d4e5 (DEFAULT_TABLE table=default.Table_b22e6fce6e0b43e09d11fca821f0934d [id=18764e6357dc4add8e6f90a6ef0c65cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.977108 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d239af45a224aecaefa1dc8a787d4e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.927799 752 tablet_service.cc:1511] Processing CreateTablet for tablet f61ac677d890487e8d6f478146a0b527 (DEFAULT_TABLE table=default.Table_2c2be2e62d114c318e2d9fe6b6f2421f [id=7246d1b3c155431fa46c4624e274e5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.934064 762 tablet_service.cc:1511] Processing CreateTablet for tablet 74a52fe3f0594b379d770797bfcf601e (DEFAULT_TABLE table=default.Table_922b2f64bba34026a097e8cfed2b655d [id=92bfd9ffc8984afba3c757f5b1adcb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.981153 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a52fe3f0594b379d770797bfcf601e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.983047 894 tablet_service.cc:1511] Processing CreateTablet for tablet d3aafb063b294eb08fd1727753722fdb (DEFAULT_TABLE table=default.Table_3f99dd18dc7f47eab04d25ddc25b8e4d [id=e3cf753a89194afabcbd96ba9e8166ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.983791 746 tablet_service.cc:1511] Processing CreateTablet for tablet 882ee6bd90ef4833a801f60ec5ecae22 (DEFAULT_TABLE table=default.Table_54440d81ff5a4fa59cde855e84964b07 [id=a0e1c937560640a087e727ca05e90f02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.984166 891 tablet_service.cc:1511] Processing CreateTablet for tablet 882ee6bd90ef4833a801f60ec5ecae22 (DEFAULT_TABLE table=default.Table_54440d81ff5a4fa59cde855e84964b07 [id=a0e1c937560640a087e727ca05e90f02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.984577 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882ee6bd90ef4833a801f60ec5ecae22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.984726 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61ac677d890487e8d6f478146a0b527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.985438 747 tablet_service.cc:1511] Processing CreateTablet for tablet 18195591bb2d4cc9989d4798528c29b3 (DEFAULT_TABLE table=default.Table_53d08888495247c286bec025bc90c392 [id=b279d0ac123d40ebaeba3ffeaec0b5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.985706 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18195591bb2d4cc9989d4798528c29b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.988802 904 tablet_service.cc:1511] Processing CreateTablet for tablet 18195591bb2d4cc9989d4798528c29b3 (DEFAULT_TABLE table=default.Table_53d08888495247c286bec025bc90c392 [id=b279d0ac123d40ebaeba3ffeaec0b5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.990006 3126 raft_consensus.cc:493] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:23.990136 3126 raft_consensus.cc:515] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:23.991417 754 tablet_service.cc:1511] Processing CreateTablet for tablet adb8869866de4aeb9f3b60dc3fba62fe (DEFAULT_TABLE table=default.Table_fa74da20235f4832b8b37639a4a88b57 [id=f8b86a2aa7c94747b02978a59591ea46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.991689 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb8869866de4aeb9f3b60dc3fba62fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.992081 887 tablet_service.cc:1511] Processing CreateTablet for tablet adb8869866de4aeb9f3b60dc3fba62fe (DEFAULT_TABLE table=default.Table_fa74da20235f4832b8b37639a4a88b57 [id=f8b86a2aa7c94747b02978a59591ea46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.994966 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d62c2293284ff8adb3c79d5f8f07c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:23.998128 753 tablet_service.cc:1511] Processing CreateTablet for tablet d3aafb063b294eb08fd1727753722fdb (DEFAULT_TABLE table=default.Table_3f99dd18dc7f47eab04d25ddc25b8e4d [id=e3cf753a89194afabcbd96ba9e8166ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.998308 754 tablet_service.cc:1511] Processing CreateTablet for tablet 499f1e6c22e64e7e8b12f82f9eaaee45 (DEFAULT_TABLE table=default.Table_99d70ef34e6b4c759db2d8a8d70772c3 [id=35db21eed3744e788a4bc346109343d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:23.998718 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbd22f0ac144f72b6d2e602002c91a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.001670 892 tablet_service.cc:1511] Processing CreateTablet for tablet 499f1e6c22e64e7e8b12f82f9eaaee45 (DEFAULT_TABLE table=default.Table_99d70ef34e6b4c759db2d8a8d70772c3 [id=35db21eed3744e788a4bc346109343d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:24.004235 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d543da47b14673848d56661a96db58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.005379 765 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0fb5f3ba2846f19764f0ae26b73532 (DEFAULT_TABLE table=default.Table_04a74087d23a4fb6a95133f1e1c97a53 [id=ab8bcf4870f841b0a5b51b5e3f2aa832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:24.005728 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0fb5f3ba2846f19764f0ae26b73532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.006032 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572a7c469a894e6e8a9333b78f8a564e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.006202 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3305009232443ce933452e03255f955. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:23.793169 1192 ts_tablet_manager.cc:1467] T 1142b61e40e6499e8244d71f2ad39b1e P ae28da1c4102450ab76eb2946a5cbf2e: Tablet startup took 617ms
W20260616 19:52:24.006280 1192 ts_tablet_manager.cc:1469] T 1142b61e40e6499e8244d71f2ad39b1e P ae28da1c4102450ab76eb2946a5cbf2e: Trace:
0616 19:51:58.765908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:51:58.802948 (+ 37040us) service_pool.cc:224] Handling call
0616 19:51:58.911970 (+109022us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0616 19:51:58.912004 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0616 19:51:58.941889 (+ 29885us) tablet_metadata.cc:665] Metadata flushed
0616 19:51:58.975782 (+ 33893us) tablet_replica.cc:206] Creating consensus instance
0616 19:51:58.975873 (+ 91us) inbound_call.cc:177] Queueing success response
0616 19:52:23.116995 (+24141122us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0616 19:52:23.175351 (+ 58356us) ts_tablet_manager.cc:1435] Starting tablet replica
0616 19:52:23.176240 (+ 889us) tablet_replica.cc:261] Starting instrumentation
0616 19:52:23.176580 (+ 340us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":183,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":343,"tablet-open.queue_time_us":24141135}
I20260616 19:52:24.006827 1192 tablet_bootstrap.cc:492] T d1e3778611a24397a1a776be2cc76284 P ae28da1c4102450ab76eb2946a5cbf2e: Bootstrap starting.
I20260616 19:52:24.008677 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbd22f0ac144f72b6d2e602002c91a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.012305 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aafb063b294eb08fd1727753722fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.012676 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d62c2293284ff8adb3c79d5f8f07c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.013474 1190 tablet_replica.cc:333] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e: stopping tablet replica
I20260616 19:52:24.013657 1190 raft_consensus.cc:2243] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:24.013950 1190 raft_consensus.cc:2272] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:24.014462 1190 ts_tablet_manager.cc:1916] T 2f1e12555be64192860eab59b3aeb562 P ae28da1c4102450ab76eb2946a5cbf2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:24.016584 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 499f1e6c22e64e7e8b12f82f9eaaee45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.016669 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61ac677d890487e8d6f478146a0b527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.020653 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a52fe3f0594b379d770797bfcf601e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.024706 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c016b8453e488591ec1abba2f3270b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.028776 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d239af45a224aecaefa1dc8a787d4e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.033120 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac9a722ca4a462f9547065c6f4907d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.039845 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aafb063b294eb08fd1727753722fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.040849 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1334) took 3412 ms. Trace:
I20260616 19:52:24.040963 1193 rpcz_store.cc:276] 0616 19:52:20.628553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:20.628670 (+ 117us) service_pool.cc:224] Handling call
0616 19:52:23.824604 (+3195934us) ts_tablet_manager.cc:1151] Deleting tablet 352ca272888f4dd2ab1a8127bb8c2b6e
0616 19:52:23.871654 (+ 47050us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.877264 (+ 5610us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:23.880523 (+ 3259us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:24.040826 (+160303us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3195798}
I20260616 19:52:24.041462 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet 352ca272888f4dd2ab1a8127bb8c2b6e (table default.Table_3e975395a7f54cc6bda4ad65f522a3c2 [id=55ebc40e7e83434fadff7113c194e90d]) successfully deleted
I20260616 19:52:24.041778 1193 tablet_replica.cc:333] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:24.041973 1193 raft_consensus.cc:2243] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260616 19:52:24.042006 3341 tablet.cc:1724] T 31db3862f78943519bcd9531c5530048 P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:24.042115 1193 raft_consensus.cc:2272] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:24.042559 3340 tablet.cc:1724] T 31db3862f78943519bcd9531c5530048 P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:24.042650 1193 ts_tablet_manager.cc:1916] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:24.043061 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882ee6bd90ef4833a801f60ec5ecae22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.045380 1198 ts_tablet_manager.cc:1434] T bc2006e262cc4bbb9b291a5bf52653cd P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.123s user 0.002s sys 0.000s
I20260616 19:52:24.045954 3126 leader_election.cc:290] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:24.047987 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18195591bb2d4cc9989d4798528c29b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.048681 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb8869866de4aeb9f3b60dc3fba62fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.049680 1192 tablet_bootstrap.cc:654] T d1e3778611a24397a1a776be2cc76284 P ae28da1c4102450ab76eb2946a5cbf2e: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:24.050660 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3fbf302cbe4c5d8cc3cf8fa52baacc" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:24.050899 916 raft_consensus.cc:2393] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61c874fef3684d10a272a9c7f280e0e2 in current term 1: Already voted for candidate 7245e7dab0ec474a876537be514c8767 in this term.
I20260616 19:52:24.052706 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 499f1e6c22e64e7e8b12f82f9eaaee45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.062359 3220 raft_consensus.cc:493] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:24.062500 3220 raft_consensus.cc:515] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:24.063117 3220 leader_election.cc:290] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:24.063217 969 heartbeater.cc:344] Connected to a master server at 127.0.105.188:34219
I20260616 19:52:24.064535 830 heartbeater.cc:344] Connected to a master server at 127.0.105.188:34219
I20260616 19:52:24.064533 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 4afa8264128f429984d73140c974d21a
W20260616 19:52:24.071959 860 leader_election.cc:343] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 5e68e2c6caff4ac38aa52b8b29f5ace6
I20260616 19:52:24.081552 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 4afa8264128f429984d73140c974d21a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:24.087821 1193 ts_tablet_manager.cc:1929] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:24.089859 1198 tablet_bootstrap.cc:492] T f293d557a9aa4ca4885aa917fe1565e4 P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:24.091753 1191 ts_tablet_manager.cc:1929] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:24.091972 1191 log.cc:1199] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-2/wal/wals/4fc0c02ef58d4e429855e5bbaa4752ad
W20260616 19:52:24.097123 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 33a6a46041464e93811b0c573db19f43 (table default.Table_b1b0d8e4d7b94dd58a1bb41bdfa9113a [id=3009ee31846f41cf8a489a729ec3d406], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 33a6a46041464e93811b0c573db19f43 consensus state has no leader
I20260616 19:52:24.099380 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 4afa8264128f429984d73140c974d21a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:24.099767 3326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c404c91cd2194cf6838fddd212f2f4ae: Bootstrap starting.
I20260616 19:52:24.102355 899 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0fb5f3ba2846f19764f0ae26b73532 (DEFAULT_TABLE table=default.Table_04a74087d23a4fb6a95133f1e1c97a53 [id=ab8bcf4870f841b0a5b51b5e3f2aa832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:24.102799 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0fb5f3ba2846f19764f0ae26b73532. 1 dirs total, 0 dirs full, 0 dirs failed
W20260616 19:52:24.113899 858 leader_election.cc:343] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 5e68e2c6caff4ac38aa52b8b29f5ace6
I20260616 19:52:24.114038 858 leader_election.cc:304] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:24.114511 3220 raft_consensus.cc:2749] T 5e68e2c6caff4ac38aa52b8b29f5ace6 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:24.119470 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 32bf8c116d6d4c8780dc6aecb2570f9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:24.125948 1193 log.cc:1199] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/e03e6a2614564eeeb8ec382b16f0ece1
I20260616 19:52:24.126734 1193 ts_tablet_manager.cc:1950] T e03e6a2614564eeeb8ec382b16f0ece1 P 7245e7dab0ec474a876537be514c8767: Deleting consensus metadata
I20260616 19:52:24.129415 3220 raft_consensus.cc:493] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:24.129551 3220 raft_consensus.cc:515] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:24.130157 3220 leader_election.cc:290] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:24.139267 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet e85e2861c41f402d88cafe64a6871429 (table default.Table_66d56024dca749dfb6300ffa4cb0dec9 [id=02a85fe82ed24f6b949c0ded2d9a7d5e]). Expected version 1 got 0
I20260616 19:52:24.119470 1191 ts_tablet_manager.cc:1950] T 4fc0c02ef58d4e429855e5bbaa4752ad P 61c874fef3684d10a272a9c7f280e0e2: Deleting consensus metadata
I20260616 19:52:24.139593 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet 5462af2002f9406b85ee20660e001a95 (table default.Table_52c372106d354fba9e90c5be75714312 [id=d2574a03769945e99b662ed1015b2703]). Expected version 1 got 0
I20260616 19:52:24.140021 459 catalog_manager.cc:5788] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571) does not have the latest schema for tablet da039dbc1089426dba1226940e37469e (table default.Table_88aaf292b9144d75a8bea47d896a63bf [id=f223ad08623343aeb681a65b744d2476]). Expected version 1 got 0
W20260616 19:52:24.141315 858 leader_election.cc:343] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: efd5fecc6d444e5fba9103287c09542e
I20260616 19:52:24.143877 452 catalog_manager.cc:5788] TS ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787) does not have the latest schema for tablet 26503d1293be438dae39fa1e1ea1885b (table default.Table_ccb660ffb17a4a01840efa8c374603d8 [id=467b42cd85544c589d2cf3f9eaf21754]). Expected version 2 got 0
I20260616 19:52:24.146152 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_6bca3516f23a4d049370d2fcadf6a94b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:24.147718 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bca3516f23a4d049370d2fcadf6a94b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:24.128083 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3fbf302cbe4c5d8cc3cf8fa52baacc" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:24.148831 1193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45106 (request call id 1333) took 3520 ms. Trace:
W20260616 19:52:24.148962 461 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:50389 (request call id 211) took 1170 ms (client timeout 1000 ms). Trace:
I20260616 19:52:24.148926 1193 rpcz_store.cc:276] 0616 19:52:20.628401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:20.628605 (+ 204us) service_pool.cc:224] Handling call
0616 19:52:24.041726 (+3413121us) ts_tablet_manager.cc:1151] Deleting tablet e03e6a2614564eeeb8ec382b16f0ece1
0616 19:52:24.041738 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:24.084976 (+ 43238us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:24.087769 (+ 2793us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:24.148812 (+ 61043us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3412813}
I20260616 19:52:24.149255 1193 tablet_replica.cc:333] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767: stopping tablet replica
I20260616 19:52:24.149464 1193 raft_consensus.cc:2243] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 1 LEADER]: Raft consensus shutting down.
W20260616 19:52:24.149227 461 rpcz_store.cc:269] 0616 19:52:22.979196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:23.142427 (+163231us) service_pool.cc:224] Handling call
0616 19:52:23.216644 (+ 74217us) spinlock_profiling.cc:243] Waited 72.5 ms on lock 0x616000043354. stack: 00007f23ba003086 00007f23ba002e40 00007f23b8fbc3ad 000000000099c914 000000000099c8dd 00007f23c94726bd 00007f23c94727b3 00007f23c603ab21 00007f23cdd9f95d 00007f23cdf2cf08 00007f23c498bca6 00007f23c498b9d5 00007f23c109b88e 00007f23c109a76e 00007f23c10a09a8 00007f23c10a130f
0616 19:52:24.148932 (+932288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0616 19:52:24.030725 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0616 19:52:24.030856 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0616 19:52:24.030866 (+ 10us) write_op.cc:435] Acquired schema lock
0616 19:52:24.030868 (+ 2us) tablet.cc:662] Decoding operations
0616 19:52:24.131154 (+100286us) write_op.cc:620] Acquiring the partition lock for write op
0616 19:52:24.131171 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0616 19:52:24.131177 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0616 19:52:24.131306 (+ 129us) tablet.cc:701] Row locks acquired
0616 19:52:24.131309 (+ 3us) write_op.cc:260] PREPARE: finished
0616 19:52:24.131351 (+ 42us) write_op.cc:270] Start()
0616 19:52:24.131394 (+ 43us) write_op.cc:276] Timestamp: P: 1781639544131304 usec, L: 0
0616 19:52:24.131398 (+ 4us) op_driver.cc:348] REPLICATION: starting
0616 19:52:24.131618 (+ 220us) log.cc:844] Serialized 913 byte log entry
0616 19:52:24.136853 (+ 5235us) op_driver.cc:464] REPLICATION: finished
0616 19:52:24.137016 (+ 163us) write_op.cc:301] APPLY: starting
0616 19:52:24.137032 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0616 19:52:24.137081 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0616 19:52:24.137109 (+ 28us) tablet.cc:1372] starting ApplyRowOperation cycle
0616 19:52:24.137183 (+ 74us) tablet.cc:1383] finished ApplyRowOperation cycle
0616 19:52:24.137222 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0616 19:52:24.137230 (+ 8us) write_op.cc:312] APPLY: finished
0616 19:52:24.137314 (+ 84us) log.cc:844] Serialized 29 byte log entry
0616 19:52:24.137380 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:24.137397 (+ 17us) write_op.cc:454] Released schema lock
0616 19:52:24.137403 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0616 19:52:24.137483 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0616 19:52:24.137487 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":23,"spinlock_wait_cycles":166697216,"child_traces":[["op",{"apply.queue_time_us":108,"apply.run_cpu_time_us":456,"apply.run_wall_time_us":456,"num_ops":2,"prepare.queue_time_us":74716,"prepare.run_cpu_time_us":11400,"prepare.run_wall_time_us":101012,"raft.queue_time_us":385,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":270,"replication_time_us":5419}]]}
I20260616 19:52:24.150846 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 1142b61e40e6499e8244d71f2ad39b1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:24.152220 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85d6b13547f2413c86ee07194ca74704: Sending DeleteTablet for 3 replicas of tablet 3decbe39deb84d1a85c3a9773fcbf5be
W20260616 19:52:24.153690 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3eb22bec05154cabb7679d577e785b66 consensus state has no leader
I20260616 19:52:24.154554 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 28cd1ad6e8744d33a2845e9f3dda4a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:24.154735 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c90eb04585c4fa992435d11015ffec7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:24.154887 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d3fbf302cbe4c5d8cc3cf8fa52baacc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:24.154846 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c19c2e43a944893b86982bee1eb2f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:24.155043 752 tablet_service.cc:1558] Processing DeleteTablet for tablet daf86e5d5f2341c78705f78c02695c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:24.154846 747 tablet_service.cc:1558] Processing DeleteTablet for tablet fab8282287434bf8b7e37f008a1b0166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:24.155300 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc0c02ef58d4e429855e5bbaa4752ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:59 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:24.155419 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 1142b61e40e6499e8244d71f2ad39b1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:24.155526 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 610d6197e35e447ea25cdba2cc454b8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:51:58 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:24.156031 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 83a199f25e5c4accba0acd1007fc73d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d589aa93d154fdcbf865774216a8738) from {username='slave'} at 127.0.0.1:45106
W20260616 19:52:24.158766 718 consensus_peers.cc:597] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 -> Peer ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787): Couldn't send request to peer ae28da1c4102450ab76eb2946a5cbf2e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260616 19:52:24.160960 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 3decbe39deb84d1a85c3a9773fcbf5be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:45106
I20260616 19:52:24.161978 1196 tablet_bootstrap.cc:492] T 93c940bd14a040ddba5ea058e732bf0c P 7245e7dab0ec474a876537be514c8767: No bootstrap required, opened a new log
I20260616 19:52:24.162263 1196 ts_tablet_manager.cc:1403] T 93c940bd14a040ddba5ea058e732bf0c P 7245e7dab0ec474a876537be514c8767: Time spent bootstrapping tablet: real 0.256s user 0.007s sys 0.007s
W20260616 19:52:24.162302 860 leader_election.cc:343] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: efd5fecc6d444e5fba9103287c09542e
I20260616 19:52:24.162120 1193 raft_consensus.cc:2272] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:24.162438 860 leader_election.cc:304] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:24.162811 3220 raft_consensus.cc:2749] T efd5fecc6d444e5fba9103287c09542e P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:24.163571 1196 raft_consensus.cc:359] T 93c940bd14a040ddba5ea058e732bf0c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:24.164345 448 catalog_manager.cc:5027] TS 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): tablet e03e6a2614564eeeb8ec382b16f0ece1 (table default.Table_d2059128d10847918c1d4b6546fda761 [id=911a55a5f54547a88ed431bb85f18351]) successfully deleted
I20260616 19:52:24.166301 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 3decbe39deb84d1a85c3a9773fcbf5be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:48636
I20260616 19:52:24.168206 996 leader_election.cc:304] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:24.168964 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet bb02ec3fe424408aa60f74517203146a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:24.169029 3126 raft_consensus.cc:3060] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Advancing to term 1
W20260616 19:52:24.172161 459 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:38239 (request call id 221) took 824 ms (client timeout 1000 ms). Trace:
W20260616 19:52:24.172609 459 rpcz_store.cc:269] 0616 19:52:23.347570 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:23.353243 (+ 5673us) service_pool.cc:224] Handling call
0616 19:52:24.172142 (+818899us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":15}
I20260616 19:52:24.177775 1031 tablet_service.cc:1511] Processing CreateTablet for tablet d3aafb063b294eb08fd1727753722fdb (DEFAULT_TABLE table=default.Table_3f99dd18dc7f47eab04d25ddc25b8e4d [id=e3cf753a89194afabcbd96ba9e8166ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:24.178154 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aafb063b294eb08fd1727753722fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.177786 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 93c016b8453e488591ec1abba2f3270b (DEFAULT_TABLE table=default.Table_869029b8c3a444579bb7aac23503358b [id=f77b687fc2f04456a25454b9fca36157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:24.178576 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c016b8453e488591ec1abba2f3270b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.179525 1198 tablet_bootstrap.cc:654] T f293d557a9aa4ca4885aa917fe1565e4 P 61c874fef3684d10a272a9c7f280e0e2: Neither blocks nor log segments found. Creating new log.
I20260616 19:52:24.183434 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 882ee6bd90ef4833a801f60ec5ecae22 (DEFAULT_TABLE table=default.Table_54440d81ff5a4fa59cde855e84964b07 [id=a0e1c937560640a087e727ca05e90f02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:24.183730 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882ee6bd90ef4833a801f60ec5ecae22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.198261 1040 tablet_service.cc:1511] Processing CreateTablet for tablet adb8869866de4aeb9f3b60dc3fba62fe (DEFAULT_TABLE table=default.Table_fa74da20235f4832b8b37639a4a88b57 [id=f8b86a2aa7c94747b02978a59591ea46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:24.198385 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 499f1e6c22e64e7e8b12f82f9eaaee45 (DEFAULT_TABLE table=default.Table_99d70ef34e6b4c759db2d8a8d70772c3 [id=35db21eed3744e788a4bc346109343d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:24.198671 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb8869866de4aeb9f3b60dc3fba62fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.198683 1196 raft_consensus.cc:385] T 93c940bd14a040ddba5ea058e732bf0c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:24.198756 1196 raft_consensus.cc:740] T 93c940bd14a040ddba5ea058e732bf0c P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7245e7dab0ec474a876537be514c8767, State: Initialized, Role: FOLLOWER
I20260616 19:52:24.199067 1196 consensus_queue.cc:260] T 93c940bd14a040ddba5ea058e732bf0c P 7245e7dab0ec474a876537be514c8767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } }
I20260616 19:52:24.199973 1196 ts_tablet_manager.cc:1434] T 93c940bd14a040ddba5ea058e732bf0c P 7245e7dab0ec474a876537be514c8767: Time spent starting tablet: real 0.037s user 0.001s sys 0.001s
I20260616 19:52:24.200423 1196 tablet_bootstrap.cc:492] T f293d557a9aa4ca4885aa917fe1565e4 P 7245e7dab0ec474a876537be514c8767: Bootstrap starting.
I20260616 19:52:24.163957 1193 ts_tablet_manager.cc:1916] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:24.179090 3321 consensus_queue.cc:1048] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:24.205431 1191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51610 (request call id 1268) took 5223 ms. Trace:
I20260616 19:52:24.205598 1191 rpcz_store.cc:276] 0616 19:52:18.981650 (+ 0us) service_pool.cc:167] Inserting onto call queue
0616 19:52:18.981692 (+ 42us) service_pool.cc:224] Handling call
0616 19:52:23.721662 (+4739970us) ts_tablet_manager.cc:1151] Deleting tablet 4fc0c02ef58d4e429855e5bbaa4752ad
0616 19:52:23.721672 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0616 19:52:23.840376 (+118704us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:24.091691 (+251315us) tablet_metadata.cc:665] Metadata flushed
0616 19:52:24.205403 (+113712us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4739842}
I20260616 19:52:24.206156 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0fb5f3ba2846f19764f0ae26b73532 (DEFAULT_TABLE table=default.Table_04a74087d23a4fb6a95133f1e1c97a53 [id=ab8bcf4870f841b0a5b51b5e3f2aa832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:24.206481 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 18195591bb2d4cc9989d4798528c29b3 (DEFAULT_TABLE table=default.Table_53d08888495247c286bec025bc90c392 [id=b279d0ac123d40ebaeba3ffeaec0b5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260616 19:52:24.211316 3126 raft_consensus.cc:2749] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:24.212146 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 3decbe39deb84d1a85c3a9773fcbf5be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:24.224368 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 4afa8264128f429984d73140c974d21a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:23 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:24.229771 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18195591bb2d4cc9989d4798528c29b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.231637 1191 tablet_replica.cc:333] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2: stopping tablet replica
I20260616 19:52:24.231909 1191 raft_consensus.cc:2243] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260616 19:52:24.232499 1191 raft_consensus.cc:2272] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260616 19:52:24.232961 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0fb5f3ba2846f19764f0ae26b73532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.234042 3341 tablet.cc:1724] T 26503d1293be438dae39fa1e1ea1885b P ae28da1c4102450ab76eb2946a5cbf2e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:24.239701 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 499f1e6c22e64e7e8b12f82f9eaaee45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260616 19:52:24.243320 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a9befb557d84f3bb7781664cbf2f28f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:02 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:24.243536 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a406124a8d34e578ba94fab2a873a55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:03 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:24.249095 3349 tablet.cc:1724] T 26503d1293be438dae39fa1e1ea1885b P 7245e7dab0ec474a876537be514c8767: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260616 19:52:24.250864 446 catalog_manager.cc:5027] TS 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): tablet 4fc0c02ef58d4e429855e5bbaa4752ad (table default.Table_98561738ee7d4ad8bf14170c99d01b96 [id=601faf6d488e40c584a3537834653ae9]) successfully deleted
I20260616 19:52:24.252290 3126 raft_consensus.cc:493] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260616 19:52:24.252537 3126 raft_consensus.cc:515] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:24.253228 3126 leader_election.cc:290] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), ae28da1c4102450ab76eb2946a5cbf2e (127.0.105.130:42787)
I20260616 19:52:24.253759 3251 consensus_queue.cc:1048] T d686190fb6a34ab18cc4799197765f1b P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:24.254537 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f280b9ea1147799635f8a6199f17c0" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" is_pre_election: true
I20260616 19:52:24.254982 1191 ts_tablet_manager.cc:1916] T 272838af35d840faa7b11217456533c2 P 61c874fef3684d10a272a9c7f280e0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260616 19:52:24.256248 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 83a199f25e5c4accba0acd1007fc73d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d589aa93d154fdcbf865774216a8738) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:24.256441 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 93c940bd14a040ddba5ea058e732bf0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-16 19:52:00 UTC) from {username='slave'} at 127.0.0.1:51610
I20260616 19:52:24.256594 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f280b9ea1147799635f8a6199f17c0" candidate_uuid: "61c874fef3684d10a272a9c7f280e0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7245e7dab0ec474a876537be514c8767" is_pre_election: true
I20260616 19:52:24.257918 996 leader_election.cc:304] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61c874fef3684d10a272a9c7f280e0e2; no voters: 7245e7dab0ec474a876537be514c8767, ae28da1c4102450ab76eb2946a5cbf2e
I20260616 19:52:24.258168 2962 raft_consensus.cc:2749] T 23f280b9ea1147799635f8a6199f17c0 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260616 19:52:24.258579 3251 consensus_queue.cc:1048] T 8d3fbf302cbe4c5d8cc3cf8fa52baacc P 7245e7dab0ec474a876537be514c8767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260616 19:52:24.274919 779 raft_consensus.cc:3060] T da039dbc1089426dba1226940e37469e P 7245e7dab0ec474a876537be514c8767 [term 0 FOLLOWER]: Advancing to term 1
I20260616 19:52:24.276329 3220 raft_consensus.cc:493] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:24.276491 3220 raft_consensus.cc:515] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:24.277143 3220 leader_election.cc:290] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:24.278060 858 leader_election.cc:343] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 482411d57f24459d8e7ed0eeb573234d
W20260616 19:52:24.278422 860 leader_election.cc:343] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 482411d57f24459d8e7ed0eeb573234d
I20260616 19:52:24.278523 860 leader_election.cc:304] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:24.279381 3220 raft_consensus.cc:2749] T 482411d57f24459d8e7ed0eeb573234d P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:24.293422 1192 tablet_bootstrap.cc:492] T d1e3778611a24397a1a776be2cc76284 P ae28da1c4102450ab76eb2946a5cbf2e: No bootstrap required, opened a new log
I20260616 19:52:24.293690 1192 ts_tablet_manager.cc:1403] T d1e3778611a24397a1a776be2cc76284 P ae28da1c4102450ab76eb2946a5cbf2e: Time spent bootstrapping tablet: real 0.287s user 0.004s sys 0.000s
I20260616 19:52:24.294672 1192 raft_consensus.cc:359] T d1e3778611a24397a1a776be2cc76284 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:24.294950 1192 raft_consensus.cc:385] T d1e3778611a24397a1a776be2cc76284 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:24.295064 1192 raft_consensus.cc:740] T d1e3778611a24397a1a776be2cc76284 P ae28da1c4102450ab76eb2946a5cbf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae28da1c4102450ab76eb2946a5cbf2e, State: Initialized, Role: FOLLOWER
I20260616 19:52:24.295415 1192 consensus_queue.cc:260] T d1e3778611a24397a1a776be2cc76284 P ae28da1c4102450ab76eb2946a5cbf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:24.327450 1193 ts_tablet_manager.cc:1929] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260616 19:52:24.330168 1193 log.cc:1199] T 61189a715da140a6833801681bbd5ef4 P 7245e7dab0ec474a876537be514c8767: Deleting WAL directory at /tmp/dist-test-tasknFdngH/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781639506439340-422-0/minicluster-data/ts-0/wal/wals/61189a715da140a6833801681bbd5ef4
I20260616 19:52:24.339870 2662 raft_consensus.cc:493] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:24.340013 2662 raft_consensus.cc:515] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:24.340346 3223 raft_consensus.cc:493] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:24.340445 3223 raft_consensus.cc:515] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:24.340688 2662 leader_election.cc:290] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
I20260616 19:52:24.340909 3223 leader_election.cc:290] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:24.342751 858 leader_election.cc:343] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 08db2c1398b946c180d81b88504c1d9c
W20260616 19:52:24.342940 858 leader_election.cc:343] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: a0cb7a1acf35403192254bf5cd1170a2
W20260616 19:52:24.344964 860 leader_election.cc:343] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: 08db2c1398b946c180d81b88504c1d9c
I20260616 19:52:24.345058 860 leader_election.cc:304] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
W20260616 19:52:24.345381 860 leader_election.cc:343] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Not found: Tablet not found: a0cb7a1acf35403192254bf5cd1170a2
I20260616 19:52:24.345465 860 leader_election.cc:304] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae28da1c4102450ab76eb2946a5cbf2e; no voters: 61c874fef3684d10a272a9c7f280e0e2, 7245e7dab0ec474a876537be514c8767
I20260616 19:52:24.346117 3220 raft_consensus.cc:2749] T 08db2c1398b946c180d81b88504c1d9c P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:24.346271 3220 raft_consensus.cc:2749] T a0cb7a1acf35403192254bf5cd1170a2 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260616 19:52:24.354678 1198 tablet_bootstrap.cc:492] T f293d557a9aa4ca4885aa917fe1565e4 P 61c874fef3684d10a272a9c7f280e0e2: No bootstrap required, opened a new log
I20260616 19:52:24.355027 1198 ts_tablet_manager.cc:1403] T f293d557a9aa4ca4885aa917fe1565e4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent bootstrapping tablet: real 0.265s user 0.005s sys 0.004s
I20260616 19:52:24.356011 1198 raft_consensus.cc:359] T f293d557a9aa4ca4885aa917fe1565e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:24.356485 1198 raft_consensus.cc:385] T f293d557a9aa4ca4885aa917fe1565e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260616 19:52:24.356607 1198 raft_consensus.cc:740] T f293d557a9aa4ca4885aa917fe1565e4 P 61c874fef3684d10a272a9c7f280e0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c874fef3684d10a272a9c7f280e0e2, State: Initialized, Role: FOLLOWER
I20260616 19:52:24.356966 1198 consensus_queue.cc:260] T f293d557a9aa4ca4885aa917fe1565e4 P 61c874fef3684d10a272a9c7f280e0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:24.357762 1198 ts_tablet_manager.cc:1434] T f293d557a9aa4ca4885aa917fe1565e4 P 61c874fef3684d10a272a9c7f280e0e2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260616 19:52:24.358078 1198 tablet_bootstrap.cc:492] T 613c869d4ac84ee0aa952718ba74917b P 61c874fef3684d10a272a9c7f280e0e2: Bootstrap starting.
I20260616 19:52:24.362046 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_be6915b4199141b5991602c3322b004e" } new_table_name: "default.Table_f44e43bbc6694c87a02032efe7e0cbce" modify_external_catalogs: true
I20260616 19:52:24.363257 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41696:
table { table_name: "default.Table_dc6b5507cf924390bbe34c207ec2cce3" } new_table_name: "default.Table_210436067c44411a82506bb52e0e5a29" modify_external_catalogs: true
I20260616 19:52:24.364400 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_e993f63607c143e1ba09581efc9f834c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260616 19:52:24.365000 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e993f63607c143e1ba09581efc9f834c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260616 19:52:24.366375 2662 raft_consensus.cc:493] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7245e7dab0ec474a876537be514c8767)
I20260616 19:52:24.366519 2662 raft_consensus.cc:515] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7245e7dab0ec474a876537be514c8767" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 46411 } } peers { permanent_uuid: "61c874fef3684d10a272a9c7f280e0e2" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 37571 } } peers { permanent_uuid: "ae28da1c4102450ab76eb2946a5cbf2e" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 42787 } }
I20260616 19:52:24.366945 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_02bcc867bc0a4b50bb5fc2db844439df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:24.367018 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41696:
name: "default.Table_c8e08f7d0f5b46828f4634e564c486c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260616 19:52:24.367158 2662 leader_election.cc:290] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411), 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571)
W20260616 19:52:24.367383 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02bcc867bc0a4b50bb5fc2db844439df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:24.367478 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8e08f7d0f5b46828f4634e564c486c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260616 19:52:24.369059 858 leader_election.cc:343] T 1a7b177800174706a985c11e5876b9d3 P ae28da1c4102450ab76eb2946a5cbf2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61c874fef3684d10a272a9c7f280e0e2 (127.0.105.131:37571): Not found: Tablet not found: 1a7b177800174706a985c11e5876b9d3
W20260616 19:52:24.369477 860 consensus_peers.cc:597] T 352ca272888f4dd2ab1a8127bb8c2b6e P ae28da1c4102450ab76eb2946a5cbf2e -> Peer 7245e7dab0ec474a876537be514c8767 (127.0.105.129:46411): Couldn'